Welcome!
To use the personalized features of this site, please log in or register.
If you have forgotten your username or password, we can help.
My Menu
Saved Items

Two-View Multibody Structure from Motion

René VidalContact Information, Yi MaContact Information, Stefano SoattoContact Information and Shankar SastryContact Information

(1)  Center for Imaging Science, Department of Biomedical Engineering, Johns Hopkins University, 308B Clark Hall, 3400 N. Charles St., Baltimore, MD, 21218
(2)  Department of ECE, University of Illinois at Urbana-Champaign, 1406 West Green Street, Urbana, IL, 61801
(3)  Computer Science Department, University of California at Los Angeles, 3531 Boelter Hall, Los Angeles, CA, 90095
(4)  Department of EECS, University of California at Berkeley, 237 Cory Hall, Berkeley, CA, 94720

Received: 1 May 2002  Accepted: 1 February 2005  Published online: 1 April 2006

Abstract  We present an algebraic geometric approach to 3-D motion estimation and segmentation of multiple rigid-body motions from noise-free point correspondences in two perspective views. Our approach exploits the algebraic and geometric properties of the so-called multibody epipolar constraint and its associated multibody fundamental matrix, which are natural generalizations of the epipolar constraint and of the fundamental matrix to multiple motions. We derive a rank constraint on a polynomial embedding of the correspondences, from which one can estimate the number of independent motions as well as linearly solve for the multibody fundamental matrix. We then show how to compute the epipolar lines from the first-order derivatives of the multibody epipolar constraint and the epipoles by solving a plane clustering problem using Generalized PCA (GPCA). Given the epipoles and epipolar lines, the estimation of individual fundamental matrices becomes a linear problem. The clustering of the feature points is then automatically obtained from either the epipoles and epipolar lines or from the individual fundamental matrices. Although our approach is mostly designed for noise-free correspondences, we also test its performance on synthetic and real data with moderate levels of noise.

Keywords  multibody structure from motion - 3-D motion segmentation - multibody epipolar constraint - multibody fundamental matrix - Generalized PCA (GPCA)

This paper is an extended version of Vidal et al. (2002). Work supported by Hopkins WSE and UIUC ECE startup funds, and by grants NSF CAREER ISS-0447739, ONR N00014-00-1-0621, NSF CAREER IIS-0347456, NSF IIS-0347456, ONR N00014-03-1-0850, ARO DAAD19-99-1-0137 and AFOSRF49620-03-1-0095, N00014-05-1-0836.

Contact Information René Vidal (Corresponding author)
Email: rvidal@cis.jhu.edu

Contact Information Yi Ma
Email: yima@uiuc.edu

Contact Information Stefano Soatto
Email: soatto@cs.ucla.edu

Contact Information Shankar Sastry
Email: sastry@eecs.berkeley.edu
Fulltext Preview (Small, Large)
Image of the first page of the fulltext

References secured to subscribers.



Export this article
Export this article as RIS | Text
 
Referenced by
7 newer articles

  1. Jian, Yong-Dian (2010) Two-View Motion Segmentation with Model Selection and Outlier Removal by RANSAC-Enhanced Dirichlet Process Mixture Models. International Journal of Computer Vision
    [CrossRef]
  2. Rao, Shankar R. (2010) Robust Algebraic Segmentation of Mixed Rigid-Body and Planar Motions from Two Views. International Journal of Computer Vision
    [CrossRef]
  3. Basah, S.N. (2009) Conditions for motion-background segmentation using fundamental matrix. IET Computer Vision 3(4)
    [CrossRef]
  4. Benedek, C. (2009) . IEEE Transactions on Image Processing 18(10)
    [CrossRef]
  5. Vidal, R. (2008) . IEEE Transactions on Pattern Analysis and Machine Intelligence 30(2)
    [CrossRef]
  6. Yuan, Chang (2007) . IEEE Transactions on Pattern Analysis and Machine Intelligence 29(9)
    [CrossRef]
  7. Vidal, René (2007) Multiframe Motion Segmentation with Missing Data Using PowerFactorization and GPCA. International Journal of Computer Vision
    [CrossRef]
Remote Address: 38.107.191.97 • Server: mpweb05
HTTP User Agent: CCBot/1.0 (+http://www.commoncrawl.org/bot.html)