not logged in. (login)


Shape and Motion Estimation from Multiple Views


The goal of this project is to automatically construct detailed 3D models of objects given multiple views. In one family of approaches developed in this project, the aim has been to reconstruct a 3D polygonal mesh model and color texture map from multiple views of an object. Efforts have also focused on the problem of estimating an object's 3D motion field (scene flow) from multiple video streams. These methods explicitly account for uncertainties of the measurements as they affect the accuracy of the recovered model. Some (often minor) uncertainty is due to sensor noise. Other uncertainty is due to surface geometry and camera projection: the structure of the local image contrast pattern affects the reliability of 3D motion or depth estimates, and must be accounted for. In addition, the number of image samples per unit 3D surface area varies depending on the viewpoint, sensor resolution, and surface orientation. In some cases, deformations of the surface must be accounted for during a motion sequence.

Personnel:
  • John Isidoro
  • Rui Li
  • Stan Sclaroff
  • Matheen Siddiqui


  • Related Publications

    title year

    Rui Li and Stan Sclaroff , "Multi-scale 3D Scene Flow from Binocular Stereo Sequences ," Computer Vision and Image Understanding (CVIU), Vol. 110, No. 1, pp 75-90, 2008.
    2008

    P. J. McNerney, J. Konrad and M. Betke , "Block-Based MAP Disparity Estimation under Alpha-Channel Constraints," IEEE Transactions on Circuits and Systems for Video Technology, Vol. 17, No. 6, pp 785-789, 2007.
    2007

    Luke J Skelly and Stan Sclaroff , "Improved feature descriptors for 3-D surface matching," Proc. SPIE Conf. on Two- and Three-Dimensional Methods for Inspection and Metrology V, Vol. SPIE 6762, 2007.
    2007

    Kevin Law and Stan Sclaroff , "Foreground Object Segmentation from Binocular Stereo Video," Proc. SPIE Conf., Intelligent Robots and Computer Vision: Algorithms, Techniques, and Active Vision, No. XXIII, pp (to appear), 2005.
    2005

    Rui Li and Stan Sclaroff , "Multi-scale 3D Scene Flow from Binocular Stereo Sequences," Proc. IEEE Workshop on Motion and Video Computing , 2005.
    2005

    John Isidoro and Stan Sclaroff , "Stochastic Refinement of the Visual Hull to Satisfy Photometric and Silhouette Consistency Constraints," Proceedings of the International Conference on Computer Vision (ICCV), pp 1335--1342, 2003.
    2003

    Matheen Siddiqui and Stan Sclaroff , "Surface reconstruction from multiple views using rational B-splines and knot insertion," Symposium on 3D Data Processing Visualization and Transmission (3DPVT), pp 372-378, 2002.
    2002

    John Isidoro and Stan Sclaroff , "Stochastic Mesh-Based Multiview Reconstruction ," Symposium on 3D Data Processing Visualization and Transmission (3DPVT), pp 568-577, 2002.
    2002

    Matheen Siddiqui and Stan Sclaroff , "Surface reconstruction from multiple views using rational B-splines," Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), No. Technical Sketches, 2001.
    2001

    Jonathan Alon and Stan Sclaroff , "Recursive Estimation of Motion and Planar Structure," Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Vol. II, pp 550-556, 2000.
    2000