System and Method for Generating Editable Constraints for Image-based Models
First Claim
1. A method, comprising:
- receiving a plurality of two-dimensional (2D) images of an object from different viewpoints of the object;
receiving input on a display in a user of one or more of the 2D images specifying one or more shape constraints for the object before generating a three dimensional (3D) model of the object, one or more shape constraints specifying a shape of the object;
generating the 3D model of the object dependent on the plurality of images and the one or more specified shape constraints; and
generating a plurality of editable constraints for the 3D model in which at least one of the plurality of editable constraints is dependent on the one or more specified shape constraints and one or more of the plurality of editable constraints are generated that are not dependent on the one or more specified shape constraints, each of the plurality of editable constraints is manipulable by a user via the use interface to change the shape of the object.
1 Assignment
0 Petitions
Accused Products
Abstract
An image-based 3D model of an object may be generated from multiple images of the object captured from different viewpoints. 3D constraints which define the shape of the model may be generated from image data and camera parameters (intrinsic and extrinsic) of the images and from user-specified constraints. A user may specify constraints by outlining, on images of the object, features which define the shape of an object. An approximation of the object'"'"'s 3D surface may be generated from depth maps computed from the images. The 3D constraints and surface approximation may be converted into a polygonal mesh representation, from which a visual display of the model may be reconstructed. The model may be displayed with a set of editable constraints which a user may manipulate to change the shape of the 3D model. The model may be stored as, and reconstructed from, the set of 3D constraints.
66 Citations
20 Claims
-
1. A method, comprising:
-
receiving a plurality of two-dimensional (2D) images of an object from different viewpoints of the object; receiving input on a display in a user of one or more of the 2D images specifying one or more shape constraints for the object before generating a three dimensional (3D) model of the object, one or more shape constraints specifying a shape of the object; generating the 3D model of the object dependent on the plurality of images and the one or more specified shape constraints; and generating a plurality of editable constraints for the 3D model in which at least one of the plurality of editable constraints is dependent on the one or more specified shape constraints and one or more of the plurality of editable constraints are generated that are not dependent on the one or more specified shape constraints, each of the plurality of editable constraints is manipulable by a user via the use interface to change the shape of the object. - View Dependent Claims (2, 3, 4, 5, 6, 7)
-
-
8. A system, comprising:
-
a memory; and one or more processors coupled to the memory, wherein the memory comprises program instructions executable by the one or more processors to implement a constraint generation module configured to; receive a plurality of two-dimensional (2D) images of an object from different viewpoints of the object; receive input on a display in a user interface of one or more of the 2D images specifying one or more shape constraints for the object before generating a three dimensional (3D) model of the object, the one or more shape constraints specifying a shape of the object; generate the 3D model of the object dependent on the plurality of images and the one or more specified shape constraints; and generate one or more editable constraints for the 3D model that are not dependent on the one or more specified shape constraints; and generate at least one editable constraint for the 3D model that is dependent on the one or more specified shape constraints. - View Dependent Claims (9, 10, 11, 12, 13, 14)
-
-
15. A computer-readable storage medium, which is not a propagating transitory signal, storing program instructions executable on a computer to implement a constraint generation module configured to:
-
receive a plurality of two-dimensional (2D) images of an object from different viewpoints of the object; receive input on a display of a user interface having one or more of the 2D images specifying one or more shape constraints that specify a shape of a portion of a boundary for the object before generating a three dimensional (3D) model of the object; generate the 3D model as a mesh of feature points of the object dependent on the plurality of images and the one or more specified shape constraints; and generate a plurality of editable constraints as corresponding to one or more of the feature points of the 3D model dependent on the one or more specified shape constraints that are manipulable by a user via the user interface to change the shape of the object, in which the feature points that do no correspond to the editable constraints are not manipulable to change the shape of the object. - View Dependent Claims (16, 17, 18, 19, 20)
-
Specification