Rapid Computer Modeling of Faces for Animation
First Claim
1. One or more computer-readable media containing a program that is executable by a computer to create a three-dimensional model of a face, the program comprising the following actions:
- capturing at least two images of the face;
matching a plurality of points between the images;
estimating rotation and translation of the face based on the images;
determining 3D positions of the matched points based on the estimated rotation and translation to create a constructed face model, the constructed face model comprising a plurality of points specified in three dimensions; and
applying a combination of deformation vectors to a pre-specified face model to deform the pre-specified face model approximately to the constructed face model, wherein the pre-specified face model comprises a plurality points specified in three dimensions and each deformation vector specifies a plurality of displacements corresponding respectively to the plurality of points of the pre-specified face model.
2 Assignments
0 Petitions
Accused Products
Abstract
Described herein is a technique for creating a 3D face model using images obtained from an inexpensive camera associated with a general-purpose computer. Two still images of the user are captured, and two video sequences. The user is asked to identify five facial features, which are used to calculate a mask and to perform fitting operations. Based on a comparison of the still images, deformation vectors are applied to a neutral face model to create the 3D model. The video sequences are used to create a texture map. The process of creating the texture map references the previously obtained 3D model to determine poses of the sequential video images.
-
Citations
18 Claims
-
1. One or more computer-readable media containing a program that is executable by a computer to create a three-dimensional model of a face, the program comprising the following actions:
-
capturing at least two images of the face;
matching a plurality of points between the images;
estimating rotation and translation of the face based on the images;
determining 3D positions of the matched points based on the estimated rotation and translation to create a constructed face model, the constructed face model comprising a plurality of points specified in three dimensions; and
applying a combination of deformation vectors to a pre-specified face model to deform the pre-specified face model approximately to the constructed face model, wherein the pre-specified face model comprises a plurality points specified in three dimensions and each deformation vector specifies a plurality of displacements corresponding respectively to the plurality of points of the pre-specified face model. - View Dependent Claims (2, 3, 4, 5, 6)
-
-
7. A method of creating a three-dimensional model of a face, comprising:
-
capturing at least two images of the face;
matching a plurality of points between the images;
estimating rotation and translation of the face based the images;
determining 3D positions of the matched points based on the estimated rotation and translation to create a constructed face model, the constructed face model comprising a plurality of points specified in three dimensions; and
applying a combination of deformation vectors to a pre-specified face model to deform the pre-specified face model approximately to the constructed face model, wherein the pre-specified face model comprises a plurality of points specified in three dimensions and each deformation vector specifies a plurality of displacements corresponding respectively to the plurality of three dimensional points of the pre-specified face model. - View Dependent Claims (8, 9, 10, 11, 12)
-
-
13. An apparatus that creates a three-dimensional model of a face, the apparatus comprising:
-
means for capturing at least two images of the face;
means for matching a plurality of points between the images;
means for estimating rotation and translation of the face based on the images;
means for determining 3D positions of the matched points based on the estimated rotation and translation to create a constructed face model, the constructed face model comprising a plurality of points specified in three dimensions; and
means for applying a combination of deformation vectors to a pre-specified face model to deform the pre-specified face model approximately to the constructed face model, wherein the pre-specified face model comprises a plurality points specified in three dimensions and each deformation vector specifies a plurality of displacements corresponding respectively to the plurality of points of the pre-specified face model. - View Dependent Claims (14, 15, 16, 17, 18)
-
Specification