Rapid computer modeling of faces for animation
First Claim
1. One or more computer-readable media containing a program that is executable by a computer to create a 3D model of a face, the program comprising the following actions:
- capturing at least two 2D images of the face;
identifying locations of a plurality of distinct facial features in the two images;
identifying head regions of the images, based on the identified positions of the plurality of distinct facial features;
matching points of the head regions between the images;
estimating rotation and translation of the head regions based on the matched points in the images;
determining 3D positions of the matched points based on the estimated rotation and translation to create a 3D representation of the face; and
fitting a neutral face model to the 3D representation by applying deformation vectors to the neutral face model.
2 Assignments
0 Petitions
Accused Products
Abstract
Described herein is a technique for creating a 3D face model using images obtained from an inexpensive camera associated with a general-purpose computer. Two still images of the user are captured, and two video sequences. The user is asked to identify five facial features, which are used to calculate a mask and to perform fitting operations. Based on a comparison of the still images, deformation vectors are applied to a neutral face model to create the 3D model. The video sequences are used to create a texture map. The process of creating the texture map references the previously obtained 3D model to determine poses of the sequential video images.
-
Citations
23 Claims
-
1. One or more computer-readable media containing a program that is executable by a computer to create a 3D model of a face, the program comprising the following actions:
-
capturing at least two 2D images of the face;
identifying locations of a plurality of distinct facial features in the two images;
identifying head regions of the images, based on the identified positions of the plurality of distinct facial features;
matching points of the head regions between the images;
estimating rotation and translation of the head regions based on the matched points in the images;
determining 3D positions of the matched points based on the estimated rotation and translation to create a 3D representation of the face; and
fitting a neutral face model to the 3D representation by applying deformation vectors to the neutral face model. - View Dependent Claims (2, 3, 4, 5)
-
-
6. A method to create a 3D model of a face, the method comprising the following actions:
-
capturing at least two 2D images of the face;
identifying locations of a plurality of distinct facial features in the two images;
identifying head regions of the images, based on the identified positions of the plurality of distinct facial features;
matching points of the head regions between the images;
estimating rotation and translation of the head regions based on the matched points in the images;
determining 3D positions of the matched points based on the estimated rotation and translation to create a 3D representation of the face;
fitting a neutral face model to the 3D representation by applying deformation vectors to the neutral face model;
capturing a succession of 2D images containing the face in a range of poses;
determining poses of the face in each of the 2D images;
creating a texture map from the succession of 2D images in conjunction with the determined poses of the 2D images. - View Dependent Claims (7, 8, 9)
-
-
10. A device that creates a 3D model of a face, the device being configured to perform actions comprising:
-
capturing at least two 2D images of the face;
identifying locations of a plurality of distinct facial features in the two images;
identifying head regions of the images, based on the identified positions of the plurality of distinct facial features;
matching points of the head regions between the images;
estimating rotation and translation of the head regions based on the matched points in the images;
determining 3D positions of the matched points based on the estimated rotation and translation to create a 3D representation of the face; and
fitting a neutral face model to the 3D representation by applying deformation vectors to the neutral face model. - View Dependent Claims (11, 12, 13, 14, 15, 16)
-
-
17. A device that creates a 3D model of a face, comprising:
-
means for capturing at least two 2D images of the face;
means for identifying locations of a plurality of distinct facial features in the two images;
means for identifying head regions of the images, based on the identified positions of the plurality of distinct facial features;
means for matching points of the head regions between the images;
means for estimating rotation and translation of the head regions based on the matched points in the images;
means for determining 3D positions of the matched points based on the estimated rotation and translation to create a 3D representation of the face; and
means for fitting a neutral face model to the 3D representation by applying deformation vectors to the neutral face model. - View Dependent Claims (18, 19, 20, 21, 22, 23)
-
Specification