Rapid computer modeling of faces for animation
First Claim
1. A method of determining the pose of an object in a given 2D image relative to a 3D model of the object, comprising:
- matching points of the object in the given image with corresponding points of a base image, wherein each matched point has a corresponding 3D position in the 3D model, the 3D positions being determined by the poses of the images, wherein the pose of the base image is known; and
calculating the pose of the given 2D image such that projections of 3D positions of matched points of the base image onto the given 2D image coincide approximately with the corresponding matched points of the given 2D image.
2 Assignments
0 Petitions
Accused Products
Abstract
Described herein is a technique for creating a 3D face model using images obtained from an inexpensive camera associated with a general-purpose computer. Two still images of the user are captured, and two video sequences. The user is asked to identify five facial features, which are used to calculate a mask and to perform fitting operations. Based on a comparison of the still images, deformation vectors are applied to a neutral face model to create the 3D model. The video sequences are used to create a texture map. The process of creating the texture map references the previously obtained 3D model to determine poses of the sequential video images.
-
Citations
9 Claims
-
1. A method of determining the pose of an object in a given 2D image relative to a 3D model of the object, comprising:
-
matching points of the object in the given image with corresponding points of a base image, wherein each matched point has a corresponding 3D position in the 3D model, the 3D positions being determined by the poses of the images, wherein the pose of the base image is known; and calculating the pose of the given 2D image such that projections of 3D positions of matched points of the base image onto the given 2D image coincide approximately with the corresponding matched points of the given 2D image. - View Dependent Claims (2, 3)
-
-
4. One or more computer-readable media containing a program that is executable by a computer to determine poses of an object in a succession of 2D images, relative to a 3D model of the object;
- the program comprising the following actions, for each current 2D image in succession;
matching points of the object in the current 2D image with corresponding points of a previous 2D image whose pose is already known, wherein the matched points of the previous 2D image has corresponding 3D positions in the 3D model; calculating a pose for the current 2D image such that the projections of 3D positions of matched points of the previous 2D image onto the current 2D image coincide approximately with the corresponding matched points of the current 2D image. - View Dependent Claims (5, 6)
- the program comprising the following actions, for each current 2D image in succession;
-
7. An apparatus that determines poses of an object in a succession of 2D images, relative to a 3D model of the object, the apparatus being configured to perform actions comprising:
-
means for matching points of the object in the current 2D image with corresponding points of a previous 2D image whose pose is already known, wherein the matched points of the previous 2D image has corresponding 3D positions in the 3D model; means for calculating a pose for the current 2D image such that the projections of 3D positions of matched points of the previous 2D image onto the current 2D image coincide approximately with the corresponding matched points of the current 2D image. - View Dependent Claims (8, 9)
-
Specification