Facial image processing
First Claim
Patent Images
1. A computer-implemented facial image-processing method comprising:
- illuminating a face with multiple different light sources simultaneously, wherein at least one of the light sources is polarized;
measuring range map data from said illuminating;
measuring image data from said illuminating;
applying a generic face template to the range map data to reject noise that is associated with the range map data;
deriving a 3-dimensional surface from the range map data;
computing surface normals to the 3-dimensional surface; and
processing the surface normals and the image data to derive an albedo map.
2 Assignments
0 Petitions
Accused Products
Abstract
In the described embodiment, methods and systems for processing facial image data for use in animation are described. In one embodiment, a system is provided that illuminates a face with illumination that is sufficient to enable the simultaneous capture of both structure data, e.g. a range or depth map, and reflectance properties, e.g. the diffuse reflectance of a subject'"'"'s face. This captured information can then be used for various facial animation operations, among which are included expression recognition and expression transformation.
49 Citations
17 Claims
-
1. A computer-implemented facial image-processing method comprising:
-
illuminating a face with multiple different light sources simultaneously, wherein at least one of the light sources is polarized; measuring range map data from said illuminating; measuring image data from said illuminating; applying a generic face template to the range map data to reject noise that is associated with the range map data; deriving a 3-dimensional surface from the range map data; computing surface normals to the 3-dimensional surface; and processing the surface normals and the image data to derive an albedo map. - View Dependent Claims (2, 3)
-
-
4. A computer-implemented facial image-processing method comprising:
-
illuminating a face with illumination, wherein the illumination comprises; a first light source that is polarized and selected so that specularly-suppressed reflective properties of the face can be ascertained; and a second light source that projects a structured pattern onto the face, while simultaneously illuminating the face with the first light source, wherein the second light source projects the structured pattern on the face from which structure data can be ascertained; and contemporaneously capturing structure data describing the face'"'"'s dimensional shape and structure and reflectance data describing reflectance properties of the face from the illumination, whereby the computer processes the structure data and the reflectance data to provide range map data, the range map data being filtered by applying a generic face template to reject noise in the range map data. - View Dependent Claims (5, 6, 7, 8, 9, 10, 11, 12)
-
-
13. A computer-implemented facial image-processing method comprising:
-
illuminating a face with a first polarized light source that is selected so that specularly-suppressed reflective properties of the face can be ascertained; illuminating the face with a second structured light source that projects a pattern onto the face, while simultaneously illuminating the face with the first polarized light source; capturing both specularly-suppressed reflection data and structure data from the simultaneous illumination, whereby the computer processes the structure data and the specularly-suppressed reflection data to provide range map data, the range map data being filtered by applying a generic face template to reject noise in the range map data. - View Dependent Claims (14, 15, 16, 17)
-
Specification