Facial image processing methods and systems
First Claim
Patent Images
1. A facial image-processing system comprising:
- means for illuminating a face with multiple different light sources, wherein at least one of the light sources is polarized;
means for measuring range map data from said illuminating;
means for measuring image data from said illuminating;
means for deriving a 3-dimensional surface from the range map data;
means for computing surface normals to the 3-dimensional surface; and
means for processing the surface normals and the image data to derive an albedo map.
2 Assignments
0 Petitions
Accused Products
Abstract
In the described embodiment, methods and systems for processing facial image data for use in animation are described. In one embodiment, a system is provided that illuminates a face with illumination that is sufficient to enable the simultaneous capture of both structure data, e.g. a range or depth map, and reflectance properties, e.g. the diffuse reflectance of a subject'"'"'s face. This captured information can then be used for various facial animation operations, among which are included expression recognition and expression transformation.
-
Citations
12 Claims
-
1. A facial image-processing system comprising:
-
means for illuminating a face with multiple different light sources, wherein at least one of the light sources is polarized;
means for measuring range map data from said illuminating;
means for measuring image data from said illuminating;
means for deriving a 3-dimensional surface from the range map data;
means for computing surface normals to the 3-dimensional surface; and
means for processing the surface normals and the image data to derive an albedo map. - View Dependent Claims (2, 3)
-
-
4. A facial image-processing system comprising:
-
means for illuminating a face with multiple different light sources, wherein all of the light sources are polarized;
means for measuring range map data from said illuminating;
means for measuring image data from said illuminating;
means for deriving a 3-dimensional surface from the range map data;
means for computing surface normals to the 3-dimensional surface; and
means for processing the surface normals and the image data to derive an albedo map.
-
-
5. A facial image-processing system comprising:
-
means for illuminating a face with multiple different light sources;
means for measuring range map data from said illuminating;
means for applying a generic face template to the range map data to reject noise that is associated with the range map data;
means for measuring image data from said illuminating;
means for deriving a 3-dimensional surface from the range map data;
means for computing surface normals to the 3-dimensional surface; and
means for processing the surface normals and the image data to derive an albedo map.
-
-
6. A facial image-processing system comprising:
-
means for illuminating a face with multiple different light sources;
means for measuring range map data from said illuminating;
means for measuring image data from said illuminating;
means for filtering the range map data;
means for deriving a 3-dimensional surface from the range map data;
means for computing surface normals to the 3-dimensional surface; and
means for processing the surface normals and the image data to derive an albedo map.
-
-
7. A facial image-processing system comprising:
-
one or more processors;
one or more computer-readable media;
computer-readable instructions on the one or more computer-readable media which, when executed by the one or more processors, cause the one or more processors to implement a method comprising;
illuminating a face with multiple different light sources, wherein at least one of the light sources is polarized;
measuring range map data from said illuminating;
measuring image data from said illuminating;
deriving a 3-dimensional surface from the range map data;
computing surface normals to the 3-dimensional surface; and
processing the surface normals and the image data to derive an albedo map. - View Dependent Claims (8, 9)
-
-
10. A facial image-processing system comprising:
-
one or more processors;
one or more computer-readable media;
computer-readable instructions on the one or more computer-readable media which, when executed by the one or more processors, cause the one or more processors to implement a method comprising;
illuminating a face with multiple different light sources, wherein all of the light sources are polarized;
measuring range map data from said illuminating;
measuring image data from said illuminating;
deriving a 3-dimensional surface from the range map data;
computing surface normals to the 3-dimensional surface; and
processing the surface normals and the image data to derive an albedo map.
-
-
11. A facial image-processing system comprising:
-
one or more processors;
one or more computer-readable media;
computer-readable instructions on the one or more computer-readable media which, when executed by the one or more processors, cause the one or more processors to implement a method comprising;
illuminating a face with multiple different light sources;
measuring range map data from said illuminating;
applying a generic face template to the range map data to reject noise that is associated with the range map data;
measuring image data from said illuminating;
deriving a 3-dimensional surface from the range map data;
computing surface normals to the 3-dimensional surface; and
processing the surface normals and the image data to derive an albedo map.
-
-
12. A facial image-processing system comprising:
-
one or more processors;
one or more computer-readable media;
computer-readable instructions on the one or more computer-readable media which, when executed by the one or more processors, cause the one or more processors to implement a method comprising;
illuminating a face with multiple different light sources;
measuring range map data from said illuminating;
measuring image data from said illuminating;
filtering the range map data;
deriving a 3-dimensional surface from the range map data;
computing surface normals to the 3-dimensional surface; and
processing the surface normals and the image data to derive an albedo map.
-
Specification