Facial image processing methods and systems
First Claim
Patent Images
1. A computer-implemented facial image-processing method comprising:
- illuminating a face with multiple different light sources;
measuring range map data from said illuminating;
measuring image data from said illuminating;
deriving a 3-dimensional surface from the range map data;
computing surface normals to the 3-dimensional surface; and
processing the surface normals and the image data to derive an albedo map.
2 Assignments
0 Petitions
Accused Products
Abstract
In the described embodiment, methods and systems for processing facial image data for use in animation are described. In one embodiment, a system is provided that illuminates a face with illumination that is sufficient to enable the simultaneous capture of both structure data, e.g. a range or depth map, and reflectance properties, e.g. the diffuse reflectance of a subject'"'"'s face. This captured information can then be used for various facial animation operations, among which are included expression recognition and expression transformation.
-
Citations
35 Claims
-
1. A computer-implemented facial image-processing method comprising:
-
illuminating a face with multiple different light sources;
measuring range map data from said illuminating;
measuring image data from said illuminating;
deriving a 3-dimensional surface from the range map data;
computing surface normals to the 3-dimensional surface; and
processing the surface normals and the image data to derive an albedo map. - View Dependent Claims (2, 3, 4, 5)
-
-
6. A computer-implemented facial image-processing method comprising:
-
receiving range map data and image data that are generated from a simultaneous facial illumination;
deriving a 3-dimensional surface from the range map data;
computing surface normals to the 3-dimensional surface; and
processing the surface normals and the image data to derive an albedo map. - View Dependent Claims (7)
-
-
8. A facial image processing system comprising:
-
multiple different light sources, one of which providing structured light that can be projected onto the face of a subject, another of which providing light from which specularly-suppressed, diffuse reflectance data from the subject'"'"'s face can be ascertained;
a camera configured to capture structure and reflectance data from an illumination of the subject'"'"'s face with the multiple different light sources; and
a computerized image processor configured to process the structure and reflectance data to provide an albedo map that describes specular-suppressed diffuse reflectance properties of the subject'"'"'s face and dimensional data that describes dimensional aspects of the subject'"'"'s face. - View Dependent Claims (9, 10, 11)
-
-
12. A computer-implemented facial image-processing method comprising:
-
illuminating a face with illumination; and
contemporaneously capturing structure data describing the face'"'"'s structure and reflectance data describing reflectance properties of the face from the illumination. - View Dependent Claims (13, 14, 15, 16, 17, 18, 19, 20, 21, 22)
-
-
23. A computer-implemented facial image-processing method comprising:
-
illuminating a face with a first polarized light source that is selected so that specularly-suppressed reflective properties of the face can be ascertained;
illuminating the face with a second structured light source that projects a pattern onto the face, while simultaneously illuminating the face with the first polarized light source;
capturing both specularly-suppressed reflection data and structure data from the simultaneous illumination. - View Dependent Claims (24, 25, 26, 27)
-
-
28. A facial image processing system comprising:
-
a facial illumination system that is configured to provide multiple different light sources at the same time for illuminating a subject'"'"'s face; and
a data-capturing system configured to capture both structure data and reflectance data from the subject'"'"'s face when illuminated by the facial illumination system. - View Dependent Claims (29, 30, 31, 32, 33, 34, 35)
-
Specification