Head-Mounted Photometric Facial Performance Capture
First Claim
1. A photometric facial performance capture system comprising:
- a camera configured to capture a sequence of images of a real face that is part of a head of a person while the face changes;
a camera support configured to cause the field of view of the camera to remain substantially fixed with respect to the face, notwithstanding movement of the head;
a lighting system configured to light the face from multiple directions;
a lighting system support configured to cause each of the directions of the light from the lighting system to remain substantially fixed with respect to the face, notwithstanding movement of the head; and
a data processing system configured to compute sequential images of the face as it changes based on the captured images, each computed image including per-pixel surface normals of the face that are calculated based on multiple, separate images of the face, each separate image being representative of the face being lit by the lighting system from a different one of the separate directions.
1 Assignment
0 Petitions
Accused Products
Abstract
A camera may capture a sequence of images of a face while the face changes. A camera support may cause the field of view of the camera to remain substantially fixed with respect to the face, notwithstanding movement of the head. A lighting system may light the face from multiple directions. A lighting system support may cause each of the directions of the light from the lighting system to remain substantially fixed with respect to the face, notwithstanding movement of the head. Sequential images of the face may be computed as it changes based on the captured images. Each computed image may include least per-pixel surface normals of the face that are calculated based on multiple, separate images of the face. Each separate image may be representative of the face being lit by the lighting system from a different one of the separate directions.
52 Citations
21 Claims
-
1. A photometric facial performance capture system comprising:
-
a camera configured to capture a sequence of images of a real face that is part of a head of a person while the face changes; a camera support configured to cause the field of view of the camera to remain substantially fixed with respect to the face, notwithstanding movement of the head; a lighting system configured to light the face from multiple directions; a lighting system support configured to cause each of the directions of the light from the lighting system to remain substantially fixed with respect to the face, notwithstanding movement of the head; and a data processing system configured to compute sequential images of the face as it changes based on the captured images, each computed image including per-pixel surface normals of the face that are calculated based on multiple, separate images of the face, each separate image being representative of the face being lit by the lighting system from a different one of the separate directions. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18)
-
-
19. A photometric facial performance capture system comprising:
-
a camera configured to capture a sequence of images of a real face while the face changes; a lighting system configured to light the face; and a data processing system configured to compute sequential images of the face as it changes based on the captured images, each computed image being composed of at least per-pixel surface normals of the face that are calculated based on a multiplicity of the captured images, at least one of which is captured while the face is lit by the lighting system and at least one of which is captured while the face is not lit by the lighting system.
-
-
20. A facial animation generation system for generating facial animation comprising:
-
a photometric facial performance capture system configured to capture a sequence of images of a real face while the face changes and to compute images of the face as it changes based on the captured images, each computed image being composed of per-pixel surface normals of the face; and a photometric shape driven animation system configured to generate a facial animation based on the data, including the per-pixel surface normals.
-
-
21. A photometric facial performance capture system comprising:
-
a camera configured to capture a sequence of images of a real face that is part of a head of a person while the face changes; a camera support configured to cause the field of view of the camera to remain substantially fixed with respect to the face, notwithstanding movement of the head; a lighting system configured to light the face; a lighting system support configured to cause the direction of light from the lighting system to remain substantially fixed with respect to the face, notwithstanding movement of the head; and a data processing system configured to compute sequential images of the face as it changes based on the captured images, each computed sequential image of the face being computed based on at least one image of the fact that is captured while the face is lit by the lighting system and at least one image of the face that is captured while the face is not lit by the lighting system.
-
Specification