COMBINED GEOMETRIC AND SHAPE FROM SHADING CAPTURE

• US 20110025685A1
• Filed: 07/29/2009
• Published: 02/03/2011
• Est. Priority Date: 07/29/2009
• Status: Abandoned Application

• Current Assignee: Two PIC MC LLC
• Original Assignee: Two PIC MC LLC
• Inventors: Epps, Doug
• Application Number:
  US12/511,926
• Publication Number:
  US 20110025685A1
• Time in Patent Office: Days
• US Class Current: 345/419
• CPC Class Codes: G06T 15/00 3D [Three Dimensional] image rendering
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 2207/30201 Face
• CPC Class Codes: G06T 7/251 involving models

Abstract

An image capturing system includes one or more image capturing devices and one or more illumination sources that have known and fixed positions relative to one another, wherein the illumination source is held constant or can be calibrated to provide a known illumination level on a subject, such that the variation in shading at various points on the surface of the subject, with different orientations relative to the illumination source, can be used to determine the orientation of the surface of the subject and thereby used to more accurately render an image or other representation of the subject.

Claims

1. A method for determining geometric shape data associated with a surface of an object comprising:

determining geometric reference data associated with an image capturing system comprising an image capturing device and an illumination source, wherein the image capturing device is configured to capture surface illumination of subject objects;

determining correlation between surface illumination data to surface normal data associated with subject objects, in response to the geometric reference data and in response to surface illumination data of subject objects;

capturing a plurality of images comprising performance data associated with the object with the image capturing device for a plurality of performance frames;

determining a plurality of surface normal data associated with the surface of the object for a plurality of surface locations on the object, for image from the plurality of images, in response to the plurality of images and in response to the correlation between surface illumination data to the surface normal data; and

rendering a plurality of images in response to the plurality of surface normal data associated with the surface of the object.

2. The method of claim 1 further comprising applying a matte surface to a surface of the object.

3. The method of claim 2 wherein the object comprises an actor'"'"'s face.

4. The method of claim 3 wherein the matte surface is in the form of make-up.

5. The method of claim 2 wherein the image capturing system comprises two or more cameras and two or more illumination sources.

6. The method of claim 5 wherein the two or more illumination sources are point sources.

7. The method of claim 5 wherein a wavelength of the illumination sources is beyond human-visible wavelength.

8. The method of claim 7 wherein the wavelength of the illumination sources is selected from a group consisting of:

infrared and ultraviolet.

9. A system for determining geometric shape data associated with a surface of an object comprising:

an image capturing system comprising an image capturing device and an illumination source;

wherein the image capturing device is configured to capture surface illumination of the object, wherein geometric reference data associated with the image capturing system is known, and a correlation between surface illumination data to surface normal data associated with the object based on the geometric reference data and surface illumination data of the object is known;

a computer system in communication with the image capturing system.

10. The system of claim 9 wherein the image capturing device comprises two or more digital cameras.

11. The system of claim 10 wherein the illumination source comprises two or more light sources.

12. The system of claim 11 wherein in the wavelength of the illumination source is beyond the human visible wavelength.

13. The system of claim 12 wherein the object is an actor'"'"'s face.

14. The system of claim 11 wherein the computer system is configured to render a plurality of images in response to the plurality of surface normal data associated with the surface of the object.

15. An apparatus for determining geometric shape data associated with a surface of an object comprising:

a head gear configured to be stably fixed to the object;

one or more arms attached to the head gear,

one or more image capturing systems comprising an image capturing device and an illumination source attached to one end of one or more of the arms;

wherein the image capturing device is configured to capture surface illumination of the object, wherein geometric reference data associated with the image capturing system is known, and a correlation between surface illumination data to surface normal data associated with the object based on the geometric reference data and surface illumination data of subject objects is known; and

a computer system in communication with the image capturing system.

16. The apparatus of claim 15 wherein one or more of the illuminations sources are point sources.

17. The apparatus of claim 15 wherein the wavelength of one or more of the illumination sources is beyond the human visible wavelength.

18. The apparatus of claim 17 wherein the object is a face.

19. The apparatus of claim 15 wherein the position of one or more of the arms on the head gear are adjustable.

20. The apparatus of claim 15 wherein the computer system is in communication with the image capturing system via a wireless link.