INTEGRATED MOTION CAPTURE

• US 20100315524A1
• Filed: 09/04/2008
• Published: 12/16/2010
• Est. Priority Date: 09/04/2007
• Status: Abandoned Application

• Current Assignee: Sony Corporation (Sony Group Corp.), Sony Pictures Entertainment Incorporated (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.), Sony Pictures Entertainment Incorporated (Sony Group Corp.)
• Inventors: Havaldar, Parag, Gordon, Demian
• Application Number:
  US12/676,041
• Publication Number:
  US 20100315524A1
• Time in Patent Office: Days
• US Class Current: 348/222.1
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/0325 using a plurality of light emitters or reflectors or a plurality of detectors forming a reference frame from which to derive the orientation of the object, e.g. by triangulation or on the basis of reference deformation in the picked up image
• CPC Class Codes: G06T 2207/30204 Marker
• CPC Class Codes: G06T 7/251 involving models

Abstract

A method including: applying a marking material having a known pattern to a body and a face of an actor; configuring at least one first video motion capture camera to capture the marking material on the body of the actor; configuring at least one second video motion capture camera to capture the marking material on the face of the actor; substantially simultaneously capturing body motion data using the at least one first video motion capture camera and facial motion data using the at least one second video motion capture camera; and integrating the body motion data and the facial motion data.

Claims

1. A method, comprising:

applying marking material having a known pattern to body and face of an actor;

configuring at least one first video motion capture camera to capture the marking material on the body of the actor;

configuring at least one second video motion capture camera to capture the marking material on the face of the actor;

substantially simultaneously capturing body motion data using the at least one first video motion capture camera and facial motion data using the at least one second video motion capture camera; and

integrating the body motion data and the facial motion data.

2. The method of claim 1, wherein the at lest one second video motion capture camera is configured to be worn on the head of the actor.

3. The method of claim 1, wherein the marking material on the body of the actor includes

a marker having encoded identification and orientation information.

5. The method of claim 3, wherein the marker is a matrix of a unique dot pattern.

6. The method of claim 3, wherein the marker is a circular test pattern.

7. The method of claim 1, wherein the marking material on the face of the actor includes

ink markings painted on the face.

8. The method of claim 7, wherein the ink markings painted on the face include

at least one of infra-red ink, glowing paint/makeup, and quantum nanodots.

9. The method of claim 1, wherein the marking material on the face of the actor includes

inherent features on the face of the actor.

10. The method of claim 9, wherein the inherent features include at least one of moles, wrinkles, freckles, and eye corners.

11. The method of claim 1, wherein the facial motion data includes

data obtained by performing facial surface capture scans.

12. The method of claim 1, further comprising

configuring a film camera to capture the entire performance.

13. The method of claim 1, wherein applying marking material includes

projecting a pattern of light onto the face of the actor.

4. (canceled)

14. A system, comprising:

marking material having a known pattern applied to body and face of an actor;

at least one first video motion capture camera to capture the marking material on the body of the actor;

at least one second video motion capture camera to capture the marking material on the face of the actor;

a processor configured to;

substantially simultaneously capture body motion data using the at least one first video motion capture camera and facial motion data using the at least one second video motion capture camera; and

integrate the body motion data and the facial motion data.

15. The system of claim 14, further comprising

a helmet to be worn on the head of the actor and to mount the at lest one second video motion capture camera.

16. The system of claim 14, wherein the marking material on the body of the actor includes

a marker having encoded identification and orientation information.

17. The system of claim 14, wherein the marking material on the face of the actor includes

ink markings painted on the face.

18. The system of claim 14, wherein the facial motion data includes

data obtained by performing facial surface capture scans.