MOBILE MOTION CAPTURE CAMERAS

• US 20110007081A1
• Filed: 09/13/2010
• Published: 01/13/2011
• Est. Priority Date: 03/13/2003
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.), Sony Pictures Entertainment Incorporated (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.), Sony Pictures Entertainment Incorporated (Sony Group Corp.)
• Inventors: Gordon, Demian
• Granted Patent: US 8,106,911 B2
• Time in Patent Office: Days
• US Class Current: 345/475
• CPC Class Codes: G06T 2207/10021 Stereoscopic video; Stereoscopic image sequence
• CPC Class Codes: G06T 2207/30201 Face
• CPC Class Codes: G06T 2207/30204 Marker
• CPC Class Codes: G06T 2207/30241 Trajectory
• CPC Class Codes: G06T 7/246 using feature-based methods, e.g. the tracking of corners or segments

Abstract

Capturing motion, including: coupling at least one body marker on at least one body point of at least one actor; coupling at least one facial marker on at least one facial point of the at least one actor; arranging a plurality of motion capture cameras around a periphery of a motion capture volume, the plurality of motion capture cameras is arranged such that substantially all laterally exposed surfaces of the at least one actor while in motion within the motion capture volume are within a field of view of at least one of the plurality of motion capture cameras at substantially all times; attaching at least one wearable motion capture camera to the at least one actor, wherein substantially all of the at least one facial marker and the at least one body marker on the at least one actor are within a field of view of the at least one wearable motion capture camera.

Claims

1. A method for capturing motion, comprising:

coupling at least one body marker on at least one body point of at least one actor;

coupling at least one facial marker on at least one facial point of the at least one actor;

arranging a plurality of motion capture cameras around a periphery of a motion capture volume, the plurality of motion capture cameras is arranged such that substantially all laterally exposed surfaces of the at least one actor while in motion within the motion capture volume are within a field of view of at least one of the plurality of motion capture cameras at substantially all times;

attaching at least one wearable motion capture camera to the at least one actor,

wherein substantially all of the at least one facial marker and the at least one body marker on the at least one actor are within a field of view of the at least one wearable motion capture camera.

2. The method of claim 1, wherein the at least one wearable motion capture camera is attached to a helmet worn on a head of the at least one actor,

wherein the at least one wearable motion capture camera moves with the at least one actor.

3. The method of claim 1, wherein the at least one wearable motion capture camera is attached to a harness worn on a body of the at least one actor.

4. The method of claim 1, wherein coupling at least one body marker on at least one body point comprises coupling the at least one body marker near the tip of each of at least one finger.

5. The method of claim 4, further comprising:

capturing motion data from the at least one motion body marker; and

generating a digital representation of a motion of the at least one finger using the captured motion data.

6. The method of claim 5, wherein generating a digital representation includes

determining a movement of a finger joint of the at least one finger using an inverse kinematics approximation.

7. The method of claim 5, wherein coupling at least one body marker includes

coupling at least one body marker near the tip of each of thumb, index finger, and pinky finger of a hand.

8. The method of claim 7, wherein generating a digital representation includes

interpolating motions of a middle finger and a ring finger of the hand using motion data of the index finger and the pinky finger.

9. The method of claim 4, wherein the at least one body marker is attached to a glove worn over the at least one finger.

10. The method of claim 4, further comprising

coupling at least one body marker to at least one joint of the at least one finger.

11. The method of claim 4, further comprising

coupling at least one body marker to a back of a hand connected to the at least one finger.

12. The method of claim 11, further comprising

coupling at least one body marker to a wrist connected to the hand.

13. A system for capturing facial and body motion, comprising:

at least one wearable motion capture camera attached to an actor; and

a motion capture processor coupled to the at least one wearable motion capture camera to produce a digital representation of movements of a face and hands of the actor,

wherein a plurality of facial markers defining plural facial points is disposed on the face and a plurality of body markers defining plural body points is disposed on the hands,

wherein the at least one wearable motion capture camera is positioned so that each of the plurality of facial markers and the plurality of body markers is within a field of view of the at least one wearable motion capure camera, and

wherein the at least one wearable motion capture camera is configured to move with the actor.

14. The system of claim 13, further comprising

a helmet worn on a head of the actor,

wherein the at least one wearable motion capture camera is attached to the helmet for capturing the plurality of facial markers on the face of the actor.

15. The system of claim 13, further comprising

a harness worn on a body of the actor,

wherein the at least one wearable motion capture camera is attached to the harness for capturing the plurality of body markers on the hands of the actor.

16. A non-transitory tangible storage medium storing a computer program for capturing hand motion of an actor, the computer program comprising executable instructions that cause a computer to:

capture motion data from at least one body marker attached near a tip of each of at least one finger of the actor; and

generate a digital representation of a motion of the at least one finger using the captured motion data.

17. The non-transitory tangible storage medium of claim 16, wherein the executable instructions that cause a computer to generate a digital representation comprises executable instructions that cause a computer to

determine a movement of a finger joint of the at least one finger using an inverse kinematics approximation.

18. The non-transitory tangible storage medium of claim 16, wherein the executable instructions that cause a computer to generate a digital representation comprises executable instructions that cause a computer to

interpolate motions of a middle finger and a ring finger of an actor'"'"'s hand using motion data of an index finger and a pinky finger obtained from at least one body marker placed near the tip of the index finger and the pinky finger.

19. The non-transitory tangible storage medium of claim 16, wherein the at least one body marker is attached to a glove worn over the at least one finger.