Mobile motion capture cameras

• US 7,812,842 B2
• Filed: 01/11/2008
• Issued: 10/12/2010
• Est. Priority Date: 03/13/2003
• Status: Expired due to Term

• Current Assignee: Sony Corporation (Sony Group Corp.), Sony Pictures Entertainment Incorporated (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.), Sony Pictures Entertainment Incorporated (Sony Group Corp.)
• Inventors: Gordon, Demian
• Primary Examiner(s): Nguyen; Kimbinh T
• Application Number:
  US12/013,257
• Publication Number:
  US 20080211815A1
• Time in Patent Office: 1,005 Days
• Field of Search: 345473-475, 345/7, 345/8, 382/103, 382/107, 382 44- 46, 382/236, 382/237, 348/E5.022, 348/E5.09, 348/162, 348/14.01, 348/14.08, 348/14.16
• US Class Current: 345/475
• CPC Class Codes: G01S 3/7864 T.V. type tracking systems
• CPC Class Codes: G06T 7/246 using feature-based methods, e.g. the tracking of corners or segments
• CPC Class Codes: H04N 5/222 Studio circuitry; Studio devices; Studio equipment cameras or camera modules comprising electronic image sensors, or control thereof H04N23/00
• CPC Class Codes: H04N 5/2224 related to virtual studio applications

Abstract

A system for capturing motion comprises: a motion capture volume configured to include at least one moving object having markers defining a plurality of points on the at least one moving object; at least one mobile motion capture camera, the at least one mobile motion capture camera configured to be moveable within the motion capture volume; and a motion capture processor coupled to the at least one mobile motion capture camera to produce a digital representation of movement of the at least one moving object.

Claims

1. A system for capturing motion, comprising:

a motion capture volume adapted to contain at least one actor having body markers defining plural body points and facial markers defining plural facial points on the at least one actor;

a plurality of motion cameras arranged around a periphery of said motion capture volume, said plurality of motion cameras is arranged such that substantially all laterally exposed surfaces of the at least one actor while in motion within said motion capture volume are within a field of view of at least one of said plurality of motion cameras at substantially all times;

at least one movable motion capture camera configured to track facial markers,

wherein substantially all of the facial markers on the at least one actor are within a field of view of said at least one movable motion capture camera, and

wherein said at least one movable motion capture camera is configured to be moveable within said motion capture volume;

a motion capture processor coupled to said at least one movable motion capture camera to produce a digital representation of movement of face of the at least one actor.

2. The system of claim 1, wherein:

a plurality of movable motion capture cameras configured to track facial markers;

substantially all facial markers of the one actor are within a field of view of at least one of said plurality of movable motion capture cameras; and

said plurality of movable motion capture cameras is configured to move with the one actor as the one actor moves within said motion capture volume.

3. The system of claim 1, wherein

said at least one movable motion capture camera is attached to a helmet worn on a head of the at least one actor.

4. The system of claim 1, wherein

said at least one movable motion capture camera is attached to a harness worn on a body of the at least one actor.

5. The system of claim 4, wherein the harness is worn on shoulders of the at least one actor.

6. The system of claim 4, wherein the harness is worn on a neck of the at least one actor.

7. The system of claim 1, wherein said motion capture processor is coupled to said at least one movable motion capture camera by a wireless connection.

8. The system of claim 1, wherein said at least one movable motion capture camera is connected to a battery.

9. The system of claim 1, further comprising:

the at least one movable motion capture camera configured to track facial expression.

10. A system for capturing facial motion, comprising:

at least one movable motion capture camera configured to track facial markers; and

a motion capture processor coupled to said at least one movable motion capture camera to produce a digital representation of movements of a face of the actor;

wherein a plurality of facial markers defining plural facial points is disposed on the face of the actor,

wherein said at least one movable motion capture camera is positioned so that each of the plurality of facial markers is within a field of view of said at least one movable motion capture camera, and

wherein said at least one movable motion capture camera is configured to move with the actor.

11. The system of claim 10, further comprising

a plurality of motion cameras arranged such that substantially all laterally exposed surfaces of the actor are within a field of view of said plurality of motion cameras at substantially all times.

12. The system of claim 11, wherein orientations of said plurality of motion cameras are moveable.

13. The system of claim 11, wherein positions of said plurality of motion cameras are fixed with respect a capture volume within which the actor is performing.

14. The system of claim 13, wherein positions of said at least one movable motion capture camera are moveable with respect to the capture volume but are fixed with respect to the actor.

15. The system of claim 13, wherein:

said at least one movable motion capture camera is attached to a helmet worn on a head of the actor, and is configured as at least one facial motion camera; and

said plurality of motion cameras is configured as a plurality of body motion cameras.

16. The system of claim 15, wherein orientations of said at least one movable motion capture camera are moveable with respect to the helmet worn on the head of the actor.

17. A system for capturing combined facial and body motion, comprising:

a motion capture volume configured to include at least one actor having body markers defining plural points of a body of the at least one actor and facial markers defining plural points of a face of the at least one actor;

a plurality of body motion cameras arranged around a periphery of said motion capture volume;

a plurality of facial motion cameras attached to the at least one actor, and moveable within said motion capture volume,

wherein said plurality of facial motion cameras is arranged such that substantially all laterally exposed surfaces of the face of the at least one actor are within a field of view of at least one of said plurality of facial motion cameras at substantially all times; and

a motion capture processor coupled to said plurality of body motion cameras and said plurality of facial motion cameras to simultaneously receive motion capture data from said plurality of body motion cameras and said plurality of facial motion cameras, and produce a digital representation representing the combined facial and body motion of the at least one actor.

18. The system of claim 17, wherein said plurality of body motion cameras is fixed with respect said motion capture volume.

19. The system of claim 17, wherein said plurality of facial motion cameras is moveable with respect to said motion capture volume but is fixed with respect to the at least one actor.

20. The system of claim 17, wherein said plurality of facial motion cameras is attached to a helmet worn on a head of the at least one actor.