Mobile motion capture cameras

• US 20060152512A1
• Filed: 03/08/2006
• Published: 07/13/2006
• Est. Priority Date: 03/13/2003
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.), Sony Pictures Entertainment Incorporated (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.), Sony Pictures Entertainment Incorporated (Sony Group Corp.)
• Inventors: Gordon, Demian
• Granted Patent: US 7,333,113 B2
• Time in Patent Office: Days
• US Class Current: 345/475
• CPC Class Codes: G01S 3/7864 T.V. type tracking systems
• CPC Class Codes: G06T 7/246 using feature-based methods, e.g. the tracking of corners or segments
• CPC Class Codes: H04N 5/222 Studio circuitry; Studio devices; Studio equipment cameras or camera modules comprising electronic image sensors, or control thereof H04N23/00
• CPC Class Codes: H04N 5/2224 related to virtual studio applications

Abstract

A system for capturing motion comprises: a motion capture volume configured to include at least one moving object having markers defining a plurality of points on the at least one moving object; at least one mobile motion capture camera, the at least one mobile motion capture camera configured to be moveable within the motion capture volume; and a motion capture processor coupled to the at least one mobile motion capture camera to produce a digital representation of movement of the at least one moving object.

Claims

1. A system for capturing motion, comprising:

a motion capture volume configured to include at least one moving object having markers defining a plurality of points on said at least one moving object;

at least one mobile motion capture camera, said at least one mobile motion capture camera configured to be moveable within said motion capture volume; and

a motion capture processor coupled to said at least one mobile motion capture camera to produce a digital representation of movement of said at least one moving object.

2. The system for capturing motion of claim 1, further comprising at least one fixed motion capture camera.

3. The system for capturing motion of claim 1, wherein said at least one mobile motion capture camera moves around the periphery of the volume.

4. The system for capturing motion of claim 1, wherein said at least one mobile motion capture camera is moved such that substantially all laterally exposed surfaces of said at least one moving object while in motion within said motion capture volume are within a field of view of said plurality of motion capture cameras at substantially all times.

5. The system for capturing motion of claim 1, wherein said plurality of motion capture cameras is arranged to provide a larger effective volume of said motion capture volume than possible with all fixed motion capture cameras.

6. The system for capturing motion of claim 1, wherein said at least one mobile motion capture camera is moved from a first position to a second position and is fixed at said second position.

7. The system for capturing motion of claim 1, wherein said at least one mobile motion capture camera is moved to follow the action of said at least one moving object and to perform motion capture while moving.

8. The system for capturing motion of claim 1, further comprising

a camera motion processor coupled to said at least one mobile motion capture camera to track the movement of said at least one mobile motion capture camera and to remove the movement in the subsequent processing of captured data to generate said digital representation of movement of said at least one moving object.

9. The system for capturing motion of claim 1, further comprising

at least one servomotor used to move said at least one mobile motion capture camera.

10. The system for capturing motion of claim 1, wherein said at least one mobile motion capture camera is moved individually.

11. The system for capturing motion of claim 1, wherein said at least one mobile motion capture camera includes

a first reference camera configured to show views of said at least one mobile motion capture camera.

12. The system for capturing motion of claim 1, wherein said at least one mobile motion capture camera includes

a second reference camera configured to generate reference and adjustment of motion captured by said at least one mobile motion capture camera.

13. The system for capturing motion of claim 1, wherein said at least one mobile motion capture camera includes

a feedback loop configured to generate reference and adjustment of motion captured by said at least one mobile motion capture camera without a reference camera.

14. The system for capturing motion of claim 1, further comprising

at least one mobile motion capture rig configured to enable at least one of said at least one mobile motion capture camera to be disposed on said at least one mobile motion capture rig such that cameras of said at least one mobile motion capture camera are moved.

15. The system for capturing motion of claim 14, wherein at least one of said at least one mobile motion capture rig includes

at least one servomotor configured to provide translation and rotational movements to said at least one mobile motion capture camera disposed on that mobile motion capture rig.

16. The system for capturing motion of claim 15, wherein said at least one servomotor is coupled to said at least one mobile motion capture rig to provide said translation and rotational movements together to said at least one mobile motion capture camera.

17. The system for capturing motion of claim 15, wherein said at least one servomotor is coupled to each of said at least one mobile motion capture camera to provide said translation and rotational movements individually to said each of said at least one mobile motion capture camera.

18. The system for capturing motion of claim 17, wherein at least one of said at least one mobile motion capture camera is restricted in at least one movement of said translation and rotational movements.

19. The system for capturing motion of claim 14, wherein said at least one mobile motion capture rig is configured such that movements of said at least one mobile motion capture rig are pre-programmed.

20. The system for capturing motion of claim 14, wherein said at least one mobile motion capture rig is configured to move automatically based on received input for said at least one moving object.

21. The system for capturing motion of claim 20, wherein said received input includes a visual signal received from said at least one moving object.

22. The system for capturing motion of claim 21, wherein said at least one mobile motion capture rig moves with said at least one moving object based on captured movement of that object.

23. The system for capturing motion of claim 1, further comprising

fixed tracking markers disposed at fixed locations within said motion capture volume.

24. The system for capturing motion of claim 23, further comprising

a camera calibration system to calibrate said at least one mobile motion capture camera using motion capture information representing the location of said fixed tracking markers.

25. A system for capturing motion, comprising:

at least one mobile motion capture camera configured to be moveable, said at least one mobile motion capture camera operating to capture motion within a motion capture volume; and

at least one mobile motion capture rig configured to enable said at least one mobile motion capture camera to be disposed on said at least one mobile motion capture rig such that cameras of said at least one mobile motion capture camera can be moved.

26. A method for capturing motion, comprising:

defining a motion capture volume configured to include at least one moving object having markers defining a plurality of points on said at least one moving object;

moving at least one mobile motion capture camera within said motion capture volume; and

processing data from said at least one mobile motion capture camera to produce a digital representation of movement of said at least one moving object.

27. The method of claim 26, wherein said moving said at least one mobile motion capture camera includes

moving said at least one mobile motion capture camera from a first position to a second position and is fixed at said second position.

28. The method of claim 26, wherein said moving said at least one mobile motion capture camera includes

moving said at least one mobile motion capture camera to follow the action of said at least one moving object and to perform motion capture while moving.

29. The method of claim 26, further comprising

tracking the movement of said at least one mobile motion capture camera;

and

removing the movement in the subsequent processing of captured data to generate said digital representation of movement of said at least one moving object.

30. The method of claim 26, wherein said at least one mobile motion capture camera includes

generating reference and adjustment of motion captured by said at least one mobile motion capture camera.

31. The method of claim 26, further comprising

placing fixed tracking markers at fixed locations within said motion capture volume.

32. The method of claim 31, further comprising

calibrating said at least one mobile motion capture camera using motion capture information representing the location of said fixed tracking markers.

33. A system for capturing motion, comprising:

means for defining a motion capture volume configured to include at least one moving object having markers defining a plurality of points on said at least one moving object;

means for moving at least one mobile motion capture camera within said motion capture volume; and

means for processing data from said at least one mobile motion capture camera to produce a digital representation of movement of said at least one moving object.