MOTION CAPTURE USING CROSS-SECTIONS OF AN OBJECT

• US 20130182079A1
• Filed: 03/07/2012
• Published: 07/18/2013
• Est. Priority Date: 01/17/2012
• Status: Abandoned Application

• Current Assignee: Lmi Liquidating Co., LLC
• Original Assignee: OcuSpec Co.
• Inventors: Holz, David
• Application Number:
  US13/414,485
• Publication Number:
  US 20130182079A1
• Time in Patent Office: Days
• US Class Current: 348/47
• CPC Class Codes: G06T 2200/08 involving all processing steps from image acquisition to 3D model generation
• CPC Class Codes: G06T 2207/10021 Stereoscopic video; Stereoscopic image sequence
• CPC Class Codes: G06T 7/593 from stereo images

Abstract

An object'"'"'s position and/or motion in three-dimensional space can be captured. For example, a silhouette of an object as seen from a vantage point can be used to define tangent lines to the object in various planes (“slices”). From the tangent lines, the cross section of the object is approximated using a simple closed curve (e.g., an ellipse). Alternatively, locations of points on an object'"'"'s surface in a particular slice can also be determined directly, and the object'"'"'s cross-section in the slice can be approximated by fitting a simple closed curve to the points. Positions and cross sections determined for different slices can be correlated to construct a 3D model of the object, including its position and shape. A succession of images can be analyzed to capture motion of the object.

Claims

1. A method of determining position and shape of an object in three-dimensional (3-D) space, the method comprising:

obtaining one or more images of an object;

analyzing, by a computer, the one or more images to define at least four points on a surface of the object in each one of a plurality of slices;

generating, by the computer, a cross-section of the object in each slice based on the at least four points;

defining a 3-D model of the object based on the cross-sections in the plurality of slices;

based on the 3-D model, determining, by the computer, a position and shape of the object.

2. The method of claim 1 wherein analyzing the one or more images to define the at least four points includes, for at least one of the slices, defining at least four coplanar tangent lines to the object in the slice.

3. The method of claim 1 wherein obtaining the one or more images of the object includes using a time-of-flight camera to capture an image of the object and wherein analyzing the one or more images to define the at least four points includes, for at least one of the slices, determining the positions of the at least four points based on time-of-flight data provided by the time-of-flight camera.

4. The method of claim 1 wherein defining the 3-D model of the object includes correlating the cross-sections generated for each of the slices.

5. A method of determining position and shape of an object in three-dimensional (3-D) space, the method comprising:

obtaining one or more silhouette images of an object;

analyzing, by a computer, the one or more silhouette images to define at least four coplanar tangent lines to the object in each one of a plurality of slices;

generating, by the computer, a cross-section of the object in each slice based on the at least four tangents;

defining a 3-D model of the object based on the cross-sections in the plurality of slices;

based on the 3-D model, determining, by the computer, a position and shape of the object.

6. The method of claim 5 wherein obtaining the one or more silhouette images of the object includes:

using at least two cameras, collecting at least two images of the object.

7. The method of claim 5 wherein obtaining the one or more silhouette images of the object includes:

directing light from a light source toward the object; and

using at least one camera, collecting an image of the object and a shadow cast by the object.

8. The method of claim 5 wherein generating the cross-section includes generating the cross-section as a simple closed curve.

9. The method of claim 5 wherein generating the cross-section includes generating the cross-section as an elliptical cross-section.

10. The method of claim 9 wherein generating the cross-section includes, for at least one of the slices:

initializing one parameter of an equation defining an ellipse to an assumed value; and

using the tangent lines and the initialized parameter, computing one or more complete solution sets of parameters for the equation defining the ellipse.

11. The method of claim 10 wherein generating the cross-section further includes:

discarding any one of the one or more complete solution sets of parameters that does not satisfy a physical constraint.

12. The method of claim 5 wherein defining the 3-D model of the object includes correlating the cross-sections generated for each of the slices.

13. The method of claim 12 wherein defining the 3-D model includes:

determining an object type from the 3-D model; and

refining the cross-sections based on the object type.

14. A method for motion capture, the method comprising:

obtaining one or more silhouette images of a moving object at each of a plurality of times;

for at least one of the plurality of times, analyzing, by a computer, the one or more silhouette images to define at least four coplanar tangent lines to the object in each one of a plurality of slices;

generating, by the computer, a cross-section of the object in each slice based on the at least four tangents;

constructing a 3-D model of the object based on the cross-sections in the plurality of slices;

based on the 3-D model, determining, by the computer, a position and a shape of the object at the given time; and

repeating the acts of analyzing, generating and constructing for each of the plurality of times to construct a model of a motion of the object.

15. The method of claim 14 further comprising:

correlating the determined position and shape of the object across different ones of the plurality of times; and

refining the model of the motion of the object based on the correlation.

16. The method of claim 15 wherein refining the model of the motion of the object based on the correlation includes eliminating from the model at a first time a cross-section that does not correlate with the model at a second time.

17. The method of claim 14 further comprising:

determining, based on the 3-D model as constructed from images at a first one of the plurality of times, an object type for the 3-D model; and

using the determined object type to constrain the construction of the 3-D model at a second one of the plurality of times.

18. The method of claim 14 wherein the object includes two or more separately articulating members and the model of the motion of the object includes a model of the motion of each of the two separately articulating members.

19. A motion capture system comprising:

a camera subsystem; and

a processor coupled to receive image data from the camera subsystem, the processor being configured to;

determine one or more silhouettes of an object from the image data;

analyze the one or more silhouettes to define at least four coplanar tangent lines to the object in each one of a plurality of slices;

generate a cross-section of the object in each slice based on the at least four tangents;

define a 3-D model of the object based on the cross-sections in the plurality of slices; and

determine, based on the 3-D model, a position and shape of the object.

20. The motion capture system of claim 19 wherein the camera subsystem includes a first camera and a second camera arranged at known positions and having overlapping fields of view.

21. The motion capture system of claim 19 wherein the camera subsystem includes:

a camera; and

a light source at a known position and configured to cast a shadow of an object into a field of view of the camera,

wherein the camera is configured to obtain an image that includes both the object and the shadow of the object.

22. The motion capture system of claim 21 wherein the processor is further configured to determine the one or more silhouettes of the object by locating the object and the shadow of the object in a single image obtained by the camera.

23. The motion capture system of claim 19 wherein the camera subsystem includes:

a camera; and

a plurality of light sources, each light source having a known position and being configured to cast a shadow of an object into a field of view of the camera,

wherein the camera is configured to obtain an image that includes the shadows of the object cast by the plurality of light sources.

24. The motion capture system of claim 19 wherein the camera subsystem includes at least one infrared camera.

25. The motion capture system of claim 19 wherein the camera subsystem includes:

a camera;

a front-surface mirror; and

a beamsplitter disposed at an angle to the front-surface mirror,

wherein the first camera is oriented toward the beamsplitter and receives multiple images of the object simultaneously, wherein the multiple images are created by light passing through the beamsplitter and the front-surface mirror.