Correlation extract method for generating 3D motion data, and motion capture system and method for easy composition of humanoid character on real background image using the same

• US 8,340,398 B2
• Filed: 11/30/2007
• Issued: 12/25/2012
• Est. Priority Date: 12/02/2006
• Status: Active Grant

• Current Assignee: Electronics and Telecommunications Research Institute
• Original Assignee: Electronics and Telecommunications Research Institute
• Inventors: Park, Chang Joon, Yu, Jung Jae, Lee, Jae Kwang, Lee, In Ho
• Primary Examiner(s): Bhatnagar, Anand
• Assistant Examiner(s): PARK, SOO JIN
• Application Number:
  US11/948,923
• Publication Number:
  US 20080130985A1
• Time in Patent Office: 1,852 Days
• Field of Search: 348/586, 382/284, 382/154, 345/419
• US Class Current: 382/154
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 7/73 using feature-based methods
• CPC Class Codes: G06T 7/80 Analysis of captured images to determine intrinsic or extrinsic camera parameters, i.e. camera calibration

Abstract

Provided are a method for extracting a correlation to generate 3D motion data, and a motion capture system and method using the extracting method to easily compose a humanoid character on a real background image. Cameras for motion capture are installed in a real background capture location (such as an outdoor location or in a studio), and the correlation between motion capture fixed cameras and a moving camera for capturing a real background image is obtained to capture 3D motion data prior to performing motion capture for integrating a humanoid character, so that even when there is interaction between a 3D figure and an actual prop such as a chair or table within the captured space, a humanoid character can easily be composed with the real background.

Claims

1. A motion capture system, comprising:

a calibration frame for calibrating positions of a fixed camera for motion capture and a moving camera for capturing a real background;

a fixed camera for capturing the calibration frame and a background marker or a corner point in a real background, and movement of a moving subject;

a moving camera for moving and capturing the real background; and

a motion capture processor for generating 3D motion data that extracts and automatically integrates a geometric correlation of the fixed camera and the moving camera with the real background.

2. The motion capture system of claim 1, wherein the background marker or the corner point comprises one of any form of a single point, line, and plane.

3. The motion capture system of claim 1, wherein the motion capture processor comprises:

a correlation extractor for determining 3D geometric relative positions of the fixed camera and the background marker or the corner point, and extracting a geometric correlation of the fixed camera and the moving camera; and

a 3D motion data generator for generating 3D motion data that automatically integrates the captured movement of the moving subject with the real background, according to the extracted geometric correlation.

4. The motion capture system of claim 3, wherein the 3D geometric relative positions of the fixed camera and the background marker or the corner point are obtained from a geometric relation between the calibration frame and the background marker or the corner point.

5. A method, comprising:

using a fixed camera for motion capture;

capturing a real background using a moving camera;

extracting a geometric correlation of the fixed camera and the moving camera; and

using the extracted correlation to capture motion of a real moving subject and generate 3D motion data automatically integrating the captured motion with the real background.

6. The method of claim 5, wherein the step of extracting the geometric correlation comprises the steps of:

obtaining a geometric relation between the fixed camera and a calibration frame;

obtaining a geometric relation between the calibration frame and a background marker captured by the moving camera or a corner point in the real background;

obtaining 3D geometric relative positions of the fixed camera and the background marker or the corner point, using the obtained geometric relation through the calibration frame; and

obtaining 3D geometric relative positions of the fixed camera and the moving camera from the obtained 3D geometric relative positions of the fixed camera and the background marker or the corner point, and extracting a correlation of the fixed camera and the moving camera.

7. The method of claim 6, wherein the calibration frame calibrates a position of the fixed camera.

8. The method of claim 6, further comprising positioning the moving camera to simultaneously observe the calibration frame, and the background marker or corner point.

9. The method of claim 6, comprising using, as the background marker or the corner point one of any form of a single point, line, and plane.