CORRELATION EXTRACT METHOD FOR GENERATING 3D MOTION DATA, AND MOTION CAPTURE SYSTEM AND METHOD FOR EASY COMPOSITION OF HUMANOID CHARACTER ON REAL BACKGROUND IMAGE USING THE SAME

• US 20080130985A1
• Filed: 11/30/2007
• Published: 06/05/2008
• Est. Priority Date: 12/02/2006
• Status: Active Grant

• Current Assignee: Electronics and Telecommunications Research Institute
• Original Assignee: Electronics and Telecommunications Research Institute
• Inventors: Lee, In Ho, Lee, Jae Kwang, Park, Chang Joon, Yu, Jung Jae
• Granted Patent: US 8,340,398 B2
• Time in Patent Office: Days
• US Class Current: 382/154
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 7/73 using feature-based methods
• CPC Class Codes: G06T 7/80 Analysis of captured images to determine intrinsic or extrinsic camera parameters, i.e. camera calibration

Abstract

Provided are a method for extracting a correlation to generate 3D motion data, and a motion capture system and method using the extracting method to easily compose a humanoid character on a real background image. Cameras for motion capture are installed in a real background capture location (such as an outdoor location or in a studio), and the correlation between motion capture fixed cameras and a moving camera for capturing a real background image is obtained to capture 3D motion data prior to performing motion capture for integrating a humanoid character, so that even when there is interaction between a 3D figure and an actual prop such as a chair or table within the captured space, a humanoid character can easily be composed with the real background.

Claims

1. A method of correlation extraction for generating three-dimensional (3D) motion data, the method comprising the steps of:

obtaining a geometric relation between a calibration frame and a background marker or a corner point in a real background;

obtaining 3D geometric relative positions of a camera for motion capture and the background marker or the corner point, from the obtained geometric relation through the calibration frame; and

extracting a correlation between the camera for motion capture and a moving camera for capturing a real background, through obtaining 3D geometric relative positions of the camera for motion capture and the camera for capturing a real background, from the obtained 3D geometric relative positions of the camera for motion capture and the background marker or the corner point.

2. The method of claim 1, wherein the calibration frame is installed to calibrate a position of the camera for motion capture.

3. The method of claim 1, wherein the background marker or the corner point comprises one of any form of a single point, line, and plane.

4. A motion capture system for easy composition of a humanoid character on a real background image, the motion capture system comprising:

a calibration frame for calibrating positions of a fixed camera for motion capture and a moving camera for capturing a real background;

a fixed camera for capturing the calibration frame and a background marker or a corner point in a real background, and movement of a moving subject;

a moving camera for moving and capturing the real background; and

a motion capture processor for generating 3D motion data that extracts and automatically integrates a geometric correlation of the fixed camera and the moving camera with the real background.

5. The motion capture system of claim 4, wherein the background marker or the corner point comprises one of any form of a single point, line, and plane.

6. The motion capture system of claim 4, wherein the motion capture processor comprises:

a correlation extractor for determining 3D geometric relative positions of the fixed camera and the background marker or the corner point, and extracting a geometric correlation of the fixed camera and the moving camera; and

a 3D motion data generator for generating 3D motion data that automatically integrates the captured movement of the moving subject with the real background, according to the extracted geometric correlation.

7. The motion capture system of claim 6, wherein the 3D geometric relative positions of the fixed camera and the background marker or the corner point are obtained from a geometric relation between the calibration frame and the background marker or the corner point.

8. A method of motion capture using a fixed camera for motion capture and a moving camera for capturing a real background, the method for easily integrating a humanoid character with a real background image, and comprising the steps of:

extracting a geometric correlation of the fixed camera and the moving camera; and

using the extracted correlation to capture motion of a real moving subject and generate 3D motion data automatically integrating the captured motion with the real background.

9. The method of claim 8, wherein the step of extracting the geometric correlation comprises the steps of:

obtaining a geometric relation between the fixed camera and a calibration frame;

obtaining a geometric relation between the calibration frame and a background marker captured by the moving camera or a corner point in the real background;

obtaining 3D geometric relative positions of the fixed camera and the background marker or the corner point, using the obtained geometric relation through the calibration frame; and

obtaining 3D geometric relative positions of the fixed camera and the moving camera from the obtained 3D geometric relative positions of the fixed camera and the background marker or the corner point, and extracting a correlation of the fixed camera and the moving camera.

10. The method of claim 9, wherein the calibration frame calibrates a position of the fixed camera.

11. The method of claim 9, wherein the moving camera is positioned to simultaneously observe the calibration frame, and the background marker or corner point.

12. The method of claim 9, wherein the background marker or the corner point comprises one of any form of a single point, line, and plane.