APPARATUS AND METHOD FOR TRACKING AUGMENTED REALITY CONTENT

• US 20120249528A1
• Filed: 02/15/2012
• Published: 10/04/2012
• Est. Priority Date: 03/31/2011
• Status: Active Grant

• Current Assignee: MAXST Co. Ltd.
• Original Assignee: MAXST Co. Ltd.
• Inventors: PARK, Jae Wan, KIM, Seung Gyun, KWON, Gi Seok
• Granted Patent: US 8,648,879 B2
• Time in Patent Office: Days
• US Class Current: 345/419
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/038 Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00

Abstract

Provided are an apparatus and method for tracking augmented reality content using a mobile sensor. The method includes recognizing an augmented reality marker from an input image and calculating a position and posture of the recognized augmented reality marker, calculating a position and posture of augmented reality content corresponding to the augmented reality marker using the calculated position and posture of the augmented reality marker, synthesizing the augmented reality content with the input image using the calculated position and posture of the augmented reality content, and displaying the synthesized image, updating the position and posture of the augmented reality content using a 6-axis sensor when the augmented reality marker is not recognized in the input image; and synthesizing the augmented reality content with the input image using the updated position and posture of the augmented reality content, and displaying the synthesized image.

Claims

1. A method of tracking augmented reality content, comprising:

recognizing an augmented reality marker from an input image and calculating a position and posture of the recognized augmented reality marker;

calculating a position and posture of augmented reality content corresponding to the augmented reality marker by using the calculated position and posture of the augmented reality marker;

synthesizing the augmented reality content with the input image by using the calculated position and posture of the augmented reality content, and displaying the synthesized image;

updating the position and posture of the augmented reality content by using a 6-axis sensor when the augmented reality marker is not recognized in the input image; and

synthesizing the augmented reality content with the input image by using the updated position and posture of the augmented reality content, and displaying the synthesized image.

2. The method of claim 1, wherein said updating the position and posture of the augmented reality content comprises:

storing, as initial values, the position and posture of the augmented reality content calculated at a point in time when the augmented reality marker is lastly recognized in the input image;

calculating position and posture changes of the 6-axis sensor from the point in time when the augmented reality marker is lastly recognized in the input image; and

updating the position and posture of the augmented reality content based on the initial values and the calculated position and posture changes of the 6-axis sensor.

3. The method of claim 2, wherein the position and posture changes of the 6-axis sensor include an amount of three-dimensional (3D) movement and an amount of 3D rotation measured by the 6-axis sensor.

4. The method of claim 1, wherein the position and posture of the augmented reality content is updated by using the 6-axis sensor only when the augmented reality marker is not recognized in the input image.

5. An apparatus for tracking augmented reality content, comprising:

a marker recognizer configured to recognize an augmented reality marker from an input image;

a calculator configured to calculate a position and posture of augmented reality content corresponding to the augmented reality marker using a position and posture of the recognized augmented reality marker;

an image output unit configured to synthesize the augmented reality content with the input image by using the calculated position and posture on the augmented reality content, and display the synthesized image; and

a 6-axis sensor configured to measure position and posture changes of the apparatus for tracking the augmented reality content,

wherein the calculator updates the position and posture of the augmented reality content by using the calculated position and posture changes measured by the 6-axis sensor when the augmented reality marker is not recognized in the input image, and

the image output unit synthesizes the augmented reality content with the input image by using the updated position and posture of the augmented reality content and displays the synthesized image.

6. The apparatus of claim 5, wherein the calculator stores position and posture of the augmented reality content calculated at a point in time when the augmented reality marker is lastly recognized in the input image as initial values, calculates position and posture changes of the 6-axis sensor since the point in time when the augmented reality marker is lastly recognized in the input image, and updates the position and posture of the augmented reality content using the calculated position and posture changes of the 6-axis sensor and the initial values.

7. The apparatus of claim 6, wherein the position and posture changes of the 6-axis sensor include an amount of three-dimensional (3D) movement and an amount of 3D rotation measured by the 6-axis sensor.

8. The apparatus of claim 5, wherein the 6-axis sensor is configured to update the position and posture of the augmented reality content only when the augmented reality marker is not recognized in the input image.