METHOD AND SYSTEM FOR GENERATING AUGMENTED REALITY SCENE

• US 20130278633A1
• Filed: 04/19/2013
• Published: 10/24/2013
• Est. Priority Date: 04/20/2012
• Status: Abandoned Application

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Ahn, Min Su, Han, Seung Ju, Han, Jae Joon, Lee, Yong Beom, Kim, Do Kyoon
• Application Number:
  US13/866,218
• Publication Number:
  US 20130278633A1
• Time in Patent Office: Days
• US Class Current: 345/633
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00

Abstract

A method and system for generating an augmented reality (AR) scene may include obtaining real world information including multimedia information and sensor information associated with a real world, loading an AR locator representing a scheme for mixing the real world information and at least one virtual object content and the real world information onto an AR container, obtaining the at least one virtual object content corresponding to the real world information using the AR locator from a local storage or an AR contents server, and visualizing AR information by mixing the real world information and the at least one virtual object content based on the AR locator.

Claims

1. A method for providing an augmented reality (AR) scene, the method comprising:

obtaining real world information associated with a real world;

loading an AR locator representing a scheme for mixing the real world information and at least one virtual object content and the real world information onto an AR container;

obtaining the at least one virtual object content corresponding to the real world information, using the AR locator; and

visualizing AR information by mixing the real world information and the at least one virtual object content based on the AR locator.

2. The method of claim 1, further comprising:

analyzing multimedia information and sensor information included in the real world information to identify the at least one virtual object content corresponding to the multimedia information; and

generating the AR locator based on a result of the analyzing.

3. The method of claim 1, wherein the AR container comprises a first area and a second area independent of one another, and

the loading of the AR locator and the real world information onto the AR container comprises:

loading the real world information onto the first area and loading the AR locator onto the second area, respectively.

4. The method of claim 2, wherein the generating of the AR locator comprises:

generating the AR locator including at least one of a three-dimensional (3D) scene description of the real world information, an AR location representing a location of the at least one virtual object content in the AR information, an AR control representing control information of the at least one virtual object content, and calibration information.

5. The method of claim 4, wherein the AR control comprises at least one of a point of time at which the at least one virtual object content is mixed and an identifier of the at least one virtual object content.

6. The method of claim 5, wherein the point of time at which the at least one virtual object content is mixed comprises:

a start time at which mixing of the at least one virtual object content commences or a stop time at which mixing of the at least one virtual object content terminates.

7. The method of claim 1, wherein the obtaining of the at least one virtual object content comprises:

transmitting a request including an identifier of the at least one virtual object content to a local storage or an AR contents server.

8. The method of claim 1, wherein the at least one virtual object content comprises at least one of:

the identifier, a virtual object, and information about a characteristic of the virtual object of the at least one virtual object content.

9. The method of claim 1, wherein the visualizing of the AR information comprises:

generating AR information by performing rendering on the real world information and the at least one virtual object content based on the AR locator.

10. The method of claim 2, further comprising:

receiving a selection from a user with respect to the visualized AR information for an interaction between the user and the at least one virtual object content; and

correcting the AR locator in response to the selection from the user.

11. The method of claim 8, wherein the virtual object comprises at least one of:

a 3D graphics object, an audio object, a video object, an image object, and a text object.

12. A non-transitory computer-readable medium comprising a program for instructing a computer to perform the method of claim 1.

13. A system for providing an augmented reality (AR) scene, the system comprising:

a real world information obtaining unit to obtain real world information;

an AR container loading unit to load an AR locator representing a scheme for mixing the real world information and at least one virtual object content and the real world information onto an AR container;

a virtual object content obtaining unit to obtain the at least one virtual object content corresponding to the real world information using the AR locator; and

an AR information visualizing unit to visualize AR information by mixing the real world information and the at least one virtual object content based on the AR locator.

14. The system of claim 13, further comprising:

a real world information analyzing unit to analyze multimedia information and sensor information included in the real world information to identify the at least one virtual object content corresponding to the multimedia information; and

an AR locator generating unit to generate the AR locator based on a result of the analyzing.

15. The system of claim 13, wherein the AR container comprises a first area and a second area independent of one another, and

the AR container loading unit comprises:

a loading unit to load the real world information onto the first area and to load the AR locator onto the second area, respectively.

16. The system of claim 13, wherein the virtual object content obtaining unit comprises:

a virtual object content requesting unit to transmit a request including an identifier of the at least one virtual object content to a local storage or an AR contents server.

17. The system of claim 13, further comprising:

a memory to store the AR container and the at least one virtual object content; and

an interface to receive a selection from a user and to display the AR information.

18. A system for providing an augmented reality (AR) scene, the system comprising:

a mobile terminal to capture an image including real world information;

an AR locator which includes information regarding virtual object content corresponding to the captured real world information;

a virtual object content obtaining unit to receive virtual object content corresponding to the real world information using at least one identifier corresponding to the virtual object content; and

an AR information visualizing unit to render the received virtual object content with the real world information using information included in the AR locator.

19. The system of claim 18, wherein the mobile terminal captures the image in real-time, and

the AR locator generates a point of time in which virtual object content is to be mixed with the real world information using three-dimensional graphics corresponding to the real world information, and calibration information which maps virtual object content to the real world information.

20. The system of claim 18, further comprising:

an interface included in the mobile terminal configured to receive an input from a user,

wherein, in response to the user selecting a first virtual object among a plurality of virtual objects displayed on the mobile terminal, a second virtual object changes position relative to the first virtual object.