AUGMENTED REALITY SYSTEMS

• US 20110234631A1
• Filed: 03/25/2010
• Published: 09/29/2011
• Est. Priority Date: 03/25/2010
• Status: Abandoned Application

• Current Assignee: Bizmodeline Co., Ltd.
• Original Assignee: Bizmodeline Co., Ltd.
• Inventors: KIM, Jae-Hyung, YOON, Jong-Min, JUNG, Ho-Jong, HONG, Jong-Cheol
• Application Number:
  US12/731,307
• Publication Number:
  US 20110234631A1
• Time in Patent Office: Days
• US Class Current: 345/632
• CPC Class Codes: G06T 15/60 Shadow generation
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 2215/16 Using real world measurements to influence rendering

Abstract

Apparatuses and techniques relating to an augmented reality (AR) device are provided. The device for augmenting a real-world image includes a light source information generating unit that generates light source information for a real-world image captured by a real-world image capturing device based on the location, the time, and the date the real-world image was captured. The light source information includes information on the position of a real-world light source for the real-world image. The device further includes a shadow image registration unit that receives the light source information generated from the light source information generating unit. The shadow image registration unit generates a shadow image of a virtual object overlaid onto the real-world image based on the light source information generated from the light source information generating unit.

Claims

1. An augmented reality system comprising:

an image capture unit configured to capture a real-world image; and

an augmented reality (AR) generator comprising

a light source information generating unit in communications with the image capture unit and configured to generate light source information for the real-world image captured by the image capture unit, based on at least one of a location, a time, and a date the real-world image is captured, the light source information including information on a position of a real-world light source with respect to the image capture unit, and

an AR image generating unit configured to generate a shadow image of a virtual object based on the generated light source information and to overlay the virtual object and the shadow image onto the real-world image.

2. The system of claim 1, wherein the image capture unit further comprises a pose detection unit configured to measure a bearing and a tilt of the image capture unit.

3. The system of claim 2, wherein the AR image generating unit comprises

a virtual object registration unit configured to determine a reference frame of the image capture unit based on the measured bearing and tilt of the image capture unit, and to determine a position of the virtual object with respect to the reference frame.

4. The system of claim 3, wherein the virtual object registration unit is further configured to perform a marker-based selection/registration technique, a markerless selection/registration technique, or a hybrid selection/registration technique to determine the position of the virtual object with respect to the reference frame.

5. The system of claim 3, wherein the AR image generating unit further comprises

a shadow image registration unit configured to determine a position of the real-world light source with respect to the reference frame based on the light source information, and to generate the shadow image of the virtual object based on the determined position of the real-world light source.

6. The system of claim 5, wherein the shadow image registration unit is further configured to set a virtual light source simulating the real-world light source at the position of the real-world light source, and to render the shadow image with respect to the set virtual light source.

7. The system of claim 6, wherein the shadow image registration unit comprises at least:

a shadow map unit configured to perform a shadow map algorithm to render the shadow image,

a shadow volume unit configured to perform a shadow volume algorithm to render the shadow image, or

a soft shadow unit configured to perform a soft shadow algorithm to render the shadow image.

8. The system of claim 6, wherein

the pose detection unit is configured to provide an update on the bearing and the tilt of the image capture unit;

and

the shadow image registration unit is configured to generate a new shadow image based on the update.

9. The system of claim 6, wherein the shadow image registration unit is further configured to receive at least one of weather information and geographical information for the real-world image from a server in communications with the AR system and to set the virtual light source based on at least the weather information or the geographical information for the real-world image.

10. The system of claim 9, wherein the shadow image registration unit is further configured to determine an intensity of the virtual light source based on at least one of the weather information and the geographical information for the real-world image.

11. The system of claim 1, wherein the image capture unit further comprises a wireless communication unit configured to communicate with a base station and to receive cell information therefrom, and wherein the light source information generating unit is further configured to determine the location of the image capture unit based on the received cell information.

12. The system of claim 1, wherein the light source information generating unit is further configured to transmit identification (ID) information of the image capture unit to a server in communications with the AR system and to receive in response from the server the location of the image capture unit.

13. A method for providing augmented reality, the method comprising:

capturing a real-world image;

determining at least one of a location, a time, and a date the real-world image was captured;

generating light source information for the captured real-world image based on at least one of the location, the time, and the date the real-world image was captured, the light source information including information on a position of a real-world light source for the real-world image; and

generating a shadow image of a virtual object overlaid onto the real-world image based on the light source information.

14. The method of claim 13, wherein determining the location the real-word image was captured comprises:

determining a location of a device that captured the real-word image by receiving GPS signals from one or more GPS satellites that are in wireless communications with the device; and

determining the location the real-world image is captured based on the GPS signals.

15. The method of claim 13, wherein determining the location the real-word image was captured comprises:

determining a location of a device that captured the real-word image by receiving cell information from a base station in wireless communications with the device; and

determining the location the real-world image was captured based on the received cell information.

16. The method of claim 13, wherein determining the location the real-word image was captured comprises:

determining a location of a device that captured the real-world image by transmitting identification (ID) information identifying the device to a server in wireless communications with the device;

receiving from the server the location of the device; and

determining the location the real-world image was captured based on the location of the device.

17. The method of claim 13, wherein generating light source information comprises,

measuring a bearing and a tilt of a device that captured the real-world image.

18. The method of claim 17, wherein generating a shadow image comprises:

determining a reference frame of the device that captured the real-world image based on the measured bearing and tilt of the device that captured the real-world image;

determining a position of the virtual object with respect to the reference frame;

determining a position of the real-world light source with respect to the reference frame based on the light source information; and

generating the shadow image of the virtual object based on the determined position of the real-world light source.

19. The method of claim 18, wherein generating the shadow image of the virtual object based on the determined position of the real-world light source comprises:

setting a virtual light source simulating the real-world light source at the position of the real-world light source; and

rendering the shadow image with respect to the set virtual light source.

20. The method of claim 13, wherein generating light source information comprises:

receiving at least one of weather information and geographical information for the real-world image from a server in wireless communication with a device that captured the real-world image; and

generating the shadow image based on at least the weather information or the geographical information.