DISPLAYING AUGMENTED REALITY INFORMATION

• US 20120019557A1
• Filed: 07/22/2010
• Published: 01/26/2012
• Est. Priority Date: 07/22/2010
• Status: Abandoned Application

• Current Assignee: Sony Ericsson Mobile Communications USA Incorporated (Sony Group Corp.)
• Original Assignee: Sony Ericsson Mobile Communications USA Incorporated (Sony Group Corp.)
• Inventors: Aronsson, Pär-Anders, Backlund, Erik, Kristensson, Andreas
• Application Number:
  US12/841,372
• Publication Number:
  US 20120019557A1
• Time in Patent Office: Days
• US Class Current: 345/633
• CPC Class Codes: G06T 11/00 2D [Two Dimensional] image generation

Abstract

A device may obtain location information of an AR display device and obtain identifiers associated with objects that are within a field of view of the AR display device based on the location information. In addition, the device may obtain, for each of the objects, AR information based on the identifiers and determine, for each of the objects, a distance of the object from the AR display device. Furthermore, the device may generate, for each of the objects, images of the AR information at a virtual distance from the AR display device, the virtual distance corresponding to the determined distance. The device may display the generated images at the AR display device.

Claims

1. A method comprising:

obtaining, by an augmented reality (AR) device, location information of an AR display device;

obtaining, by the AR device, identifiers associated with objects that are within a field of view of the AR display device based on the location information;

obtaining, for each of the objects, AR information based on the identifiers;

determining, for each of the objects, a distance of the object from the AR display device;

generating, for each of the objects, images of the AR information at a virtual distance from the AR display device, the virtual distance corresponding to the determined distance; and

displaying the generated images at the AR display device.

2. The method of claim 1, wherein determining the distance includes:

measuring the distance from the AR display device to the object;

or

obtaining a location of the object from the corresponding AR information and calculating a distance based on the location of the object and the location information of the AR display device.

3. The method of claim 1, further comprising:

receiving gaze tracking information from the AR display device to identify one or more of the objects,

wherein determining, for one or more of the objects, a distance includes at least one of;

determining the distance based on the eye-tracking information;

determining the distance via a laser distance meter;

or

determining the distance based on measurements by an infrared time-of-flight camera.

4. The method of claim 1, wherein, determining, for each of the objects, a distance includes:

determining a distance of a stationary object from the AR display device;

or

determining a distance of a mobile object from the AR display device.

5. The method of claim 1, wherein generating images of the AR information includes:

generating images of the AR information at one of predetermined virtual distances.

6. The method of claim 1, wherein obtaining the AR information includes:

sending a request for the AR information to a remote database.

7. The method of claim 1, wherein obtaining the AR information includes:

receiving images from the AR display device;

performing image recognition to identify mobile objects in the images; and

obtaining AR information corresponding to the identified mobile objects.

8. The method of claim 1, wherein generating the images of the AR information includes:

generating images of the AR information for three-dimensional vision.

9. The method of claim 1, further comprising:

receiving a viewer input to activate a menu system, the receiving the viewer input further comprising at least one of;

detecting eye blinking;

determining an object at which the viewer gazes or looks;

measuring brain waves;

measuring muscle activity;

detecting voice;

or measuring hand or foot movements.

10. The method of claim 9, wherein receiving the viewer input further comprises:

detecting a selection of an object that is not visible to the viewer but whose AR information is visible to the viewer.

11. A device comprising:

a processor to;

obtain location information associated with a display device;

identify objects that are within a field of view of the display device;

obtain, for each of the objects, augmentation information from a remote device;

determine, for each of the objects, a distance of the object from the display device;

generate, for each of the objects, images of the augmentation information at a virtual distance corresponding to the determined distance; and

display the generated images at the display device.

12. The device of claim 11, wherein the device comprises:

a smart phone, a tablet computer, or a pair of augmented reality (AR) glasses.

13. The device of claim 11, wherein the objects includes:

a stationary object; and

a mobile object.

14. The device of claim 11, wherein the device includes:

the display device.

15. The device of claim 14, further comprising at least one of:

a global positioning system satellite (GPS) receiver;

an accelerometer;

a gyroscope;

a WiFi positioning system;

cell identifier (cell ID) component;

or

a combination of camera and image recognition component to recognize a specific position in surroundings based on images from the camera.

16. The device of claim 15, wherein the device is configured to obtain eye-tracking information based on images of viewer'"'"'s eyes.

17. The device of claim 16, wherein the processor is further configured to use the eye tracking information to identify a first object at which the viewer'"'"'s eyes gaze or look.

18. The device of claim 17, wherein the processor is further configure to use the identity of the first object to prioritize a list of the objects whose augmentation information is to be obtained, whose distances from the device are to be determined, or whose augmentation information is to be displayed.

19. The device of claim 11, further comprising one of:

a Bluetooth interface, ANT interface, or WiFi interface for communicating with the display device.

20. An augmented reality (AR) display device comprising:

a receiver to determine location information;

a camera to receive images of objects;

a transmitter to send the location information and the images to a remote device;

a receiver to receive images that include AR information for each of the objects, the AR information identifying virtual distances corresponding to distances of the objects from the AR display device; and

at least one display to display the received AR images at the identified virtual distances.