OVERLAY OF INFORMATION ASSOCIATED WITH POINTS OF INTEREST OF DIRECTION BASED DATA SERVICES

• US 20090319178A1
• Filed: 06/12/2009
• Published: 12/24/2009
• Est. Priority Date: 06/19/2008
• Status: Abandoned Application

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Novik, Lev, Khosravy, Moe
• Application Number:
  US12/483,920
• Publication Number:
  US 20090319178A1
• Time in Patent Office: Days
• US Class Current: 701/207
• CPC Class Codes: G01C 21/20 Instruments for performing navigational calculations G01C21/24, G01C21/26 take precedence
• CPC Class Codes: G01C 21/3664 Details of the user input interface, e.g. buttons, knobs or sliders, including those provided on a touch screen; remote controllers; input using gestures
• CPC Class Codes: G01C 21/3811 Point data, e.g. Point of Interest [POI]
• CPC Class Codes: G06Q 30/0241 Advertisements
• CPC Class Codes: H04L 67/52 specially adapted for the location of the user terminal
• CPC Class Codes: H04W 4/02 Services making use of location information
• CPC Class Codes: H04W 4/026 using orientation information, e.g. compass
• CPC Class Codes: H04W 4/029 Location-based management or tracking services

Abstract

With the addition of directional information in the environment, a variety of service(s) can be provided on top of user identification or interaction with specific object(s) of interest by pointing at the objects. Image data representing a subset of real space near a portable computing device can be displayed including a set of points of interest (POIs) for direction based service(s) within scope and automatically overlaying POI content on the image data relating to the POIs. In one embodiment, the display is included in an electronic device worn such that the display is substantially in front of an eye, e.g., a heads up display.

Claims

1. A method, comprising:

displaying image data representing a subset of real space in a pre-defined vicinity of a portable computing device;

determining a set of points of interest (POIs) of one or more location based services supported by the portable computing device within scope of the subset of real space represented by the image data; and

automatically overlaying content relating to at least one POI of the set of POIs on the image data displayed according to the displaying.

2. The method of claim 1, wherein the overlaying includes automatically overlaying content indicating at least one interactive capability with respect to the at least one POI via the one or more location based services.

3. The method of claim 1, further comprising:

automatically receiving the content relating to the at least one POI from the one or more location based services.

4. The method of claim 1, wherein the automatically overlaying includes automatically overlaying content relating to the at least one POI over or overlapping with the at least one POI as represented in the image data.

5. The method of claim 1, wherein the automatically overlaying includes automatically overlaying content relating to the at least one POI substantially near the at least one POI as represented in the image data.

6. The method of claim 1, wherein the displaying includes displaying video data input from an image capture device of the portable computing device.

7. The method of claim 1, wherein the displaying includes displaying the image data received from a network service based on a location of the portable computing device.

8. The method of claim 1, wherein the displaying includes displaying satellite image data received from a network service based on a location of the portable computing device.

9. The method of claim 1, wherein the displaying includes displaying the image data received from a network service based on a direction and the location of the portable computing device.

10. The method of claim 1, further comprising:

determining a planar orientation of a display of the portable computing device employed for the displaying.

11. The method of claim 10, wherein, if the planar orientation is substantially vertical, the displaying includes displaying two dimensional image data representing a subset of three dimensional real space corresponding to a direction defined from the front of the display to the back of the display and substantially orthogonal to the display of the portable computing device.

12. The method of claim 10, wherein, if the planar orientation is substantially vertical, the displaying includes displaying two dimensional image data representing a subset of three dimensional real space corresponding to a direction defined from the back of the display to the front of the display and substantially orthogonal to the display of the portable computing device.

13. The method of claim 10, further comprising:

if the planar orientation is substantially horizontal, determining whether the display is facing substantially up or substantially down.

14. The method of claim 13, wherein, if the display is facing substantially up, the displaying includes displaying image data representing the subset of real space in the pre-defined vicinity of the portable computing device as topographical map image data representing a topographical map of at least part of the pre-defined vicinity.

15. The method of claim 13, wherein, if the display is facing substantially down, the displaying includes displaying image data representing the subset of real space in the pre-defined vicinity of the portable computing device as celestial body map image data representing a sky object map associated with a skyward direction from the pre-defined vicinity.

16. The method of claim 1, wherein the determining includes determining a set of points of interest (POIs) of one or more direction based services based on an orientation of the portable computing device.

17. An electronic device adapted to be worn with a display of the electronic device substantially in front of at least one eye of a user of the electronic device, comprising:

a positional component that outputs position information as a function of a location of the electronic device;

a directional component that outputs direction information as a function of an orientation of the electronic device; and

at least one processor configured to process at least the position information and the direction information to determine at least one point of interest relating to the position information, configured to display, within the display of the electronic device, the at least one point of interest representing geographical space nearby the electronic device, and configured to overlay interactive user interface elements corresponding to the at least one point of interest nearby, overlapping or over the at least one point of interest in the user interface.

18. The electronic device of claim 17, wherein the direction component is a digital compass.

19. The electronic device of claim 17, wherein the at least one processor is further configured to receive input via one or more of the interactive user interface elements and automatically take action based on the input.

20. The electronic device of claim 17, further comprising:

a motion component that outputs motion information as a function of at least one movement of the electronic device.

21. The electronic device of claim 20, wherein the at least one processor is further configured to process at least the motion information and the direction information to determine at least one pre-defined gesture undergone with respect to the at least one point of interest and to automatically make a request based on the at least one pre-defined gesture and the at least one point of interest.

22. A method for displaying point of interest information on a mobile device, comprising:

determining direction information as a function of a direction of the mobile device;

determining position information as a function of a position of the mobile device;

determining a set of points of interest within interactive scope of the mobile device based on the direction information and the position information;

displaying an image based representation of at least the subset of points of interest; and

receiving point of interest advertisement information for at least a subset of the points of interest of the set and automatically overlaying the point of interest advertisement information at pertinent one or more locations of the image based representation associated with at least the subset of points of interest.

23. The method of claim 22, further comprising:

modifying the image based representation prior to the displaying.

24. The method of claim 23, further comprising:

wherein the modifying includes modifying the image based representation based on whether the mobile device is experiencing substantially nighttime or substantially daytime.

25. The method of claim 23, further comprising:

wherein the modifying includes modifying the image based representation based on a planar orientation of a display of the mobile device.

26. The method of claim 23, further comprising:

wherein the modifying includes modifying the image based representation based on the direction information.