BUSINESS DATA DISPLAY AND POSITION CORRECTION IN STREET-SIDE IMAGERY

• US 20100250109A1
• Filed: 03/30/2009
• Published: 09/30/2010
• Est. Priority Date: 03/30/2009
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Gomez, Manuel Reyes, Johnston, Carolyn P.
• Granted Patent: US 9,020,745 B2
• Time in Patent Office: Days
• US Class Current: 701/200
• CPC Class Codes: G01C 21/3679 Retrieval, searching and output of POI information, e.g. hotels, restaurants, shops, filling stations, parking facilities G01C21/3611 takes precedence
• CPC Class Codes: G06Q 30/0261 based on user location
• CPC Class Codes: G06T 17/05 Geographic models
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00

Abstract

A separate panel may be used to display business icons near images of business entries, if the GIS does not include a business'"'"'s front door geolocation. Users may place icons that represent business entities near the entrances to the entity. Also, a concise but extensive display of business listing data (e.g., reviews, summaries, services, hours, etc.) in the display near the geolocation and the presentation of further information upon user actions such as a mouse-overs, may avoid browsing away from the viewing application in order to learn more about the business.

Claims

1. A method of adding detail to an electronic image comprising:

Illustrating to a user the electronic image of a location at a known view level;

Presenting a movable icon that represents an entity that is visible at a view level;

Allowing the user to place the movable icon to a proper location on the electronic image wherein the proper location comprises the location that the user knows as being the location of the entity;

Determining a position of the proper location in an electronic image space further comprising;

projecting a ray from a position of the movable icon toward objects in the electronic image in three dimensions; and

resolving the proper location in three dimensions of the entity using one or more depth maps associated with the electronic image;

Storing the proper location of the entity in a memory; and

Using the proper location to identify the proper location of the entity in future electronic images.

2. The method of claim 1, wherein if the electronic image is a street level illustration, the depth map is created using LIDAR at a similar street level.

3. The method of claim 1, wherein if the electronic image is an aerial image, an oblique image or an overhead map image, the depth map is created using digital elevation models.

4. The method of claim 1, further comprising displaying previously placed movable icons in the proper location on the electronic image.

5. The method of claim 4, if a placed movable icon is selected, displaying additional information about the entity that is represented by the movable icon that was selected.

6. The method of claim 5, further comprising displaying the additional information in an additional window.

7. The method of claim 5, wherein the additional information comprises at least one selected from a group comprising:

a URL for the entity;

a summary review of the entity;

contact information for the entity;

payment option;

price ranges; and

summary information for the entity.

8. The method of claim 1, wherein the electronic image comprises a plurality of the objects.

9. The method of claim 8, wherein the objects are buildings and the entity is a business.

10. The method of claim 8, wherein each of the objects have numerous entities which are related to displayed movable icons.

11. The method of claim 10, wherein one of the objects comprises a strip mall.

12. The method of claim 8, wherein

one of the objects comprises a multistory building;

the ray points toward a floor of the multistory building; and

the movable icon displayed relate to the entity on or near floors pointed to by the ray.

13. A computer system comprising a processor physically configured in accordance with computer executable instructions, a memory physically configured to store computer executable instructions and an input/output circuit, the computer executable instructions comprising instructions for adding detail to an electronic image, the computer executable instructions comprising instructions for:

Illustrating to a user the electronic image of a location at a known view level;

Presenting a movable icon that represents an entity that is visible at a view level;

Allowing the user to place the movable icon to a proper location on the electronic image wherein the proper location comprises the location that the user knows as being the location of the entity;

Determining a position of the proper location in an electronic image space further comprising;

projecting a ray from a position of the movable icon toward objects in the electronic image in three dimensions; and

resolving the proper location in three dimensions of the entity using one or more depth maps associated with the electronic image wherein

if the electronic image is a street level illustration, the depth map is created using LIDAR at a similar street level and

if the electronic image is an aerial image, an oblique image or an overhead map image, the depth map is created using digital elevation models;

Storing the proper location of the entity in a memory; and

Using the proper location to identify the proper location of the entity in future electronic images.

14. The computer system of claim 13, further comprising computer executable instructions for displaying previously placed movable icons in the proper location on the electronic image.

15. The computer system of claim 14, further comprising if a placed movable icon is selected, computer executable instructions for displaying additional information about the entity that is represented by the movable icon that was selected in an additional window.

16. The computer system of claim 15, wherein the additional information comprises at least one selected from a group comprising:

a URL for the entity;

a summary review of the entity;

contact information for the entity;

payment option;

price ranges; and

summary information for the entity.

17. The computer system of claim 13, wherein the electronic image comprises a plurality of the objects wherein the objects are buildings and the entity is a business and wherein each of the objects have numerous entities which are related to displayed movable icons.

18. The computer system of claim 17, wherein:

one of the objects comprises a multistory building;

the ray points toward a floor of the multistory building; and

the movable icon displayed relate to the entity on or near floors pointed to by the ray.

19. A computer storage medium physically configured according to computer executable instructions for adding detail to an electronic image, the computer executable instructions comprising instructions for:

Illustrating to a user the electronic image of a location at a known view level wherein the electronic image comprises a plurality of objects wherein the objects are buildings and the entity is a business and wherein each of the objects have numerous entities which are related to displayed movable icons;

Displaying previously placed movable icons in a proper location on the electronic image;

If a placed movable icon is selected, displaying additional information about an entity that is represented by a movable icon that was selected in an additional window

Presenting a movable icon that represents an entity that is visible at a view level;

Allowing the user to place the movable icon to a proper location on the electronic image wherein the proper location comprises the location that the user knows as being the location of the entity;

Determining a position of the proper location in an electronic image space further comprising;

projecting a ray from a position of the movable icon toward the objects in the electronic image in three dimensions; and

resolving the proper location in three dimensions of the entity using one or more depth maps associated with the electronic image wherein

if the electronic image is a street level illustration, the depth map is created using LIDAR at a similar street level and

if the electronic image is an aerial image, an oblique image or an overhead map image, the depth map is created using digital elevation models;

Storing the proper location of the entity in a memory;

and

Using the proper location to identify the proper location of the entity in future electronic images.

20. The computer storage medium of claim 19, wherein the additional information comprises at least one selected from a group comprising:

a URL for the entity;

a summary review of the entity;

contact information for the entity;

payment option;

price ranges; and