Rendering images on map using orientations

• US 10,360,709 B2
• Filed: 04/05/2017
• Issued: 07/23/2019
• Est. Priority Date: 04/05/2017
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Rusu, Andi Fabian
• Primary Examiner(s): Sun, Hai Tao
• Application Number:
  US15/479,526
• Publication Number:
  US 20180293769A1
• Time in Patent Office: 839 Days
• Field of Search: 345634
• CPC Class Codes: G01C 21/20 Instruments for performing navigational calculations G01C21/24, G01C21/26 take precedence
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text
• CPC Class Codes: G06T 3/60 Rotation of whole images or parts thereof
• CPC Class Codes: G09B 29/007 using computer methods
• CPC Class Codes: G09B 29/106 using electronic means

Abstract

A map application is provided that allows orientations to be assigned to images such as photographs. The orientation is the direction that a real or hypothetical photographer that took the image was facing when the image was taken or created. The orientation for an image may be specified by the user, determined based on metadata associated with the image, and/or may be determined based on known features or landmarks that may be visible in the image. When an image is rendered on a map, it is displayed perpendicular to a surface of the map with the determined orientation. The amount of the image that is visible to the user depends on the orientation of the map. As the user rotates the orientation of the map, the rendered images are rotated in proportion to the rotation of the map.

Claims

1. A system for determining the orientation of an image and for rendering the image on a map based on the determined orientation and an orientation of the map, the system comprising:

at least one computing device; and

a map engine adapted to;

receive a map;

receive an image, wherein the image is associated with a location on the map;

determine an orientation of the image;

display the map on a display associated with the at least one computing device;

determine an orientation of the displayed map; and

render the image on the displayed map at the associated location, the image defined within an image plane bounded by a border, both the border and the image plane being rendered to appear perpendicular to the displayed map based on a viewing angle of the displayed map and further rendered to be facing a select cardinal direction based on the determined orientation of the image and the determined orientation of the displayed map.

2. The system of claim 1, wherein the map engine adapted to determine the orientation of the image comprises the map engine adapted to request the orientation of the image from a user.

3. The system of claim 1, wherein the map engine adapted to determine the orientation of the image comprises the map engine adapted to determine the orientation of the image based on visual characteristics of the image.

4. The system of claim 1, wherein the map engine adapted to determine the orientation of the image comprises the map engine adapted to determine the orientation of the image based on metadata associated with the image.

5. The system of claim 4, wherein the metadata comprise EXIF data.

6. The system of claim 1, wherein the map engine is further adapted to:

receive a change to the orientation of the displayed map; and

in response to the received change to the orientation of the displayed map, re-render the image on the displayed map at the associated location based on the orientation of the image and the change to the orientation of the displayed map.

7. The system of claim 1, wherein the displayed map is associated with a viewing angle and a zoom level, and the map engine is further adapted to render the image on the displayed map at the associated location based on the orientation of the image, the orientation of the displayed map, the viewing angle, and the zoom level.

8. The system of claim 1, wherein the image is a photograph and the orientation of the image is a direction that a photographer associated with the image was facing when the image was captured by the photographer.

9. A system for determining orientations for images and for rendering the images on a map based on the determined orientations, the system comprising:

at least one computing device; and

a map engine adapted to;

select a subset of images from a plurality of images, wherein each image of the plurality of images is associated with a location;

for each image of the subset of images, determine an orientation for the image;

display a map on a display associated with the at least one computing device, wherein the map is associated with an orientation and the map is associated with a plurality of locations; and

for each image of the subset of images, render the image on the map at the location associated with the image, the image defined within an image plane bounded by a border, both the border and the image plane rendered to appear perpendicular to the displayed map based on a viewing angle of the displayed map and further rendered to be facing a select cardinal direction based on the determined orientation of the image and the orientation of the map.

10. The system of claim 9, wherein the map engine adapted to select the subset of images from the plurality of images comprises the map engine adapted to select the subset of images from the plurality of images based on the location associated with each image and the plurality of locations associated with the map.

11. The system of claim 9, wherein the map is associated with a zoom level, and the map engine adapted to select the subset of images from the plurality of images comprises the map engine adapted to select the subset of images from the plurality of images based on the zoom level.

12. The system of claim 9, wherein the map engine is further adapted to:

receive a change to the orientation of the map; and

in response to the received change to the orientation of the map, for each image of the subset of images, re-render the image on the map at the location associated with the image based on the orientation of the image and the received change to the orientation of the map.

13. The system of claim 9, wherein the map is associated with a viewing angle and a zoom level, and the map engine is further adapted to render each image on the map at the location associated with the image based on the orientation of the image, the orientation of the map, the viewing angle, and the zoom level.

14. The system of claim 9, wherein the map engine adapted to determine the orientation of the image comprises the map engine adapted to determine the orientation of the image based on visual characteristics of the image.

15. The system of claim 9, wherein the map engine adapted to determine the orientation of the image comprises the map engine adapted to determine the orientation of the image based on metadata associated with the image.

16. A method for rendering an image on a map based on an orientation associated with the image, the method comprising:

receiving a map by a computing device;

receiving an image by the computing device, wherein the image is associated with an orientation and a location on the map;

displaying the map on a display by the computing device, wherein the displayed map is associated with an orientation;

rendering the image on the displayed map at the associated location, the image defined within an image plane bounded by a border, both the border and the image plane rendered to appear perpendicular to the displayed map based on a viewing angle of the displayed map and further rendered to be facing a select cardinal direction based on the orientation of the image and the orientation of the displayed map by the computing device;

receiving a change to the orientation of the displayed map by the computing device; and

in response to the received change to the orientation of the map, re-rendering the image on the map at the associated location based on the orientation of the image and the change to the orientation of the displayed map by the computing device.

17. The method of claim 16, wherein the displayed map is associated with a viewing angle and a zoom level, and further comprising rendering the image on the displayed map at the associated location based on the orientation of the image, the orientation of the displayed map, the viewing angle, and the zoom level.