Interactive geo-referenced source imagery viewing system and method

• US 8,989,434 B1
• Filed: 04/15/2013
• Issued: 03/24/2015
• Est. Priority Date: 04/05/2010
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Reinhardt, Tilman, Lafon, Stephane, Szybalski, Andrew
• Primary Examiner(s): Thirugnanam, Gandhi
• Application Number:
  US13/862,956
• Time in Patent Office: 708 Days
• Field of Search: 382/100
• US Class Current: 382/100
• CPC Class Codes: G06F 16/29 Geographical information databases
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text
• CPC Class Codes: G06T 17/05 Geographic models
• CPC Class Codes: G09G 2340/12 Overlay of images, i.e. displayed pixel being the result of switching between the corresponding input pixels
• CPC Class Codes: G09G 5/377 for mixing or overlaying two or more graphic patterns G09G5/02, G09G5/397 take precedence
• CPC Class Codes: G09G 5/38 with means for controlling the display position

Abstract

The present invention pertains to geographical image applications. A user may transition between nadir and street level imagery using unstitched oblique imagery. Oblique images offer a rich set of views of a target location and provide a smooth transition to or from other images such as nadir photographs taken by satellites or street level photographs taken by ground level users. Using unstitched oblique images avoids artifacts that may be introduced when stitching together one or more images. This allows an application to display images to a user and create the illusion of three dimensional motion.

Claims

1. A method of managing geographical imagery, the method comprising:

receiving, using one or more computing devices, oblique imagery and storing the oblique imagery as unstitched oblique images in a database;

associating, using the one or more computing devices, metadata with the unstitched oblique images, the metadata including location information for each respective unstitched image;

receiving, using the one or more computing devices, a first request for images, the first request including a target location and a first point of view;

comparing, using the one or more computing devices, the target location to the location information;

selecting, using the one or more computing devices, at least a first one of the unstitched oblique images based upon the comparison, wherein the at least one first unstitched oblique image is selected according to a ranking function, wherein the ranking function measures relevance of the unstitched oblique images based on the requested first point of view;

transmitting, using the one or more computing devices, the at least one first unstitched oblique images to a client device;

receiving, using the one or more computing devices, a second request for images, the second request including the target location from a second point of view;

selecting, using the one or more computing devices, at least a second one of the unstitched oblique images according to the ranking function; and

transmitting, using the one or more computing devices, the at least one second unstitched oblique images to the client device, wherein the transmitting includes a smooth transition between the at least one first unstitched oblique image and the at least one second unstitched oblique image.

2. The method of claim 1, wherein the ranking function evaluates resolution and timing information for each unstitched oblique image.

3. The method of claim 1, wherein the ranking function evaluates each unstitched oblique image in relation to a display resolution of the client device.

4. The method of claim 1, wherein the ranking function evaluates an orientation of each unstitched oblique image.

5. The method of claim 1, wherein the ranking function evaluates a direction of image dragging in a user interface of the client device.

17. The method of claim 1, further comprising computing the ranking function for each unstitched oblique image whose location information in its associated metadata matches the target location.

6. An apparatus for managing geographical imagery, the apparatus comprising:

means for storing received oblique imagery as unstitched oblique images; and

at least one processor coupled to the storing means, the at least one processor being configured to;

associate metadata with the unstitched oblique images, the metadata including location information for each respective unstitched image;

receive a first request for images from a client device, the first request including a target location and a first point of view;

compare the target location to the location information;

select at least a first one of the unstitched oblique images based upon the comparison, the at least one first unstitched oblique image being selected according to a ranking function, wherein the ranking function measures relevance of the unstitched oblique images based on the requested first point of view;

transmit the at least one first unstitched oblique images to the client device;

receive a second request for images, the second request including the target location from a second point of view;

select at least a second one of the unstitched oblique images according to the ranking function; and

transmit the at least one second unstitched oblique images to the client device, wherein the transmitting includes a smooth transition between the at least one first unstitched oblique image and the at least one second unstitched oblique image.

7. The apparatus of claim 6, wherein the ranking function evaluates resolution and timing information for each unstitched oblique image.

8. The apparatus of claim 6, wherein the ranking function evaluates each unstitched oblique image in relation to a display resolution of the client device.

9. The apparatus of claim 6, wherein the ranking function evaluates an orientation of each unstitched oblique image.

10. The apparatus of claim 6, wherein the ranking function evaluates a direction of image dragging in a user interface of the client device.

18. The apparatus of claim 6, wherein the at least one processor is further configured to compute the ranking function for each unstitched oblique image whose location information in its associated metadata matches the target location.

11. A system for managing geographical imagery, the system comprising:

one or more memories storing received oblique imagery as unstitched oblique images; and

one or more computing devices coupled to the one or more memories and programmed to;

associate metadata with the unstitched oblique images, the metadata including location information for each respective unstitched image;

receive a first request for images, the first request including a target location and a first point of view;

compare the target location to the location information;

select at least a first one of the unstitched oblique images based upon the comparison, wherein the at least one first unstitched oblique image is selected according to a ranking function, wherein the ranking function measures relevance of the unstitched oblique images based on the requested first point of view;

transmit the at least one first unstitched oblique images to a client device;

receive a second request for images, the second request including the target location from a second point of view;

select at least a second one of the unstitched oblique images according to the ranking function; and

transmit the at least one second unstitched oblique images to the client device, wherein the transmitting includes a smooth transition between the at least one first unstitched oblique image and the at least one second unstitched oblique image.

12. The system of claim 11, wherein the ranking function evaluates resolution and timing information for each unstitched oblique image.

13. The system of claim 11, wherein the ranking function evaluates each unstitched oblique image in relation to a display resolution of the client device.

14. The system of claim 11, wherein the ranking function evaluates an orientation of each unstitched oblique image.

15. The system of claim 11, wherein the ranking function evaluates a direction of image dragging in a user interface of the client device.

16. The system of claim 11, wherein the one or more computing devices are further programmed to compute the ranking function for each unstitched oblique image whose location information in its associated metadata matches the target location.