Viewing and navigating within panoramic images, and applications thereof

• US 7,990,394 B2
• Filed: 05/25/2007
• Issued: 08/02/2011
• Est. Priority Date: 05/25/2007
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Yang, Zhonghao, Lafon, Stéphane, Filip, Daniel, Szybalski, Andrew Timothy, Chau, Stephen, Vincent, Luc
• Primary Examiner(s): Wang; Andrew
• Assistant Examiner(s): Chu; David H
• Application Number:
  US11/754,267
• Publication Number:
  US 20080291217A1
• Time in Patent Office: 1,530 Days
• Field of Search: None
• US Class Current: 345/629
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06F 3/04817 using icons graphical or visual programming using iconic symbols G06F8/34
• CPC Class Codes: G06T 17/05 Geographic models
• CPC Class Codes: G06T 19/00 Manipulating 3D models or images for computer graphics
• CPC Class Codes: G06T 19/003 Navigation within 3D models or images
• CPC Class Codes: G06T 19/20 Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
• CPC Class Codes: G06T 2219/028 Multiple view windows (top-side-front-sagittal-orthogonal)
• CPC Class Codes: G06T 2219/2004 Aligning objects, relative positioning of parts

Abstract

A panorama viewer is disclosed which facilitates navigation from within the panorama of a larger, structured system such as a map. The panorama viewer presents a viewport on a portion of a panoramic image, the viewport including a three-dimensional overlay rendered with the panoramic image. As the orientation of the viewport within the panoramic image changes, the three-dimensional overlay'"'"'s orientation in three-dimensional space also changes as it is rendered with the panoramic image in a manner that matches the change in orientation of the viewport.

Claims

1. A method for viewing panoramic images, comprising:

(a) receiving at least a portion of a first panoramic image;

(b) presenting a viewport that displays the portion of the first panoramic image, the viewport including a three-dimensional overlay rendered with the first panoramic image, wherein the three-dimensional overlay includes a navigational icon used to navigate between panoramic images;

(c) changing the three-dimensional overlay'"'"'s orientation in three-dimensional space as it is rendered with the first panoramic image so as to match a change in orientation of the first panoramic image within the viewport;

(d) retrieving a second panoramic image in response to a user selecting the navigation icon, wherein the second panoramic image is located at a direction relative to a location of the first panoramic image, the direction corresponding to a position of the navigation icon in the three-dimensional overlay;

(e) in response to the user'"'"'s selection of the navigation icon, automatically displaying at least a portion of the second panoramic image determined in (d) in the viewport, in response to the user'"'"'s selection of the navigation icon and prior to display of the second panoramic image in (e);

(f) zooming into the first panoramic image to create a sense of movement; and

(g) fading between the first and second panoramic images, wherein the zooming and fading presents a smooth transition between the first and second panoramic images to the user.

2. The method of claim 1, wherein the receiving (a) comprises receiving street-level imagery.

3. The method of claim 2, wherein the three-dimensional overlay further includes a street line positioned to correspond to the direction of a street in the first panoramic image, and a street name positioned to identify the street in the first panoramic image.

4. The method of claim 1, further comprising:

(h) displaying a user orientation character at a first position on a map, the first position corresponding to a location of the first panoramic image; and

(i) displaying the user orientation character at a second position on a map in response to a user selecting the navigation icon, wherein the second position is located at a direction relative to the first position, the direction corresponding to a position of the navigation icon in the three-dimensional overlay and to the position of the second panoramic image.

5. The method of claim 1, wherein the navigational icon is a button and the user uses an input device to select the button.

6. A system for viewing panoramic images, comprising:

a panorama viewer that receives at least a portion of a first panoramic image, and presents a viewport that displays the portion of the first panoramic image, the viewport including a three-dimensional overlay rendered with the first panoramic image, wherein the three-dimensional overlay includes a navigational icon used to navigate between panoramic images,

wherein the panorama viewer changes the three-dimensional overlay'"'"'s orientation in three-dimensional space as it is rendered with the first panoramic image so as to match a change in orientation of the first panoramic image with the viewport,

wherein the panorama viewer, in response to a user selecting the navigating icon, receives a second panoramic image in the viewport, and

wherein the second panoramic image is located at a direction relative to a location of the first panoramic image, the direction corresponding to a position of the navigation icon in the three-dimensional overlay, wherein the panorama viewer, in response to user'"'"'s selection of the navigation icon and prior to display of the second panoramic image, zooms into the first panoramic image create a sense of movement and fades between the first and second panoramic images, wherein the zooming and fading presents a smooth transition between the first and second panoramic images to the user.

7. The system of claim 6, wherein the first panoramic image includes street level imagery.

8. The system of claim 7, wherein the three-dimensional overlay further includes a street line positioned to correspond to the direction of a street in the first panoramic image, and a street name positioned to identify the street in the first panoramic image.

9. The system of claim 6, wherein the navigational icon is a button and the user uses an input device to select the button.

10. The system of claim 6, further comprising:

a mapping service that displays a user orientation character at a first position on a map, the first position corresponding to a location of the first panoramic image.

11. The system of claim 10, wherein the mapping service displays the user orientation character at a second position on a map in response to a user selecting the navigation icon,

wherein the second position is at a direction relative to the first location, the direction corresponding to a position of the navigation icon in the three-dimensional overlay and to the position of the second panoramic image.

12. The system of claim 10, wherein mapping service initiates the panorama viewer in response to a user positioning the user orientation character at the first position on the map.

13. A system for serving panoramic images and metadata, comprising:

a server that sends data to a client, the data including at least a portion of a first panoramic image, a metadata associated with the panoramic image, and a file,

wherein the file instructs the client to present a viewport that displays the portion of the first panoramic image, the viewport including a three-dimensional overlay rendered with the panoramic image according to the metadata, wherein the three-dimensional overlay includes a navigation icon used to navigate between panoramic images,

wherein the file instructs the client to change the three-dimensional overlay'"'"'s orientation in three-dimensional space as it is rendered with the panoramic image so as to match a change in orientation of the panoramic image within the viewport,

wherein the server receives a request from the client indicating that a user of the client has selected the navigational icon, retrieves, in response to the request, a second panoramic image at a direction relative to the first panoramic image corresponding to the position of a navigational icon in the three-dimensional overlay, and sends the second panoramic image to the client for display, and

wherein the file instructs the client, in response to the user'"'"'s selection of the navigation icon and prior to display of the second panoramic image, to zoom into the first panoramic image to create a sense of movement and to fade between the first and second panoramic images,

wherein the zooming and fading presents a smooth transition between the first and second panoramic images to the user.

14. The system of claim 13, wherein the file is a Flash file.

15. The system of claim 13, wherein the panoramic image includes street level imagery.