MANAGING STORAGE AND DELIVERY OF NAVIGATION IMAGES

• US 20100250120A1
• Filed: 03/31/2009
• Published: 09/30/2010
• Est. Priority Date: 03/31/2009
• Status: Abandoned Application

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Waupotitsch, Roman, Ofek, Eyal, Chen, Billy
• Application Number:
  US12/416,127
• Publication Number:
  US 20100250120A1
• Time in Patent Office: Days
• US Class Current: 701/207
• CPC Class Codes: G06T 3/4038 Image mosaicing, e.g. composing plane images from plane sub-images
• CPC Class Codes: H04N 1/333 Mode signalling or mode changing; Handshaking therefor
• CPC Class Codes: H04N 1/33353 according to the available bandwidth used for a single communication, e.g. the number of ISDN channels used
• CPC Class Codes: H04N 2201/0086 Image transceiver H04N2201/0093 and H04N2201/0094 take precedence
• CPC Class Codes: H04N 2201/0089 Image display device
• CPC Class Codes: H04N 2201/33321 Image or page size, e.g. A3, A4
• CPC Class Codes: H04N 2201/33328 Resolution
• CPC Class Codes: H04N 2201/3335 Speed or rate

Abstract

The storage and/or transmission of image bubbles may be managed for effective use of space and/or time. In one example, a street-view application allows a user to navigate through an image at ground level. The application makes use of panoramic images called “bubbles,” which are captured at spatial intervals. The user can navigate through the images by changing position, or by changing the direction of view. Various aspects of how the bubbles are stored or transmitted may be controlled, in order to make effective use of the bandwidth that is available to transmit the bubbles. Examples of these aspects may include: how much of a given bubble is transmitted; the resolution at which the bubble is transmitted; and/or the spatial frequency at which the user moves through the bubbles.

Claims

1. One or more computer-readable storage media that store executable instructions that, when executed by a computer, cause the computer to perform acts comprising:

receiving a first indication of a geographic position;

receiving a second indication of a view direction;

receiving a third indication of a speed of motion;

based on criteria comprising;

(a) said first indication, (b) said second indication, (c) said third indication, and (d) an amount of data transmission bandwidth that is available, choosing one or more aspects of image delivery, said aspects comprising;

a first resolution;

a field of view; and

a frame rate; and

providing a plurality of portions of panoramic images at said first resolution, wherein each portion of a panoramic image comprises said field of view, wherein said portions of said panoramic images are delivered in succession at said frame rate.

2. The one or more computer-readable storage media of claim 1, and wherein the portions of said panoramic images that are provided comprise said field of view but do not include the entire visual field through which said panoramic images are captured.

3. The one or more computer-readable storage media of claim 1, wherein said panoramic images are captured in a sequence at a capture rate, wherein said frame rate is lower than said capture rate, and wherein said providing comprises:

omitting, from the images that are provided, some of the panoramic images in said sequence, in order to prevent an amount of data used in transmitting said images from exceeding said bandwidth.

4. The one or more computer-readable storage media of claim 1, wherein said panoramic images are captured at a second resolution that is higher than said first resolution, and wherein said acts further comprise:

choosing said first resolution in order to prevent an amount of data used in transmitting said images from exceeding said bandwidth.

5. The one or more computer-readable storage media of claim 1, wherein said panoramic images are captured in a sequence at a capture rate, wherein said frame rate is higher than said capture rate, and wherein said acts further comprise:

interpolating intermediate images between panoramic images in said sequence.

6. The one or more computer-readable storage media of claim 1, wherein said panoramic images are stored in a file that has a plurality of streams, each of said streams corresponding to a tile of said panoramic images, and wherein said acts further comprise:

identifying one or more streams in said file that correspond to said field of view; and

providing images from the one or more streams that were identified by said identifying act.

7. The one or more computer-readable storage media of claim 1, wherein said panoramic images are capture from a first street that forks into a second street and a third street, wherein a file stores a first set of streams that store portions of panoramic images of said second street and a second set of streams that store portions of panoramic images of said third street, and wherein said acts further comprise:

receiving an fourth indication that a user has chosen to travel on said second street; and

based on said fourth indication, providing images from said first set of streams.

8. The one or more computer-readable storage media of claim 1, wherein said acts further comprise:

anticipating a change in said speed of motion, said geographic position, or said view direction; and

providing images to a viewer application based on the change that is anticipated.

9. A system for simulating navigation through an area, the system comprising:

a database that stores panoramic images;

an image server that receives a first indication of a geographic position, a second indication of a view direction, and a third indication of a speed of motion, said image server comprising;

an animation selector that determines one or more aspects of transmitting images based on factors comprising (a) said first indication, (b) said second indication, (c) said third indication, and (d) an amount of bandwidth available to transmit data, wherein said image server receives said panoramic images from said database and determines how to transmit said panoramic images, or portions of said panoramic images, so as not exceed said bandwidth.

10. The system of claim 9, wherein said one or more aspects comprise a first resolution at which to transmit said panoramic images or portions of said panoramic images, wherein said panoramic images are captured at a second resolution, and wherein said database stores said panoramic images at a plurality of resolutions, at least one of which is lower than said second resolution.

11. The system of claim 10, wherein said first resolution is lower than said second resolution, and wherein said image server retrieves a file from said database that comprises said panoramic images at said first resolution and transmits said panoramic images, or portions of said panoramic images, at said second first resolution.

12. The system of claim 9, wherein said one or more aspects comprise a field of view that will be shown to a user, said field of view comprising part of a visual field through which said panoramic images were captured, and wherein said image server chooses one or more portions of said panoramic images, said one or more portions being chosen to include said field of view, said one or more portions also being chosen to omit at least some of said visual field that will not be shown to said user.

13. The system of claim 9, wherein said one or more aspects comprise a field of view that will be shown to a user, wherein said panoramic images were captured through visual field, wherein said database stores a multi-stream file in which each stream represents a different portion of the visual field through which said panoramic image was captured, and wherein said image server chooses one or more of the streams from the file based on which of the streams comprise said field of view.

14. The system of claim 9, wherein said one or more aspects comprise a speed at which motion is to be simulated for a user, wherein said panoramic images were captured at a capture rate, said panoramic images being stored in said database in a sequence in which said panoramic images were captured, and wherein said image server provides said panoramic images or portions of said panoramic images by omitting some of said panoramic images in said sequence to accommodate said bandwidth.

15. The system of claim 9, wherein said one or more aspects comprise a speed at which motion is to be simulated for a user, wherein said panoramic images were captured at a capture rate, said panoramic images being stored in said database in a sequence in which said panoramic images were captured, and wherein the system further comprises:

an interpolator that interpolates intermediate images between said panoramic images in said sequence in order to increase smoothness of transitions between images.

16. The system of claim 9, wherein said one or more aspects comprise a speed at which motion is to be simulated for a user, wherein said panoramic images were captured at a capture rate, said panoramic images being stored in said database in a sequence in which said panoramic images were captured, and wherein said image server provides, to an application that receives said panoramic images or portions of said panoramic images, data that is usable by said application to interpolate intermediate images between said panoramic images in said sequence.

17. The system of claim 9, wherein said image server anticipates a change in said speed of motion, said geographic position, or said view direction, and provides images to a viewer application based on the change that is anticipated.

18. A method of providing a street-level view, the method comprising:

using a processor to perform acts comprising;

receiving a first indication of a geographic position along a street;

receiving a second indication of a direction;

receiving a third indication of a speed of travel;

determining an amount of bandwidth that is available to transmit data;

retrieving, from a database, a first file that contains panoramic images captured along said street, each of said panoramic images being captured through a first angle;

choosing an arc of said panoramic images to serve, said arc having an second angle that is less than said first angle;

choosing a first resolution and a frame rate such that transmission portions of said panoramic images at said first resolution and at said frame rate does not exceed said bandwidth;

serving, to an application, a plurality of images, at said first resolution, wherein said plurality of images constitute portions of said panoramic images that correspond to said arc, wherein said plurality of images are served at said frame rate.

19. The method of claim 18, wherein said first file comprises successive images that were captured along said street, said first file being a multi-stream file, each stream in said first file corresponding to a portion of said first angle through which said panoramic images were captured, and wherein said serving comprises:

serving one or more streams of said first file that encompass said arc.

20. The method of claim 18, wherein said panoramic images were captured at a second resolution that is higher than said first resolution, said first file storing said panoramic images at said first resolution, said database also storing a second file that stores said panoramic images at said second resolution, and wherein the method further comprises:

using a processor to perform acts comprising;

choosing said first file from said database based on a fact that said first file stores said panoramic images at said first resolution.