Apparatus and method for panoramic video hosting with reduced bandwidth streaming

• US 9,838,687 B1
• Filed: 09/27/2013
• Issued: 12/05/2017
• Est. Priority Date: 12/02/2011
• Status: Active Grant

• Current Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Original Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Inventors: Banta, Bill, Alioshin, Paul
• Primary Examiner(s): Ustaris, Joseph
• Assistant Examiner(s): Volentine, Rebecca
• Application Number:
  US14/040,390
• Time in Patent Office: 1,530 Days
• CPC Class Codes: H04N 19/40 using video transcoding, i.e. partial or full decoding of a coded input stream followed by re-encoding of the decoded output stream
• CPC Class Codes: H04N 19/85 using pre-processing or post-processing specially adapted for video compression
• CPC Class Codes: H04N 21/21805 enabling multiple viewpoints, e.g. using a plurality of cameras
• CPC Class Codes: H04N 21/47202 for requesting content on demand, e.g. video on demand
• CPC Class Codes: H04N 21/4728 for selecting a Region Of Interest [ROI], e.g. for requesting a higher resolution version of a selected region
• CPC Class Codes: H04N 2101/00 Still video cameras
• CPC Class Codes: H04N 23/698 for achieving an enlarged field of view, e.g. panoramic image capture

Abstract

A server includes an input node to receive video streams forming a panoramic video. A module forms a suggested field of view in the panoramic video. The suggested field of view is based upon a viewing parameter, such as a client device motion parameter or a motion prediction parameter. An output node sends the suggested field of view to a client device.

Claims

1. A server, comprising:

a processor programmed to;

receive a plurality of image frames;

generate a panoramic video from the plurality of image frames;

receive a request from a requesting client device for at least a portion of the panoramic video;

determine a suggested field of view in the panoramic video, wherein the suggested field of view is determined based upon data received from a plurality of client devices, the data representing viewing parameters associated with the client devices;

identify a direction in which the plurality of client devices navigate in the panoramic video;

increase a size of a buffer of the suggested field of view in the direction in which the plurality of client devices navigated in the panoramic video; and

send the suggested field of view to the requesting client device.

2. The server of claim 1 wherein the viewing parameters comprise a motion parameter of the requesting client device.

3. The server of claim 1 wherein the viewing parameters comprise a motion prediction parameter based upon view selections from the plurality of client devices.

4. The server of claim 3 wherein the motion prediction parameter is based upon evaluating panning sequences from the plurality of client devices.

5. The server of claim 3 wherein the motion prediction parameter is based upon evaluating popular field of view selections from the plurality of client devices.

6. The server of claim 1, wherein the processor is further programmed to determine a direction in which a user of the requesting client device is looking relative to the suggested field of view.

7. The server of claim 1 wherein the processor is further programmed to determine a current field of view of a user of the requesting client device within the panoramic video.

8. The server of claim 1 wherein the processor is further programmed to modulate panoramic video delivered to the requesting client device based upon a dynamic assessment of available network bandwidth.

9. The server of claim 1, wherein the processor is further programmed to supply panoramic video to the requesting client device, wherein the panoramic video has high resolution video in a field of view and low resolution video outside the field of view.

10. The server of claim 1, wherein the processor is further programmed to evaluate time stamps associated with the plurality of image frames.

11. The server of claim 1, wherein the processor is further programmed to:

determine an average navigation speed of the plurality of client devices in terms of a first number of degrees per unit of time; and

increase the size of the buffer to a second number of degrees, wherein the second number of degrees is at least twice the first number of degrees.

12. The server of claim 1, wherein the buffer comprises buffered image data, and wherein the processor is further programmed to segment the buffered image data into a number of polygons including at least one oblique angle.

13. The server of claim 1, wherein the processor is further programmed to:

send the suggested field of view to the requesting client device at a first resolution; and

send a different field of view to a second requesting client device at a second resolution lower than the first resolution, wherein the different field of view has been requested fewer times by the plurality of client devices relative to the suggested field of view.

14. The server of claim 1, wherein:

the plurality of image frames are recorded for an event; and

the processor is further programmed to send the suggested field of view to a client device while the event is occurring.

15. A method, comprising:

receiving a plurality of image frames;

generating a panoramic video from the plurality of image frames;

receiving a request from a requesting client device for at least a portion of the panoramic video;

determining a suggested field of view in the panoramic video, wherein the suggested field of view is determined based upon data received from a plurality of client devices, the data representing viewing parameters associated with the client devices;

identify a direction in which the plurality of client devices navigate in the panoramic video;

increase a size of a buffer of the suggested field of view in the direction in which the plurality of client devices navigated in the panoramic video; and

send the suggested field of view to the requesting client device.

16. The method of claim 15, further comprising:

recording the plurality of image frames for an event; and

sending the suggested field of view to a client device while the event is occurring.

17. The method of claim 15, wherein the buffer comprises buffered image data, and wherein the method further comprises segmenting the buffered image data into a number of polygons including at least one oblique angle.

18. The method of claim 15, further comprising:

sending the suggested field of view to the requesting client device at a first resolution; and

sending a different field of view to a second requesting client device at a second resolution lower than the first resolution, wherein the different field of view has been requested fewer times by the plurality of client devices relative to the suggested field of view.

19. The method of claim 15 wherein the viewing parameters comprise a motion parameter of the requesting client device.

20. The method of claim 15 wherein the viewing parameters comprise a motion prediction parameter based upon view selections from the plurality of client devices.