LOW LATENCY VIDEO STORYBOARD DELIVERY WITH SELECTABLE RESOLUTION LEVELS

• US 20140082661A1
• Filed: 03/05/2013
• Published: 03/20/2014
• Est. Priority Date: 03/06/2012
• Status: Abandoned Application

• Current Assignee: Google Inc. (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Krahnstoever, Nils Oliver, Wilson, Kevin William
• Application Number:
  US13/785,913
• Publication Number:
  US 20140082661A1
• Time in Patent Office: Days
• US Class Current: 725/32
• CPC Class Codes: G06V 20/49 Segmenting video sequences, i.e. computational techniques such as parsing or cutting the sequence, low-level clustering or determining units such as shots or scenes
• CPC Class Codes: G11B 27/34 Indicating arrangements indicating means incorporated in magazine or cassette G11B23/046 and G11B23/0875; indicating measured values in general G01D
• CPC Class Codes: H04N 21/234336 by media transcoding, e.g. video is transformed into a slideshow of still pictures or audio is converted into text
• CPC Class Codes: H04N 21/2358 for generating different versions, e.g. for different recipient devices
• CPC Class Codes: H04N 21/435 Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
• CPC Class Codes: H04N 21/47202 for requesting content on demand, e.g. video on demand
• CPC Class Codes: H04N 21/8126 involving additional data, e.g. news, sports, stocks, weather forecasts
• CPC Class Codes: H04N 21/8549 Creating video summaries, e.g. movie trailer retrieval in video databases by using presentations in form of a video summary G06F16/739

Abstract

A video storyboard delivery system is disclosed. The system receives, from a playback client executed on a user device, a request for a video including one or more user device parameters. The system obtains a storyboard manifest including information defining a storyboard associated with the video, wherein the information includes a plurality of storyboard resolution levels. Using the one or more user device parameters, a selection is made of one of the plurality of storyboard resolution levels from the storyboard manifest. The storyboard at the selected resolution level is delivered to the playback client.

Claims

1. A method of delivering a storyboard associated with a video, comprising:

receiving, from a playback client executed on a user device, a request for a video, the request comprising one or more user device parameters;

obtaining a storyboard manifest comprising information defining a storyboard associated with the video, wherein the information comprises a plurality of storyboard resolution levels;

selecting, using one or more user device parameters, one of the plurality of storyboard resolution levels from the storyboard manifest; and

delivering, to the playback client, the storyboard at the selected storyboard resolution level.

2. The method of claim 1 further comprising:

transforming the storyboard manifest to remove one or more inapplicable storyboard resolution levels; and

delivering the transformed storyboard manifest to the playback client.

3. The method of claim 2 further comprising receiving a fetch request from the playback client for the storyboard at the selected storyboard resolution level.

4. The method of claim 3 further comprising receiving a second fetch request from the playback client for the storyboard at a higher storyboard resolution level than the selected storyboard resolution level.

5. The method of claim 1, wherein the storyboard comprises one or more storyboard mosaics.

6. The method of claim 5 further comprising storing an image of each storyboard mosaic with a specific mosaic filename.

7. The method of claim 6, wherein the storyboard manifest comprises the specific mosaic filename for each storyboard mosaic image.

8. The method of claim 1, wherein the storyboard manifest is stored with a manifest filename associated with an identifier of the video.

9. The method of claim 8, wherein the playback client is configured to determine the manifest filename using the identifier of the video and fetch the storyboard manifest.

10. The method of claim 1 further comprising delivering the storyboard manifest to the playback client configured to fetch the storyboard in accordance with the storyboard manifest.

11. A method of delivering a storyboard associated with a live video stream, comprising:

receiving a live video stream;

performing multi-frame sampling of the live video stream to produce a plurality of video frames;

generating a storyboard comprising the plurality of video frames; and

delivering, to a playback client executed on a user device, the storyboard associated with the live video stream.

12. The method of claim 11 further comprising adding one or more newly produced video frames to a mosaic at an end of a storyboard resolution level to produce a modified mosaic.

13. The method of claim 12 further comprising updating a storyboard manifest associated with the storyboard to reflect the modified mosaic.

14. The method of claim 11 further comprising generating a storyboard manifest comprising information defining the generated storyboard associated with the live video stream, wherein the information comprises a plurality of storyboard resolution levels.

15. The method of claim 14 further comprising:

receiving, from the playback client, one or more user device parameters;

selecting, using the one or more user device parameters, one of the plurality of storyboard resolution levels; and

delivering, to the playback client, the storyboard at the selected storyboard resolution level.

16. A non-transitory computer readable storage medium having instructions that, when executed by a processing device, cause the processing device to perform operations comprising:

receive, from a playback client executed on a user device, a request for a video, the request comprising one or more user device parameters;

obtain a storyboard manifest comprising information defining a storyboard associated with the video, wherein the information comprises a plurality of storyboard resolution levels;

select, using the one or more user device parameters, one of the plurality of storyboard resolution levels from the storyboard manifest; and

deliver, to the playback client, the storyboard at the selected storyboard resolution level.

17. A non-transitory computer readable storage medium having instructions that, when executed by a processing device, cause the processing device to perform operations comprising:

receive a live video stream;

perform multi-frame sampling of the live video stream to produce a plurality of video frames;

generate a storyboard comprising the plurality of video frames; and

deliver, to a playback client executed on a user device, the storyboard associated with the live video stream.

18. A computing device comprising:

a memory; and

a processing device coupled to the memory, wherein the processing device is configured to;

receive, from a playback client executed on a user device, a request for a video, the request comprising one or more user device parameters,

obtain a storyboard manifest comprising information defining a storyboard associated with the video, wherein the information comprises a plurality of storyboard resolution levels,

select, using the one or more user device parameters, one of the plurality of storyboard resolution levels from the storyboard manifest, and

deliver, to the playback client, the storyboard at the selected storyboard resolution level.

19. A computing device comprising:

a memory; and

a processing device coupled to the memory, wherein the processing device is configured to;

receive a live video stream,

perform multi-frame sampling of the live video stream to produce a plurality of video frames,

generate a storyboard comprising the plurality of video frames, and

deliver, to a playback client executed on a user device, the storyboard associated with the live video stream.

20. A method of obtaining a storyboard associated with a video, comprising:

determining one or more user device parameters;

transmitting a request for a video, the request comprising the one or more user device parameters;

receiving a storyboard manifest comprising information defining a storyboard associated with the video and a storyboard resolution level selected using the one or more user device parameters; and

obtaining, using the storyboard manifest, the storyboard at the selected storyboard resolution level.

21. A computing device comprising:

a memory; and

a processing device coupled to the memory, wherein the processing device is configured to;

determine one or more user device parameters,

transmit a request for a video, the request comprising the one or more user device parameters,

receive a storyboard manifest comprising information defining a storyboard associated with the video and a storyboard resolution level selected using the one or more user device parameters, and

obtain, using the storyboard manifest, the storyboard at the selected storyboard resolution level.

22. The computer device of claim 21, wherein the processing device is further configured to facilitate rendering of the storyboard at the selected resolution level via a display.

23. A method of delivering a storyboard associated with a video, comprising:

receiving, from a playback client executed on a user device, a request for a video, the request comprising a device parameter indicating a selected storyboard resolution level; and

delivering, to the playback client, the storyboard at the selected storyboard resolution level.

24. A method of obtaining a storyboard associated with a video, comprising:

transmitting a request for a video, the request comprising the one or more user device parameters;

receiving the video;

generating a storyboard manifest comprising information defining a storyboard associated with the video and a storyboard resolution level selected using one or more parameters associated with the video; and

obtaining, using the storyboard manifest, the storyboard at the selected storyboard resolution level.

25. A method of obtaining a storyboard associated with a video, comprising:

determining, by a playback client executed on a user device, one or more user device parameters;

selecting, using the one or more user device parameters, one of a plurality of storyboard resolution levels for playback of a storyboard associated with a video;

fetching the storyboard at the selected storyboard resolution level; and

presenting the storyboard at the selected storyboard resolution level.