Systems and methods for adaptive streaming systems with interactive video timelines

• US 9,354,799 B2
• Filed: 06/13/2012
• Issued: 05/31/2016
• Est. Priority Date: 06/13/2012
• Status: Active Grant

• Current Assignee: Sonic IP Incorporated (Endeavor Group Holdings Inc.)
• Original Assignee: Sonic IP Incorporated (Endeavor Group Holdings Inc.)
• Inventors: Shivadas, Abhishek, Soroushian, Kourosh
• Primary Examiner(s): Augustine, Nicholas
• Application Number:
  US13/495,757
• Publication Number:
  US 20130339855A1
• Time in Patent Office: 1,448 Days
• Field of Search: 715720-723
• US Class Current: 1/1
• CPC Class Codes: G06F 2203/04803 Split screen, i.e. subdividing the display area or the window area into separate subareas
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/0485 Scrolling or panning
• CPC Class Codes: H04N 21/47217 for controlling playback functions for recorded or on-demand content, e.g. using progress bars, mode or play-point indicators or bookmarks specific graphical features in visual interfaces H04N21/4312
• CPC Class Codes: H04N 21/845 Structuring of content, e.g. decomposing content into time segments
• CPC Class Codes: H04N 21/8545 for generating interactive applications

Abstract

Systems and methods for adaptive streaming systems configured to generate interactive video timelines in accordance with embodiments of the invention are disclosed. In one embodiment of the invention, a method for selecting video to stream and playback using an interactive video timeline includes selecting a plurality of frames of video from a first stream of video data using a network client, displaying the plurality of frames of video in an interactive video timeline using the network client, selecting a playback frame of video data from the plurality of frames of video in the interactive video timeline using the network client, receiving a second stream of video data beginning from the playback frame of video data using the network client, and playing the second stream of video data using the network client.

Claims

1. A method for selecting video to stream and playback using an interactive video timeline, comprising:

selecting a first set of frames of video ordered based on time with at least a first time interval between each frame in the first set of frames from a first stream of video data using a network client, wherein a particular frame in the first set of frames corresponds to a first time and a frame immediately following the particular frame in the first set of frames corresponds to the first time plus the first time interval;

displaying the first set of frames of video in an interactive video timeline using the network client;

selecting a first frame of video from the first set of frames of video in the interactive video timeline using the network client;

selecting a second set of frames of video from the first stream of video, the second set of frames including a new set of frames, different from the first set of frames, that are for display during playback within the first time interval following the first frame, wherein the second set of frames for display (i) begin from the selected first frame of video and (ii) end at, at a latest time associated with a last frame in the second set of frames, the frame in the first set of frames that immediately follows the first frame using the network client, wherein frames within the second set of frames of video are separated by a second time interval between each frame in the second set of frames that is less than the first time interval between frames in the first set of frames; and

displaying the second set of frames of video in the interactive video timeline using the network client.

2. The method of claim 1, wherein the first stream of video data is a stream of intra frames.

3. The method of claim 1, wherein the first stream of video data is stored in one or more container files.

4. The method of claim 3, wherein the container files are Matroska container files.

5. The method of claim 1, wherein the first stream of video data is encoded using scalable video coding.

6. The method of claim 1, wherein the first set of frames of video are displayed in a grid.

7. The method of claim 1, further comprising:

receiving a second stream of video data beginning from the first frame of video data using the network client; and

playing the second stream of video data using the network client, wherein

playing the second stream of video data using the network client comprises;

closing the interactive video timeline using the network client; and

playing the second stream of video data in a full screen mode using the network client.

8. The method of claim 7, wherein playing the second stream of video data using the network client comprises playing the second stream of video data in a window on top of the interactive video timeline using the network client.

9. The method of claim 7, wherein playing the second stream of video data using the network client comprises playing the second stream of video data in the interactive video timeline using the network client.

10. The method of claim 1, wherein displaying the first set of frames of video in an interactive video timeline further comprises:

receiving a structure file using the network client, wherein the structure file contains the structure defining the layout of the interactive video timeline;

receiving the first stream of video data using the network client;

creating the interactive video timeline using the structure file, the first stream of video data; and

the network client; and

displaying the interactive video timeline using the network client.

11. The method of claim 1, further comprising displaying metadata for a plurality of frames of video in the first set of frames of video in the interactive video timeline using the network client.

12. A network client, comprising:

memory configured store a client application and video data; and

a processor;

wherein the client application configures the processor to;

select a first set of frames of video ordered based on time with at least a first time interval between each frame in the first set of frames from a first stream of video data, wherein a particular frame in the first set of frames corresponds to a first time and a frame immediately following the particular frame in the first set of frames corresponds to the first time plus the first time interval;

display the first set of frames of video in an interactive video timeline;

select a first frame of video from the first set of frames of video in the interactive video timeline;

select a second set of frames of video from the first stream of video, the second set of frames including a new set of frames, different from the first set of frames, that are for display during playback within the first time interval following the first frame, wherein the second set of frames for display (i) begin from the selected first frame of video and (ii) end at, at a latest time associated with a last frame in the second set of frames, the frame in the first set of frames that immediately follows the first frame, wherein frames within the second set of frames of video are separated by a second time interval between each frame in the second set of frames that is less than the first time interval between frames in the first set of frames; and

display the second set of frames of video in the interactive video timeline.

13. The network client of claim 12, wherein the client application further configures the processor to:

receive a structure file from a media server, wherein the structure file contains the structure defining the layout of the interactive video timeline;

receive the first set of frames of video from a media server; and

create the interactive video timeline using the structure file and the first set of frames of video.

14. The network client of claim 12, wherein the client application further configures the processor to display an overlay for one or more frames of video in the first set of frames of video, where the overlay comprises metadata related to the one or more frames of video.

15. A non-transitory machine readable medium containing processor instructions, where execution of the instructions by a processor causes the processor to perform a process comprising:

selecting a first set of frames of video ordered based on time with at least a first time interval between each frame in the first set of frames from a first stream of video data, wherein a particular frame in the first set of frames corresponds to a first time and a frame immediately following the particular frame in the first set of frames corresponds to the first time plus the first time interval;

displaying the first set of frames of video in an interactive video timeline;

selecting a first frame of video from the first set of frames of video in the interactive video timeline;

selecting a second set of frames of video from the first stream of video, the second set of frames including a new set of frames, different from the first set of frames, that are for display during playback within the first time interval following the first frame, wherein the second set of frames for display (i) begin from the selected first frame of video and (ii) end at, at a latest time associated with a last frame in the second set of frames, the frame in the first set of frames that immediately follows the first frame, wherein frames within the second set of frames of video are separated by a second time interval between each frame in the second set of frames that is less than the first time interval between frames in the first set of frames; and

displaying the second set of frames of video in the interactive video timeline.

16. A media server, comprising:

a video decoder;

memory configured store a server application and video data; and

a processor;

wherein the server application configures the processor to;

receive a first request for an interactive video timeline;

select a first set of frames of video ordered based on time with at least a first time interval between each frame in the first set of frames from a first stream of video data, wherein a particular frame in the first set of frames corresponds to a first time and a frame immediately following the first frame in the first set of frames corresponds to the first time plus the first time interval;

generate an interactive video timeline using the first set of frames and the video decoder;

transmit the interactive video timeline in response to the request for the interactive video timeline;

receive a selection of a first frame from the first set of frames;

select a second set of frames of video from the first stream of video, the second set of frames including a new set of frames, different from the first set of frames, that are for display during playback within the first time interval following the first frame, wherein the second set of frames for display (i) begin from the selected first frame of video and (ii) end at, at a latest time associated with a last frame in the second set of frames, the frame in the first set of frames that immediately follows the first frame, wherein frames within the second set of frames of video are separated by a second time interval between each frame in the second set of frames that is less than the first time interval between frames in the first set of frames;

re-generate the interactive video timeline using the second set of frames and the video decoder; and

transmit the interactive video timeline in response to the selection of the first frame.