Dynamic summary generation for real-time switchable videos

• US 10,218,760 B2
• Filed: 06/22/2016
• Issued: 02/26/2019
• Est. Priority Date: 06/22/2016
• Status: Active Grant

• Current Assignee: JBF Interlude 2009 Ltd.
• Original Assignee: JBF Interlude 2009 Ltd.
• Inventors: Vishnia, Opher, Barlow, Sam, Bloch, Jonathan, Feldman, Barak, Zubalsky, Tal, Hofshy, Yuval
• Primary Examiner(s): Kim, Hee Soo
• Application Number:
  US15/189,931
• Publication Number:
  US 20170374120A1
• Time in Patent Office: 979 Days
• Field of Search: 709231
• CPC Class Codes: H04L 65/613 for the control of the source by the destination control signals issued by the client directed to the server or network components specially adapted for selective content distribution H04N21/637
• CPC Class Codes: H04L 65/65 Network streaming protocols, e.g. real-time transport protocol [RTP] or real-time control protocol [RTCP]
• CPC Class Codes: H04L 65/70 Media network packetisation
• CPC Class Codes: H04L 65/75 Media network packet handling
• CPC Class Codes: H04N 21/4325 by playing back content from the storage medium reproduction of recorded television signals H04N5/76; reproduction of recorded television signals H04N9/79
• CPC Class Codes: H04N 21/4347 Demultiplexing of several video streams
• CPC Class Codes: H04N 21/44016 involving splicing one content stream with another content stream, e.g. for substituting a video clip
• CPC Class Codes: H04N 21/472 End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content end-user interfaces for retrieving video data from a database G06F16/739; network services for supporting unicast streaming H04L65/612
• CPC Class Codes: H04N 21/8456 by decomposing the content in the time domain, e.g. in time segments
• CPC Class Codes: H04N 21/8549 Creating video summaries, e.g. movie trailer retrieval in video databases by using presentations in form of a video summary G06F16/739

Abstract

In viewing a media presentation having multiple streams or tracks running in parallel and synchronized to a common playback timeline, a user experiencing one of the streams will miss interesting events and other content occurring in other streams. Accordingly, upon receiving an instruction to switch from a first stream to a second stream, a summary of the second stream is dynamically generated based on content that the user missed while watching the first stream. The summary is presented to the user prior to transitioning to presentation of the second stream.

Claims

1. A computer-implemented method comprising:

simultaneously receiving a plurality of video streams, wherein each of the video streams is synchronized to a common playback timeline;

presenting a first one of the video streams to a user between a first time in the playback timeline and a second, later time in the playback timeline;

receiving an instruction to switch to presentation of a second one of the video streams;

generating a video summary of the second video stream based on content in the second video stream occurring between the first time and the second time; and

presenting at least a portion of the video summary to the user prior to switching to the presentation of the second video stream, wherein the video summary is presented to the user between the second time and a third, later time in the playback timeline, and wherein the generating of the video summary is further based on content in the second video stream occurring between the second time and the third time, such that the video summary includes a summary of content in the second video stream that the user will miss during watching the video summary.

2. The method of claim 1, wherein each video stream comprises content related to the other video streams.

3. The method of claim 1, wherein the video summary comprises content not previously viewed by the user.

4. The method of claim 1, wherein the video summary comprises at least one of (i) video content from the second video stream presented at an increased playback speed and (ii) a selection of still images of video content in the second video stream.

5. The method of claim 1, wherein the video summary comprises content from the second video stream previously designated as important.

6. The method of claim 1, wherein each video stream comprises a plurality of segments, each segment comprising a segment summary video and a segment idle video.

7. The method of claim 6, wherein the generating of the video summary comprises including in the video summary at least one segment summary video from one or more segments occurring at least in part between the first time and the second time.

8. The method of claim 6, wherein the generating of the video summary comprises including in the video summary at least one segment idle video from one or more segments occurring at least in part between the first time and the second time.

9. The method of claim 1, further comprising:

switching back to presentation of the first video stream while the video summary is playing;

identifying content in the second video stream corresponding to a portion of the video summary not viewed by the user; and

including a summary of at least some of the identified content in a second video summary generated for presentation to the user when next switching to the second video stream.

10. The method of claim 1, further comprising providing an indicator informing the user when an interesting event is occurring or has occurred on a video stream not currently being viewed by the user.

11. A system comprising:

at least one memory for storing computer-executable instructions; and

at least one processor for executing the instructions stored on the memory, wherein execution of the instructions programs the at least one processor to perform operations comprising;

simultaneously receiving a plurality of video streams, wherein each of the video streams is synchronized to a common playback timeline;

presenting a first one of the video streams to a user between a first time in the playback timeline and a second, later time in the playback timeline;

receiving an instruction to switch to presentation of a second one of the video streams;

generating a video summary of the second video stream based on content in the second video stream occurring between the first time and the second time; and

presenting at least a portion of the video summary to the user prior to switching to the presentation of the second video stream, wherein the video summary is presented to the user between the second time and a third, later time in the playback timeline, and wherein the generating of the video summary is further based on content in the second video stream occurring between the second time and the third time, such that the video summary includes a summary of content in the second video stream that the user will miss during watching the video summary.

12. The system of claim 11, wherein each video stream comprises content related to the other video streams.

13. The system of claim 11, wherein the video summary comprises content not previously viewed by the user.

14. The system of claim 11, wherein the video summary comprises at least one of (i) video content from the second video stream presented at an increased playback speed and (ii) a selection of still images of video content in the second video stream.

15. The system of claim 11, wherein the video summary comprises content from the second video stream previously designated as important.

16. The system of claim 11, wherein each video stream comprises a plurality of segments, each segment comprising a segment summary video and a segment idle video.

17. The system of claim 16, wherein the generating of the video summary comprises including in the video summary at least one segment summary video from one or more segments occurring at least in part between the first time and the second time.

18. The system of claim 16, wherein the generating of the video summary comprises including in the video summary at least one segment idle video from one or more segments occurring at least in part between the first time and the second time.

19. The system of claim 11, wherein the operations further comprise:

switching back to presentation of the first video stream while the video summary is playing;

identifying content in the second video stream corresponding to a portion of the video summary not viewed by the user; and

including a summary of at least some of the identified content in a second video summary generated for presentation to the user when next switching to the second video stream.

20. The system of claim 11, wherein the operations further comprise providing an indicator informing the user when an interesting event is occurring or has occurred on a video stream not currently being viewed by the user.