Computerized system and method for automatic highlight detection from live streaming media and rendering within a specialized media player

• US 10,681,391 B2
• Filed: 07/13/2016
• Issued: 06/09/2020
• Est. Priority Date: 07/13/2016
• Status: Active Grant

• Current Assignee: Yahoo Assets LLC
• Original Assignee: Oath Inc. (Verizon Communications Inc.)
• Inventors: Ni, Bin, Lieb, Kirk, Hawes, Rick, Song, Yale, Schillings, Benoit, Oughourlian, Vahe, Vallmitjana, Jordi, Nystrom, Jennelle, Ruparel, Hardik, Chen, Michael, Mathes, Adam, Balasubramanian, Arunkumar, Zhou, Jian, Edelman, Matt
• Primary Examiner(s): Rabovianski, Jivka A
• Application Number:
  US15/209,051
• Publication Number:
  US 20180020243A1
• Time in Patent Office: 1,427 Days
• Field of Search: 725 37, 725 20, 725 42
• CPC Class Codes: G11B 27/031 Electronic editing of digitised analogue information signals, e.g. audio or video signals
• CPC Class Codes: G11B 27/28 by using information signals recorded by the same method as the main recording G11B27/22 takes precedence
• CPC Class Codes: H04N 21/2187 Live feed
• CPC Class Codes: H04N 21/23418 involving operations for analysing video streams, e.g. detecting features or characteristics television picture signal circuitry for scene change detection H04N5/147; filtering for image enhancement G06T5/00; methods or arrangements for recognising scenes G06V20/00; arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/2387 Stream processing in response to a playback request from an end-user, e.g. for trick-play
• CPC Class Codes: H04N 21/4882 for displaying messages, e.g. warnings, reminders arrangements for providing short real-time information to substation in data switching networks H04L12/1895
• CPC Class Codes: H04N 21/8549 Creating video summaries, e.g. movie trailer retrieval in video databases by using presentations in form of a video summary G06F16/739

Abstract

Disclosed are systems and methods for improving interactions with and between computers in content generating, searching, hosting and/or providing systems supported by or configured with personal computing devices, servers and/or platforms. The systems interact to identify and retrieve data within or across platforms, which can be used to improve the quality of data used in processing interactions between or among processors in such systems. The disclosed systems and methods automatically analyze a live streaming media file, and identify portions of the media that are highlights. The content classified as a highlight can be shared across social media platforms, and indexed for searching respective to attributes of the video content. The streaming and highlight media content is renderable in a novel, modified video player that enables variable playback speeds for how content is classified, and enables on-demand selections of specific content portions and adjustable rendering displays during streaming.

Claims

1. A computing device for rendering a media player, comprising:

a processor; and

a non-transitory computer-readable storage medium for tangibly storing thereon program logic for execution by the processor, the program logic comprising logic executed by the processor for rendering the media player on the computing device via the processor, said media player logic comprising;

logic executed by the processor for playing a stream of a media file, said playing comprising receiving frames of the media file and displaying each received frame sequentially in a first display area displayed within the media player;

logic executed by the processor for receiving an indication that a set of frames is classified as a highlight scene;

logic executed by the processor for automatically visibly displaying an indication within a displayed status bar of the media player, said indication providing a visible notification on the displayed status bar at a temporal location within the streamed media file where said set of frames is located and that said set of frames is a highlight scene;

logic executed by the processor for receiving an input to switch rendering of the media file at a current location associated with the live-stream and begin rendering the highlight scene, said input received respective to said displayed indication;

logic executed by the processor for automatically displaying a second display area in response to said input, said second display area displayed as a window overlaying the first display area at a position associated with said displayed indication; and

logic executed by the processor for automatically rendering the highlight scene comprising the set of frames of the streamed media file in said second display area while continuing to render content of the live-streamed media file in the first display area.

2. The computing device of claim 1, further comprising:

logic executed by the processor for receiving an input to switch rendering of the media file at a current location associated with the live-stream and begin rendering the highlight scene, said input received respective to said displayed indication; and

logic executed by the processor for automatically, in response to said input, rendering the set of frames of the highlight scene such that the first display area displays content associated with said set of frames.

3. The computing device of claim 1, further comprising:

logic executed by the processor automatically, in response to said input, rendering the set of frames of the highlight scene in the first display area and continuing rendering of the live-streamed media file in the second display area; and

logic executed by the processor for automatically switching the display of the content of the media file back to the first display area upon completion of the rendering of the set of frames, said switching further comprising automatically closing said second display area upon said completion of the rendering of the set of frames.

4. The computing device of claim 1, further comprising:

logic executed by the processor for receiving a request to render the highlight scene;

logic executed by the processor for identifying, based on said received request, a playlist associated with said media file, said playlist comprising information associated with said set of frames identified as said highlight scene;

logic executed by the processor for rendering, using said playlist, said set of frames in response to said request.

5. A non-transitory computer-readable storage medium tangibly encoded with computer-executable instructions, that when executed by a processor associated with a computing device, perform a method comprising:

playing a stream of a media file, said playing comprising receiving frames of the media file and displaying each received frame sequentially in a first display area displayed within the media player;

receiving an indication that a set of frames is classified as a highlight scene;

automatically visibly displaying an indication within a displayed status bar of the media player, said indication providing a visible notification on the displayed status bar at a temporal location within the streamed media file where said set of frames is located and that said set of frames is a highlight scene;

receiving an input to switch rendering of the media file at a current location associated with the live-stream and begin rendering the highlight scene, said input received respective to said displayed indication;

automatically displaying a second display area in response to said input, said second display area displayed as a window overlaying the first display area at a position associated with said displayed indication; and

automatically rendering the highlight scene comprising the set of frames of the streamed media file in said second display area while continuing to render content of the live-streamed media file in the first display area.

6. The non-transitory computer-readable storage medium of claim 5, further comprising:

receiving an input to switch rendering of the media file at a current location associated with the live-stream and begin rendering the highlight scene, said input received respective to said displayed indication; and

automatically, in response to said input, rendering the set of frames of the highlight scene such that the first display area displays content associated with said set of frames.

7. The non-transitory computer-readable storage medium of claim 5, further comprising:

automatically, in response to said input, rendering the set of frames of the highlight scene in the first display area and continuing rendering of the live-streamed media file in the second display area; and

automatically switching the display of the content of the media file back to the first display area upon completion of the rendering of the set of frames, said switching further comprising automatically closing said second display area upon said completion of the rendering of the set of frames.

8. The non-transitory computer-readable storage medium of claim 5, further comprising:

receiving a request to render the highlight scene;

for identifying, based on said received request, a playlist associated with said media file, said playlist comprising information associated with said set of frames identified as said highlight scene;

for rendering, using said playlist, said set of frames in response to said request.

9. A method comprising:

playing a stream of a media file, said playing comprising receiving frames of the media file and displaying each received frame sequentially in a first display area displayed within the media player;

receiving an indication that a set of frames is classified as a highlight scene;

automatically visibly displaying an indication within a displayed status bar of the media player, said indication providing a visible notification on the displayed status bar at a temporal location within the streamed media file where said set of frames is located and that said set of frames is a highlight scene

receiving an input to switch rendering of the media file at a current location associated with the live-stream and begin rendering the highlight scene, said input received respective to said displayed indication;

automatically displaying a second display area in response to said input, said second display area displayed as a window overlaying the first display area at a position associated with said displayed indication; and

automatically rendering the highlight scene comprising the set of frames of the streamed media file in said second display area while continuing to render content of the live-streamed media file in the first display area.

10. The method of claim 9, further comprising:

receiving an input to switch rendering of the media file at a current location associated with the live-stream and begin rendering the highlight scene, said input received respective to said displayed indication; and

automatically, in response to said input, rendering the set of frames of the highlight scene such that the first display area displays content associated with said set of frames.

11. The method of claim 9, further comprising:

automatically, in response to said input, rendering the set of frames of the highlight scene in the first display area and continuing rendering of the live-streamed media file in the second display area; and

automatically switching the display of the content of the media file back to the first display area upon completion of the rendering of the set of frames, said switching further comprising automatically closing said second display area upon said completion of the rendering of the set of frames.

12. The method of claim 9, further comprising:

receiving a request to render the highlight scene;

for identifying, based on said received request, a playlist associated with said media file, said playlist comprising information associated with said set of frames identified as said highlight scene;

for rendering, using said playlist, said set of frames in response to said request.