Providing supplemental content for a second screen experience

• US 10,664,138 B2
• Filed: 03/14/2013
• Issued: 05/26/2020
• Est. Priority Date: 03/14/2003
• Status: Active Grant

• Current Assignee: Comcast Cable Communications LLC (Comcast Corporation)
• Original Assignee: Comcast Cable Communications LLC (Comcast Corporation)
• Inventors: Carney, John, Thomson, Greg, Ahrens, Don, Gravante, Justin, Evans, Andrew, McLaughlin, Jill
• Primary Examiner(s): Brahmachari, Mandrita
• Application Number:
  US13/803,274
• Publication Number:
  US 20130198642A1
• Time in Patent Office: 2,630 Days
• CPC Class Codes: G06F 3/0484 for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
• CPC Class Codes: H04N 21/233 Processing of audio elementary streams monitoring, identification or recognition of audio in broadcast systems H04H60/58
• CPC Class Codes: H04N 21/23418 involving operations for analysing video streams, e.g. detecting features or characteristics television picture signal circuitry for scene change detection H04N5/147; filtering for image enhancement G06T5/00; methods or arrangements for recognising scenes G06V20/00; arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/235 Processing of additional data, e.g. scrambling of additional data or processing content descriptors
• CPC Class Codes: H04N 21/2408 Monitoring of the upstream path of the transmission network, e.g. client requests monitoring data switching networks utilization H04L43/0876; scheduling or organising the servicing of application requests H04L67/60
• CPC Class Codes: H04N 21/251 Learning process for intelligent management, e.g. learning user preferences for recommending movies details of learning user preferences for the retrieval of video data in a video database G06F16/739; computer systems using learning methods G06N3/08
• CPC Class Codes: H04N 21/25808 Management of client data terminal profiles in network data switching protocols H04L67/303
• CPC Class Codes: H04N 21/25866 Management of end-user data customer care in data networks H04L41/5077
• CPC Class Codes: H04N 21/2665 Gathering content from different sources, e.g. Internet and satellite
• CPC Class Codes: H04N 21/4122 additional display device, e.g. video projector digital output for controlling a plurality of local displays G06F3/1423
• CPC Class Codes: H04N 21/41265 having a remote control device for bidirectional communication between the remote control device and client device unidirectional remote control device H04N21/42204
• CPC Class Codes: H04N 21/43079 of additional data with content streams on multiple devices
• CPC Class Codes: H04N 21/4312 involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
• CPC Class Codes: H04N 21/4316 for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window
• CPC Class Codes: H04N 21/4334 Recording operations recording of a television signal H04N5/76; arrangements for recording or accumulating broadcast information or broadcast-related information H04H60/27
• CPC Class Codes: H04N 21/435 Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
• CPC Class Codes: H04N 21/47 End-user applications
• CPC Class Codes: H04N 21/47214 for content reservation or setting reminders; for requesting event notification, e.g. of sport results or stock market stock exchange data over packet-switching network H04L12/1804; push services over packet-switching network H04L12/1859; notification of incoming messages in packet switching networks H04L51/224
• CPC Class Codes: H04N 21/47217 for controlling playback functions for recorded or on-demand content, e.g. using progress bars, mode or play-point indicators or bookmarks specific graphical features in visual interfaces H04N21/4312
• CPC Class Codes: H04N 21/4722 for requesting additional data associated with the content
• CPC Class Codes: H04N 21/4782 : Web browsing , e.g. WebTV
• CPC Class Codes: H04N 21/4788 : communicating with other users, e.g. chatting arrangements for providing for computer conferences, e.g. chat rooms, to substation in data switching networks H04L12/1813; distributed application using peer-to-peer [P2P] networks H04L67/104
• CPC Class Codes: H04N 21/482 : End-user interface for program selection broadcast systems using EPGs H04H60/72
• CPC Class Codes: H04N 21/6547 : comprising parameters, e.g. for client setup
• CPC Class Codes: H04N 21/6581 : Reference data, e.g. a movie identifier for ordering a movie or a product identifier in a home shopping application
• CPC Class Codes: H04N 21/6582 : Data stored in the client, e.g. viewing habits, hardware capabilities, credit card number arrangements where receivers interact with the broadcast H04H20/38
• CPC Class Codes: H04N 21/6587 : Control parameters, e.g. trick play commands, viewpoint selection
• CPC Class Codes: H04N 21/8133 : specifically related to the content, e.g. biography of the actors in a movie, detailed information about an article seen in a video program
• CPC Class Codes: H04N 21/8173 : End-user applications, e.g. Web browser, game
• CPC Class Codes: H04N 21/84 : Generation or processing of descriptive data, e.g. content descriptors systems specially adapted for using meta-information in broadcast systems H04H60/73
• CPC Class Codes: H04N 21/8455 : involving pointers to the content, e.g. pointers to the I-frames of the video stream
• CPC Class Codes: H04N 21/8547 : involving timestamps for synchronizing content

Abstract

Computing devices, computer-readable media storing computer-executable instructions, methods, and systems for discovering, organizing, and presenting supplemental content are disclosed. A discovery system may be used to discover an item, such as a supplemental content presentation application, which, when launched may present supplemental content to a user while the user is consuming primary content. The supplemental content presentation application may also present a timeline that users may interact with to view different portions of the supplemental content. The timeline may also be modified by adding markers along the timeline so that when a marker is selected, a particular piece of supplemental content is presented.

Claims

1. A method comprising:

sending, by a computing device and to a second device, a timeline corresponding to a duration of first content outputted at a first device, wherein the timeline comprises a first plurality of time markers associated with a first application that is related to the first content;

receiving, by the computing device and after the sending the timeline to the second device, an indication that a user of the first device has selected a second application;

generating, by the computing device and after receiving the indication, an indication of a second plurality of time markers corresponding to the second application; and

sending, by the computing device and to the second device, instructions for the second device to modify the timeline to display the second plurality of time markers instead of the first plurality of time markers.

2. The method of claim 1, further comprising:

receiving a data feed comprising a plurality of messages;

sending one or more messages of the plurality of messages to the second device; and

receiving a report from the second device indicating a selection of at least one of the one or more messages,

wherein the first application is associated with one or more social-network applications.

3. The method of claim 2, wherein the receiving of the data feed comprises subscribing to a hashtag of a social network service or subscribing to a rich site summary (RSS) feed of a news source.

4. The method of claim 1, wherein the timeline is configured to cause output of supplemental content in synchronization with the first content outputted at the first device.

5. The method of claim 1 further comprising:

receiving a plurality of reports, from a plurality of user devices, indicating a selection of one or more messages;

analyzing the plurality of reports to determine whether a particular message, of the one or more messages, has been selected a quantity of times that satisfies a threshold; and

generating, based on determining that the quantity of times the particular message has been selected satisfies the threshold, an indication to group an additional time marker with the first plurality of time markers, and

wherein the additional time marker corresponds to the particular message.

6. The method of claim 1, wherein the timeline comprises instructions that allow the second device to, based on a user input to the second device, modify the timeline to add an additional time marker at a point along the timeline and output, based on a selection of the additional time marker, additional content.

7. The method of claim 1, further comprising:

before the sending the timeline, identifying the first content;

generating the timeline for the first content; and

adding, based on results of at least one of an audio recognition process or an image recognition process, supplemental content to the timeline.

8. The method of claim 1, further comprising

sending instructions for a third device to modify an additional timeline to display an additional marker at an additional point on the additional timeline, wherein the additional point is not marked on the timeline.

9. A method comprising:

determining a set of markers comprising a first subset of markers corresponding to a first application and a second subset of markers corresponding to a second application, wherein the first application and the second application are associated with content;

outputting, by a device, on a timeline that corresponds to a duration of the content, and based on a selection of the first application, the first subset of markers;

modifying, while the first subset of markers is outputted on the timeline, the first subset of markers to add a first marker at a first point along the timeline, wherein the first marker is configured to trigger the device to output first supplemental content associated with a first point in the content;

receiving a selection of the second application; and

changing, based on the selection of the second application, the first subset of markers to the second subset of markers.

10. The method of claim 9, further comprising:

sending, based on the timeline and in synchronization with the content, different supplemental content, wherein the different supplemental content and the content are associated with one another, and wherein the content is outputted on a display separate from the device.

11. The method of claim 9, wherein the first application comprises an interface for a selection of an option to share data through a plurality of social network services.

12. The method of claim 9, wherein the modifying the first subset of markers to add the first marker comprises:

determining, based on a user input associated with a time point of the content, the first point along the timeline; and

sending the first marker on the timeline at the first point along the timeline.

13. An apparatus comprising:

one or more processors; and

memory storing instructions that, when executed by the one or more processors, cause the apparatus to;

send, to a second device, a timeline corresponding to a duration of first content outputted at a first device, wherein the timeline comprises a first plurality of time markers associated with a first application that is related to the first content;

receive, after sending the timeline to the second device, an indication that a user of the first device has selected a second application;

generate, after receiving the indication, an indication of a second plurality of time markers corresponding to the second application; and

send, to the second device, instructions for the second device to modify the timeline to display the second plurality of time markers instead of the first plurality of time markers.

14. The apparatus of claim 13, wherein the instructions, when executed by the one or more processors, cause the apparatus to:

receive a data feed comprising a plurality of messages;

send one or more messages of the plurality of messages to the second device; and

receive a report from the second device indicating a selection of at least one of the one or more messages,

wherein the first application is associated with one or more social-network applications.

15. The apparatus of claim 14, wherein the instructions, when executed by the one or more processors, cause the apparatus to receive the data feed by causing the apparatus to subscribe to a hashtag of a social network service or subscribe to a rich site summary (RSS) feed of a news source.

16. The apparatus of claim 13, wherein the instructions, when executed by the one or more processors, cause, according to the timeline, output of supplemental content in synchronization with the first content outputted at the first device.

17. The apparatus of claim 13, wherein the instructions, when executed by the one or more processors, cause the apparatus to:

receive a plurality of reports, from a plurality of user devices, indicating a selection of one or more messages;

analyze the plurality of reports to determine whether a particular message, of the one or more messages, has been selected a quantity of times that satisfies a threshold; and

generate, based on determining that the quantity of times the particular message has been selected satisfies the threshold, an indication to group an additional time marker with the first plurality of time markers, and

wherein the additional time marker corresponds to the particular message.

18. The apparatus of claim 13, wherein the instructions, when executed by the one or more processors, cause the apparatus to:

allow the second device to, based on a user input to the second device, modify the timeline to add an additional time marker at a point along the timeline and output, based on a selection of the additional time marker, additional content.

19. The apparatus of claim 13, wherein the instructions, when executed by the one or more processors, cause the apparatus to:

before sending the timeline, identify the first content;

generate the timeline for the first content; and

add, based on results of at least one of an audio recognition process or an image recognition process, supplemental content to the timeline.

20. An apparatus comprising:

one or more processors; and

memory storing instructions that, when executed by the one or more processors, cause the apparatus to;

determine a set of markers comprising a first subset of markers corresponding to a first application and a second subset of markers corresponding to a second application, wherein the first application and the second application are associated with content;

output, on a timeline that corresponds to a duration of the content, and based on a selection of the first application, the first subset of markers;

modify, while the first subset of markers is outputted on the timeline, the first subset of markers to add a first marker at a first point along the timeline, wherein the first marker is configured to trigger the apparatus to output first supplemental content associated with a first point in the content;

receive a selection of the second application; and

change, based on the selection of the second application, the first subset of markers to the second subset of markers.

21. The apparatus of claim 20, wherein the instructions, when executed by the one or more processors, cause the apparatus to:

send, based on the timeline and in synchronization with the content, different supplemental content, wherein the different supplemental content and the content are associated with one another, and wherein the content is outputted on a display separate from the apparatus.

22. The apparatus of claim 20, wherein the first application comprises an interface for a selection of an option to share data through a plurality of social network services.

23. The apparatus of claim 20, wherein the instructions, when executed by the one or more processors, cause the apparatus to modify the first subset of markers to add the first marker by causing the apparatus to:

determine, based on a user input associated with a time point of the content, the first point along the timeline; and

send the first marker on the timeline at the first point along the timeline.