Carrier-based active text enhancement

• US 10,477,283 B2
• Filed: 05/22/2015
• Issued: 11/12/2019
• Est. Priority Date: 05/22/2015
• Status: Active Grant

• Current Assignee: Dish Technologies LLC (Dish Network Corporation)
• Original Assignee: Dish Technologies LLC (Dish Network Corporation)
• Inventors: Landow, Kate Megan Carney
• Primary Examiner(s): Flynn, Randy A
• Application Number:
  US14/720,633
• Publication Number:
  US 20160345078A1
• Time in Patent Office: 1,635 Days
• CPC Class Codes: H04N 21/2353 specifically adapted to content descriptors, e.g. coding, compressing or processing of metadata
• CPC Class Codes: H04N 21/26283 for associating distribution time parameters to content, e.g. to generate electronic program guide data
• CPC Class Codes: H04N 21/432 Content retrieval operation from a local storage medium, e.g. hard-disk details of retrieval of video data and associated meta data in video databases G06F16/739
• CPC Class Codes: H04N 21/4347 Demultiplexing of several video streams
• CPC Class Codes: H04N 21/435 Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
• CPC Class Codes: H04N 21/44008 involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/6543 for forcing some client operations, e.g. recording remote booting in general G06F9/4416
• CPC Class Codes: H04N 21/812 involving advertisement data advertising per se G06Q30/02
• CPC Class Codes: H04N 21/8133 specifically related to the content, e.g. biography of the actors in a movie, detailed information about an article seen in a video program
• CPC Class Codes: H04N 21/85406 involving a specific file format, e.g. MP4 format
• CPC Class Codes: H04N 21/8545 for generating interactive applications
• CPC Class Codes: H04N 21/8547 involving timestamps for synchronizing content

Abstract

Auxiliary or enhanced features associated with broadcast television programs are activated using carrier-based active text enhancement (CATE) signals embedded within timed text (TT) associated with the broadcast program. The active text enhancements can be interpreted by the viewer'"'"'s set top box (STB) or other receiver to activate software applications, video clips, imagery, uniform resource locators (URLs), interactive interface features or the like on either or both of primary or secondary displays. Timed text enhancements can flexibly reference different types of content to provide richer and more powerful viewer experiences for the viewer.

Claims

1. A system to process auxiliary content associated with broadcast television programming for presentation of the broadcast television programming including the auxiliary content on a second screen device that is separate from the system but in communication with the system during time shifted playback of the broadcast television programming, the system comprising:

a television receiver interface configured to receive a live television broadcast comprising the broadcast television programming and the auxiliary content associated with the broadcast television programming, wherein the live television broadcast is received with timed text comprising a carrier-based active text enhancement signal that identifies the auxiliary content in the television broadcast and an upcoming time to present the auxiliary content;

a data storage configured to store the broadcast television programming as a recorded television program along with the auxiliary content associated with the broadcast television programming; and

a processor configured to provide a place shifted video stream of the stored broadcast television programming to the second screen device that includes the timed text comprising the carrier-based active text enhancement signal, wherein the second screen device is configured to receive the place shifted video stream, to interpret the timed text associated with the received broadcast television programming and to thereby recognize the carrier-based active text enhancement signal in the timed text that identifies the auxiliary content in the television broadcast, wherein the data associated with the auxiliary content is received by the system via the television receiver interface in the live television broadcast as a stream with the timed text prior to the time during the live television broadcast to present the auxiliary content and provided to the second screen device with the place shifted video stream, wherein the recorded television program is rendered for playback to the viewer by the second screen device at a time after the broadcast, and wherein the auxiliary content stored with the recorded television program is transferred from the system to the second screen device prior to the time to present the auxiliary content during the playback of the recorded television program, and wherein the second screen device detects the carrier based active text enhancement signal in the timed text and initiates processing of the data associated with the previously-received auxiliary content in response to the carrier-based active text enhancement signal in the timed text to render the auxiliary content in time synchronization with the presentation of the recorded television program by the second screen device.

2. The system of claim 1 wherein the stream is contained within an MPEG multiplex that is broadcast as part of the live broadcast television programming.

3. The system of claim 2 wherein the carrier-based active text enhancement signal specifies a presentation time stamp identifying a time during playback of the television broadcast that the previously received auxiliary content is active on the second screen device.

4. The system of claim 1 wherein the system further comprises a network interface to a network, and wherein at least some of the data associated with the auxiliary content is retrieved from a service on the network via the network interface and stored in the data storage prior to the time during the live broadcast to present the auxiliary content identified by the carrier-based active text enhancement signal that initiates the processing of the data.

5. The system of claim 2 wherein the system further comprises a network interface to a network, and wherein at least some of the data associated with the auxiliary content is retrieved from a service on the network via the network interface prior to the time during the live broadcast to present the auxiliary content in response to a uniform resource locator (URL) contained in the carrier-based active text enhancement signal that initiates the processing of the data.

6. The system of claim 1 wherein the auxiliary content comprises video content that is played by the second screen device in response to a viewer input, and wherein a prompt for the viewer input is presented in response to the carrier-based active text enhancement signal.

7. The system of claim 1 wherein the auxiliary content received with the television broadcast comprises a software application that is executed by the second screen device in response to a viewer input, and wherein a prompt for the viewer input is presented in response to the carrier-based active text enhancement signal.

8. The system of claim 1 wherein the timed text is formatted in accordance with a SMPTE timed text standard.

9. The system of claim 1 wherein the timed text is formatted in accordance with a W3C Timed Text Markup Language (TTML) standard.

10. The system of claim 1 wherein the timed text is formatted in accordance with a Web Video Text Tracks (WebVTT) standard.

11. A method performed by a television receiver device to provide enhanced time shifted content to a viewer of a live broadcast television program via a second screen device that is separate from the television receiver device, the method comprising:

receiving the live broadcast television programming by the television receiver device as a live television broadcast, wherein the received broadcast television programming is associated with a stream comprising timed text that comprises at least one text enhancement signal, the text enhancement signal identifying the enhanced content and an upcoming time during playback of the live television broadcast that the enhanced content will be active on the second screen device;

receiving the enhanced content at the television receiver device as part of the media stream that comprises the at least one carrier-based active text enhancement signal, wherein the enhanced content is received by the television receiver device as part of the live television broadcast prior to the time during the live television broadcast that the enhanced content is active;

storing the received live television broadcast including the enhanced content as a recorded television program in a digital video recorder by the television receiver device; and

during subsequent playback of the recorded television program from the recording stored in the digital video recorder, the television receiver device providing a place shifted video stream of the stored broadcast television programming to the second screen device that includes the timed text comprising the carrier-based active text enhancement signal, wherein the second screen device is configured to receive the place shifted video stream and the enhanced content received as part of the broadcast television program from the television receiver device prior to the upcoming time during playback of the recorded television program that the enhanced content will be active on the second screen device;

wherein the second screen device receives the place shifted video stream from the television receiver device and interprets the timed text during playback of the recorded television program to thereby identify the at least one carrier-based active text enhancement signal in the timed text, and wherein the second screen device responds to the at least one carrier-based active text enhancement signal in the timed text to provide the previously received and stored enhanced content to the viewer to thereby maintain time synchronization with the playback of the recorded television program.

12. The method of claim 11 wherein the receiving of the timed text is received by the television receiver as part of the live broadcast television programming.

13. The method of claim 12 wherein the enhanced content is received as part of the timed text.

14. The method of claim 11 wherein the enhanced content comprises motion video content that is received as part of the timed text received as part of the live broadcast television programming prior to the upcoming time that the enhanced content is active.

15. The method of claim 11 wherein at least some of the enhanced content is received via a server on a network.

16. The method of claim 15 wherein the at least one carrier-based active text enhancement signal comprises a uniform resource locator that identifies a location of the enhanced content on the network.

17. The method of claim 11 wherein the enhanced content is received via an out-of-band signal transmitted via the same medium as the live broadcast television programming.

18. The method of claim 11 wherein the enhanced content comprises video content that is played in response to a viewer input, and wherein a prompt for the viewer input is presented in response to the carrier-based active text enhancement signal.

19. The method of claim 11 wherein the enhanced content comprises a software application that is executed by the second screen device in response to a viewer input, and wherein a prompt for the viewer input is presented in response to the carrier-based active text enhancement signal.

20. The method of claim 11 further comprising the television receiver device establishing a data connection with the second screen device prior to the television receiver receiving the carrier-based text enhancement signal in the timed text, wherein the television receiver device transfers the enhanced content to the second screen device via the data connection, and wherein the television receiver device instructs the second screen device to provide the enhanced content by transmitting the instruction to the second screen device via the data connection at the time during playback of the live broadcast program that is indicated by the carrier-based active text enhancement signal.