System and method for synchronizing enhancing content with a video program using closed captioning

• US 20040040042A1
• Filed: 08/25/2003
• Published: 02/26/2004
• Est. Priority Date: 01/06/1997
• Status: Abandoned Application

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Feinleib, David
• Application Number:
  US10/647,549
• Publication Number:
  US 20040040042A1
• Time in Patent Office: Days
• US Class Current: 725/112
• CPC Class Codes: G06F 16/40 of multimedia data, e.g. slideshows comprising image and additional audio data retrieval of still image data G06F16/50; retrieval of audio data G06F16/60; retrieval of video data G06F16/70
• CPC Class Codes: H04N 21/4143 embedded in a Personal Computer [PC]
• CPC Class Codes: H04N 21/4348 Demultiplexing of additional data and video streams
• CPC Class Codes: H04N 21/435 Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
• CPC Class Codes: H04N 21/4622 Retrieving content or additional data from different sources, e.g. from a broadcast channel and the Internet web site content organization and management for information retrieval from the Internet G06F16/958; transmission by internet of broadcast information H04H60/82; stock exchange data over packet-switching network H04L12/1804; push services including data channel over packet-switching network H04L12/1859
• CPC Class Codes: H04N 21/4782 Web browsing , e.g. WebTV
• CPC Class Codes: H04N 21/4884 for displaying subtitles
• CPC Class Codes: H04N 21/8586 by using a URL processing chained hypermedia data for information retrieval G06F16/94; information retrieval from the Internet by using URLs G06F16/955; URL in broadcast information H04H20/93; Web-based protocols H04L67/02
• CPC Class Codes: H04N 5/445 for displaying additional information H04N5/50 takes precedence
• CPC Class Codes: H04N 7/0885 for the transmission of subtitles
• CPC Class Codes: H04N 7/0887 for the transmission of programme or channel identifying signals
• CPC Class Codes: H04N 7/173 with two-way working, e.g. subscriber sending a programme selection signal

Abstract

A system and method uses a closed captioning script to synchronize supplemental data with specified junctures in a video program. A parser parses the closed captioning script to identify a set of unique key phrases. A producer associates the supplemental data with the key phrases of the closed captioning script that correspond to the desired points in the program. When the program is played, a viewer computing unit monitors the closed captioning script to detect the key phrases. Upon detection of a particular key phrase, the viewer computing unit retrieves the supplemental data associated with the particular key phrase. The supplemental data is multicast to a multicast address. A listener listens to the multicast address to receive and handle any enhancement action supported by the supplemental data. The listener can be embedded in a container, such as an HTML page or other hypermedia document.

Claims

1. For use with a viewer computing unit having a processor, a program enhancement listener implemented as computer-executable instructions stored on a computer-readable medium and executable on the processor to direct the viewer computing unit to:

receive supplemental data sent to a multicast address; and

initiate an enhancement action based upon the supplemental data to enhance a video program as the video program is being played.

2. A program enhancement listener as recited in claim 1, wherein the enhancement action comprises activation of a hyperlink.

3. A program enhancement listener as recited in claim 1, wherein the enhancement action comprises launching executable code.

4. A program enhancement listener as recited in claim 1, wherein the supplemental data is associated with at least one key phrase of a closed captioning script of the video program.

5. A program enhancement listener as recited in claim 1, further comprising computer-executable instructions to direct the viewer computing unit to display the supplemental data concurrently with the primary content.

6. A program enhancement listener as recited in claim 1, further comprising computer-executable instructions to direct the viewer computing unit to:

present the video program within a hypermedia document; and

controlling placement of the video program within the hypermedia document using the supplemental data.

7. For use with a viewer computing unit having a processor and a display, a hypermedia document stored on computer-readable medium and executable on the processor for graphical rendering on the display, the hypermedia document containing the program enhancement listener as recited in claim 1.

8. A method comprising:

receiving supplemental data sent to a multicast address; and

initiating an enhancement action based upon the supplemental data to enhance a video program as the video program is being played.

9. A method as recited in claim 8, further comprising associating the supplemental data with at least one key phrase of a closed captioning script of the video program.

10. A method as recited in claim 8, wherein the supplemental data comprises a hyperlink to a target resource, and the initiating comprises activating the hyperlink to the target resource.

11. A method as recited in claim 8, wherein the supplemental data 2comprises executable code, and the initiating comprises launching the executable code.

12. A method as recited in claim 8, further comprising displaying the supplemental data concurrently with the primary content.

13. A method as recited in claim 8, further comprising:

presenting the video program within a hypermedia document; and

controlling placement of the video program within the hypermedia document using the supplemental data.

14. A computer programmed to perform the method as recited in claim 8.

15. A computer-readable media having computer-executable instructions for performing the steps of the method as recited in claim 8.

16. A system comprising:

means for listening to a multicast address for supplemental data; and

means for initiating an enhancement action based upon the supplemental data to enhance a video program as the video program is being played.

17. A system comprising as recited in claim 16, wherein the supplemental data comprises a hyperlink to a target resource, and the initiating means activates the hyperlink to the target resource.

18. A system comprising as recited in claim 16, wherein the supplemental data comprises executable code, and the initiating means launches the executable code.

19. A system comprising as recited in claim 16, further comprising means for displaying the supplemental data concurrently with the primary content.

20. A system comprising as recited in claim 16, further comprising:

means for presenting the video program within a hypermedia document; and

means for controlling placement of the video program within the hypermedia document using the supplemental data.

21. A viewing unit comprising:

a key phrase module to identify one or more key phrases from the closed captioning script and to associate supplemental data to the one or more key phrases identified from the closed captioning script;

the key phrase module multicasting the enhancement action to a multicast address;

a program enhancement listener to listen to the multicast address for the enhancement action and to initiate an enhancement action based upon the supplemental data to enhance a video program as the video program is being played.

22. A viewer unit as recited in claim 21, wherein the program enhancement listener comprises a control embedded in a container.

23. A viewer unit as recited in claim 21, wherein the program enhancement listener comprises a control embedded in an HTML page.

24. A viewer unit as recited in claim 21, wherein the program enhancement listener comprises a control embedded in an application.