Presenting information relating to a program by recognizing text in closed captioning data

• US 6,141,678 A
• Filed: 04/29/1998
• Issued: 10/31/2000
• Est. Priority Date: 04/29/1998
• Status: Expired due to Term

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: WebTV Networks Inc. (Microsoft Corporation)
• Inventors: Britt, Joe F. Jr.
• Primary Examiner(s): Lim, Krisna
• Application Number:
  US09/069,322
• Time in Patent Office: 916 Days
• Field of Search: 709/200, 709/203, 348/6, 348/8, 348/13, 346/6, 345/327
• US Class Current: 709/200
• CPC Class Codes: H04N 21/4622 Retrieving content or additional data from different sources, e.g. from a broadcast channel and the Internet web site content organization and management for information retrieval from the Internet G06F16/958; transmission by internet of broadcast information H04H60/82; stock exchange data over packet-switching network H04L12/1804; push services including data channel over packet-switching network H04L12/1859
• CPC Class Codes: H04N 21/478 Supplemental services, e.g. displaying phone caller identification, shopping application
• CPC Class Codes: H04N 7/0885 for the transmission of subtitles

Abstract

Presenting to a viewer additional information corresponding to a television program by recognizing key text data included in closed captioning is disclosed. A client computer that is capable of displaying television programming to a viewer and retrieving information from the Internet or from another network receives broadcast data including a program and closed captioning data. The client computer accesses a list of key text data having entries, each of which includes key text that is included in the closed captioning data of a particular program and that is distinctive to the program. The entries in the list of key text data further include instructions enabling the client computer to retrieve the additional information corresponding to the programs. The client computer decodes the closed captioning data and compares it to the key text data entries. When a match is identified, the client computer system executes the instructions included in the entry that has been matched. The instructions typically result in a viewer-selectable link being displayed on the display device. When the viewer selects the link, the client computer retrieves the additional information from a remote server computer and displays the additional information to the viewer.

Claims

1. In a client computer system that is capable of both communicating with at least one server computer system and receiving broadcast data from a broadcast data source, a method of analyzing the broadcast data to present to a viewer additional information relating to a program included in the broadcast data, the method comprising:

receiving broadcast data that includes closed captioning data and a program;

decoding the closed captioning data;

accessing a list of key text data including key text data entries that reference additional data corresponding to programs based on closed captioning data associated with the programs;

comparing text included in the decoded closed captioning data with the list of key text data and determining that the text matches a particular key text data entry; and

based on the determination that the text matches the particular key text data entry, presenting to the viewer additional information that is referenced by the particular key text data entry and that corresponds to the program included in the received broadcast data.

2. The method of claim 1, wherein decoding the closed captioning data comprises decoding a twenty-first line in a vertical blanking interval in the broadcast data.

3. The method of claim 1, wherein comparing text included in the closed captioning data comprises sending the closed captioning data through a text analyzer that recognizes the key text data of the particular key text data entry.

4. The method of claim 1, wherein accessing the list of key text data comprises the step of receiving the list of key text data from a remote computer system.

5. The method of claim 4, further comprising the step of programming a text analyzer at the client computer system to recognize the key text data of the particular key text data entry.

6. The method of claim 1, wherein presenting to the viewer additional information comprises the step of generating a user-selectable interface that is selectable to retrieve said additional information from one of the at least one server computer system.

7. A computer-readable medium having stored thereon sequences of instructions that, when executed by a processor of a client computer system, cause the processor to perform a method of analyzing broadcast data to present to a viewer additional information relating to a program included in the broadcast data, the method comprising the steps of:

decoding closed captioning data from broadcast data that has been received at the client computer system and includes the closed captioning data and a program;

accessing a list of key text data including key text data entries that reference additional data corresponding to programs based on closed captioning data associated with the programs;

comparing text included in the decoded closed captioning data with the list of key text data and determining that the text matches a particular data matches key text data entry; and

based on the determination that the text matches the particular key text data entry, presenting to the viewer additional information that is referenced by the particular key text data entry and that corresponds to the program included in the received broadcast data.

8. The computer-readable medium of claim 7, wherein decoding the closed captioning data comprises decoding a twenty-first line in a vertical blanking interval in the broadcast data.

9. The computer-readable medium of claim 7, wherein decoding the closed captioning data comprises accessing a video decoder of the client computer system.

10. The computer-readable medium of claim 7, wherein comparing text included in the closed captioning data comprises sending the closed captioning data through a text analyzer that recognizes the key text data of the particular key text data entry.

11. The computer-readable medium of claim 7, wherein accessing the list of key text data comprises the step of receiving the list of key text data from a remote computer system.

12. The computer-readable medium of claim 7, wherein the method further comprises the step of programming a text analyzer to recognize the key text data of the particular key text data entry.

13. The computer-readable medium of claim 7, wherein presenting to the view additional information comprises the step of generating a user-selectable interface that is selectable to retrieve said additional information from a server computer system.

14. In a client computer system that is capable of both communicating with at least one server computer system and receiving broadcast data from a broadcast data source, a method of analyzing the broadcast data to present to a viewer additional information relating to a program included in the broadcast data, the method comprising:

accessing a list of key text data having at least one key text data entry, wherein each key text data entry;

identifies a program included in broadcast data based on closed captioning data that is transmitted simultaneously in the broadcast data with the program; and

references instructions that, when executed by the client computer system, enable a viewer to obtain to additional information corresponding to the program identified by the key text data entry;

receiving broadcast data that includes closed captioning data and a program;

decoding the closed captioning data;

comparing text included in the decoded closed captioning data with the list of key text data and determining that the text matches a particular key text data entry; and

executing the instructions referenced by the particular key text data entry and, upon executing the instructions, presenting to the viewer a link that, when selected by the viewer. causes the additional information corresponding to the program to be retrieved from one of said at least one server computer system.

15. The method of claim 14, wherein decoding the closed captioning data comprises decoding a twenty-first line in a vertical blanking interval the broadcast data.

16. The method of claim 14, wherein the step of accessing the list of key text data comprises the step of receiving the list of key text data from a remote data center that is connected with the client computer system.

17. The method of claim 14, wherein the step of accessing the list of key text data comprises retrieving the list of key text data from a data storage device included in the client computer system.

18. The method of claim 14, wherein the program included in the broadcast data is an advertisement, and wherein the additional information comprises information relating to an advertiser associated with the advertisement.

19. The method of claim 14, wherein the additional information is retrieved from an HTML file at said one server computer system.