Method and system for displaying content relating to a subject matter of a displayed media program

• US 9,817,911 B2
• Filed: 05/10/2013
• Issued: 11/14/2017
• Est. Priority Date: 05/10/2013
• Status: Active Grant

• Current Assignee: Pinterest, Inc.
• Original Assignee: Excalibur IP, LLC (Acacia Research Corporation)
• Inventors: De Francisci Morales, Gianmarco, Blanco, Roi, Silvestri, Fabrizio
• Primary Examiner(s): Fan, Shiow-Jy
• Application Number:
  US13/891,854
• Publication Number:
  US 20140337308A1
• Time in Patent Office: 1,649 Days
• CPC Class Codes: G06F 16/958 Organisation or management of web site content, e.g. publishing, maintaining pages or automatic linking
• CPC Class Codes: H04N 21/23418 involving operations for analysing video streams, e.g. detecting features or characteristics television picture signal circuitry for scene change detection H04N5/147; filtering for image enhancement G06T5/00; methods or arrangements for recognising scenes G06V20/00; arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/2393 involving handling client requests scheduling or organising the servicing of application requests H04L67/60
• CPC Class Codes: H04N 21/2665 Gathering content from different sources, e.g. Internet and satellite
• CPC Class Codes: H04N 21/4622 Retrieving content or additional data from different sources, e.g. from a broadcast channel and the Internet web site content organization and management for information retrieval from the Internet G06F16/958; transmission by internet of broadcast information H04H60/82; stock exchange data over packet-switching network H04L12/1804; push services including data channel over packet-switching network H04L12/1859

Abstract

Disclosed is a system and method for analyzing, by a server computer, closed captioning text associated with a media program being experienced by a user having a client device. The server computer obtains, based on the analyzing, a subject matter of a portion of the media program from the closed captioning text. The server computer constructs a query associated with the determined subject matter and submits the query to a computer network as a search query. The server computer receives, in response to the submitting of the query, content relating to the subject matter and measures an elapsed time period between the receiving of the content and the obtaining of the subject matter. If the elapsed time period is less than a predetermined period of time, the server computer communicates, to the client device, information related to the content.

Claims

1. A method comprising:

determining, by a server computer, an identity of a media program being displayed on a display device at a first time, the identity determined based on an audio signal fingerprint associated with the media program;

retrieving, by the server computer, closed captioning text associated with the media program based on the identity of the media program;

determining, by the server computer, a subject matter of a portion of the media program from the closed captioning text;

constructing, by the server computer, a query associated with the determined subject matter;

submitting, by the server computer, the query to a computer network as a search query;

receiving, by the server computer in response to the submitting of the query, content relating to the subject matter at a second time;

measuring, by the server computer, an elapsed time period between the first time and the second time;

ranking, by the server computer, the content;

when the elapsed time period is less than a predetermined period of time, communicating, by the server computer to a client device separate from the display device, information related to the content; and

when the elapsed time period is less than the predetermined period of time, communicating, by the server computer, a first document in the content, the first document ranked above a predetermined threshold, to the client device.

2. The method of claim 1, wherein the communicating of the information further comprises communicating one or more of a link to the content, a web page, or the content.

3. The method of claim 1, wherein the obtaining of the subject matter further comprises identifying topics associated with the portion of the media program.

4. The method of claim 3, wherein the identifying of the topics further comprises determining a theme from segments of consecutive lines of text in the closed captioning text.

5. The method of claim 4, wherein the determining of the theme further comprises defining a theme based on a sliding window scheme, which is a windowed approach to build candidate segments.

6. The method of claim 4, wherein the constructing of the query further comprises constructing the query utilizing consecutive lines in the closed captioning text.

7. The method of claim 6, further comprising extracting entities from a plurality of documents by extracting terms from the closed captioning text that reflect the theme.

8. The method of claim 7, wherein the plurality of documents comprise news articles.

9. The method of claim 1, wherein the subject matter is a news story.

10. A computing device comprising:

a processor;

a storage medium for tangibly storing thereon program logic for execution by the processor, the program logic comprising;

determining logic executed by a processor for determining an identity of a media program being displayed on a display device at a first time, the identity determined based on an audio signal fingerprint associated with the media program;

retrieving logic executed by the processor for retrieving closed captioning text associated with the media program based on the identity of the media program;

determining logic executed by the processor for determining a subject matter of a portion of the media program from the closed captioning text;

constructing logic executed by the processor for constructing a query associated with the determined subject matter;

submitting logic executed by the processor for submitting the query to a computer network as a search query;

receiving logic executed by the processor for receiving, in response to the submitting of the query, content relating to the subject matter at a second time;

measuring logic executed by the processor for measuring an elapsed time period between the first time and the second time;

ranking logic executed by the processor for ranking the content;

first communicating logic executed by the processor for communicating, when the elapsed time period is less than a predetermined period of time, to a client device separate from the display device, information related to the content; and

second communicating logic executed by the processor for communicating, when the elapsed time period is less than a predetermined period of time, to the client device, a first document in the content, the first document ranked above a predetermined threshold, to the client device.

11. The computing device of claim 10, wherein the communicating logic for communicating the information further comprises communicating logic for communicating one or more of a link to the content, a web page, or the content.

12. The computing device of claim 10, wherein the obtaining logic for obtaining the subject matter further comprises identifying logic executed by the processor for identifying topics associated with the portion of the media program.

13. The computing device of claim 12, wherein the identifying logic for identifying the topics further comprises defining logic for defining a theme from segments of consecutive lines in the closed captioning text.

14. The computing device of claim 12, wherein the constructing logic for constructing the query further comprises constructing logic for constructing the query out of consecutive lines in the closed captioning text.

15. The computing device of claim 14, further comprising extracting logic executed by the processor for extracting entities from a plurality of documents by extracting terms from the closed captioning text that reflect the theme.

16. A non-transitory computer readable storage medium tangibly storing computer program instructions capable of being executed by a computer processor, the computer program instructions defining the steps of:

determining, by the computer processor, an identity of a media program being displayed on a display device at a first time, the identity determined based on an audio signal fingerprint associated with the media program;

retrieving, by the computer processor, closed captioning text associated with the media program based on the identity of the media program;

determining, by the computer processor, a subject matter of a portion of the media program from the closed captioning text;

constructing, by the computer processor, a query associated with the determined subject matter;

submitting, by the computer processor, the query to a computer network as a search query;

receiving, by the computer processor in response to the submitting of the query, content relating to the subject matter at a second time;

measuring, by the computer processor, an elapsed time period between the first time and the second time;

ranking, by the computer processor, the content;

when the elapsed time period is less than a predetermined period of time, communicating, by the computer processor to a client device separate from the display device, information related to the content; and

when the elapsed time period is less than the predetermined period of time, communicating, by the server computer, a first document in the content, the first document ranked above a predetermined threshold, to the client device.

17. The non-transitory computer readable storage medium of claim 16 wherein the communicating of the information further comprises communicating one or more of a link to the content, a web page, or the content.