Content Recognition and Synchronization on a Television or Consumer Electronics Device

• US 20110041154A1
• Filed: 08/14/2009
• Published: 02/17/2011
• Est. Priority Date: 08/14/2009
• Status: Abandoned Application

• Current Assignee: Rovi Technologies Corporation (Adeia Inc.)
• Original Assignee: All Media Guide LLC (Adeia Inc.)
• Inventors: Olson, Kenneth
• Application Number:
  US12/541,552
• Publication Number:
  US 20110041154A1
• Time in Patent Office: Days
• US Class Current: 725/54
• CPC Class Codes: G06F 16/7834 using audio features
• CPC Class Codes: H04H 2201/37 via a different channel
• CPC Class Codes: H04H 2201/50 characterised by the use of watermarks
• CPC Class Codes: H04H 2201/90 characterised by the use of signatures
• CPC Class Codes: H04H 60/58 of audio determination or detection of speech characteristics in general G10L25/00; speech recognition in general G10L15/00
• CPC Class Codes: H04H 60/64 for providing detail information
• CPC Class Codes: H04H 60/72 using electronic programme guides [EPG] focusing on identifying broadcast space time H04H60/39 ; menu type display of EPG in television receivers H04N21/47
• CPC Class Codes: H04H 60/73 using meta-information
• CPC Class Codes: H04N 21/4394 involving operations for analysing the audio stream, e.g. detecting features or characteristics in audio streams arrangements characterised by components specially adapted for monitoring, identification or recognition of audio in broadcast systems H04H60/58

Abstract

An audio portion of content, such as an audio stream, is associated with a multimedia program. A server receives an audio fingerprint and a program identifier from a network and associates the audio fingerprint with an audio identifier. A request packet including the program identifier is transmitted over the network to request program guide information associated with the program identifier. The program data including the program guide information is received from the network and metadata associated with the audio identifier and the program data are transmitted onto the network. A user device initiates a request for the metadata by using an audio fingerprint and the program identifier.

Claims

1. A system for associating an audio portion of received content with a multimedia program, the system comprising:

a server including a network interface to transmit and receive data over a network, the server operable to;

receive an audio fingerprint and a program identifier from the network,

associate the audio fingerprint with an audio identifier,

transmit a request packet including the program identifier over the network, the request packet requesting program guide information associated with the program identifier,

receive program data including the program guide information from the network, and

transmit metadata associated with the audio identifier and the program data onto the network.

2. The system according to claim 1, wherein the server is configured to generate a record corresponding to the program identifier including at least one audio identifier associated with the multimedia program and metadata associated with each audio identifier.

3. The system according to claim 2, wherein the metadata includes a metric associated with each audio identifier.

4. The system according to claim 1, further comprising:

a user device including;

an input interface operable to receive the received content from at least one source, the received content containing an audio portion, a video portion and program guide data, the program guide data including the program identifier; and

a processor operable to generate an audio fingerprint from a subset of the audio portion, communicate the program identifier and the audio fingerprint onto a network, and receive metadata associated with the audio identifier and the program data from the network through the network interface.

5. The system according to claim 4, wherein the user device further includes a remote interface operable to receive from a remote control a command to initiate a lookup for metadata.

6. The system according to claim 4, wherein the user device further includes:

a memory operable to store the subset of the audio portion, wherein the processor generates another audio fingerprint based on at least one of;

an additional subset of the audio portion and

combined subsets of the audio portion.

7. The system according to claim 4, wherein the processor is further configured to detect a time-based offset location of the received content corresponding to the audio fingerprint and transmit the location onto the network.

8. A method for associating an audio portion of received content with a multimedia program, the method comprising:

receiving an audio fingerprint and a program identifier from a network;

associating the audio fingerprint with an audio identifier;

transmitting a request packet including the program identifier over the network, the request packet requesting program guide information associated with the program identifier;

receiving program data including the program guide information from the network; and

transmitting metadata associated with the audio identifier and the program data onto the network.

9. The method according to claim 8, further comprising:

generating a record corresponding to the program identifier including at least one audio identifier associated with the multimedia program and metadata associated with each audio identifier.

10. The method according to claim 9, wherein the metadata includes a metric associated with each audio identifier.

11. The method of claim 8, further comprising:

receiving the received content, from at least one source, the received content containing an audio portion, a video portion and program guide data, the program guide data including the program identifier;

generating an audio fingerprint from a subset of the audio portion of the received content;

communicating the program identifier and the audio fingerprint onto a network; and

receiving the metadata associated with the audio identifier and the program data from the network through a network interface,

wherein the above steps are performed by a user device including at least one processor.

12. The method according to claim 11, further comprising:

receiving, from a remote control, a command to initiate a lookup for the metadata.

13. The method according to claim 11, further comprising:

storing the subset of the audio portion of the received content; and

generating another audio fingerprint based on at least one of;

an additional subset of the audio portion and

combined subsets of the audio portion of the received content.

14. The method according to claim 11, further comprising:

detecting a time-based offset location of the received content corresponding to the audio fingerprint; and

transmitting the location onto the network.

15. A computer-readable medium having stored thereon sequences of instructions, the sequences of instructions including instructions which when executed by a computer system causes the computer system to perform:

receiving an audio fingerprint and a program identifier from a network;

associating the audio fingerprint with an audio identifier;

transmitting a request packet including the program identifier over the network, the request packet requesting program guide information associated with the program identifier;

receiving program data including the program guide information from the network; and

transmitting metadata associated with the audio identifier and the program data onto the network.

16. The computer-readable medium according to claim 15, further having stored thereon a sequence of instructions which when executed by the computer system causes the computer system to perform:

generating a record corresponding to the program identifier including at least one audio identifier associated with the multimedia program and metadata associated with each audio identifier.

17. The computer-readable medium of claim 16, wherein the metadata includes a metric associated with each audio identifier.

18. The computer-readable medium of claim 15, further having stored thereon a sequence of instructions which when executed by the computer system causes the computer system to perform:

receiving content, from at least one source, the received content containing an audio portion, a video portion, and program guide data, the program guide data including the program identifier;

generating an audio fingerprint from a subset of the audio portion of the received content;

communicating the program identifier and the audio fingerprint onto a network; and

receiving the metadata associated with the audio identifier and the program data from the network through a network interface,

wherein the above steps are performed by a user device including at least one processor.

19. The computer-readable medium of claim 18, further having stored thereon a sequence of instructions which when executed by the computer system causes the computer system to perform:

storing the subset of the audio portion; and

generating another audio fingerprint based on at least one of;

an additional subset of the audio portion and

combined subsets of the audio portion of the received content.

20. The computer-readable medium of claim 18, further having stored thereon a sequence of instructions which when executed by the computer system causes the computer system to perform:

detecting a time-based offset location of the received content corresponding to the audio fingerprint; and

transmitting the location onto the network.