Method for high-throughput identification of distributed broadcast content

• US 7,881,657 B2
• Filed: 10/03/2007
• Issued: 02/01/2011
• Est. Priority Date: 10/03/2006
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Shazam Entertainment Limited (Apple Inc.)
• Inventors: Wang, Avery Li Chun, Symons, Jonathan, Wong, Chee
• Primary Examiner(s): SHARMA, SUJATHA R
• Application Number:
  US11/866,814
• Publication Number:
  US 20080082510A1
• Time in Patent Office: 1,217 Days
• Field of Search: 455/3.01, 455/3.02, 455/3.03, 455/3.06, 455/427, 455/404.2, 455/412.1, 455/414.2, 455/12.1, 709/224, 709/219, 709/217, 709/94, 709/229, 709/231, 709/203, 725/14, 725/18, 725/9, 725/35
• US Class Current: 455/3.02
• CPC Class Codes: G06F 16/683 using metadata automatically derived from the content
• CPC Class Codes: H04H 2201/30 characterised by the use of a return channel, e.g. for collecting users' opinions, for returning broadcast space/time information or for requesting data
• CPC Class Codes: H04H 60/37 for identifying segments of broadcast information, e.g. scenes or extracting programme ID
• CPC Class Codes: H04H 60/40 for identifying broadcast time
• CPC Class Codes: H04H 60/42 for identifying broadcast areas
• CPC Class Codes: H04H 60/58 of audio determination or detection of speech characteristics in general G10L25/00; speech recognition in general G10L15/00
• CPC Class Codes: H04H 60/74 using programme related information, e.g. title, composer or interpreter
• CPC Class Codes: H04N 21/44 Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs

Abstract

A method and system of performing high-throughput identifications of broadcast content is provided. A device can send a content identification query, which includes a sample of content being broadcast, to a server to request an identity of the content. The server will perform a computational identification of the content, return the result to the device, and store the result. For all subsequently received content identification queries requesting an identity of content being broadcast from the same source and in a time during which the content is still being broadcast from the source, the server will send the stored content identification in response to the subsequent queries. If a subsequent content identification query does not request the identity of content being broadcast from the same source or is not received during the time that the content is still being broadcast, the server will perform a computational identification of a content sample.

Claims

1. A method of identifying content within a data stream comprising:

receiving a content identification query from a client device, the content identification query requesting an identity of content that was broadcast from a broadcast source;

if content from the broadcast source has previously been identified and if the content identification query has been received at a time during which the content is still being broadcast from the source, sending the previous identification of the content to the client device; and

if not, (i) performing a content identification using a sample of the content broadcast from the broadcast source, and (ii) storing the content identification.

2. The method of claim 1, further comprising determining if content from the broadcast source has previously been identified by:

accessing a cache including a listing of content identifications, each of which is associated with a given broadcast source; and

matching the broadcast source of the content to one of the given broadcast sources in the listing.

3. The method of claim 2, further comprising determining if the content identification query has been received at a time during which the content is still being broadcast from the source by:

determining a length of the content;

determining a relative time offset (RTO) of the content from a beginning of the content;

calculating a time at which the content will not be broadcast from the source using the length of the content and the RTO of the content; and

comparing a receipt time of the content identification query with the time at which the content will not be broadcast from the source.

4. The method of claim 1, further comprising determining an identity of the broadcast source by receiving an indication of a broadcast frequency.

5. The method of claim 4, further comprising:

receiving information pertaining to a location of the client device; and

identifying a broadcast station having the broadcast frequency and that broadcasts within a coverage area including the location of the client device.

6. The method of claim 5, further comprising determining coverage areas of broadcast stations by:

receiving content identification queries from client devices requesting an identity of content that was broadcast from a broadcast source, each content identification query including a sample of the content, a broadcast frequency of the broadcast source, and information pertaining to a location of the client devices;

making an identification of the samples of the content;

determining a time interval of validity of the identification of the samples of the content, wherein the time interval of validity indicates a time during which the identification of the sample will be valid as being broadcast from the broadcast source;

for content identification queries received (i) including the same broadcast frequency, (ii) having a temporal overlapping time interval of validity, and (iii) for which the identification of the sample of the content matches, associating locations of the client devices within the content identification queries to be within a coverage area of a broadcast source that broadcasts using the broadcast frequency; and

estimating a coverage area for the broadcast source using the associated locations.

7. The method of claim 1, further comprising:

determining when the content will stop being broadcast from the source; and

sending information indicating when the content will stop being broadcast from the source to the client device.

8. The method of claim 7, further comprising receiving a second content identification query from the client device after the content has stopped being broadcast from the source.

9. The method of claim 1, further comprising after the content has stopped being broadcast from the source, sending information pertaining to content subsequently broadcast from the source to the client device without receiving the content identification query.

10. A method of identifying content within a data stream comprising:

receiving a content identification query from a client device, the content identification query requesting an identity of content being broadcast from a broadcast source and including information pertaining to the broadcast source of the content;

accessing a cache including a listing of content identifications that were each generated using a content sample, the listing including information pertaining to identity of content broadcast from a plurality of broadcast sources and each item in the listing including (i) an identity of given content, (ii) an identity of a given broadcast source that broadcast the given content, and (iii) an indication of when the content identification is valid;

matching the broadcast source of the content to a broadcast source of one of the content samples from which any of the content identifications were generated; and

if the content identification query was received during a time in which the content identification in the listing pertaining to the one of the content samples is still valid, sending the content identification in the listing pertaining to the one of the content samples to the client device in response to the content identification query.

11. The method of claim 10, further comprising if the content identification query was not received during a time in which the content identification in the listing pertaining to the one of the content samples is still valid, performing a computational content identification to determine the identity of the content using a recording of a sample of the content broadcast from the broadcast source.

12. The method of claim 10, further comprising sending information indicating when the content identification will no longer be valid to the client device.

13. The method of claim 12, further comprising receiving a second content identification query from the client device after the content identification is no longer valid requesting an identity of subsequent content being broadcast from the source.

14. The method of claim 10, further comprising determining an identity of the broadcast source from the information received in the content identification query by receiving an indication of a broadcast frequency.

15. The method of claim 14, further comprising:

receiving information pertaining to a location of the client device; and

identifying a broadcast station having the broadcast frequency and that broadcasts within a coverage area including the location of the client device.

16. A computer readable medium having stored therein instructions for causing a central processing unit to execute the method of claim 10.

17. A method of identifying content within a data stream comprising:

receiving a first content identification query from a first client device, the first content identification query including a recording of a sample of content being broadcast from a first source;

making a content identification using the sample of the content;

determining a time during which the content will be broadcast from the first source;

storing the content identification, the time, and information pertaining to the first source of the content in a cache;

receiving a second content identification query from a second client device, the second content identification query requesting an identity of content being broadcast from a second source and including information pertaining to the second source of the content; and

if the first source and the second source are the same and if the time has not expired, (i) sending the content identification made in response to the first content identification query to the second client device in response to the second content identification query, and if not, (ii) making a second content identification using a sample of the content being broadcast from the second source and storing the second content identification in the cache.

18. The method of claim 17, further comprising determining an identity of the first source by receiving an indication of a broadcast frequency of the first source.

19. The method of claim 18, wherein determining the identity of the first source further comprises:

receiving information pertaining to a location of the first client device; and

identifying a broadcast station having the broadcast frequency of the first source and that broadcasts within a coverage area including the location of the first client device.

20. The method of claim 17, further comprising removing the stored content identification, time and information pertaining to the first source of the content from the cache after expiration of the time.

21. The method of claim 17, further comprising, for all content identification queries from client devices received after the first content identification query, at a time during which the content will be broadcast from the first source, and pertaining to the same broadcast source, sending the content identification made in response to the first content identification query in response to the client devices.

22. A method of identifying content within a data stream being broadcast from broadcast sources and determining coverage areas of the broadcast sources comprising:

receiving content identification queries from client devices requesting an identity of content that was broadcast from a broadcast source, each content identification query including a sample of the content, a broadcast frequency of the broadcast source, and information pertaining to a location of the client devices;

making an identification of the samples of the content;

determining a time interval of validity of the identification of the samples of the content, wherein the time interval of validity indicates a time during which the identification of the sample will be valid as being broadcast from the broadcast source;

for content identification queries received (i) including the same broadcast frequency, (ii) having a temporal overlapping time interval of validity, and (iii) for which the identification of the sample of the content matches, associating locations of the client devices within the content identification queries to be within a coverage area of a given broadcast source that broadcasts using the broadcast frequency; and

estimating a coverage area for the given broadcast source using the associated locations.

23. The method of claim 22, wherein, if content from the broadcast source has previously been identified and if the content identification query has been received during the time interval of validity of the identification, sending the previous identification of the content to the client device.

24. The method of claim 22, further comprising determining the locations of the client devices using information within an IP address of the client devices.