Methods and Systems for Identifying Content in Data Stream by a Client Device

• US 20120191231A1
• Filed: 02/14/2012
• Published: 07/26/2012
• Est. Priority Date: 05/04/2010
• Status: Abandoned Application

• Current Assignee: Apple Inc.
• Original Assignee: Shazam Entertainment Limited (Apple Inc.)
• Inventors: Wang, Avery Li-Chun
• Application Number:
  US13/396,390
• Publication Number:
  US 20120191231A1
• Time in Patent Office: Days
• US Class Current: 700/94
• CPC Class Codes: G06F 16/632 Query formulation
• CPC Class Codes: G06F 16/683 using metadata automatically derived from the content
• CPC Class Codes: G06F 16/7834 using audio features
• CPC Class Codes: G11B 27/28 by using information signals recorded by the same method as the main recording G11B27/22 takes precedence
• CPC Class Codes: H04H 2201/90 characterised by the use of signatures
• CPC Class Codes: H04H 60/37 for identifying segments of broadcast information, e.g. scenes or extracting programme ID

Abstract

Methods and systems for identifying content in a data stream by a client device are provided. The methods may include receiving at the client device a signature file that is indicative of one or more features extracted from media content and information identifying the media content. The method may also include based on a comparison with the signature file, the client device performing a content identification of received media content rendered by a media rendering source. The client device may receive a set of signature files based on any number of factors including a physical location of the client device, a network address of the client device, a previous content recognition request of the client device, a genre preference, an artist preference, and a user profile.

Claims

1. A method comprising:

receiving at a client device a signature file, wherein the signature file is indicative of one or more features extracted from media content and information identifying the media content; and

based on a comparison with the signature file, the client device performing a content identification of received media content rendered by a media rendering source.

2. The method of claim 1, wherein the signature file includes a temporally mapped collection of the one or more features extracted the media content, wherein each of the one or more features describes the media content in a vicinity of a mapped timepoint.

3. The method of claim 1, wherein the one or more features extracted from the media content correspond to peak values in a spectrogram of the media content where corresponding energy values are local maximums, and the signature file includes pairs of the peak values and corresponding time locations.

4. The method of claim 1, wherein the one or more features extracted from the media content correspond to spectrogram bitmap rasters in a spectrogram of the media content.

5. The method of claim 1, wherein the peak values in the spectrogram of the media content correspond to be between about 10 to about 50 peak values per second.

6. The method of claim 1, further comprising receiving at the client device a set of signature files corresponding to a plurality of media content, wherein the plurality of media content is based on a physical location of the client device.

7. The method of claim 1, further comprising receiving at the client device a set of signature files corresponding to a plurality of media content, wherein the plurality of media content is based on a network address of the client device.

8. The method of claim 1, further comprising receiving at the client device a set of signature files corresponding to a plurality of media content, wherein the plurality of media content is based on factors selected from the group consisting of a previous content recognition request of the client device, a genre preference, an artist preference, and a user profile.

9. The method of claim 1, further comprising receiving at the client device a set of signature files corresponding to a plurality of media content, wherein the plurality of media content is based on a statistical ranking of popular media content.

10. The method of claim 1, further comprising the client device receiving the media content rendered by the media rendering source using a microphone.

11. The method of claim 1, further comprising the client device receiving the media content rendered by the media rendering source on a continuous basis.

12. The method of claim 1, wherein the client device performing the content identification of the received media content rendered by the media rendering source comprises:

determining one or more features of the received media content; and

comparing the one or more features of the received media content with the one or more features extracted from media content as indicated by the signature file to determine a match of one or more features.

13. The method of claim 12, wherein determining the one or more features of the received media content comprises determining a set of fingerprints of the received media content, each fingerprint associated with a landmark within the received media content.

14. The method of claim 1, wherein receiving at the client device the signature file comprises receiving the signature file from a server.

15. The method of claim 14, wherein the client device includes a database storing a plurality of signature files, wherein the signature file is one of the plurality of signature files, and where the method further comprises receiving from the server at the client device an update to the database, wherein the update includes one or more new signature files to incorporate into the database or an instruction to remove one or more existing signature files from the database.

16. The method of claim 1, wherein receiving at the client device the signature file comprises:

receiving at the client device the media content; and

processing, by the client device, the media content to generate the signature file for the media content.

17. A non-transitory computer readable medium having stored therein instructions executable by a client device to cause the client device to perform functions comprising:

receiving at the client device a signature file, wherein the signature file is indicative of one or more features extracted from media content and information identifying the media content; and

based on a comparison with the signature file, the client device performing a content identification of received media content rendered by a media rendering source.

18. The non-transitory computer readable medium of claim 17, wherein the instructions are further executable by the client device to cause the client device to perform functions comprising:

determining a set of fingerprints of the received media content, each fingerprint associated with a landmark within the received media content; and

comparing the set of fingerprint of the received media content with the one or more features extracted from media content as indicated by the signature file to determine a match of one or more features.

19. A client device comprising:

a database configured to receive and incorporate a signature file, wherein the signature file is indicative of one or more features extracted from media content and information identifying the media content; and

a content identification module coupled to the database and configured to perform a content identification of received media content rendered by a media rendering source based on a comparison with the signature file.

20. The client device of claim 19, wherein the database is further configured to receive a set of signature files corresponding to a plurality of media content, wherein the plurality of media content is based on one or more of a type of the client device or a configuration of the client device, wherein the type of the client device or the configuration of the client device is indicative of a given location or a given service provider of the client device.

21. The client device of claim 19, further comprising a microphone configured to receive the media content rendered by the media rendering source.

22. A method comprising:

determining, by a server, a set of signature files from a database of signature files for a client device, wherein each signature file is indicative of one or more features extracted from a respective media content and information associated with the respective media content; and

providing the set of signature files to the client device.

23. The method of claim 22, wherein the information identifying the respective media content includes one or more of a title of a song, an artist of the song, and a genre of a song.

24. The method of claim 22, wherein each signature file includes a fingerprint of the respective media content associated with a landmark within the respective media content.

25. The method of claim 22, wherein providing the set of signature files to the client device comprises:

the server identifying a communication interface to the client device; and

determining that the communication interface includes a sufficient amount of bandwidth for transfer of the set of signature files.

26. The method of claim 25, wherein determining that the communication interface includes the sufficient amount of bandwidth for transfer of the set of signature files comprises determining that the communication interface is made via a local wireless broadband connection (WiFi).

27. The method of claim 25, wherein providing the set of signature files to the client device comprises:

the server identifying a communication interface to the client device;

determining that the communication interface is made via a cellular wireless network provided by a cellular wireless provider; and

providing the set of signature files to the client device upon a determination that the communication interface is made via a local wireless broadband connection.

28. The method of claim 22, wherein the respective media content includes a song, and the method further comprising:

the server ranking signature files in a database according to a listing of purchased songs associated with the user profile and provided by a digital media service provider; and

determining the set of signature files to the client device based on the ranking

29. The method of claim 22, wherein determining the set of signature files for the client device comprises determining signature files to include in the set of signature files based on a location of the client device.

30. The method of claim 22, wherein determining the set of signature files for the client device comprises determining signature files to include in the set of signature files based on previous content identification requests received at the server and requested by the client device.

31. The method of claim 22, wherein determining the set of signature files for the client device comprises determining signature files to include in the set of signature files based on media content stored on the client device.

32. The method of claim 22, wherein determining the set of signature files for the client device comprises determining signature files to include in the set of signature files based on one or more of a genre preference, an artist preference, and a date of origination of the respective media content.

33. The method of claim 22, wherein determining the set of signature files for the client device comprises determining a plurality of signature files based on a predetermined storage limit for the set of signature files at the client device.

34. The method of claim 22, further comprising providing with the set of signature files a set of advertisements related to the respective media content.

35. The method of claim 22, wherein determining the set of signature files from the database of signature files for the client device comprises determining signature files to include in the set of signature files based on a statistical profile indicating a popularity of pieces of media content.

36. The method of claim 22, wherein determining the set of signature files from the database of signature files for the client device comprises determining signature files to include in the set of signature files based on a statistical profile pertaining to a history of content identification requests requested at the server.

37. The method of claim 22, further comprising:

the server receiving a plurality of content identification requests, wherein the content identification requests each include a sample of the content;

the server ranking signature files in a database based on a frequency of media content, to which the signature files correspond, has been a subject of the plurality of content identification requests; and

providing the set of signature files to the client device based on the ranking

38. A non-transitory computer readable medium having stored therein instructions executable by a computing device to cause the computing device to perform functions comprising:

determining, by the computing device, a set of signature files from a database of signature files for a client device, wherein each signature file is indicative of one or more features extracted from a respective media content and information associated with the respective media content; and

providing the set of signature files to the client device.

39. The non-transitory computer readable medium of claim 38, wherein each signature file includes a fingerprint of the respective media content associated with a landmark within the respective media content.

40. The non-transitory computer readable medium of claim 38, wherein the instructions are further executable by the computing device to cause the computing device to perform functions comprising determining signature files to include in the set of signature files based on a statistical profile pertaining to a history of content identification requests requested at the computing device.

41. A server comprising:

a database configured to store signature files, wherein each signature file is indicative of one or more features extracted from a respective media content and information associated with the respective media content; and

a content identification module coupled to the database and configured to determine a set of signature files from the stored signature files for a client device, and to provide the set of signature files to the client device to enable the client device to perform a content identification of received media content.

42. The server of claim 41, wherein the content identification module is further configured to determine the set of signature files from the database of signature files for the client device based on a statistical profile pertaining to a history of content identification requests of media content received at the server.