Multiple step identification of recordings

• US 8,468,357 B2
• Filed: 03/09/2010
• Issued: 06/18/2013
• Est. Priority Date: 07/31/2001
• Status: Active Grant

• Current Assignee: Gracenote, Inc. (RR Donnelley & Sons Company)
• Original Assignee: Gracenote, Inc. (RR Donnelley & Sons Company)
• Inventors: Roberts, Dale T., Hyman, David C., White, Stephen Helling
• Primary Examiner(s): Kyle, Tamara T
• Application Number:
  US12/720,537
• Publication Number:
  US 20100158488A1
• Time in Patent Office: 1,197 Days
• Field of Search: 713/176
• US Class Current: 713/176
• CPC Class Codes: G06F 16/634 Query by example, e.g. query by humming
• CPC Class Codes: G06F 16/683 using metadata automatically derived from the content
• CPC Class Codes: G06F 16/7328 Query by example, e.g. a complete video frame or video sequence graphical querying G06F16/7335
• CPC Class Codes: G06F 16/78 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 16/7834 using audio features
• CPC Class Codes: G06F 16/7844 using original textual content or text extracted from visual content or transcript of audio data

Abstract

Multiple information is extracted from an unknown recording and information associated therewith. Associated information includes the filename, if the recording is a computer file in, e.g., MP3 format, or table of contents (TOC) data, if the recording is on a removable medium, such as a compact disc. At least one and preferably several algorithmically determined fingerprints are extracted from the recording using one or more fingerprint extraction methods. The information extracted is compared with corresponding information in a database maintained for reference recordings. Identification starts with the most accurate and efficient method available, e.g., using a hash ID, a unique ID or text. Fingerprint matching is used to confirm other matches and validation is performed by comparing the duration of the unknown and a possibly matching reference recording.

Claims

1. A method, comprising:

accessing associated data that is associated with a recording, the associated data forming part of metadata associated with the recording;

extracting at least one fingerprint from at least one portion of the recording containing at least one of audio or video content data, the accessing and the extracting being performed for different copies of the recording;

storing the at least one fingerprint as identifying information for the recording when a match of the associated data is found in a database that contains the associated data, the associated data and the at least one fingerprint to be used in future identification of the recording;

comparing the at least one fingerprint extracted from a first one of the different copies with the at least one fingerprint extracted from a second one of the different copies; and

updating the at least one fingerprint in the database based on the comparing.

2. The method of claim 1, wherein the associated data indicates the length of the recording.

3. The method of claim 1, wherein the recording is stored on a removable medium and the associated data is derived from table of contents data for the recording.

4. The method of claim 1, wherein the associated data includes text associated with the recording.

5. The method of claim 4, wherein the text includes at least one of a file path and a filename of the recording, a title of the recording, an artist name of a participant in creation of the recording, or an album name associated with the recording.

6. The method of claim 1, wherein the associated data has been derived from an ID3 tag.

7. The method of claim 6,

wherein the ID3 tag includes encoded information, and

wherein the database is maintained by a provider of identification services and the encoded information is generated under control of the provider of identification services.

8. The method of claim 7, further comprising:

validating the associated data by decoding the encoded information prior to the storing of the identifying information in the database.

9. The method of claim 1, wherein the associated data includes a watermark.

10. The method of claim 1, wherein the associated data includes media information regarding source media type.

11. The method of claim 10, wherein the media information identifies the source media type as one of CD-R, CD-DA, a digital file, or a digital versatile disc.

12. The method of claim 1, wherein the accessing and the extracting are performed by client equipment, and wherein the at least one fingerprint is stored in the database in response to receiving the at least one fingerprint from the client equipment.

13. The method of claim 12, further comprising:

maintaining the database on at least one server under control of a provider of identification services, and

transmitting extraction instructions from the at least one server to the client equipment to guide the client equipment in the extracting.

14. The method of claim 13, further comprising:

transmitting the associated data from the client equipment to the at least one server; and

selecting the extraction instructions by the at least one server for transmitting the extraction instructions from the at least one server to the client equipment based on the associated data.

15. The method of claim 13, further comprising:

updating the extraction instructions based at least in part on at least one of frequency of receipt of the associated data for the recording or a number of users that have supplied the identifying information.

16. The method of claim 14, wherein the selecting of the extraction instructions is based at least in part on at least one of type of the client equipment receiving the extraction instructions, geographical location of the client equipment receiving the extraction instructions, software operating on the client equipment receiving the extraction instructions, or quality of copies of the recording.

17. The method of claim 13, further comprising:

transmitting the at least one fingerprint from the client equipment to the at least one server at a time specified by the extraction instructions.

18. The method of claim 13, further comprising:

storing the at least one fingerprint at the client equipment until a specified number of fingerprints are ready for transmitting to the at least one server.

19. The method of claim 17, wherein the transmitting the at least one fingerprint occurs when a communication channel coupled to the at least one server is available.

20. The method of claim 12,

wherein the recording is stored on a removable medium and the client equipment generates at least one encoded file from the recording.

21. The method of claim 1, wherein the database includes the identifying information for music recordings.

22. The method of claim 1, wherein the database includes the identifying information for video recordings.

23. The method of claim 1, further comprising:

detecting a quality of the at least one fingerprint;

identifying a copy of the recording using the at least one fingerprint; and

replacing the at least one fingerprint with a higher quality fingerprint when the copy of the recording produces the higher quality fingerprint.

24. The method of claim 23, wherein the detecting is based on at least one of an encoding technique used for the recording, a media type used to store the recording, error correction capability of user equipment accessing the recording, or a number of errors detected during the extracting.

25. The method of claim 1, wherein the updating is performed after the comparing determines that fingerprints extracted from the different copies have a predetermined correlation.

26. The method of claim 1, wherein the updating comprises:

combining fingerprints extracted from the different copies for storage in the database.

27. The method of claim 1, wherein at least two fingerprints are derived from the at least one of audio or video content data using different fingerprinting techniques.

28. The method of claim 1, wherein the associated data comprises table of contents data, and wherein the at least one fingerprint is extracted from one or more tracks of the recording.

29. A system, comprising:

a receiving unit to access associated data associated with a recording, the associated data forming part of metadata associated with the recording;

an extraction unit to extract at least one fingerprint from at least one of audio or video content data contained in at least one portion of the recording, the accessing and the extracting being performed for different copies of the recording; and

a storage unit, coupled to the receiving unit and the extraction unit, the storage unit to;

store the at least one fingerprint as identifying information for the recording when a match of the associated data is found in a database that contains the associated data, the associated data and the at least one fingerprint to be used in future identification of the recording;

compare the at least one fingerprint extracted from a first one of the different copies with the at least one fingerprint extracted from a second one of the different copies; and

update the at least one fingerprint in the database based on the comparing.

30. The system of claim 29, wherein the extraction unit is to extract at least two fingerprints from the at least one of audio or video content data using different fingerprinting techniques.

31. The system of claim 29, wherein the associated data includes at least one of a file path and a filename of the recording.

32. The system of claim 29, wherein the associated data comprises table of contents data, and wherein the at least one fingerprint is extracted from one or more tracks of the recording.

33. A method, comprising:

accessing associated data that is associated with a recording, the associated data forming part of metadata associated with the recording;

extracting at least one fingerprint from at least one portion of the recording containing at least one of audio or video content data;

storing the at least one fingerprint as identifying information for the recording when a match of the associated data is found in a database that contains the associated data, the associated data and the at least one fingerprint to be used in future identification of the recording;

detecting a quality of the at least one fingerprint;

identifying a copy of the recording using the at least one fingerprint; and

replacing the at least one fingerprint with a higher quality fingerprint when the copy of the recording produces the higher quality fingerprint.

34. A system, comprising:

a receiving unit to access associated data associated with a recording, the associated data forming part of metadata associated with the recording;

an extraction unit to extract at least one fingerprint from at least one of audio or video content data contained in at least one portion of the recording; and

a storage unit, coupled to the receiving unit and the extraction unit, the storage unit to;

store the at least one fingerprint as identifying information for the recording when a match of the associated data is found in a database that contains the associated data, the associated data and the at least one fingerprint to be used in future identification of the recording;

detect a quality of the at least one fingerprint;

identify a copy of the recording using the at least one fingerprint; and

replace the at least one fingerprint with a higher quality fingerprint when the copy of the recording produces the higher quality fingerprint.