Combined watermarking and fingerprinting

• US 8,300,884 B2
• Filed: 05/21/2010
• Issued: 10/30/2012
• Est. Priority Date: 05/21/2009
• Status: Active Grant

• Current Assignee: Digimarc Corporation
• Original Assignee: Digimarc Corporation
• Inventors: Sharma, Ravi K.
• Primary Examiner(s): Azarian, Seyed
• Application Number:
  US12/785,290
• Publication Number:
  US 20100322469A1
• Time in Patent Office: 893 Days
• Field of Search: 382/100, 382115-116, 382/119, 382/124, 382/137, 382/168, 382/173, 382/181, 382/188, 382/232, 382/233, 382/254, 382/274, 382/275, 382/276, 382290-294, 382/305, 382/312, 713/155, 725/22, 704/200
• US Class Current: 382/100
• CPC Class Codes: G06T 1/0028 Adaptive watermarking, e.g. Human Visual System [HVS]-based watermarking
• CPC Class Codes: G10L 19/018 Audio watermarking, i.e. embedding inaudible data in the audio signal

Abstract

Content fingerprints and watermarks are combined in various ways for content identification applications. Fingerprints are used to identify content generally while watermarks provide more detailed localization of parts within the content, and vice versa. Fingerprint techniques are further used for signal synchronization and other pre-processing steps to assist in digital watermark decoding. A variety of fingerprint/watermark techniques identify characteristics of the channel of content from content samples.

Claims

1. A content recognition method comprising:

using a programmed processor to perform the acts of;

computing a fingerprint for a received portion of a content signal;

sending the fingerprint to a reference database to identify the content signal, the reference database providing identity by matching the fingerprint with reference fingerprints in the database;

based on the identity, obtaining a reference copy of the content signal; and

determining distortion of the received portion of the content signal based on a comparative analysis between the received portion and the reference copy.

2. The content recognition method of claim 1 wherein the reference copy and the received portion are used to determine the geometric transformation of the received portion relative to the reference copy.

3. The content recognition method of claim 2 including applying the geometric transformation to synchronize the received portion for extraction of a digital watermark from the received portion.

4. The content recognition method of claim 3 including:

extracting the digital watermark from the received portion.

5. The content recognition method of claim 1 wherein the distortion is used to determine a distribution channel of the received portion.

6. A method of content recognition comprising:

using a programmed processor to perform the acts of;

analyzing a received portion of a content signal to infer signal degradation of the content signal;

determining a distribution channel from the signal degradation;

computing a fingerprint for the received portion of the content signal;

sending the fingerprint to a reference database to identify the content signal, the reference database providing identity by matching the fingerprint with a set of reference fingerprints in the database corresponding to the distribution channel, the database being segmented into different sets of reference fingerprints corresponding to distribution channels such that the different sets include reference fingerprints for a common set of content signals, but store different reference fingerprints for the common set of content signals that are computed based on signal characteristics relevant for the different distribution channels; and

using the distribution channel to determine which of the different sets to use to identify the content signal.

7. The method of claim 6 wherein the distribution channel corresponds to compression format.

8. The method of claim 6 wherein the analyzing comprises analyzing characteristics of the content signal to infer a transmission channel.

9. A content recognition method comprising:

using a programmed processor to perform the acts of;

receiving different versions of a content signal, the different versions corresponding to different distribution channels;

computing reference fingerprints for the different versions, and storing the reference fingerprints in a corresponding section of a segmented database, the corresponding section being associated with a particular distribution channel; and

in response to a request, determining a match for a received fingerprint by searching for a match in a section of the database corresponding to distribution channel associated with the received fingerprint.

10. The method of claim 9 including:

extracting a characteristic of a transmission channel through which a content signal is transmitted, and using the characteristic to determine the transmission channel.

11. The method of claim 10 wherein determining a match comprises searching for a match in a section of the database that is dependent on the transmission channel.

12. The method of claim 10 wherein extracting the characteristic comprises performing a distortion analysis, and further including determining the match in a section of the database depending on the distortion analysis.

13. A content recognition system comprising:

one or more programmed computers configured to;

obtain a fingerprint for a received portion of a content signal;

search for the fingerprint in a reference database to identify the content signal, the reference database providing identity by matching the fingerprint with reference fingerprints in the database;

obtain, based on the identity, a reference copy of the content signal; and

determine distortion of the received portion of the content signal based on a comparative analysis between the received portion and the reference copy.

14. The content recognition system of claim 13 wherein the reference copy and the received portion are used to determine the geometric transformation of the received portion relative to the reference copy.

15. The content recognition system of claim 14 including a programmed computer configured to apply the geometric transformation to synchronize the received portion for extraction of a digital watermark from the received portion.

16. The content recognition system of claim 15 including:

a programmed computer configured to extract the digital watermark from the received portion.

17. The content recognition system of claim 13 wherein the distortion is used to determine a distribution channel of the received portion.

18. A system for content recognition comprising:

one or more programmed computers configured to;

analyze a received portion of a content signal to infer signal degradation of the content signal;

determine a distribution channel from the signal degradation;

compute a fingerprint for the received portion of the content signal;

send the fingerprint to a reference database to identify the content signal, the reference database configured to provide identity by matching the fingerprint with a set of reference fingerprints in the database corresponding to the distribution channel, the database being segmented into different sets of reference fingerprints corresponding to distribution channels such that the different sets include reference fingerprints for a common set of content signals, but configured to store different reference fingerprints for the common set of content signals that are computed based on signal characteristics relevant for the different distribution channels; and

use the distribution channel to determine which of the different sets to use to identify the content signal.

19. The system of claim 18 wherein the distribution channel corresponds to compression format.

20. The system of claim 18 including a programmed computer configured to analyze characteristics of the content signal to infer a transmission channel, wherein the system is configured to identify the content signal depending on the transmission channel.

21. A content recognition system comprising:

one or more programmed computers configured to;

receive different versions of a content signal, the different versions corresponding to different distribution channels;

compute reference fingerprints for the different versions, and store the reference fingerprints in a corresponding section of a segmented database, the corresponding section being associated with a particular distribution channel; and

determine, in response to a request, a match for a received fingerprint by searching for a match in a section of the database corresponding to distribution channel associated with the received fingerprint.

22. The system of claim 21 including:

one or more programmed computers configured to extract a characteristic of a transmission channel through which a content signal is transmitted, and configured to use the characteristic to determine the transmission channel.

23. The system of claim 22 including a programmed computer configured to determine a match by searching for a match in a section of the database that is dependent on the transmission channel.

24. The system of claim 22 including one or more programmed computers configured to perform a distortion analysis, and configured to determine a match in a section of the database depending on the distortion analysis.