Combined watermarking and fingerprinting

• US 8,488,838 B2
• Filed: 10/29/2012
• Issued: 07/16/2013
• Est. Priority Date: 05/21/2009
• Status: Active Grant

• Current Assignee: Digimarc Corporation
• Original Assignee: Digimarc Corporation
• Inventors: Sharma, Ravi K.
• Primary Examiner(s): AZARIAN, SEYED H
• Application Number:
  US13/663,063
• Publication Number:
  US 20130064419A1
• Time in Patent Office: 260 Days
• Field of Search: 382/100, 382115-116, 382/119, 382/124, 382/137, 382/168, 382/173, 382/181, 382/188, 382/232, 382/233, 382/254, 382/274, 382/275, 382/276, 382290-294, 382/305, 382/312, 704/200, 725/22, 713/155, 713/176
• US Class Current: 382/100
• CPC Class Codes: G06T 1/0028 Adaptive watermarking, e.g. Human Visual System [HVS]-based watermarking
• CPC Class Codes: G10L 19/018 Audio watermarking, i.e. embedding inaudible data in the audio signal

Abstract

Content fingerprints and watermarks are combined in various ways for content identification applications. Fingerprints are used to identify content generally while watermarks provide more detailed localization of parts within the content, and vice versa. Fingerprint techniques are further used for signal synchronization and other pre-processing steps to assist in digital watermark decoding. A variety of fingerprint/watermark techniques identify characteristics of the channel of content from content samples.

Claims

1. A method of identifying a content signal comprising:

using a programmed processor to perform the acts of;

decoding a digital watermark from a received portion of the content signal, including aggregating instances of the digital watermark repeated in the content signal;

the digital watermark serving to identify the content signal and associated content fingerprints for the content signal;

using the content fingerprints to localize the received portion of the content signal;

wherein using the content fingerprints to localize the received portion comprises;

extracting fingerprints from the received portion of the content signal; and

matching extracted fingerprints from the received portion of the content signal with the associated content fingerprints to determine which part of the content signal the digital watermark was detected from.

2. The method of claim 1 wherein decoding the digital watermark comprises:

receiving a watermarked electronic signal in which a watermark having first and second components is embedded, where the first component is repeated over a first temporal portion of the electronic signal, and the second component is not repeated over the first temporal portion;

selectively accumulating the first component; and

decoding the watermark from the accumulated first component and the second component from the first temporal portion.

3. The method of claim 2 wherein the decoding comprises performing error correction decoding on the accumulated first component and the second component.

4. The method of claim 3 wherein the error correction decoding comprises convolutional decoding.

5. The method of claim 2 including decoding the watermark using a weighted repetition scheme wherein a component of the watermark that is repeated more frequently is weighted more than a component repeated less frequently in the electronic signal.

6. The method of claim 5 including:

decoding an implicit weighted repetition code by accumulating common coded message symbols of adjacent segments; and

decoding an explicit weighted repetition code in which a portion of a message payload of the digital watermark is given higher repetition weighting in the error correction coding of the message payload.

7. The method of claim 2 including selectively combining coded message symbols that are common between adjacent watermark segments in the watermarked electronic signal.

8. The method of claim 2 including:

accumulating a common component and a varying component of a watermark signal between adjacent watermark segments in the watermarked electronic signal; and

interpolating between common components to decode the varying component.

9. The method of claim 1 wherein the associated content fingerprints comprise fingerprints of time segments of the content signal, and localizing the received portion includes matching the fingerprints of time segments with fingerprints of the received portion to provide time localization.

10. The method of claim 1 wherein the associated content fingerprints comprise fingerprints of regions of the content signal, the content signal comprises image data, and localizing the received portion includes matching the fingerprints of regions with fingerprints of the received portion to localize regions within the received portion.

11. Apparatus for identifying a content signal comprising:

one or more programmed processors configured to decode a digital watermark from a received portion of the content signal, including aggregating instances of the digital watermark repeated in the content signal;

the digital watermark serving to identify the content signal and associated content fingerprints for the content signal;

the one or more programmed processors further configured to use the content fingerprints to localize the received portion of the content signal, including;

a processor configured to extract fingerprints from the received portion of the content signal; and

a processor configured to match extracted fingerprints from the received portion of the content signal with the associated content fingerprints to determine which part of the content signal the digital watermark was detected from.

12. The apparatus of claim 11 wherein the associated content fingerprints comprise fingerprints of time segments of the content signal, and a programmed processor localizes the received portion by matching the fingerprints of time segments with fingerprints of the received portion to provide time localization.

13. The apparatus of claim 11 wherein the associated content fingerprints comprise fingerprints of regions of the content signal, the content signal comprises image data, and a programmed processor localizes the received portion by matching the fingerprints of regions with fingerprints of the received portion to localize regions within the received portion.

14. The apparatus of claim 11 including a programmed processor configured to:

receive a watermarked electronic signal in which a watermark, having at least a first component that is repeated over a first temporal portion of the electronic signal, is embedded;

selectively accumulate the first component; and

decode the watermark from the accumulated first component from the first temporal portion.

15. The apparatus of claim 14 wherein the decoding comprises performing error correction decoding on the accumulated first component.

16. The apparatus of claim 15 wherein the error correction decoding comprises convolutional decoding.

17. The apparatus of claim 14 including decoding the watermark using a weighted repetition scheme wherein a component of the watermark that is repeated more frequently is weighted more than a component repeated less frequently in the electronic signal.

18. The apparatus of claim 11 comprising a microphone for capturing the received portion.

19. The apparatus of claim 11 comprising a camera for capturing the received portion.

20. The apparatus of claim 11 wherein the one or more programmed processors are within a handheld mobile device.