Content authentication and recovery using digital watermarks

• US 7,389,420 B2
• Filed: 10/18/2001
• Issued: 06/17/2008
• Est. Priority Date: 11/08/2000
• Status: Active Grant

• Current Assignee: Digimarc Corporation
• Original Assignee: Digimarc Corporation
• Inventors: Tian, Jun
• Primary Examiner(s): Barron; Gilberto
• Assistant Examiner(s): PERUNGAVOOR, VENKATANARAY
• Application Number:
  US10/035,830
• Publication Number:
  US 20020146123A1
• Time in Patent Office: 2,434 Days
• Field of Search: 713/176, 713/179, 380/209, 380/217
• US Class Current: 713/176
• CPC Class Codes: G06F 21/10 Protecting distributed programs or content, e.g. vending or licensing of copyrighted material protection in video systems or pay television H04N7/16 ; Digital rights management [DRM]
• CPC Class Codes: G06F 21/16 Program or content traceability, e.g. by watermarking
• CPC Class Codes: G06T 1/0042 Fragile watermarking, e.g. so as to detect tampering
• CPC Class Codes: G06T 1/005 Robust watermarking, e.g. average attack or collusion attack resistant
• CPC Class Codes: G06T 2201/0051 Embedding of the watermark in the spatial domain
• CPC Class Codes: G06T 2201/0053 Embedding of the watermark in the coding stream, possibly without decoding; Embedding of the watermark in the compressed domain
• CPC Class Codes: G06T 2201/0061 Embedding of the watermark in each block of the image, e.g. segmented watermarking
• CPC Class Codes: G06T 2201/0065 Extraction of an embedded watermark; Reliable detection
• CPC Class Codes: G06T 2201/0083 whereby only watermarked image required at decoder, e.g. source-based, blind, oblivious
• CPC Class Codes: G11B 20/00007 Time or data compression or expansion audio compression based on psychoacoustics G10L19/00; data processing for reproducing audio data at different playback speeds G10L21/04; video compression H04N19/00; data compression per se H03M7/30
• CPC Class Codes: G11B 20/00086 Circuits for prevention of unauthorised reproduction or copying, e.g. piracy indicating unauthorised use of record carriers in general G11B23/28; scrambling for television signal recording H04N5/913; network architectures or network protocols for network security H04L63/00; cryptographic mechanisms or cryptographic arrangements for secret or secure communication H04L9/00
• CPC Class Codes: G11B 20/00884 involving a watermark, i.e. a barely perceptible transformation of the original data which can nevertheless be recognised by an algorithm
• CPC Class Codes: H04N 1/00005 relating to image data
• CPC Class Codes: H04N 1/00037 Detecting, i.e. determining the occurrence of a predetermined state H04N1/00031 takes precedence
• CPC Class Codes: H04N 1/00084 Recovery or repair, e.g. self-repair
• CPC Class Codes: H04N 1/32144 embedded in the image data, i.e. enclosed or integrated in the image, e.g. watermark, super-imposed logo or stamp
• CPC Class Codes: H04N 1/32219 involving changing the position of selected pixels, e.g. word shifting, or involving modulating the size of image components, e.g. of characters H04N1/32224 takes precedence
• CPC Class Codes: H04N 2005/91335 the copy protection signal being a watermark
• CPC Class Codes: H04N 21/23892 involving embedding information at multiplex stream level, e.g. embedding a watermark at packet level
• CPC Class Codes: H04N 21/8358 involving watermark protecting executable software by watermarking G06F21/16; image watermarking in general G06T1/0021; watermarks inserted in still images for transmission purposes H04N1/32144; inserting watermarks during video coding H04N19/467
• CPC Class Codes: H04N 2201/3233 : of authentication information, e.g. digital signature, watermark
• CPC Class Codes: H04N 2201/3236 : Details of authentication information generation
• CPC Class Codes: H04N 2201/327 : which are undetectable to the naked eye, e.g. embedded codes
• CPC Class Codes: H04N 2201/3283 : Compression

Abstract

The disclosure describes methods for using digital watermarking to authenticate digital media signals, such as images, audio and video signals. It also describes techniques for using embedded watermarks to repair altered parts of a media signal when alteration is detected. Alteration is detected using hashes, digital watermarks, and a combination of hashes and digital watermarks.

Claims

1. A method for hiding auxiliary data in a media signal, the method comprising:

compressing a first media signal to generate a compressed first media signal from which a counterpart to the first media signal can later be decompressed; and

embedding the compressed first media signal into a second media signal, the second media signal representing a content object;

wherein the first media signal also represents a content object, and said two content objects are perceptually similar.

3. A computer readable medium on which is stored software for performing the method of claim 1.

2. A method for hiding auxiliary data in a media signal, the method comprising:

compressing a first media signal; and

embedding the compressed first media signal into a second media signaL the second media sisuial representing a content obiect;

wherein the first media signal also represents a content object, and said two content objects are perceptually similar; and

wherein the compressed first media signal comprises plural samples, and said embedding includes associating a symbol with a sorting order, determining a sorting order of a block of samples, and modulating the sorting order of the block of samples as necessary to make the sorting order match the sorting order associated with a symbol to be embedded.

4. A method of processing a host signal, comprising:

decoding an auxiliary signal imperceptibly embedded into said host signal;

decompressing said decoded auxiliary signal to yield a content object; and

using the decompressed auxiliary signal to authenticate the host signal;

wherein the host signal represents a first content object, and the auxiliary signal represents at least a portion of a content object that is perceptually similar to said first content object.

6. A computer readable medium on which is stored software for performing the method of claim 4.

7. The method of claim 4 wherein the decoding is performed on blocks of the host signal.

8. The method of claim 4 wherein the host signal comprises plural blocks of samples, and wherein an auxiliary signal decoded from one block of the host signal is used to authenticate another block of the host signal.

38. The method of claim 4 that includes decompressing the compressed version using a JPEG 2000 decompression process.

44. The method of claim 4 in which the auxiliary signal is a compressed signal, and the method includes decompressing the compressed signal, and using the decompressed signal to authenticate the host signal.

5. A method of processing a host signal, comprising:

decoding an auxiliary signal imperceptibly embedded into said host signal; and

using the auxiliary signal to authenticate the host signal;

wherein the host signal represents a first content object, and the auxiliary signal represents at least a portion of a content object that is perceptually similar to said first content object; and

wherein the compressed auxiliary signal comprises plural symbols and the host signal comprises plural blocks of samples, and wherein the decoding includes using a sorting order decoder to analyze sorting orders of selected blocks of samples, and to determine symbols corresponding to the sorting orders.

9. A method of watermarking media content comprising:

selecting non-overlapping blocks A, B and C of the media content;

losslessly compressing blocks B and C of the content to form compressed content;

watermark embedding the compressed content into block B of the media content to form a new block B′

;

creating a hash of block A and B′

;

watermark embedding the hash into block C to create a new block C′

; and

combining blocks A, B′ and

C′

to form watermarked media content.

10. The method of claim 9 wherein the media content is an image.

11. The method of claim 9 wherein the media content is an audio signal.

12. A computer readable medium having software for executing the method of claim 9.

13. A watermark decoder for decoding the hash from the watermarked media content created by the method of claim 9, the decoder operable to compare the hash with a new hash calculated from the watermarked media content to determine whether the watermarked media content is authentic.

14. The watermark decoder of claim 13 further including a decoder for reconstructing original un-watermarked media content by using watermark decoding to extract the compressed content and decompressing the compressed content.

15. A computer readable medium on which is stored software for implementing the watermark decoder of claim 13.

16. A method for encoding a reversible watermark in a media signal comprising:

embedding a watermark message signal into a reference media signal to create a watermarked reference signal, where the watermark message signal includes information about a watermark embedder function used to embed the watermark message signal into the reference signal;

subtracting the reference signal from the watermarked reference signal to form a difference signal; and

adding the difference signal to a host media signal to embed the watermark message signal in the host signal;

wherein adding the difference signal is reversible by decoding the information about the watermark embedder function from the host media signal, using the information about the watermark embedder function to re-compute the difference signal, and subtracting the difference signal from the host media signal to restore the host signal.

17. The method of claim 16 further including:

computing a hash of the host signal; and

including the hash in the watermark message signal such that the message signal includes the hash and the information about the watermark embedder function.

18. The method of claim 16 wherein the information about the watermark embedder function is a watermark durability parameter.

19. The method of claim 16 wherein the host signal is a still image.

20. The method of claim 19 wherein the reference signal is an image of substantially uniform pixel values.

21. The method of claim 20 wherein the reference signal comprises uniform pixel values ata mid-level between a range of possible pixel values between a lowest possible value and a highest possible value.

22. A computer readable medium on which is stored software for pefforming the method of claim 16.

23. A method for authenticating a watermarked media signal that has been watermarked using a watermark embedding function on an un-watermarked version of the media signal, comprising:

decoding a watermark message from the watermarked media signal, wherein the watermark message includes a hash of the un-watermarked media signal and watermark embedding information used by the watermark embedding function to create the watermarked media signal;

transforming the watermark embedding information and hash into a watermark difference signal using the watermark embedding function;

subtracting the watermark difference signal from the watermarked media signal to restore the un-watermarked media signal;

computing a new hash of the restored, un-watermarked media signal; and

comparing the new hash with the hash decoded from the watermarked media signal to determine the authenticity of the watermarked media signal.

24. The method of claim 23 wherein transforming includes watermark embedding a reference signal with the hash and watermark embedding information to compute a watermarked reference signal, computing a difference signal between the watermarked reference signal and the reference signal to compute the watermark difference signal.

25. The method of claim 24 wherein the reference signal comprises an image having substantially uniform pixel values.

26. A computer readable medium on which is stored software for performing the method of claim 23.

27. A method for encoding a reversible watermark in a media signal comprising:

creating a watermark difference signal carrying information about a watermark embedder function used to embed the watermark message signal into the difference signal; and

adding the difference signal to a host media signal to embed the watermark message signal in the host signal;

wherein adding the difference signal is reversible by decoding the information about the watermark embedder function from the host media signal, using the information about the watermark embedder function to re-compute the difference signal, and subtracting the difference signal from the host media signal to restore the host signal.

28. A computer readable medium on which is stored software for performing the method of claim 27.

29. A method of hiding auxiliary data in a media signal, the method comprising:

dividing the media signal into blocks;

partitioning the media signal into two regions;

for a plurality of the blocks, compressing the media signal from a first region of a block and embedding redundant instances of the compressed media signal of the block into a second region of two or more blocks.

30. The method of claim 29 including:

for a plurality of blocks, computing a fragile hash of the first region of the media signal for the block and embedding the fragile hash into a second region of one or more blocks.

31. The method of claim 30 wherein the fragile hash comprises a fragile hash of the compressed media signal of the block.

32. The method of claim 30 wherein the second region of blocks in the media signal are partitioned into sub-regions and the sub-regions for the blocks are embedded with a fragile hash from another block and instances of the compressed media signal from the first region of other blocks.

33. A computer readable media on which is stored software for performing the method of claim 29.

34. The method of claim 29 wherein the second region comprises one or more least significant bits of data samples of the media signal, and embedding of redundant instances comprises replacing least significant bits of the data samples.

35. The method of claim 29 wherein the redundant instances are scrambled before the embedding using a key.

36. The method of claim 29 wherein the redundant instances are mapped to different blocks for embedding according to a permutation.

37. A method of authenticating a media signal using hidden embedded data in the media signal, the method comprising:

dividing the media signal into blocks;

partitioning the blocks into regions;

for a plurality of blocks, extracting hidden compressed bit streams of a first region of other blocks from a second region in the blocks;

for a plurality of blocks, evaluating whether a block is altered by comparing the extracted compressed bit streams for a block with the media signal in the first region of the block; and

when an altered block is detected by the comparison, using a fragile hash to identify location of altered data, and using an extracted compressed bit stream to replace the altered data.

39. A method comprising:

receiving a first set of data representing a first content object;

generating a second set of data representing a second content object that is perceptually similar to the first content object; and

digitally watermarking the second set of data into the first set of data.

40. The method of claim 39 in which said first and second content objects comprise images, and the generating comprises applying a wavelet-based compression technique to the first set of data to yield the second set of data.

41. The method of claim 39 wherein:

said first set of data comprises a group of plural samples, the group having an initial sorting order;

the second set of data comprises plural symbols; and

the digitally watermarking of a symbol of the second set of data comprises associating said symbol with a corresponding sorting order, determining if the initial sorting order of said group matches said corresponding sorting order and, if not, altering said group of samples to have said corresponding sorting order.

42. The method of claim 41 that includes performing said determining and altering for other symbols in said second set of data.

43. A signal processing method that includes receiving a first set of data representing a first content object, processing the first set of data to yield a second set of data, and digitally watermarking the second set of data in the first set of data, characterized in that the second set of data represents a content object that is perceptually similar to said first content object.