Electronic watermarking in the compressed domain utilizing perceptual coding

• US 6,493,457 B1
• Filed: 11/16/1998
• Issued: 12/10/2002
• Est. Priority Date: 12/03/1997
• Status: Expired due to Term

• Current Assignee: Hanger Solutions, LLC (IP Investments Group LLC)
• Original Assignee: AT&T Corporation (AT&T, Inc.)
• Inventors: Quackenbush, Schuyler Reynier, Shur, David Hilton, Reibman, Amy Ruth, Snyder, James H.
• Primary Examiner(s): Mancuso, Joseph
• Assistant Examiner(s): BHATNAGAR, ANAND P
• Application Number:
  US09/192,359
• Time in Patent Office: 1,485 Days
• Field of Search: 382/100, 382/232, 382/239, 382/251, 380/210, 380/252, 380/287, 380/54, 713/176, 704/200.1, 704/273, 381/73.1, 348/460, 348/463
• US Class Current: 382/100
• CPC Class Codes: G06T 1/0028 Adaptive watermarking, e.g. Human Visual System [HVS]-based watermarking
• CPC Class Codes: G06T 1/0035 Output size adaptive watermarking
• CPC Class Codes: G06T 2201/0052 Embedding of the watermark in the frequency domain
• CPC Class Codes: G06T 2201/0053 Embedding of the watermark in the coding stream, possibly without decoding; Embedding of the watermark in the compressed domain
• CPC Class Codes: G06T 2201/0083 whereby only watermarked image required at decoder, e.g. source-based, blind, oblivious
• CPC Class Codes: G10L 19/018 Audio watermarking, i.e. embedding inaudible data in the audio signal
• CPC Class Codes: H04N 1/32128 attached to the image data, e.g. file header, transmitted message header, information on the same page or in the same computer file as the image for information embedded in the image H04N1/32144
• CPC Class Codes: H04N 1/32149 Methods relating to embedding, encoding, decoding, detection or retrieval operations
• CPC Class Codes: H04N 1/32154 Transform domain methods H04N1/32309 takes precedence
• CPC Class Codes: H04N 1/32187 with selective or adaptive application of the additional information, e.g. in selected frequency coefficients
• CPC Class Codes: H04N 1/32272 Encryption or ciphering
• CPC Class Codes: H04N 1/32277 Compression
• CPC Class Codes: H04N 1/32299 using more than one embedding method
• CPC Class Codes: H04N 1/32304 Embedding different sets of additional information
• CPC Class Codes: H04N 19/00 Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
• CPC Class Codes: H04N 19/147 according to rate distortion criteria rate-distortion as a criterion for motion estimation H04N19/567
• CPC Class Codes: H04N 19/19 using optimisation based on Lagrange multipliers
• CPC Class Codes: H04N 19/196 being specially adapted for the computation of encoding parameters, e.g. by averaging previously computed encoding parameters processing of motion vectors H04N19/513
• CPC Class Codes: H04N 19/467 characterised by the embedded information being invisible, e.g. watermarking
• CPC Class Codes: H04N 19/48 using compressed domain processing techniques other than decoding, e.g. modification of transform coefficients, variable length coding [VLC] data or run-length data motion estimation in a transform domain H04N19/547; processing of decoded motion vectors H04N19/513
• CPC Class Codes: H04N 19/90 : using coding techniques not provided for in groups H04N19/10-H04N19/85, e.g. fractals
• CPC Class Codes: H04N 21/23892 : involving embedding information at multiplex stream level, e.g. embedding a watermark at packet level
• CPC Class Codes: H04N 21/8358 : involving watermark protecting executable software by watermarking G06F21/16; image watermarking in general G06T1/0021; watermarks inserted in still images for transmission purposes H04N1/32144; inserting watermarks during video coding H04N19/467
• CPC Class Codes: H04N 2201/3233 : of authentication information, e.g. digital signature, watermark
• CPC Class Codes: H04N 2201/3239 : using a plurality of different authentication information
• CPC Class Codes: H04N 2201/327 : which are undetectable to the naked eye, e.g. embedded codes
• CPC Class Codes: H04N 2201/3281 : Encryption; Ciphering

Abstract

A method and apparatus are described for inserting a watermark in the compressed domain. The watermark inserted does not require a reference. An overall watermarking system incorporating the invention combines cleartext, bitstream, and integrated watermarking. In a perceptual coder, the data enters a filterbank, where it is processed into multiple separate coefficients. A rate/distortion control module uses noise threshold information from a perceptual coder, together with bit-count information from a noiseless coder, to compute scale factors. The coefficients are multiplied by the scale factors and quantized, then noiseless coded and then output for further processing/transmission. The invention supports three embodiments for inserting a mark into the bitstream imperceptibly. It is assumed that some set of scale factor bands have been selected, into which mark data will be inserted. In one embodiment, a set of multipliers {x_i=2^Ni: iεM} is chosen. Each triple is modified by dividing the scale factor by x,_i multiplying the quantized coefficients by {x_i}, and adding mark data to the non-zero modified quantized coefficients. In an alternate embodiment, watermark data is represented via two characteristics of the bitstream data. A Huffinan table is selected for encoding the Scale Factor Band receiving watermark data which is not the table that would normally be used. The watermark data bit is set according to any desired scheme, and the quantized coefficients are derived using the alternate Huffinan table. In another embodiment, watermarking is integrated with quantization. The watermark is therefore difficult to remove without perceptible effects. The fact that marking data is present is again indicated by characteristics of the bitstream data. The modification factors {x_i} are now all close to unity.

Claims

1. A perceptual coder for encoding at least one compressed audio or video signal to include hidden data, comprising, in combination:

means for setting quantization step sizes to obtain a set of integer values after quantization of said at least one compressed signal, said means for setting step sizes employing at least one perceptual technique;

means for adding the hidden data to said at least one compressed signal;

means for quantizing said at least one compressed signal; and

means for selecting a set of multipliers during the quantization, said adding of the hidden data occurring during the quantization.

2. The coder of claim 1, further including means for selecting a specific Huffman Table for encoding said at least one compressed signal.

3. The coder of claim 2, wherein said selected Huffman Table is not the Huffman Table that would normally be selected for encoding said at least one compressed signal.

4. The coder of claim 1, wherein said hidden data has a watermarking function.

5. The coder of claim 4, wherein said hidden data has the form of at least one watermark data bit.

6. The coder of claim 1, further including:

means for modifying said encoded compressed signal by utilizing said set of multipliers.

7. The coder of claim 6, wherein each member of said set of multipliers is close to unity.

8. The coder of claim 7, wherein said compressed signal has at least one associated scale factor and said means for modifying comprises, in combination:

means for dividing said at least one scale factor by a respective one of said multipliers; and

means for multiplying said integer values by respective ones of said multipliers.

9. The coder of claim 6, wherein said compressed signal has at least one associated scale factor and said means for modifying comprises, in combination:

means for dividing said at least one scale factor by a respective one of said multipliers; and

means for multiplying said integer values by respective ones of said multipliers.

10. The coder of claim 1 wherein said means for adding hidden data is responsive to said means for quantizing said at least one compressed signal.

11. A perceptual coder for encoding at least one of compressed audio or video signal to include hidden data, comprising, in combination:

means for setting quantization step sizes to obtain a set of integer values after quantization of said at least one compressed signal, said means for setting step sizes employing at least one perceptual technique;

means for quantizing said at least one compressed signal containing said hidden data;

noiseless coding means for adding the hidden data to said quantized compressed signals; and

means for selecting a set of multipliers during the quantization, said adding of the hidden data occurring during the quantization.

12. The coder of claim 11, wherein said hidden data has a watermarking function.

13. The coder of claim 12, wherein said hidden data is added to at least one non-zero one of said integer values.

14. The coder of claim 11, further including:

means for modifying said encoded compressed signal by utilizing said set of multipliers.

15. The coder of claim 14, wherein said compressed signal has at least one associated scale factor and said means for modifying comprises, in combination:

means for dividing said at least one scale factor by a respective one of said multipliers; and

means for multiplying said integer values by respective ones of said multipliers.

16. The coder of claim 14 wherein each member, x, of said set of multipliers is equal to 2^Ni, where N is a positive integer and i represents a set of indices associated with said compressed signal.

17. The coder of claim 16, wherein said compressed signal has at least one associated scale factor and said means for modifying comprises, in combination:

means for dividing said at least one scale factor by a respective one of said multipliers; and

means for multiplying said integer values by respective ones of said multipliers.

18. A method of perceptually encoding at least one compressed audio or video signals to include hidden data comprising, in combination, the steps of:

setting quantization step sizes to obtain a set of integer values after quantization of said at least one compressed signal, said setting of step sizes employing at least one perceptual technique;

adding the hidden data to said at least one compressed signal;

quantizing said at least one compressed signal; and

selecting a set of multipliers during the quantization, said adding of the hidden data occurring during the quantization.

19. The method of claim 18, further including the step of selecting a specific Huffman Table for encoding said at least one compressed signal.

20. The method of claim 19, wherein said selected Huffman Table is not the Huffman Table that would normally be selected for encoding said at least one compressed signal.

21. The method of claim 18, wherein said hidden data has a watermarking function.

22. The method of claim 21, wherein said hidden data has the form of at least one watermark data bit.

23. The method of claim 18, further including:

modifying said encoded compressed signal by utilizing said set of multipliers.

24. The method of claim 23, wherein each member of said set of multipliers is close to unity.

25. The method of claim 24, wherein said compressed signal has at least one associated scale factor and step of modifying comprises the steps, in combination, of:

dividing said at least one scale factor by a respective one of said multipliers; and

multiplying said integer values by respective ones of said multipliers.

26. The method of claim 23, wherein said compressed signal has at least one associated scale factor and said step of modifying comprises the steps, in combination, of:

dividing said at least one scale factor by a respective one of said multipliers; and

multiplying said integer values by respective ones of said multipliers.

27. The method of claim 18, further including the step of marking said at least one audio or video signal with hidden data before compression.

28. The method of claim 18, further including the step of bitstream marking said quantized compressed signal with hidden data.

29. The method of claim 28, further including the step of marking said at least one audio or video signal with hidden data before compression.

30. The method of claim 18 wherein said step of adding hidden data occurs simultaneously with said step of quantizing said at least one compressed signal.

31. The method of claim 18 wherein said step of adding hidden data occurs after said step of quantizing said at least one compressed signal.

32. A method of perceptually encoding at least one compressed audio or video signal to include hidden data comprising, in combination, the steps of:

setting quantization step sizes to obtain a set of integer values after quantization of said at least one compressed signal, said setting of step sizes employing at least one perceptual technique;

quantizing said at least one compressed signal containing said hidden data;

adding the hidden data to said quantized compressed signal; and

selecting a set of multipliers during the quantization, said adding of the hidden data occurring during quantization.

33. The method of claim 32, wherein said hidden data has a watermarking function.

34. The method of claim 33, wherein said hidden data is added to at least one non-zero one of said integer values.

35. The method of claim 32, further including:

modifying said encoded compressed signal by utilizing said set of multipliers.

36. The coder of claim 35, wherein said compressed signal has at least one associated scale factor and said step of modifying comprises, in combination:

dividing said at least one scale factor by a respective one of said multipliers; and

multiplying said integer values by respective ones of said multipliers.

37. The method of claim 35, wherein each member, x, of said set of multipliers is equal to 2^Ni, where N is a positive integer and i represents a set of indices associated with said compressed signal.

38. The method of claim 37, wherein said compressed signal has at least one associated scale factor and said step of modifying comprises, in combination:

dividing said at least one scale factor by a respective one of said multipliers; and

multiplying said integer values by respective ones of said multipliers.

39. The method of claim 32, further including the step of marking said at least one audio or video signal with hidden data before compression.

40. The method of claim 32, further including the step of bitstream marking said quantized compressed signal with hidden data.

41. The method of claim 40, further including the step of marking said at least one audio or video signal with hidden data before compression.

42. A method of perceptually coding as signal to add watermark data using a codebook characterized by the steps of:

establishing scale factors from perceptual thresholds;

establishing scale factor bands to watermark;

choosing a set of multipliers approximately equal to 1; and

dividing the scale factors by respective multipliers of said set of multipliers for selecting said codebook.