Secure spread spectrum watermarking for multimedia data

• US 5,930,369 A
• Filed: 09/10/1997
• Issued: 07/27/1999
• Est. Priority Date: 09/28/1995
• Status: Expired due to Term

• Current Assignee: NEC Corporation
• Original Assignee: NEC Research Institute, Inc. (NEC Corporation)
• Inventors: Shamoon, Talal G., Cox, Ingemar J., Kilian, Joseph J.
• Primary Examiner(s): Gregory, Bernarr E.
• Application Number:
  US08/926,720
• Time in Patent Office: 685 Days
• Field of Search: 380/3, 380/4, 380/9, 380/23, 380/54, 380/59, 380/51, 380/55, 283/73, 283/113, 283/17, 283/901
• US Class Current: 380/54
• CPC Class Codes: G06T 1/0028 Adaptive watermarking, e.g. Human Visual System [HVS]-based watermarking
• CPC Class Codes: G06T 1/005 Robust watermarking, e.g. average attack or collusion attack resistant
• CPC Class Codes: G06T 2201/0052 Embedding of the watermark in the frequency domain
• CPC Class Codes: G06T 2201/0063 in relation to collusion attacks, e.g. collusion attack resistant
• CPC Class Codes: G06T 2201/0065 Extraction of an embedded watermark; Reliable detection
• CPC Class Codes: G06T 2201/0202 whereby the quality of watermarked images is measured; Measuring quality or performance of watermarking methods; Balancing between quality and robustness
• CPC Class Codes: G11B 20/00891 embedded in audio data
• CPC Class Codes: G11B 20/00913 based on a spread spectrum technique
• CPC Class Codes: H04H 20/31 using in-band signals, e.g. subsonic or cue signal
• CPC Class Codes: H04N 1/32154 Transform domain methods H04N1/32309 takes precedence
• CPC Class Codes: H04N 1/3216 using Fourier transforms
• CPC Class Codes: H04N 1/32165 using cosine transforms
• CPC Class Codes: H04N 1/3217 using wavelet transforms
• CPC Class Codes: H04N 1/32197 according to the spatial domain characteristics of the transform domain components
• CPC Class Codes: H04N 1/3232 Robust embedding or watermarking
• CPC Class Codes: H04N 19/00 Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
• CPC Class Codes: H04N 19/39 involving multiple description coding [MDC], i.e. with separate layers being structured as independently decodable descriptions of input picture data
• CPC Class Codes: H04N 21/23892 involving embedding information at multiplex stream level, e.g. embedding a watermark at packet level
• CPC Class Codes: H04N 21/8358 involving watermark protecting executable software by watermarking G06F21/16; image watermarking in general G06T1/0021; watermarks inserted in still images for transmission purposes H04N1/32144; inserting watermarks during video coding H04N19/467
• CPC Class Codes: H04N 2201/3233 of authentication information, e.g. digital signature, watermark
• CPC Class Codes: H04N 2201/327 : which are undetectable to the naked eye, e.g. embedded codes
• CPC Class Codes: H04N 7/08 : Systems for the simultaneous or sequential transmission of more than one television signal, e.g. additional information signals, the signals occupying wholly or partially the same frequency band , e.g. by time division H04N7/007 takes precedence
• CPC Class Codes: H04N 7/24 : Systems for the transmission of television signals using pulse code modulation H04N21/00 takes precedence
• CPC Class Codes: H04N 7/52 : Systems for transmission of a pulse code modulated video signal with one or more other pulse code modulated signals, e.g. an audio signal or a synchronizing signal assembling of a multiplex stream by combining a video stream with other content or additional data, remultiplexing of multiplex streams, insertion of stuffing bits into the multiplex stream, assembling of a packetised elementary stream at server side H04N21/236; disassembling of a multiplex stream, remultiplexing of multiplex streams, extraction or processing of Service Information, disassembling of packetised elementary stream at client side H04N21/434

Abstract

Digital watermarking of audio, image, video or multimedia data is achieved by inserting the watermark into the perceptually significant components of a decomposition of the data in a manner so as to be visually imperceptible. In a preferred method, a frequency spectral image of the data, preferably a Fourier transform of the data, is obtained. A watermark is inserted into perceptually significant components of the frequency spectral image. The resultant watermarked spectral image is subjected to an inverse transform to produce watermarked data. The watermark is extracted from watermarked data by first comparing the watermarked data with the original data to obtain an extracted watermark. Then, the original watermark, original data and the extracted watermark are compared to generate a watermark which is analyzed for authenticity of the watermark.

Claims

1. A method of inserting a watermark into data comprising the steps of:

obtaining a spectral decomposition of data to be watermarked which data is a representation of humanly perceivable material;

inserting a watermark into the perceptually significant components of the decomposition of data; and

applying an inverse transform to the decomposition of data with the watermark for generating watermarked data.

2. A method of inserting a watermark into data as set forth in claim 1, where said data comprises image data.

3. A method of inserting a watermark into data as set forth in claim 1, where said data comprises video data.

4. A method of inserting a watermark into data as set forth in claim 1, where said data comprises audio data.

5. A method of inserting a watermark into data as set forth in claim 1, where said data comprises multimedia data.

6. A method of inserting a watermark into data as set forth in claim 1, where said obtaining a spectral decomposition of data is selected from the group consisting of Fourier transformation, discrete cosine transformation, Hadamard transformation, and wavelet, multi-resolution, sub-band method.

7. A method of inserting a watermark into data as set forth in claim 6, where said inserting a watermark inserts watermark values where addition of additional signal into a perceptually significant component affects the perceived quality of the data.

8. A method of inserting a watermark into data as set forth in claim 1, further comprising:

comparing data with watermarked data for obtaining extracted data values;

comparing extracted data values with watermark values and data for obtaining difference values; and

analyzing difference values to determine the watermark in the watermarked data.

9. The method of inserting a watermark into data as set forth in claim 8, wheye watermark values include associated scaling parameters.

10. A method of inserting a watermark into data as set forth in claim 9, where scaling parameters are selected such that adding additional watermark value affects the perceived quality of the data.

11. A method of inserting a watermark into data as set forth in claim 8, where the watermark values are chosen according to a random distribution.

12. A method of inserting a watermark into data comprising the steps of:

extracting values of perceptually significant components of a spectral decomposition of data which data is a representation of human perceivable material;

combining watermark values with the extracted values to create adjusted values; and

inserting the adjusted values into the data in place of the extracted values to produce watermarked data.

13. The method of inserting a watermark into data as set forth in claim 12, where watermark values include associated scaling parameters.

14. A method of inserting a watermark into data as set forth in claim 13, where scaling parameters are selected such that adding additional watermark value affects the perceived quality of the data.

15. A method of inserting a watermark into data as set forth in claim 12, where the watermark values are chosen according to a random distribution.

16. A method of inserting a watermark into data as set forth in claim 12, further comprising:

comparing data with watermarked data for obtaining extracted data values;

comparing extracted data values with watermark values and data for obtaining difference values; and

analyzing difference values to determine the watermark in the watermarked data.

17. The method of inserting a watermark into data as set forth in claim 16, where watermark values include associated scaling parameters.

18. A method of inserting a watermark into data as set forth in claim 12, where scaling parameters are selected such that adding additional watermark value affects the perceived quality of the data.

19. A method of inserting a watermark into data as set forth in claim 16, where the watermark values are chosen according to a random distribution.

20. A method of inserting a watermark into data as set forth in claim 16, further comprising the step of preprocessing distorted or tampered watermarked data before said comparing data.

21. A method of inserting a watermark into data as set forth in claim 20, where said distorted or tampered watermarked data is clipped data and said preprocessing comprises replacing missing portions of the data with corresponding portions from original unwatermarked data.

22. A method of inserting a watermark into data as set forth in claim 12, where said combining watermark values sequentially combines watermark values for a plurality of watermarks.

23. A system for inserting a watermark into data comprising:

providing image data;

providing watermark data;

first transform lens for transforming image data passing therethrough into transformed image data;

second transform lens for transforming watermark data passing therethrough into transformed watermark data;

optical combiner for combining the transformed image data and the transformed watermark data to form transformed watermarked data; and

inverse transform lens for forming watermarked data by inverse transformation of transformed watermarked data.

24. A system for inserting a watermark into data as set forth in claim 23, where said first transform lens and said second transform lens are Fourier transform lenses and said inverse transform lens is an inverse Fourier transform lens.

25. A method of inserting a watermark into data comprising the steps of:

providing a medium containing data;

obtaining a spectral decomposition of data to be watermarked;

inserting a watermark into the perceptually significant components of the decomposition of data; and

applying an inverse transform to the decomposition of data with the watermark to generate watermarked data.

26. A method of inserting a watermark into data as set forth in claim 25, where said data comprises image data.

27. A method of inserting a watermark into data as set forth in claim 25, where said data comprises video data.

28. A method of inserting a watermark into data as set forth in claim 25, where said data comprises audio data.

29. A method of inserting a watermark into data as set forth in claim 25, where said data comprises multimedia data.

30. A method of inserting a watermark into data as set forth in claim 25, where said obtaining a spectral decomposition of data is selected from the group consisting of Fourier transformation, discrete cosine transformation, Hadamard transformation, and wavelet, multi-resolution, sub-band method.

31. A method of inserting a watermark into data as set forth in claim 30, where said inserting a watermark inserts watermark values where addition of additional signal into a perceptually significant component affects the perceived quality of the data.

32. A method of inserting a watermark into data as set forth in claim 25, further comprising:

comparing data with watermarked data for obtaining extracted data values;

comparing extracted data values with watermark values and data for obtaining difference values; and

analyzing difference values to determine the watermark in the watermarked data.

33. The method of inserting a watermark into data as set forth in claim 32, where watermark values include associated scaling parameters.

34. A method of inserting a watermark into data as set forth in claim 33, where scaling parameters are selected such that adding additional watermark value affects the perceived quality of the data.

35. A method of inserting a watermark into data as set forth in claim 32, where the watermark values are chosen according to a random distribution.

36. A method of inserting a watermark into data comprising the steps of:

providing a medium containing data;

extracting values of perceptually significant components of a spectral decomposition of the data;

combining watermark values with the extracted values to create adjusted values; and

inserting the adjusted values into the data in place of the extracted values to produce watermarked data.

37. The method of inserting a watermark into data as set forth in claim 36, where watermark values include associated scaling parameters.

38. A method of inserting a watermark into data as set forth in claim 37, where scaling parameters are selected such that adding additional watermark value affects the perceived quality of the data.

39. A method of inserting a watermark into data as set forth in claim 36, where the watermark values are chosen according to a random distribution.

40. A method of inserting a watermark into data as set forth in claim 36, further comprising:

comparing data with watermarked data for obtaining extracted data values;

comparing extracted data values with watermark values and data for obtaining difference values; and

analyzing difference values to determine the watermark in the watermarked data.

41. The method of inserting a watermark into data as set forth in claim 40, where watermark values include associated scaling parameters.

42. A method of inserting a watermark into data as set forth in claim 41, where scaling parameters are selected such that adding additional watermark value affects the perceived quality of the data.

43. A method of inserting a watermark into data as set forth in claim 40, where the watermark values are chosen according to a random distribution.

44. A method of inserting a watermark into data as set forth in claim 40, further comprising the step of preprocessing distorted or tampered watermarked data before said comparing data.

45. A method of inserting a watermark into data as set forth in claim 44, where said distorted or tampered watermarked data is clipped data and said preprocessing comprises replacing missing portions of the data with corresponding portions from original unwatermarked data.

46. A method of inserting a watermark into data as set forth in claim 36, where said combining watermark values sequentially combines watermark values for a plurality of watermarks.