Embedding data in material

• US 7,085,396 B2
• Filed: 12/06/2001
• Issued: 08/01/2006
• Est. Priority Date: 12/07/2000
• Status: Expired due to Fees

• Current Assignee: Sony United Kingdom Limited (Sony Group Corp.)
• Original Assignee: Sony United Kingdom Limited (Sony Group Corp.)
• Inventors: Pelly, Jason Charles, Keating, Stephen Mark, Tapson, Daniel
• Primary Examiner(s): Mancuso, Joseph
• Assistant Examiner(s): KRONENTHAL, CRAIG W
• Application Number:
  US10/010,026
• Publication Number:
  US 20020106105A1
• Time in Patent Office: 1,699 Days
• Field of Search: 382/100, 375/240.19, 713/176, 380/54, 348/465
• US Class Current: 382/100
• CPC Class Codes: G06T 1/0028 Adaptive watermarking, e.g. Human Visual System [HVS]-based watermarking
• CPC Class Codes: G06T 1/005 Robust watermarking, e.g. average attack or collusion attack resistant
• CPC Class Codes: G06T 2201/0052 Embedding of the watermark in the frequency domain
• CPC Class Codes: G06T 2201/0203 whereby the image with embedded watermark is reverted to the original condition before embedding, e.g. lossless, distortion-free or invertible watermarking
• CPC Class Codes: H04N 1/32154 Transform domain methods H04N1/32309 takes precedence
• CPC Class Codes: H04N 1/3217 using wavelet transforms

Abstract

A spatial domain using image produced by a source is combined with watermark data Ri to produce a spatial domain watermarked image. The watermarked image is produced by an embedder according to equation: Ci′=Ci+α. Ri, where Ci and Ci′ are wavelet transform coefficients of the image, and α is a scaling factor. α is chosen so that the watermark is imperceptible in the image and to resist removal of the watermark by unauthorized processing. It is desirable that a has the smallest value which achieves that. If α is too big the watermark is perceptible in the image. If α is too small the mark may not survive processing of the image.

Claims

1. A method of embedding data in an information signal representing material, said method comprising the steps of:

producing transform coefficients Ci of the material;

comparing the magnitudes of the coefficients with a threshold value T; and

producing modified coefficient value Ci′

by adding an additive offset to the coefficient Ci, wherein said offset is an information symbol of a pseudo random symbol sequence modulated by said data to be embedded;

wherein said step of producing modified coefficient values does not use coefficients of magnitude greater than the said threshold T and does not use the corresponding information symbols of the pseudo random symbol sequence, the value of said threshold T being set to reduce a likelihood of any coefficient having a dominant effect on a correlation of the pseudo random symbol sequence and the information signal in which the data has been embedded.

2. A method according to claim 1, wherein

the modified coefficients Ci′

=Ci+α

Pi

where α

Pi is an information symbol modulated by the data to be embedded, a being a scaling factor.

3. A method according to claim 2, wherein

α

is dependent on the data.

4. A method according to claim 2, wherein

α

is of fixed value.

5. A method according to claim 1, wherein

the modified coefficients Ci′

=Ci+α

Ri

where Ri is an information symbol Pi modulated by the data, and α

is a scaling factor.

6. A method according to claim 1, wherein

said transform is a wavelet transform.

7. A method according to claim 1, wherein

said transform is a spatial frequency transform.

9. A method according to claim 1, wherein

said data comprises a Unique Material Identifier.

10. A method according to claim 1, wherein

said material comprises video material.

11. A method according to claim 1, wherein

said material comprises audio material.

8. A computer program product embodied in a computer readable medium arranged to carry out the method of 1, when run on a computer.

12. Apparatus for embedding data in an information signal representing material, said apparatus comprising:

a transformer for producing transform coefficients Ci of the information signal;

a comparator for comparing the magnitudes of the coefficients with a threshold value T; and

a combiner for producing modified coefficient value Ci′

by adding an additive offset to the coefficient Ci, wherein said offset is an information symbol of a pseudo random symbol sequence modulated by said data to be embedded;

wherein the combiner does not use coefficients of magnitude greater than said threshold T and does not use the corresponding information symbols of the pseudo random symbol sequence, the value of said threshold T being set to reduce a likelihood of any coefficient having a dominant effect on the correlation of the pseudo random symbol sequence and the information signal in which the data has been embedded.

13. Apparatus according to claim 12, wherein

the combiner is arranged to produce modified coefficients Ci′

=Ci+α

.Pi

where α

.Pi is an information symbol modulated by the data to be embedded, α

being a scaling factor.

14. Apparatus according to claim 13, wherein

α

is dependent on the data.

15. Apparatus according to claim 13, wherein

α

is of fixed value.

16. Apparatus according to claim 12, wherein

the combiner is arranged to produce coefficients Ci′

=Ci α

.Ri

where Ri is an information symbol Pi modulated by the data, and α

is a scaling factor.

17. Apparatus according to claim 16, said apparatus further comprising:

a pseudo random sequence generator and a modulator for modulating the pseudo random sequence with said data.

18. Apparatus according to claim 12, wherein

said transformer is a wavelet transformer.

19. Apparatus according to claim 12, wherein

the said transformer produces a spatial frequency transform of said information signal.

20. A method for detecting data embedded in an information signal representing material, the detecting method comprising:

receiving transform coefficients of the information signal;

comparing the magnitudes of the received coefficients with a threshold value T; and

correlating, said coefficients with respective symbols of a pseudo random symbol sequence to detect said data,

wherein the correlating step does not use coefficients of magnitude greater than said threshold T and corresponding symbols of the pseudo random symbol sequence.

21. A method according to claim 20, further comprising the step of:

removing said data from said received coefficients not using coefficients of magnitude greater than said threshold T.

22. A computer program product embodied in a computer readable medium arranged to carry out the method of claim 20 when run on a computer.

23. A method of detecting data embedded in an information signal representing material, the method comprising the steps of:

receiving transform coefficients of the information signal;

comparing the magnitudes of the received coefficients with a threshold Tclip;

clipping, to a magnitude Tclip, the magnitude of coefficients of magnitude greater than said threshold Tclip; and

correlating the clipped and unclipped coefficients with a pseudo random symbol sequence to detect data embedded in the information signal.

24. A method according to claim 23, further comprising the step of:

composing removing data from said clipped and unclipped coefficients.

25. A computer program product embodied in a computer readable medium arranged to carry out the method of claim 23 when run on a computer.

26. A method of embedding data in an information signal representing material, said method comprising the steps of:

producing transform coefficients Ci of the material;

comparing the magnitudes of the coefficients with a threshold value T; and

producing, from the coefficients Ci and the said data, modified coefficient values Ci′

which are modified by respective information symbols of a pseudo random symbol sequence modulated by the said data to be embedded;

wherein the said step of producing modified coefficient values does not use coefficients of magnitude greater than the said threshold T and does not use the corresponding information symbols; and

detecting the data by

receiving transform coefficients of the material;

comparing the magnitudes of the received coefficients with a threshold Tclip;

clipping, to a magnitude Tclip, the magnitude of coefficients of magnitude greater than the said threshold Tclip; and

correlating the clipped and unclipped coefficients with a pseudo random symbol sequence to detect data embedded in the material.

27. Apparatus for detecting data embedded in an information signal representing material, the detecting apparatus comprising:

an input for receiving transform coefficients of an information signal;

a comparator for comparing the magnitudes of the received coefficients with a threshold T; and

a correlator for correlating said coefficients with respective symbols of a pseudo random symbol sequence to detect said data,

wherein the correlation does not use coefficients of magnitude greater than the said threshold T and the corresponding symbols of the pseudo random symbol sequence.

28. Apparatus according to claim 27, further comprising:

a data remover for removing data from the receiving coefficients, the remover omitting coefficients of magnitude greater than said threshold T.

29. Apparatus for detecting data embedded in an information signal representing material, said apparatus comprising:

an input for receiving transform coefficients Ci′

of the information signal;

a comparator for comparing the magnitudes of the received coefficients with a threshold Tclip;

a clipper for clipping, to a magnitude Tclip, the magnitude of coefficients of magnitude greater than said threshold T; and

a correlator for correlating the clipped and unclipped coefficients with a pseudo random symbol sequence to detect data embedded in the information signal.

30. Apparatus according to claim 29, further comprising:

a remover for removing data from the clipped and unclipped coefficients.

31. A system including an embedding apparatus, said system comprising:

a transformer for producing transform coefficients Ci of an information signal representing material,

a comparator for comparing the magnitudes of the coefficients with a threshold value T, and

a combiner for producing, from the coefficients Ci and the said data, modified coefficient values Ci′

which are modified by respective information symbols of a pseudo random symbol sequence modulated by the said data to be embedded, wherein the combiner does not use coefficients of magnitude greater than the said threshold T and does not use the corresponding information symbols; and

detecting apparatus comprising;

an input for receiving transform coefficients of the material;

a comparator for comparing the magnitudes of the received coefficients with a threshold T; and

a correlator for correlating the said coefficients with respective symbols of a pseudo random symbol sequence to detect the said data, wherein the correlation does not use coefficients of magnitude greater than the said threshold T and the corresponding symbols of the pseudo random symbol sequence.

32. A method of embedding data in an information signal representing material, the method comprising the steps of:

producing transform coefficients C_i representing a transform of the information signal;

producing a pseudo random symbol stream having L symbols P_i, the pseudo random symbol stream comprising symbol values of +1 or −

1;

calculating a correlation value S=Σ

C_i*P_i for i=1 to L; and

calculating modified coefficient values C_i′

=Ci+α

*Pi, where α

is calculated dependent on the value of S being positive or negative to identify a corresponding binary value of the data symbol being embedded.

33. A method according to claim 32 wherein α

=(α

′

+offset)

where α

′

+offset is a function of the data bit to be embedded in the coefficient,

α

′

=0 if S is positive and the data to be embedded is a symbol of a first value,

α

′

=0 if S is negative and the data to be embedded is a symbol of a second value, and

otherwise α

is a function of S such that Σ

Ci′

Pi has the correct sign to represent the symbol to be embedded.

34. A method according to claim 33, wherein

the first value is “

1” and

the second value is “

0”

.

35. A method according to claim 33, wherein the said function of S is α

′

=−

S/(L−

1) or α

′

=−

S/L.

36. A method according to claim 33, wherein the magnitude of the offset is greater than or equal to zero.

37. A method according to claim 36, wherein

the magnitude of the offset is one.

38. A method according to claim 32, wherein

said coefficients are coefficients of a wavelet transform of the information signal.

39. A method according to claim 32, wherein the data to be embedded includes a Unique Material Identifier (UMID).

40. A method of removing data from an information signal representing material, which data has been embedded by the method of claim 32, the method comprising the steps of:

calculating the correlation S′

=E Ci′

*Pi for i=1 to L, where Pi are the bits of the Pseudo Random Symbol Sequence (PRSS) and have values +1 and −

1;

calculating α

_r as a function of S′

; and

calculating Ci=Ci′

−

α

_r.Pi to recover the unmodified coefficients Ci.

41. A method according to claim 40, wherein

α

_r=S′

/(L−

1) or α

_r=(S′

/L).

42. A method according to claim 40, further comprising the step of:

deriving the symbols of the embedded data from S′

, where if S′

is positive a symbol is of the first value and if S′

is negative a symbol is of the second value.

43. A method according to claim 40, further comprising the step of:

generating and synchronizing a reference pseudo random symbol sequence with the pseudo random symbol sequence of the embedded data.

44. A computer program product embodied in a computer readable medium arranged to carry out the method of claim 32, when run on a computer.

45. A computer program product embodied in a computer readable medium arranged to carry out the method of claim 32 when run on a computer.

46. An apparatus for embedding data in an information signal representing material, the apparatus comprising:

a transformer for producing transform coefficients C_i representing a transform of the information signal;

a generator for producing a pseudo random symbol stream having L symbols P_i, the pseudo random symbol stream comprising symbol values of +1 or −

1;

an input for receiving symbols of the data to be embedded; and

a data embedder arranged to calculate a correlation value S=Σ

C_i*P_i for i=1 to L; and

to calculate modified coefficient values C_i′

=Ci+α

*Pi, where α

is calculated dependent on the value of S being positive or negative to identify a corresponding binary value of the data symbol being embedded.

47. Apparatus according to claim 46 wherein

α

=(α

′

+offset)

where α

′

offset is a function of the data bit to be embedded in the coefficient, and the apparatus is arranged to

calculate modified coefficient values Ci′

=Ci+(α

′

+offset)*Pi where

α

′

=0 if S is positive and the data to be embedded is a bit of a first value,

α

′

=0 if S is negative and the data to be embedded is a bit of a second value, and

otherwise α

′

is a function of S such that Σ

Ci′

.Pi has the correct sign to represent the bit to be embedded.

48. Apparatus according to claim 47, wherein

the first value is “

1” and

the second value is “

0”

.

49. Apparatus according to claim 47, wherein

α

=−

S/(L−

1) or −

S/L.

50. Apparatus according to claim 47, wherein

the offset is greater than or equal to zero.

51. Apparatus according to claim 50 wherein the offset=1.

52. Apparatus according to claim 46, wherein

the coefficients are coefficients of a wavelet transform of the material information signal.

53. Apparatus according to claim 52, wherein α

_r=S/(L−

1) or (S/L).

54. Apparatus according to claim 46, further comprising:

a generator for generating a Unique Material Identifier (UMID) as said data to be embedded.

55. Apparatus for removing data from an information signal representing material, which data has been embedded by the apparatus of claim 46, the apparatus comprising:

a generator for generating a Pseudo Random Symbol Sequence (PRSS); and

a calculator for calculating,

the correlation S′

=Σ

Ci′

.Pi for i=1 to L where Pi are the bits of the PRSS,

a value α

_r, dependent on S′

, and

a coefficient value Ci=Ci′

−

α

_r.Pi to recover the unmodified coefficients Ci.

56. Apparatus according to claim 55, further comprising:

a decoder for deriving the bits of the embedded data from the correlation value S′

, where if S′

is positive a bit of the data has a first value and if S′

is negative a bit of the data has a second value.

57. Apparatus according to claim 55, further comprising

a synchronizer for synchronizing the generated PRSS Pseudo Random Symbol Sequence (PRSS) with the PRSS of the embedded data.