Methods and apparatus for embedding and recovering watermarking information based on host-matching codes

• US 7,159,118 B2
• Filed: 01/31/2002
• Issued: 01/02/2007
• Est. Priority Date: 04/06/2001
• Status: Expired due to Fees

• Current Assignee: Verance Corporation
• Original Assignee: Verance Corporation
• Inventors: Petrovic, Rade
• Primary Examiner(s): Barron, Jr.; Gilberto
• Assistant Examiner(s): LEMMA, SAMSON B
• Application Number:
  US10/066,039
• Publication Number:
  US 20030014634A1
• Time in Patent Office: 1,797 Days
• Field of Search: 713/176
• US Class Current: 713/176
• CPC Class Codes: G06T 1/0028 Adaptive watermarking, e.g. Human Visual System [HVS]-based watermarking
• CPC Class Codes: G06T 2201/0202 whereby the quality of watermarked images is measured; Measuring quality or performance of watermarking methods; Balancing between quality and robustness
• CPC Class Codes: G10L 19/018 Audio watermarking, i.e. embedding inaudible data in the audio signal
• CPC Class Codes: H04N 1/32149 Methods relating to embedding, encoding, decoding, detection or retrieval operations
• CPC Class Codes: H04N 1/32229 with selective or adaptive application of the additional information, e.g. in selected regions of the image H04N1/32213 takes precedence
• CPC Class Codes: H04N 2201/3233 of authentication information, e.g. digital signature, watermark
• CPC Class Codes: H04N 2201/327 which are undetectable to the naked eye, e.g. embedded codes
• CPC Class Codes: H04N 2201/3281 Encryption; Ciphering

Abstract

The invention provides apparatus and methods for embedding and recovering watermarking information based on host-matching codes. A code selector provides codes to be embedded in the host signal. The code selector associates distinct input data strings to be embedded into the host signal with distinct code sets. Codes from the associated code sets are selected to represent the input data strings based on an analysis of the host signal (i.e. “host-matching”). The code selector may associate the distinct input data strings with distinct code sets based on a predefined mapping. An embedder embeds the codes into the host signal to provide a watermarked signal. An extractor at a decoder extracts the embedded codes from the watermarked signal. A code interpreter interprets the codes to recover the data represented thereby. The interpreter may perform a many-to-one mapping of an extracted code to the associated data string.

Claims

1. A method for embedding watermarking information, comprising:

providing a host signal;

calculating at least one feature of said host signal;

extracting said at least one feature from said host signal;

providing data to be embedded in the host signal;

associating distinct input data strings of said data with distinct code sets;

matching each of said at least one feature with a code from each code set;

selecting codes from the associated code sets to represent said input data strings based on said matching; and

embedding said selected codes into the host signal to provide a watermarked signal.

2. A method in accordance with claim 1, wherein said associating step is based on a predefined mapping.

3. A method in accordance with claim 2, wherein the predefined mapping is known to both a code selector at an encoder and a code interpreter at a decoder.

4. A method in accordance with claim 1, further comprising:

transmitting said watermarked signal to a decoder;

extracting said embedded codes from said watermarked signal; and

interpreting said codes to recover said data.

5. A method in accordance with claim 4, wherein said interpreting step comprises a many-to-one mapping of an extracted code to the associated data string.

6. A method in accordance with claim 1, further comprising:

error correction coding of said data.

7. A method in accordance with claim 1, further comprising:

segmenting the data into said input strings.

8. A method in accordance with claim 1, further comprising:

generating for each input data string a code set containing said codes.

9. A method in accordance with claim 8, wherein:

said code set contains L codes;

each code is m-bits long;

L is less than or equal to 2<sup>m−

n</sup>;

n is any positive integer; and

m is greater than n.

11. A method in accordance with claim 1, wherein said matching comprises:

calculating a cross-correlation factor between the extracted feature and each code from said code set; and

comparing each cross-correlation factor to determine the code which is a best match for said feature of said host signal.

12. A method in accordance with claim 11, wherein:

said selecting step comprises selecting said code which is a best match for said feature; and

said embedding step comprises embedding said selected code in the host signal at a location of the feature used in said matching step.

13. A method in accordance with claim 12, further comprising:

assigning appropriate gains to said selected code in order to reduce distortion of the host signal when said selected code is embedded in said host signal.

14. A method in accordance with claim 1, wherein said input strings are mapped to codes with the objective of minimizing distortion of the host signal.

15. A method in accordance with claim 1, wherein said codes are symbol-error correcting codes, with each symbol corresponding to one data segment that is mapped to the host matching codes in order to limit error multiplication effects.

10. A method for embedding watermarking information, comprising:

providing a host signal;

providing data to be embedded in the host signal;

associating distinct input data strings of said data with distinct code sets;

selecting codes from the associated code sets to represent said input data strings based on an analysis of the host signal; and

embedding said codes into the host signal to provide a watermarked signal

wherein the codes within the code sets are selected such that they have a maximum Hamming distance.

16. A method for embedding watermarking information, comprising:

providing a host signal;

providing data to be embedded in the host signal;

error correction coding of said data;

scrambling said data with each code from a code set to provide a plurality of scrambled data sequences;

comparing each scrambled data sequence to said host signal;

selecting a scrambled sequence which is a best match to said host signal;

embedding said best matched scrambled data sequence into the host signal to provide a watermarked signal;

transmitting said watermarked signal to a decoder;

extracting said embedded scrambled data sequence from said watermarked signal;

further scrambling said extracted scrambled data sequence with each code from said code set to provide a plurality of unscrambled data sequences;

error-decoding of each of said unscrambled data sequences; and

determining which of said error-decoded unscrambled data sequences is a valid watermarking sequence.

17. A method in accordance with claim 16, wherein said scrambling step comprises an XOR operation between the data and each code of the code set.

18. A method for recovering embedded watermarking data from a watermarked signal, comprising the steps of:

receiving said watermarked signal;

extracting embedded codes from said watermarked signal; and

interpreting said extracted codes to recover said watermarking data;

wherein;

each code represents an input string of said watermarking data, each code being selected from a code set associated with said in put data string; and

said watermarked signal is generated by;

calculating at least one feature of said host signal;

extracting said at least one feature from said host signal; and

matching each of said at least one feature with a code from each code set.

19. A method in accordance with claim 18, wherein each code is associated with said input string based on a predefined mapping known to both a code selector at an encoder and a code interpreter at a decoder.

20. A method in accordance with claim 18, wherein said interpreting step comprises a many-to-one mapping of the extracted codes to said data string.

21. A method in accordance with claim 18, wherein:

said code set contains L codes;

each code is m-bits long;

L is less than or equal to 2<sup>m−

n</sup>;

n is any positive integer; and

m is greater than n.

22. A method in accordance with claim 18, wherein the codes within the code sets are selected such that they have a maximum Hamming distance.

23. A method in accordance with claim 18, wherein said matching comprises:

calculating a cross-correlation factor between the extracted feature and each code from said code set; and

comparing each cross-correlation factor to determine the code which is a best match for said feature of said host signal.

24. A method in accordance with claim 23, wherein:

a code which is a best match for said feature is selected from the code set; and

said selected code is embedded in the host signal at a location of the feature used in said matching step.

26. A method in accordance with claim 18, wherein said codes are symbol-error correcting codes, with each symbol corresponding to one data segment that is mapped to the host matching codes in order to limit error multiplication effects.

25. A method for recovering embedded watermarking data from a watermarked signal, comprising the steps of:

receiving said watermarked signal;

extracting embedded codes from said watermarked signal;

interpreting said extracted codes to recover said watermarking data;

wherein each code represents an input string of said watermarking data, each code being selected from a code set associated with said input data string based on an analysis of a host signal to be watermarked; and

assigning appropriate gains to said selected code in order to reduce distortion of the host signal when said selected code is embedded in said host signal.

27. A method for recovering watermarking data from a watermarked signal, comprising the steps of:

receiving said watermarked signal at a decoder;

extracting an embedded scrambled data sequence from said watermarked signal;

generating a plurality of scrambled data sequences at said decoder;

comparing said extracted scrambled data sequence with said plurality of scrambled data sequences generated at said decoder; and

determining whether any of said scrambled data sequences generated at said decoder match, within predefined parameters, said extracted data sequence;

wherein said embedded scrambled data sequence is selected from a plurality of scrambled data sequences generated by scrambling said watermarking data with each code from a code set, based on a comparison with a host signal.

28. A method in accordance with claim 27, wherein said scrambling of said watermarking data with said codes comprises an XOR operation between the watermarking data and each code.

29. A method in accordance with claim 27, wherein said generating of a plurality of scrambled data sequences at the decoder comprises scrambling said watermarking data with each code from a code set to provide a plurality of scrambled data sequences at said decoder.

30. A method for recovery of watermarking information from a watermarked signal, comprising the steps of:

receiving said watermarked signal;

extracting an embedded scrambled data sequence from said watermarked signal;

further scrambling said extracted scrambled data sequence with codes from a code set to provide a plurality of unscrambled data sequences;

error-decoding each of said unscrambled data sequences; and

determining which of said error-decoded unscrambled data sequences is a valid watermarking sequence;

wherein said embedded scrambled data sequence is selected from a plurality of scrambled data sequences generated by scrambling error-encoded watermarking data with each code from a code set, based on a comparison with a host signal.

31. Apparatus for embedding watermarking information, comprising:

a feature extractor for calculating and extracting at least one feature of said host signal;

a code selector for associating distinct code sets with distinct input data strings to be embedded in a host signal;

a matching device for matching each of said at least one feature with a code from each of said code sets;

said code selector selecting codes from the associated code sets to represent said input data strings based on said matching; and

an embedder for embedding said selected codes into the host signal to provide a watermarked signal.

32. Apparatus in accordance with claim 31, wherein said code selector associates said distinct input data strings with distinct code sets based on a predefined mapping.

33. Apparatus in accordance with claim 32, wherein the predefined mapping is known to both the code selector at an encoder and a code interpreter at a decoder.

34. Apparatus in accordance with claim 31, further comprising:

a transmitter for transmitting said watermarked signal to a decoder;

an extractor for extracting said embedded codes from said watermarked signal; and

a code interpreter for interpreting said codes to recover data represented thereby.

35. Apparatus in accordance with claim 34, wherein said interpreting comprises a many-to-one mapping of an extracted code to the associated data string.

36. Apparatus in accordance with claim 31, further comprising:

a channel encoder for error correction coding of said data.

37. Apparatus in accordance with claim 31, further comprising:

a data segmentation device for segmenting the data into said input strings.

38. Apparatus in accordance with claim 31, further comprising:

a code list generator for generating for each input data string a code set containing said codes.

39. Apparatus in accordance with claim 38, wherein:

said code set contains L codes;

each code is m-bits long;

L is less than or equal to 2<sup>m−

n</sup>;

n is any positive integer; and

m is greater than n.

41. Apparatus in accordance with claim 31, wherein:

said matching device calculates a cross-correlation factor between the extracted feature and each code from said code set and compares each cross-correlation factor to determine the code which is a best match for said feature of said host signal.

42. Apparatus in accordance with claim 41, wherein:

said code is selected which is a best match for said feature; and

said selected code is embedded in the host signal at a location of the feature used in said matching.

43. Apparatus in accordance with claim 42, wherein:

appropriate gains are assigned to said selected code in order to reduce distortion of the host signal when said selected code is embedded in said host signal.

44. Apparatus in accordance with claim 31, wherein said input strings are mapped to codes with the objective of minimizing distortion of the host signal.

45. Apparatus in accordance with claim 31, wherein said codes are symbol-error correcting codes, with each symbol corresponding to one data segment that is mapped to the host matching codes in order to limit error multiplication effects.

40. Apparatus for embedding watermarking information, comprising:

a code selector for providing codes to be embedded in a host signal; and

an embedder for embedding said codes into the host signal to provide a watermarked signal;

wherein;

said code selector;

associates distinct input data strings to be embedded into said host signal with distinct code sets; and

selects codes from the associated code sets to represent said input data strings based on an analysis of the host signal; and

the codes within the code sets are selected such that they have a maximum Hamming distance.

46. Apparatus for embedding watermarking information, comprising:

a channel encoder for error correction coding of data to be embedded in a host signal;

a first scrambler for scrambling said data with each code from a code set to provide a plurality of scrambled data sequences;

a code selector for comparing each scrambled data sequence to said host signal and selecting a scrambled sequence which is a best match to said host signal;

an embedder for embedding said best matched scrambled data sequence into the host signal to provide a watermarked signal;

a transmitter for transmitting said watermarked signal to a decoder;

an extractor for extracting said embedded scrambled data sequence from said watermarked signal;

a second scrambler for further scrambling said extracted scrambled data sequence with each code from said code set to provide a plurality of unscrambled data sequences; and

a channel decoder for error-decoding of each of said unscrambled data sequences and determining which of said error-decoded unscrambled data sequences is a valid watermarking sequence.

47. Apparatus in accordance with claim 46, wherein said scrambler performs an XOR operation between the data and each code of the code set.

48. Apparatus for recovering embedded watermarking data from a watermarked signal, comprising:

an extractor for extracting embedded codes from a received watermarked signal; and

an interpreter for interpreting said extracted codes to recover said watermarking data;

wherein;

each code represents an input string of said watermarking data, each code being selected from a code set associated with said input data string; and

said watermarked signal is generated at an encoder by;

calculating at least one feature of said host signal;

extracting said at least one feature from said host signal; and

matching each of said at least one feature with a code from each code set.

49. Apparatus in accordance with claim 48, wherein each code is associated with said input string based on a predefined mapping known to both a code selector at an encoder and a code interpreter at a decoder.

50. Apparatus in accordance with claim 48, wherein said interpreter provides a many-to-one mapping of the extracted codes to said data string.

51. Apparatus in accordance with claim 48, wherein:

said code set contains L codes;

each code is m-bits long;

L is less than or equal to 2<sup>m−

n</sup>;

n is any positive integer; and

m is greater than n.

52. Apparatus in accordance with claim 48, wherein the codes within the code sets are selected such that they have a maximum Hamming distance.

53. Apparatus in accordance with claim 48 wherein said matching comprises:

calculating a cross-correlation factor between the extracted feature and each code from said code set; and

comparing each cross-correlation factor to determine the code which is a best match for said feature of said host signal.

54. Apparatus in accordance with claim 53, wherein:

a code selector at said encoder selects a code from the code set which is a best match for said feature; and

an embedder at said encoder embeds said selected code in the host signal at a location of the feature used in said matching step.

56. Apparatus in accordance with claim 48, wherein said codes are symbol-error correcting codes, with each symbol corresponding to one data segment that is mapped to the host matching codes in order to limit error multiplication effects.

55. Apparatus for recovering embedded watermarking data from a watermarked signal, comprising:

an extractor for extracting embedded codes from a received watermarked signal; and

an interpreter for interpreting said extracted codes to recover said watermarking data;

wherein each code represents an input string of said watermarking data, each code being selected from a code set associated with said input data string based on an analysis of a host signal to be watermarked;

wherein appropriate gains are assigned to said selected code in order to reduce distortion of the host signal when said selected code is embedded in said host signal.

57. Apparatus for recovering watermarking data from a watermarked signal, comprising:

an extractor for extracting an embedded scrambled data sequence from a received watermarked signal;

a scrambler for generating a plurality of scrambled data sequences; and

a processor for comparing said extracted scrambled data sequence with said plurality of scrambled data sequences generated at said decoder, said processor determining whether any of said scrambled data sequences generated at said decoder match, within predefined parameters, said extracted data sequence;

wherein said embedded scrambled data sequence is selected from a plurality of scrambled data sequences generated by scrambling said watermarking data with each code from a code set, based on a comparison with a host signal.

58. Apparatus in accordance with claim 57, wherein said scrambler performs an XOR operation between the watermarking data and each code.

59. Apparatus in accordance with claim 57, wherein said scrambler generates a plurality of scrambled data sequences at the decoder by scrambling said watermarking data with each code from a code set to provide a plurality of scrambled data sequences at said decoder.

60. Apparatus for recovery of watermarking information from a watermarked signal, comprising:

an extractor for extracting an embedded scrambled data sequence from a received watermarked signal;

a scrambler for further scrambling said extracted scrambled data sequence with codes from a code set to provide a plurality of unscrambled data sequences; and

a channel decoder for error-decoding each of said unscrambled data sequences and determining which of said error-decoded unscrambled data sequences is a valid watermarking sequence;

wherein said embedded scrambled data sequence is selected from a plurality of scrambled data sequences generated by scrambling error-encoded watermarking data with each code from a code set, based on a comparison with a host signal.