Methods for watermarking media data

• US 7,983,441 B2
• Filed: 10/18/2007
• Issued: 07/19/2011
• Est. Priority Date: 10/18/2006
• Status: Active Grant

• Current Assignee: Destiny Software Productions Incorporated (Destiny Media Technologies Incorporated)
• Original Assignee: Destiny Software Productions Incorporated (Destiny Media Technologies Incorporated)
• Inventors: Vestergaard, Steven Erik, Tsui, Che-Wai
• Primary Examiner(s): Akhavannik; Hadi
• Application Number:
  US11/874,839
• Publication Number:
  US 20080098022A1
• Time in Patent Office: 1,370 Days
• Field of Search: 382/100, 704/500
• US Class Current: 382/100
• CPC Class Codes: G06T 1/005 Robust watermarking, e.g. average attack or collusion attack resistant
• CPC Class Codes: G06T 1/0085 Time domain based watermarking, e.g. watermarks spread over several images
• CPC Class Codes: G06T 2201/0051 Embedding of the watermark in the spatial domain
• CPC Class Codes: G06T 2201/0052 Embedding of the watermark in the frequency domain
• CPC Class Codes: G06T 2201/0053 Embedding of the watermark in the coding stream, possibly without decoding; Embedding of the watermark in the compressed domain
• CPC Class Codes: G10L 19/018 Audio watermarking, i.e. embedding inaudible data in the audio signal
• CPC Class Codes: H04N 1/32203 Spatial or amplitude domain methods H04N1/32309 takes precedence
• CPC Class Codes: H04N 1/32208 involving changing the magnitude of selected pixels, e.g. overlay of information or super-imposition H04N1/32219, H04N1/32224 take precedence
• CPC Class Codes: H04N 1/32229 with selective or adaptive application of the additional information, e.g. in selected regions of the image H04N1/32213 takes precedence
• CPC Class Codes: H04N 2201/3233 of authentication information, e.g. digital signature, watermark
• CPC Class Codes: H04N 2201/327 which are undetectable to the naked eye, e.g. embedded codes
• CPC Class Codes: H04N 2201/3284 for error correction

Abstract

Methods are provided for encoding watermark information into media data containing a series of digital samples in a sample domain. The method involves: dividing the series of digital samples into a plurality of sections in the sample domain, each section comprising a corresponding plurality of samples; processing the corresponding plurality of samples in each section to obtain a single energy value associated with each section; grouping the sections into groups, each group containing three or more sections; assigning a nominal bit value to each group according to a bit assignment rule, the bit assignment rule based on the energy values of the sections in the group; and assigning a watermark bit value to each group. The methods also involve, for each group, comparing the watermark bit value to the nominal bit value and, if the nominal bit value and the watermark bit value of the watermark information bit do not match, modifying one or more energy values of one or more corresponding sections in the group such that re-application of the bit assignment rule would assign the watermark bit value to the group. The bit assignment rule may comprise: a categorization rule for categorizing each group into one of a plurality of categories; and for each category, a unique category bit assignment rule for assigning a nominal zero bit value or a nominal one bit value to each group.

Claims

1. A method for encoding watermark information into media data containing a series of digital samples in a sample domain, the method comprising:

dividing the series of digital samples into a plurality of sections in the sample domain, each section comprising a corresponding plurality of samples;

processing the corresponding plurality of samples in each section to obtain a single energy value associated with each section;

grouping the sections into groups, each group containing an ordered plurality of three or more sections wherein first and second sections are adjacent to one another in the sample domain and a third section is adjacent to the second section in the sample domain, but spaced apart from the first section in the sample domain;

assigning a nominal bit value to each group according to a bit assignment rule, the bit assignment rule based on the energy values of the sections in the group;

assigning a watermark bit value to each group;

for each group, comparing the watermark bit value to the nominal bit value and, if the nominal bit value and the watermark bit value of the watermark information bit do not match, modifying one or more energy values of one or more corresponding sections in the group such that re-application of the bit assignment rule would assign the watermark bit value to the group;

wherein assigning the nominal bit value to each group according to the bit assignment rule comprises;

categorizing each group into one of a plurality of categories according to a categorization rule based on the energy value of the first section relative to the energy value of the second section and the energy value of the third section relative to the energy values of the first and second sections; and

for each category, assigning a nominal zero bit value or a nominal one bit value to each group according to a unique category bit assignment rule associated with the category;

wherein, for a particular group, the categorization rule comprises;

categorizing the particular group into a first shape category if the energy value of the second section is greater than an energy value of the first section and the energy value of the third section is greater than the energy values of the first and second sections;

categorizing the particular group into a second shape category if the energy value of the second section is less than an energy value of the first section and the energy value of the third section is less than the energy values of the first and second sections;

categorizing the particular group into a third shape category if the energy value of the second section is greater than an energy value of the first section and the energy value of the third section is between the energy values of the first and second sections;

categorizing the particular group into a fourth shape category if the energy value of the second section is greater than an energy value of the first section and the energy value of the third section is less than the energy values of the first and second sections;

categorizing the particular group into a fifth shape category if the energy value of the second section is less than an energy value of the first section and the energy value of the third section is between the energy values of the first and second sections; and

categorizing the particular group into a sixth shape category if the energy value of the second section is less than an energy value of the first section and the energy value of the third section is greater than the energy values of the first and second sections.

2. A method according to claim 1 wherein at least one of:

the media data comprises audio data and the sample domain comprises a time domain;

the media data comprises image data and the sample domain comprises a spatial domain; and

the media data comprises video data and the sample domain comprises at least one of;

a spatial domain and a time domain.

6. A method according to claim 1 wherein, for each category, the category bit assignment rule is based on a difference between the energy values of the first and second sections relative to a difference between the energy values of the second and third sections and wherein:

for the first and second shape categories, the category bit assignment rule assigns a first bit value where a magnitude of a first slope between the energy values of the first and second sections is greater than a magnitude of a second slope between the energy values of the second and third sections and assigns a second bit value where the magnitude value of the first slope is less than the magnitude of the second slope;

for the third and fifth shape categories, the category bit assignment rule assigns a first bit value where a magnitude of a second slope between the energy values of the second and third sections is greater than one half of a magnitude of a first slope between the first and second energy values and assigns a second bit value where the magnitude of the second slope is less than one half of the magnitude of the first slope; and

for the fourth and sixth shape categories, the category bit assignment rule assigns a first bit value where a magnitude of a second slope between the energy values of the second and third sections is greater than twice a magnitude of a first slope between the first and second energy values and assigns a second bit value where the magnitude of the second slope is less than twice the magnitude of the first slope.

7. A method according to claim 1 wherein modifying one or more energy values of one or more corresponding sections in the group comprises modifying a single energy value corresponding to a single section in the group.

8. A method according to claim 1 wherein modifying one or more energy values of one or more corresponding sections in the group comprises modifying the one or more energy values in the group in such a manner that re-application of the categorization rule to the group would categorize the group into a different category.

9. A method according to claim 1 wherein modifying one or more energy values of one or more corresponding sections in the group comprises modifying the one or more energy values in the group in such a manner that re-application of the category bit assignment rule to the group would assign a different bit value to the group but that re-application of the categorization rule to the group would categorize the group into the same category.

10. A method according to claim 1 wherein modifying one or more energy values of one or more corresponding sections in the group comprises modifying three or more energy values corresponding to three or more sections in the group.

11. A method according to claim 10 wherein modifying the three or more energy values corresponding to three or more sections in the group comprises repetitively incrementally modifying at least one of the three or more energy values until satisfying a termination condition, the termination condition based on the three or more energy values.

16. A method according to claim 1 wherein grouping the sections into groups comprises defining the groups to overlap one another such that the adjacent groups in the sampling domain include one or more sections in common.

17. A method according to claim 1 wherein the corresponding plurality of samples in each section is equal and wherein processing the corresponding plurality of samples in each section includes, for each section, integrating values of the corresponding plurality of samples in the section to obtain the energy value without performing a division operation.

3. A method for encoding watermark information into media data containing a series of digital samples in a sample domain, the method comprising:

dividing the series of digital samples into a plurality of sections in the sample domain, each section comprising a corresponding plurality of samples;

processing the corresponding plurality of samples in each section to obtain a single energy value associated with each section;

grouping the sections into groups, each group containing an ordered plurality of three or more sections wherein first and second sections are adjacent to one another in the sample domain and a third section is adjacent to the second section in the sample domain, but spaced apart from the first section in the sample domain;

assigning a nominal bit value to each group according to a bit assignment rule, the bit assignment rule based on the energy values of the sections in the group;

assigning a watermark bit value to each group;

for each group, comparing the watermark bit value to the nominal bit value and, if the nominal bit value and the watermark bit value of the watermark information bit do not match, modifying one or more energy values of one or more corresponding sections in the group such that re-application of the bit assignment rule would assign the watermark bit value to the group;

wherein assigning the nominal bit value to each group according to the bit assignment rule comprises;

categorizing each group into one of a plurality of categories according to a categorization rule based on the energy value of the first section relative to the energy value of the second section and the energy value of the third section relative to the energy values of the first and second sections; and

for each category, assigning a nominal zero bit value or a nominal one bit value to each group according to a unique category bit assignment rule associated with the category;

wherein, for each category, the corresponding category bit assignment rule is based on relative differences between the energy values of sections that are adjacent to one another in the sample domain.

4. A method according to claim 3 wherein, for each category, the corresponding category bit assignment rule is based on a difference between the energy values of the first and second sections relative to a difference between the energy values of the second and third sections.

5. A method according to claim 3 wherein, for each category, the category bit assignment rule is based on a slope between the energy values of the first and second sections relative to a slope between the energy values of the second and third sections.

20. A method according to claim 3 wherein at least one of:

the media data comprises audio data and the sample domain comprises a time domain;

the media data comprises image data and the sample domain comprises a spatial domain; and

the media data comprises video data and the sample domain comprises at least one of;

a spatial domain and a time domain.

21. A method according to claim 3 wherein, for each category, the category bit assignment rule is based on a difference between the energy values of the first and second sections relative to a difference between the energy values of the second and third sections and wherein:

for the first and second shape categories, the category bit assignment rule assigns a first bit value where a magnitude of a first slope between the energy values of the first and second sections is greater than a magnitude of a second slope between the energy values of the second and third sections and assigns a second bit value where the magnitude value of the first slope is less than the magnitude of the second slope;

for the third and fifth shape categories, the category bit assignment rule assigns a first bit value where a magnitude of a second slope between the energy values of the second and third sections is greater than one half of a magnitude of a first slope between the first and second energy values and assigns a second bit value where the magnitude of the second slope is less than one half of the magnitude of the first slope; and

for the fourth and sixth shape categories, the category bit assignment rule assigns a first bit value where a magnitude of a second slope between the energy values of the second and third sections is greater than twice a magnitude of a first slope between the first and second energy values and assigns a second bit value where the magnitude of the second slope is less than twice the magnitude of the first slope.

22. A method according to claim 3 wherein grouping the sections into groups comprises defining the groups to overlap one another such that the adjacent groups in the sampling domain include one or more sections in common.

23. A method according to claim 3 wherein the corresponding plurality of samples in each section is equal and wherein processing the corresponding plurality of samples in each section includes, for each section, integrating values of the corresponding plurality of samples in the section to obtain the energy value without performing a division operation.

24. A method according to claim 3 wherein modifying one or more energy values of one or more corresponding sections in the group comprises modifying a single energy value corresponding to a single section in the group.

25. A method according to claim 3 wherein modifying one or more energy values of one or more corresponding sections in the group comprises modifying the one or more energy values in the group in such a manner that re-application of the categorization rule to the group would categorize the group into a different category.

26. A method according to claim 3 wherein modifying one or more energy values of one or more corresponding sections in the group comprises modifying the one or more energy values in the group in such a manner that re-application of the category bit assignment rule to the group would assign a different bit value to the group but that re-application of the categorization rule to the group would categorize the group into the same category.

27. A method according to claim 3 wherein modifying one or more energy values of one or more corresponding sections in the group comprises modifying three or more energy values corresponding to three or more sections in the group.

12. A method for encoding watermark information into media data containing a series of digital samples in a sample domain, the method comprising:

dividing the series of digital samples into a plurality of sections in the sample domain, each section comprising a corresponding plurality of samples;

processing the corresponding plurality of samples in each section to obtain a single energy value associated with each section;

grouping the sections into groups, each group containing three or more sections;

assigning a nominal bit value to each group according to a bit assignment rule, the bit assignment rule based on the energy values of the sections in the group;

assigning a watermark bit value to each group;

for each group, comparing the watermark bit value to the nominal bit value and, if the nominal bit value and the watermark bit value of the watermark information bit do not match, modifying one or more energy values of one or more corresponding sections in the group such that re-application of the bit assignment rule would assign the watermark bit value to the group;

wherein assigning the nominal bit value to each group according to the bit assignment rule comprises;

categorizing each group into one of a plurality of categories according to a categorization rule; and

for each category, assigning a nominal zero bit value or a nominal one bit value to each group according to a unique category bit assignment rule associated with the category,

wherein modifying one or more energy values of one or more corresponding sections in the group comprises modifying three or more energy values corresponding to three or more sections in the group;

wherein modifying the three or more energy values corresponding to three or more sections in the group comprises repetitively incrementally modifying at least one of the three or more energy values until satisfying a termination condition, the termination condition based on the three or more energy values; and

wherein repetitively incrementally modifying at least one of the three or more energy values comprises repetitively incrementally modifying a plurality of the three or more energy values until satisfying one or more intermediate conditions, the one or more intermediate conditions based on at least two of the three or more energy values.

13. A method for encoding watermark information into media data containing a series of digital samples in a sample domain, the method comprising:

dividing the series of digital samples into a plurality of sections in the sample domain, each section comprising a corresponding plurality of samples;

processing the corresponding plurality of samples in each section to obtain a single energy value associated with each section;

grouping the sections into groups, each group containing three or more sections;

assigning a nominal bit value to each group according to a bit assignment rule, the bit assignment rule based on the energy values of the sections in the group;

assigning a watermark bit value to each group;

for each group, comparing the watermark bit value to the nominal bit value and, if the nominal bit value and the watermark bit value of the watermark information bit do not match, modifying one or more energy values of one or more corresponding sections in the group such that re-application of the bit assignment rule would assign the watermark bit value to the group;

wherein assigning the nominal bit value to each group according to the bit assignment rule comprises;

categorizing each group into one of a plurality of categories according to a categorization rule; and

for each category, assigning a nominal zero bit value or a nominal one bit value to each group according to a unique category bit assignment rule associated with the category,

wherein modifying one or more energy values of one or more corresponding sections in the group comprises modifying three or more energy values corresponding to three or more sections in the group;

wherein modifying the three or more energy values corresponding to three or more sections in the group comprises repetitively incrementally modifying at least one of the three or more energy values until satisfying a termination condition, the termination condition based on the three or more energy values; and

wherein repetitively incrementally modifying at least one of the three or more energy values comprises, for each repetitive iteration, incrementally modifying the at least one of the three or more energy values by a fixed percentage of its previous value.

14. A method for encoding watermark information into media data containing a series of digital samples in a sample domain, the method comprising:

dividing the series of digital samples into a plurality of sections in the sample domain, each section comprising a corresponding plurality of samples;

processing the corresponding plurality of samples in each section to obtain a single energy value associated with each section;

grouping the sections into groups, each group containing three or more sections;

assigning a nominal bit value to each group according to a bit assignment rule, the bit assignment rule based on the energy values of the sections in the group;

assigning a watermark bit value to each group;

for each group, comparing the watermark bit value to the nominal bit value and, if the nominal bit value and the watermark bit value of the watermark information bit do not match, modifying one or more energy values of one or more corresponding sections in the group such that re-application of the bit assignment rule would assign the watermark bit value to the group;

wherein assigning the nominal bit value to each group according to the bit assignment rule comprises;

categorizing each group into one of a plurality of categories according to a categorization rule; and

for each category, assigning a nominal zero bit value or a nominal one bit value to each group according to a unique category bit assignment rule associated with the category,

wherein modifying one or more energy values of one or more corresponding sections in the group comprises modifying three or more energy values corresponding to three or more sections in the group;

wherein modifying the three or more energy values corresponding to three or more sections in the group comprises repetitively incrementally modifying at least one of the three or more energy values until satisfying a termination condition, the termination condition based on the three or more energy values; and

wherein the termination condition comprises a condition where re-application of the bit assignment rule would assign the watermark bit value to the group modified by an error margin δ

.

15. A method according to claim 14 wherein modifying three or more energy values corresponding to three or more sections in the group comprises minimizing a sum of the changes to the three or more energy values while satisfying the termination condition.

28. A method according to claim 14 wherein at least one of:

the media data comprises audio data and the sample domain comprises a time domain;

the media data comprises image data and the sample domain comprises a spatial domain; and

the media data comprises video data and the sample domain comprises at least one of;

a spatial domain and a time domain.

29. A method according to claim 14 wherein grouping the sections into groups comprises defining the groups to overlap one another such that the adjacent groups in the sampling domain include one or more sections in common.

30. A method according to claim 14 wherein the corresponding plurality of samples in each section is equal and wherein processing the corresponding plurality of samples in each section includes, for each section, integrating values of the corresponding plurality of samples in the section to obtain the energy value without performing a division operation.

18. A method for extracting watermark information from media data containing a series of digital samples in a sample domain, the method comprising:

aligning the series of samples with an original version of the media data, wherein aligning the series of samples comprises adding zero samples to the series or removing samples from the series to translate the series in the sample domain;

dividing the series of digital samples into a plurality of sections in the sample domain, each section comprising a corresponding plurality of samples;

processing the corresponding plurality of samples in each section to obtain a single energy value associated with each section;

grouping the sections into groups, each group containing three or more sections;

assigning a nominal bit value to each group according to a bit assignment rule, the bit assignment rule based on the energy values of the sections in the group;

wherein assigning the nominal bit value to each group according to the bit assignment rule comprises;

categorizing each group into one of a plurality of categories according to a categorization rule; and

for each category, assigning a nominal zero bit value or a nominal one bit value to each group according to a unique category bit assignment rule associated with the category.

19. A method according to claim 18 wherein aligning the series of samples with the original version of the media data comprises comparing each sample of series with a corresponding sample of the original version of the media data and adding zero samples or removing samples from the series to minimize a metric associated with a difference between the series and the original version of the media data.