Invisible image watermark for image verification

• US 5,875,249 A
• Filed: 01/08/1997
• Issued: 02/23/1999
• Est. Priority Date: 01/08/1997
• Status: Expired due to Term

• Current Assignee: Trend Micro Inc.
• Original Assignee: International Business Machines Corporation
• Inventors: Mintzer, Frederick Cole, Yeung, Minerva Ming-Yee
• Primary Examiner(s): Gregory, Bernarr E.
• Application Number:
  US08/780,484
• Time in Patent Office: 776 Days
• Field of Search: 382/232, 382/115, 382/252, 382/280, 382/287, 382/248, 382/250, 380/3-5, 380/51, 380/55, 380/4, 380/9, 380/10, 380/21, 380/23, 380/25, 380/44, 380/45, 380/46, 380/47, 380/49, 380/50, 380/54, 380/59, 283/17, 283/113, 283/901, 283/902, 283/73, 355/79
• US Class Current: 380/54
• CPC Class Codes: G06T 1/0021 Image watermarking
• CPC Class Codes: H04N 1/32203 Spatial or amplitude domain methods H04N1/32309 takes precedence
• CPC Class Codes: H04N 1/32208 involving changing the magnitude of selected pixels, e.g. overlay of information or super-imposition H04N1/32219, H04N1/32224 take precedence
• CPC Class Codes: H04N 1/32229 with selective or adaptive application of the additional information, e.g. in selected regions of the image H04N1/32213 takes precedence
• CPC Class Codes: H04N 1/32352 Controlling detectability or arrangements to facilitate detection or retrieval of the embedded information, e.g. using markers for decoding, detection or retrieval operations H04N1/32149 and subgroups take precedence
• CPC Class Codes: H04N 2201/3233 of authentication information, e.g. digital signature, watermark
• CPC Class Codes: H04N 2201/3269 of machine readable codes or marks, e.g. bar codes or glyphs

Abstract

A system quickly verifies that the content of an image has not been changed since an earlier time when the content of that image was stamped. The system consists of a stamping process that embeds stamping information into a source image and produces a verification key, and a verification process that extracts stamping information from a stamped source image based on the verification key. Furthermore, the verification process produces an image itself, from which the verification can be readily judged visually or by use of a computer or other display device. In the verification process, the changes in an image can be detected and localized. The image stamping process further includes an error diffussion process so that the effects of combining the stamping information with the original image are not readily perceptable. An image is safeguarded against malicious manipulations and the proprietary rights are protected by maintaining the integrity of the image content.

Claims

1. An apparatus for stamping and verifying a source image with stamping information in which the source image has a plurality of source image values, the apparatus comprising:

image stamping means for producing a stamped image by;

(a) forming a verification key from a seed value and a mapping function, the seed and the mapping function corresponding to at least one look-up table (LUT);

b) mapping, according to the mapping function and the at least one LUT, each of the plurality of the source image values to form a respective extracted value; and

c) altering selected ones of the plurality of source image values whose extracted value does not match a corresponding portion of the stamping information to produce a respective altered source image value having an altered extracted value equivalent to the corresponding portion of the stamping information; and

image extracting means for receiving the stamped image, for using the verification key to extract the stamping information in accordance with the mapping function, and for providing extracted stamping information; and

signaling means for signaling that there is a corruption to the stamped image if the stamping information and the extracted stamping information are not substantially equivalent.

2. The image verification apparatus as recited in claim 1, wherein the verification key includes a seed value and the image stamping means further includes table generating means for generating each entry of the at least one LUT using a random number generator and the seed value.

3. The image verification apparatus as recited in claim 1, wherein the stamping information is a watermark image.

4. The image verification apparatus as recited in claim 3, wherein the source image is formed of a plurality of source pixel values and the watermark image is formed of a plurality of watermark image pixel values.

5. The image verification apparatus as recited in claim 4, wherein:

the image stamping means further includes means for determining an order in which each of the plurality of source pixel values are to be addressed; and

error diffusion means comprising;

means for identifying one source pixel and a corresponding modified pixel in the source image, the modified pixel including an error value;

means for determining an amount of modified pixel error defined as the difference between the value of the modified pixel, including the error value, and value of the corresponding pixel in the stamped source image; and

means for error-diffusing the modified pixel error by providing means to adjust successive adjacent source pixel values away from the identified source pixel with decreasing amounts of modified pixel error, such that the total amount of the adjustment in the adjacent pixel values is equivalent to the modified pixel error.

6. The image verification apparatus as recited in claim 1, the image stamping means further including:

means for stamping the verification key with the stamped image; and

the image extracting means further includes means to extract the verification key from the stamped image.

7. The image verification apparatus as recited in claim 1, the signaling means further comprising:

means for storing the stamped information and the extracted stamping information;

means for comparing the stamped information and the extracted stamped information to produce comparison information; and

means for detecting the corruption to the extracted source image from the comparison information and for indicating at least one region of the extracted source image corresponding to the corruption.

8. The image verification apparatus as recited in claim 1, wherein the stamped image is one of a plurality of stamped images stored in a first memory, and each of the plurality of stamped images has a corresponding verification key, each verification key being one of the plurality of keys, stored in a second memory.

9. The image verification apparatus as recited in claim 8, the apparatus further comprising:

means for selecting the stamped image from the plurality of stamped images in the first memory; and

means to retrieve the verification key corresponding to the stamped image from the plurality of keys stored in the second memory.

10. The image verification apparatus as recited in claim 9, further comprising:

image integrity verification means for verifying the integrity of each of the plurality of stamped images in the first memory, the image integrity verification means repetitively;

     1) selecting each one of the plurality of stamped images and the corresponding verification key,

     2) extracting the stamping information from the stamped image based on the corresponding verification key; and

     3) verifying the integrity of the stamped image by verifying the stamping information with the verification key.

11. A system for stamping a source image with stamping information in which the source image has a plurality of source image values comprising:

forming means for forming a verification key from a seed value and a mapping function, the seed and the mapping function corresponding to at least one look-up table (LUT);

mapping means for mapping, according to the mapping function and the at least one LUT, each of the plurality of the source image values to form a respective extracted value; and

pixel alteration means for altering selected ones of the plurality of source image values whose extracted value does not match a corresponding portion of the stamping information to produce a respective altered source image value having an altered extracted value equivalent to the corresponding portion of the stamping information.

12. The image stamping system as recited in claim 11, wherein the plurality of the source image values is a plurality of source pixel values and the stamping information is a watermark image formed of a plurality of watermark image pixel values.

13. A system for stamping and verifying a source image with stamping information in which the source image is represented by a plurality of frequency-domain coefficient values, the system comprising:

image stamping means for producing a stamped image by;

(a) forming a verification key from a seed value and a mapping function, the seed and the mapping function corresponding to at least one look-up table (LUT);

b) mapping, according to the mapping function and the at least one LUT, each of the plurality of frequency-domain coefficient values to form a respective extracted value; and

c) altering selected ones of the frequency-domain coefficient values whose extracted value does not match a corresponding portion of the stamping information to produce a respective altered frequency-domain coefficient value having an altered extracted value equivalent to the corresponding portion of the stamping information;

image extracting means for receiving the stamped image, for using the verification key to extract the stamping information from the portion of the plurality of frequency-domain coefficient values in accordance with the mapping function and the LUT, and for providing extracted stamping information; and

signaling means for signaling that there is a corruption to the extracted source image if the stamping information and the extracted stamping information are not substantially equivalent.

14. The image verification apparatus as recited in claim 13, wherein the plurality of the frequency-domain coefficient values is formed by a frequency-domain transform operation on the source image represented by a plurality of source image pixel values.

15. The image verification system as recited in claim 14, wherein the transform operation on the source image pixel values is a discrete cosine transform (DCT) and the portion of the plurality of the frequency-domain coefficient values includes the dc coefficients of the DCT transformed plurality of source image pixel values.

16. The image verification system as recited in claim 13, wherein the stamping information is a a watermark image.

17. A system for stamping a source image with stamping information in which the source image is represented by a plurality of frequency-domain coefficient values, the system comprising:

stamping means for generating a verification key from a seed value and a mapping function, the seed and the mapping function corresponding to at least one look-up table (LUT);

mapping means for mapping, according to the mapping function and the at least one LUT, each of a portion of the plurality of frequency-domain coefficient values to form a corresponding extracted value; and

means for modifying selected ones of the portion of the plurality of frequency-domain coefficient values whose extracted value does not match a corresponding portion of the stamping information to produce a respective modified frequency-domain coefficient value having a modified extracted value equivalent to the corresponding portion of the stamping information.

18. The image verification system as recited in claim 17, wherein the stamping information is a watermark image which is formed as a plurality of watermark image values.

19. The image verification system as recited in claim 18, wherein the plurality of frequency-domain coefficient values are a set of discrete cosine (DCT) transform coefficient values of the source image and the portion of the plurality of frequency-domain coefficient values includes the dc coefficients of the set of DCT transform coefficient values.

20. A method of stamping and verifying a source image with stamping information in which the source image has a plurality of source image values, the method comprising the steps of:

(a) forming a verification key from a seed value and a mapping function, the seed and the mapping function corresponding to at least one lookup table (LUT);

(b) mapping, according to the mapping function and the at least one LUT, each of the plurality of the source image values to form a respective extracted value;

(c) altering selected ones of the plurality of source image values whose extracted value does not match a corresponding portion of the stamping information to produce a respective altered source image value having an altered extracted value equivalent to the corresponding portion of the stamping information;

d) extracting the stamping information in accordance with the mapping function and the at least one LUT defined by the verification key;

e) providing extracted stamping information; and

f) signaling that there is a corruption to the extracted source image if the stamping information and the extracted stamping information are not substantially equivalent.

21. A method of stamping a source image with stamping information in which the source image has a plurality of source image values comprising the steps of:

(a) forming a verification key from a seed value and a mapping function, the seed and the mapping function corresponding to at least one lookup table (LUT);

(b) mapping, according to the mapping function and the LUT, each of the plurality of the source image values to form a respective extracted value; and

(c) modifying selected ones of the plurality of source image values whose extracted value does not match a corresponding portion of the stamping information to produce a respective modified source image value having a modified extracted value equivalent to the corresponding portion of the stamping information.

22. The image stamping method as recited in claim 21, wherein the plurality of the source image values is a plurality of source pixel values and the stamping information is a watermark image formed as a plurality of watermark image pixel values, wherein the mapping step a) further comprises the step of:

a)(1) embedding the watermark image into the source image by setting each source pixel value to a corresponding one of the stamped image values according to the mapping function, the at least one LUT, and the corresponding one of the plurality of watermark image pixel values.

23. A method of providing an error-diffused stamped image, the stamped image being a source image defined by a plurality of source pixel values, each stamped with stamping information to form a corresponding modified pixel, comprising the steps of:

a) identifying one source pixel and a corresponding modified pixel in the source image, the modified pixel including an error value;

b) determining an amount of modified pixel error defined as the difference between the value of the modified pixel, including the error value, and value of the corresponding pixel in the stamped source image; and

c) error-diffusing the modified pixel error by adjusting successive adjacent source pixel values away from the identified source pixel with decreasing amounts of the modified pixel error, in which the corresponding modified pixel of each adjacent source pixel is altered such that the total amount of the adjustment in the adjacent pixel values is equivalent to the modified pixel error, and wherein the modified pixel value has incorporated the stamping information, and the adjacent altered pixel values have not yet incorporated the desired stamping information, which are further modified to incorporate appropriate stamping information in subsequent stamping processing.

24. A method of providing an error-diffused stamped image, the stamped image being a source image defined by a plurality of source pixel values, each stamped with stamping information to form a corresponding modified pixel, comprising the steps of:

a) identifying one source pixel value and a corresponding modified pixel value in the stamped image, the source pixel value including an error value;

b) determining an amount of modified pixel error defined as the difference between the source pixel value including the error value and the corresponding modified pixel value; and

c) error-diffusing the modified pixel error by adjusting successive adjacent source pixel values away from the identified source pixel with decreasing amounts of the modified pixel error by altering the corresponding modified pixel of each adjacent source pixel, wherein i) each altered modified pixel and ii) the modified pixel have a substantially similar portion of the stamping information as the modified pixel value.

25. The method of providing an error-diffused stamped image as recited in claim 24, further comprising the step of:

d) repeating steps a) through d) until all source pixel values are identified and error-diffused to provide the error-diffused stamped image.

26. A system for stamping a source image with stamping information in which the source image is represented by a plurality of source image pixels and in which the stamping information is a plurality of stamping values, comprising:

means for generating at least one look-up table (LUT) based upon a verification key; and

means for applying a mapping function corresponding to the at least one LUT to each source image pixel and for altering each source pixel such that the output value of the mapping function corresponds to a corresponding one of the plurality of stamping values.

27. A system for extracting stamping information from a stamped source image having stamping information in which the stamped source image is represented by a plurality of stamped source image pixels and in which the stamping information is a plurality of stamping values, comprising:

table generating means for generating at least one look-up table (LUT) based upon a verification key; and

means for applying a mapping function corresponding to the at least one LUT to each stamped source image pixel such that the output value of the mapping function extracts a corresponding one of the plurality of stamping values.

28. The system for extracting stamping information from a stamped source image as recited in claim 27, wherein the verification key contains a seed value and the table generating means generates each entry of the at least one LUT by using a random number generator employing the seed value.