Method and apparatus for reducing quantization artifacts in a hierarchical image storage and retrieval system

• US 5,568,570 A
• Filed: 09/30/1994
• Issued: 10/22/1996
• Est. Priority Date: 09/30/1994
• Status: Expired due to Term

• Current Assignee: Eastman Kodak Company
• Original Assignee: Eastman Kodak Company
• Inventors: Rabbani, Majid
• Primary Examiner(s): Boudreau, Leo
• Assistant Examiner(s): Tadayon, Bijan
• Application Number:
  US08/315,781
• Time in Patent Office: 753 Days
• Field of Search: 382/251, 382/252, 382/275, 382/239, 382/240, 382/309, 382/238, 348/418, 348/419, 348/408, 348/405, 348/417, 348/414, 348/394, 358/428
• US Class Current: 382/238
• CPC Class Codes: G06T 1/0028 Adaptive watermarking, e.g. Human Visual System [HVS]-based watermarking
• CPC Class Codes: H04N 1/32144 embedded in the image data, i.e. enclosed or integrated in the image, e.g. watermark, super-imposed logo or stamp
• CPC Class Codes: H04N 1/32251 in multilevel data, e.g. greyscale or continuous tone data
• CPC Class Codes: H04N 1/32267 combined with processing of the image
• CPC Class Codes: H04N 1/40068 Modification of image resolution, i.e. determining the values of picture elements at new relative positions H04N1/3935 takes precedence
• CPC Class Codes: H04N 21/23892 involving embedding information at multiplex stream level, e.g. embedding a watermark at packet level
• CPC Class Codes: H04N 21/8358 involving watermark protecting executable software by watermarking G06F21/16; image watermarking in general G06T1/0021; watermarks inserted in still images for transmission purposes H04N1/32144; inserting watermarks during video coding H04N19/467
• CPC Class Codes: H04N 2201/3233 of authentication information, e.g. digital signature, watermark
• CPC Class Codes: H04N 2201/3273 Display
• CPC Class Codes: H04N 2201/3274 Storage or retrieval of prestored additional information
• CPC Class Codes: H04N 2201/328 Processing of the additional information

Abstract

The system and method reduces the quantization artifacts in the addition and removal of a digital watermark to and from a selected resolution image of a hierarchical image storage system where the watermark removal record is placed in a higher resolution image component. For those applications where preserving the image quality of a higher resolution image component is more critical than preserving the image quality of a lower resolution image component, the low-resolution image is modified according to the teachings of the present invention to minimize and in many cases eliminate the quantization artifacts at the higher resolution component.

Claims

1. A method for reducing quantization artifacts in a hierarchical image system of the type that decomposes a high resolution image into low resolution image components, including low resolution image pixel values, and residual image pixel values comprising the steps of:

a) forming a predicted higher resolution image by interpolating the pixel values of the low resolution image components;

b) determining the difference values between the pixel values in the low resolution image and the corresponding pixel values in the higher resolution image;

c) comparing each of the difference values against quantizer conversion values to determine if an error would exist for an executed conversion;

d) adjusting the image pixel values within the low resolution image component if an error would exist, to a value that eliminates the error to form an adjusted low resolution image;

e) using the unadjusted image pixel value as part of the adjusted low resolution image component if an error does not exist; and

f) forming a predicted higher resolution image by interpolating the pixel values of the adjusted low resolution image components of steps d) and e);

g) determining the difference values between the interpolated pixel values in the predicted higher resolution image and the corresponding pixel values in the higher resolution image;

h) comparing each of the difference values against quantizer conversion values to determine if an error would exist for an executed conversion;

i) adjusting further the image pixel values within the adjusted low resolution image component if an error would exist, to a value that eliminates the error to form an adjusted low resolution image; and

j) using the unadjusted image pixel value as part of the adjusted low resolution image component if an error does not exist.

2. A method for reducing quantization artifacts in a hierarchical image system of the type that decomposes a high resolution image into low resolution image pixel values and residual image pixel values comprising the steps of:

a) forming a predicted higher resolution image by interpolating the pixel values of the low resolution image components;

b) computing a predicted value for the high-resolution pixel value being processed from the to be adjusted low-resolution image using interpolation;

c) determining the difference value between the predicted value from the low-resolution image and the corresponding pixel value in the higher resolution image;

d) comparing the difference value against quantizer conversion values to determine if an error would exist for an executed conversion;

e) adjusting a pixel value in the low-resolution image to a value that eliminates the error to form an adjusted low resolution image if an error exists; and

making no adjustment if an error does not exist; and

f) repeating steps b) through e) for all the pixels in the high-resolution image;

3. A method for reducing quantization artifacts in a hierarchical image system of the type that decomposes a high resolution image into low resolution image pixel values and residual image pixel values comprising the steps of:

a) sequentially forming a predicted higher resolution image by interpolating the pixel values of a first block of low resolution image pixel values;

b) determining the difference value between the pixel values in the predicted higher resolution image and the corresponding pixel value in the higher resolution image;

c) comparing the difference value against quantizer conversion values to determine if an error would exist for an executed conversion;

d) adjusting the image pixel value within the low resolution image component if an error would exist, to a value that eliminates the error to form an adjusted low resolution image;

e) using the image pixel value as part of the adjusted low resolution image component if an error does not exist; and

f) repeating steps b) through e) for each pixel value in the higher resolution image.

4. A method for reducing quantization artifacts in a hierarchical image system of the type that decomposes a high resolution image into low resolution image pixel values and residual image pixel values comprising the steps of:

a) applying pixel values to pixel positions within a low resolution image to form a low resolution image component;

b) sequentially forming a predicted higher resolution image by interpolating the pixel values of a first block of the low resolution image components;

c) determining the difference value between the pixel value in the predicted higher resolution image and the corresponding pixel value in the higher resolution image;

d) comparing the difference values against established conversion values to determine if an error would exist for an executed conversion;

e) adjusting the image pixel value within the low resolution image component if an error would exist, to a value that eliminates the error to form an adjusted low resolution image;

f) using the image pixel value as part of the adjusted low resolution image component if an error does not exist; and

g) repeating steps b) through f) for each pixel value in the higher resolution image.

5. Apparatus for reducing quantization artifacts in a hierarchical image system of the type that decomposes a high resolution image into low resolution image pixel values, and residual image pixel values, comprising:

means for applying pixel values to pixel positions within the low resolution image to form a low resolution image component;

means for determining the difference values between the pixel values in the low resolution image component and the corresponding pixel values in the higher resolution image;

means for comparing each of the difference values against quantizer conversion values to determine if an error would exist for an executed conversion;

means for adjusting the image pixel values within the low resolution image component if an error would exist, to a value that eliminates the error to form an adjusted low resolution image component and using the image pixel value as part of the adjusted low resolution image component if an error does not exist; and

means for forming a predicted higher resolution image by interpolating the pixel values of the adjusted low resolution image component;

means for determining the difference values between the interpolated pixel values in the predicted higher resolution image and the corresponding pixel values in the higher resolution image;

means for comparing each of the difference values against quantizer conversion values to determine if an error would exist for an executed conversion;

means for adjusting the image pixel values within the adjusted low resolution image component if an error would exist, to a value that eliminates the error to form a twice adjusted low resolution image component; and

means for using the image pixel value as part of the twice adjusted low resolution image component if an error does not exist.

6. Apparatus for reducing quantization artifacts in a hierarchical image system of the type that decomposes a high resolution image into low resolution image components and residual image components comprising:

means for sequentially forming a predicted higher resolution image by interpolating the pixel values of a first block of the low resolution image components;

means for determining the difference value between the pixel value in the predicted higher resolution image and the corresponding pixel value in the higher resolution image;

means for comparing the difference values against established conversion values to determine if an error would exist for an executed conversion;

means for adjusting an image pixel value within the low resolution image component if an error would exist, to a value that eliminates the error to form an adjusted low resolution image;

means for using the image pixel value as part of the adjusted low resolution image component if an error does not exist; and

means for controlling said means for sequentially forming so as to form blocks for all of the pixels of the high resolution image.

7. A method for reducing quantization artifacts in a hierarchical image system of the type that decomposes a high resolution image into low resolution image pixel values and residual image pixel values and applies a watermark to the low resolution image pixel values comprising the steps of:

a) applying watermark pixel values to pixel positions within the low resolution image to form a watermarked low resolution image component;

b) determining the difference values between the pixel values in the watermarked low resolution image and the corresponding pixel values in the higher resolution image;

c) comparing each of the difference values against quantizer conversion values to determine if an error would exist for an executed conversion;

d) adjusting the watermark image pixel values within the watermarked low resolution image component if an error would exist, to a value that eliminates the error to form an adjusted watermarked low resolution image; and

e) using the watermark image pixel value as part of the adjusted watermarked low resolution image component if an error does not exist.

8. A method for reducing quantization artifacts in a hierarchical image system of the type that decomposes a high resolution image into low resolution image pixel values and residual image pixel values and applies a watermark to the low resolution image pixel values comprising the steps of:

a) applying watermark pixel values to pixel positions within the low resolution image to form a watermarked low resolution image component;

b) determining the difference values between the pixel values in the watermarked low resolution image and the corresponding pixel values in the higher resolution image;

c) comparing each of the difference values against quantizer conversion values to determine if an error would exist for an executed conversion;

d) adjusting the watermark image pixel values within the watermarked low resolution image component if an error would exist, to a value that eliminates the error to form an adjusted watermarked low resolution image;

e) using the watermark image pixel value as part of the adjusted watermarked low resolution image component if an error does not exist; and

f) forming a predicted higher resolution image by interpolating the pixel values of the adjusted watermarked low resolution image components of steps d) and e);

g) determining the difference values between the interpolated pixel values in the predicted higher resolution image and the corresponding pixel values in the higher resolution image;

h) comparing each of the difference values against quantizer conversion values to determine if an error would exist for an executed conversion;

i) adjusting further the watermark image pixel values within the adjusted watermarked low resolution image component if an error would exist, to a value that eliminates the error to form an adjusted watermarked low resolution image; and

j) using the watermark image pixel value as part of the adjusted watermarked low resolution image component if an error does not exist.

9. A method for reducing quantization artifacts in a hierarchical image system of the type that decomposes a high resolution image into low resolution image pixel values and residual image pixel values and applies a watermark to the low resolution image pixel values comprising the steps of:

a) applying watermark pixel values to pixel positions within the low resolution image to form a watermarked low resolution image component;

b) computing a predicted value for the high-resolution pixel value being processed from the to be adjusted watermarked low-resolution image using interpolation;

c) determining the difference value between the predicted value from the low-resolution watermarked image and the corresponding pixel value in the higher resolution image;

d) comparing the difference value against quantizer conversion values to determine if an error would exist for an executed conversion;

e) adjusting a pixel value in the low-resolution watermarked image to a value that eliminates the error to form an adjusted watermarked low resolution image if an error exists; and

making no adjustment if an error does not exist; and

f) repeating steps b) through e) for all the pixels in the high-resolution image;

10. A method for reducing quantization artifacts in a hierarchical image system of the type that decomposes a high resolution image into low resolution image pixel values and residual image pixel values and applies a watermark to the low resolution image pixel values comprising the steps of:

a) applying watermark pixel values to pixel positions within the low resolution image to form a watermarked low resolution image component;

b) sequentially forming a predicted higher resolution image by interpolating the pixel values of a first block of the watermarked low resolution image components;

c) determining the difference value between the pixel value in the predicted higher resolution image and the corresponding pixel value in the higher resolution image;

d) comparing the difference value against quantizer conversion values to determine if an error would exist for an executed conversion;

e) adjusting the watermark image pixel value within the watermarked low resolution image component if an error would exist, to a value that eliminates the error to form an adjusted watermarked low resolution image;

f) using the watermark image pixel value as part of the adjusted watermarked low resolution image component if an error does not exist; and

g) repeating steps b) through f) for each pixel value in the higher resolution image.

11. A method for reducing quantization artifacts in a hierarchical image system of the type that decomposes a high resolution image into low resolution image pixel values and residual image pixel values and applies a watermark to the low resolution image pixel values comprising the steps of:

a) applying watermark pixel values to pixel positions within the low resolution image to form a watermarked low resolution image component;

b) sequentially forming a predicted higher resolution image by interpolating the pixel values of a first block of the watermarked low resolution image components;

c) determining the difference value between the pixel value in the predicted higher resolution image and the corresponding pixel value in the higher resolution image;

d) comparing the difference values against established conversion values to determine if an error would exist for an executed conversion;

e) adjusting the watermark image pixel value within the watermarked low resolution image component if an error would exist, to a value that eliminates the error to form an adjusted watermarked low resolution image;

f) using the watermark image pixel value as part of the adjusted watermarked low resolution image component if an error does not exist; and

g) repeating steps b) through f) for each pixel value in the higher resolution image.

12. Apparatus for reducing quantization artifacts in a hierarchical image system of the type that decomposes a high resolution image into low resolution image pixel values and residual image pixel values and applies a watermark to the low resolution image pixel values comprising:

means for applying watermark pixel values to pixel positions within the low resolution image to form a watermarked low resolution image component;

means for determining the difference values between the pixel values in the watermarked low resolution image and the corresponding pixel values in the higher resolution image;

means for comparing each of the difference values against quantizer conversion values to determine if an error would exist for an executed conversion; and

means for adjusting the watermark image pixel values within the watermarked low resolution image component if an error would exist, to a value that eliminates the error to form an adjusted watermarked low resolution image component and using the watermark image pixel value as part of the adjusted watermarked low resolution image component if an error does not exist.

13. Apparatus for reducing quantization artifacts in a hierarchical image system of the type that decomposes a high resolution image into low resolution image pixel values and residual image pixel values and applies a watermark to the low resolution image pixel values comprising:

means for applying watermark pixel values to pixel positions within the low resolution image to form a watermarked low resolution image component;

means for determining the difference values between the pixel values in the watermarked low resolution image and the corresponding pixel values in the higher resolution image;

means for comparing each of the difference values against quantizer conversion values to determine if an error would exist for an executed conversion;

means for adjusting the watermark image pixel values within the watermarked low resolution image component if an error would exist, to a value that eliminates the error to form an adjusted low resolution image component and using the watermark image pixel value as part of the adjusted watermarked low resolution image component if an error does not exist; and

means for forming a predicted higher resolution image by interpolating the pixel values of the adjusted watermarked low resolution image;

means for determining the difference values between the interpolated pixel values in the predicted higher resolution image and the corresponding pixel values in the higher resolution image;

means for comparing each of the difference values against quantizer conversion values to determine if an error would exist for an executed conversion;

means for adjusting the watermark image pixel values within the adjusted watermarked low resolution image component if an error would exist, to a value that eliminates the error to form a twice adjusted watermarked low resolution image component; and

means for using the watermark image pixel value as part of the twice adjusted watermarked low resolution image component if an error does not exist.

14. Apparatus for reducing quantization artifacts in a hierarchical image system of the type that decomposes a high resolution image into low resolution image components and residual image components and applies a watermark to the low resolution image components comprising:

means for applying watermark pixel values to pixel positions within the low resolution image to form a watermarked low resolution image component;

means for sequentially forming a predicted higher resolution image by interpolating the pixel values of a first block of the watermarked low resolution image components;

means for determining the difference value between the pixel value in the predicted higher resolution image and the corresponding pixel value in the higher resolution image;

means for comparing the difference values against established conversion values to determine if an error would exist for an executed conversion;

means for adjusting the watermark image pixel value within the watermarked low resolution image component if an error would exist, to a value that eliminates the error to form an adjusted watermarked low resolution image;

means for using the watermark image pixel value as part of the adjusted watermarked low resolution image component if an error does not exist; and

means for controlling said means for sequentially forming so as to form blocks for all of the pixels of the high resolution image.