Hybrid residual-based hierarchical storage and display method for high resolution digital images in a multiuse environment

• US 4,969,204 A
• Filed: 11/29/1989
• Issued: 11/06/1990
• Est. Priority Date: 11/29/1989
• Status: Expired due to Term

• Current Assignee: Eastman Kodak Company
• Original Assignee: Eastman Kodak Company
• Inventors: Jones, Paul W., Melnychuck, Paul W.
• Primary Examiner(s): Boudreau, Leo H.
• Assistant Examiner(s): NOT, DEFINED
• Application Number:
  US07/442,872
• Time in Patent Office: 342 Days
• Field of Search: 358/133, 358/166, 358/426, 382/41, 382/49, 382/56
• US Class Current: 382/240
• CPC Class Codes: G06F 16/532 Query formulation, e.g. graphical querying
• CPC Class Codes: G06T 3/4007 based on interpolation, e.g. bilinear interpolation image demosaicing G06T3/4015; edge-driven or edge-based scaling G06T3/403
• CPC Class Codes: H04N 11/042 Codec means
• CPC Class Codes: H04N 19/186 the unit being a colour or a chrominance component
• CPC Class Codes: H04N 19/59 involving spatial sub-sampling or interpolation, e.g. alteration of picture size or resolution
• CPC Class Codes: H04N 19/63 using sub-band based transform, e.g. wavelets

Abstract

An image processing method is described for the hierarchical storage and display of high resolution digital images in a multiuse environment. The method makes reduced resolution versions of the original image available for quick display on video monitors while providing access to the full resolution image for photographic quality hardcopies. This multiresolution method also provides for the efficient storage of this data via a hybrid coding scheme based on residuals. Several embodiments of this approach are described.

Claims

1. A hierarchical storage method comprising the steps of:

(a) forming a digital representation of an image;

(b) decomposing said digital representation according to the following steps;

1. lowpass filtering and subsampling said digital representation to form a lower resolution image;

2. interpolating or replicating said lower resolution image to the dimensions of the higher resolution image to form a prediction image;

3. subtracting said prediction image from the higher resolution image to form a residual image;

4. encoding and storing said residual image; and

5. creating a plurality of encoded and stored residual images of different resolutions by iterating steps 1, 2, 3, and 4 where the input to the lowpass filtering and subsampling operation of step 1 is the lower resolution image formed in the previous iteration of step 1;

(c) further decomposing the lowest resolution image formed in (b) into a plurality of lower resolution images according to the following steps;

subsampling the even-numbered pixels on the even-numbered lines to create the first partitioned image;

subsampling the odd-numbered pixels on the even-numbered lines to create the first partitioned image;

subsampling the even-numbered pixels on the odd-numbered lines to create the first partitioned image; and

subsampling the odd-numbered pixels on the odd-numbered lines to create the first partitioned image;

(d) encoding and storing said partitioned images.

2. A hierarchical display method according to claim 1 and further comprising the steps of:

retrieving and decoding one of said lower resolution images of (c); and

displaying said one retrieved image.

3. A hierarchical display method according to claim 2 and further comprising the steps of:

retrieving and decoding at least one of the remainder of said lower resolution images of (c);

combining all of said retrieved lower resolution images to form a higher resolution image for display; and

displaying said combined retrieved image.

4. A hierarchical display method according to claim 3 and further comprising the steps of:

retrieving and decoding all of said lower resolution images of (c);

combining all of said retrieved lower resolution images to form a higher resolution image for display; and

displaying said combined retrieved image.

5. A hierarchical display method according to claim 4 and further comprising the steps of:

interpolating or replicating said combined retrieved image to the dimensions of the next higher resolution level to form a prediction image;

retrieving and decoding the residual image corresponding to said next higher resolution level;

adding said residual image to said prediction image to form a higher resolution image for display;

displaying said higher resolution image; and

iterating these steps for each remaining residual image of (b).

6. A hierarchical storage method comprising the steps of:

(a) forming a digital representation of an image;

(b) decomposing said digital representation according to the following steps;

1. lowpass filtering and subsampling said digital representation to form a lower resolution image;

2. interpolating or replicating said lower resolution image to the dimensions of the higher resolution image to form a prediction image;

3. subtracting said prediction image from the higher resolution image to form a residual image;

4. encoding and storing said residual image; and

5. creating a plurality of encoded and stored residual images of different resolutions by iterating steps 1, 2, 3, and 4 where the input to the lowpass filtering and subsampling operation of step 1 is the lower resolution image formed in the previous iteration step 1;

(c) further decomposing the lowest resolution image formed in (b) into a plurality of lower resolution images according to the following steps;

iteratively lowpass filtering and subsampling said image to create one or more lower resolution images; and

encoding and storing said lower resolution images.

7. A hierarchical display method according to claim 6 and further comprising the steps of:

retrieving and decoding one of said lower resolution images of (c); and

displaying said retrieved image.

8. A hierarchical display method according to claim 7 and further comprising the steps of:

retrieving and decoding said lowest resolution image of (b); and

displaying said retrieved image.

9. A hierarchical display method according to claim 8 and further comprising the steps of:

interpolating or replicating said retrieved image to the dimensions of the next higher resolution level to form a prediction image;

retrieving and decoding the residual image corresponding to said next higher resolution level;

adding said residual image to said prediction image to form a higher resolution image for display;

displaying said higher resolution image; and

iterating these steps for each remaining residual image of (b).

10. A hierarchical storage method comprising the steps of:

(a) forming a digital representation of an image;

(b) decomposing said digital representation according to the following steps;

1. lowpass filtering and subsampling said digital representation to form a lower resolution image;

2. interpolating or replicating said lower resolution image to the dimensions of the higher resolution image to form a prediction image;

3. subtracting said prediction image from the higher resolution image to form a residual image;

4. encoding and storing said residual image; and

5. creating a plurality of encoded and stored residual images of different resolutions by iterating steps 1, 2, 3, and 4 where the input to the lowpass filtering and subsampling operation of step 1 is the lower resolution image formed in the previous iteration of step 1;

(c) further decomposing the lowest resolution image formed in (b) into one or more lower resolution images by iteratively lowpass filtering and subsampling the image until the lowest resolution image formed has dimensions of 256 pixels×

384 lines;

(d) encoding and storing the lowest resolution image of (c) using the Philips CD-I (Compact Disc-Interactive) real-time video data format; and

(e) further decomposing the remaining images of (c) according to the following steps;

1. decoding the lowest resolution image of (d);

2. interpolating or replicating said decoded image to the dimensions of the next higher resolution level to form a prediction image;

3. subtracting said prediction image from the next higher resolution image formed in (c) to create a residual image;

4. quantizing said residual image using the Philips CD-I 7-level quantization scheme to form a CD-I extended resolution residual;

5. encoding and storing said CD-I extended resolution residual using the Philips CD-I real-time video format;

6. subtracting said CD-I extended resolution residual from the residual of step 3 to form a secondary residual;

7. encoding and storing said residual;

8. iterating steps 2, 3, and 7 for each remaining image in (c).

11. A hierarchical display method according to claim 10 and further comprising the steps of:

retrieving and decoding said lowest resolution image of (c); and

displaying said retrieved image.

12. A hierarchical display method according to claim 11 and further comprising the steps of:

interpolating or replicating said retrieved image to the dimensions of the next higher resolution level to form a prediction image;

retrieving and decoding the CD-I extended resolution residual of (e);

adding said prediction image to said decoded extended resolution residual to reconstruct an image for display; and

displaying said reconstructed image.

13. A hierarchical display method according to claim 12 and further comprising the steps of:

retrieving and decoding the secondary residual of (e);

adding said reconstructed image to said decoded secondary residual to reconstruct an image for display; and

displaying said reconstructed image.

14. A hierarchical display method according to claim 13 and further comprising the steps of:

interpolating or replicating said reconstructed image to the dimensions of the next higher resolution level to form a prediction image;

retrieving and decoding the corresponding residual of (e);

adding said reconstructed image to said decoded residual to reconstruct an image for display;

displaying said reconstructed image; and

iterating these steps until the lowest resolution image of (b) is reconstructed.

15. A hierarchical display method according to claim 14 and further comprising the steps of:

interpolating or replicating said reconstructed image to the dimensions of the next higher resolution level to form a prediction image;

retrieving and decoding the corresponding residual of (b);

adding said reconstructed image to said decoded residual to reconstruct an image for display;

displaying said reconstructed image; and

iterating these steps for each remaining residual of (b).