Hybrid subband-based hierarchical storage and display method for high resolution digital images in a multiuse environment

• US 5,048,111 A
• Filed: 11/06/1989
• Issued: 09/10/1991
• Est. Priority Date: 11/06/1989
• Status: Expired due to Term

• Current Assignee: Eastman Kodak Company
• Original Assignee: Eastman Kodak Company
• Inventors: Jones, Paul W., Melnychuck, Paul W.
• Primary Examiner(s): Shepperd, John W.
• Application Number:
  US07/432,293
• Time in Patent Office: 673 Days
• Field of Search: 358/12, 358/13, 358/21 R, 358/141, 358/160, 358/448, 358/450, 358/467, 358/426, 358/133, 382/49, 382/56
• US Class Current: 382/248
• CPC Class Codes: G06T 3/4007 based on interpolation, e.g. bilinear interpolation image demosaicing G06T3/4015; edge-driven or edge-based scaling G06T3/403
• CPC Class Codes: H04N 19/36 Scalability techniques involving formatting the layers as a function of picture distortion after decoding, e.g. signal-to-noise [SNR] scalability
• CPC Class Codes: H04N 19/63 using sub-band based transform, e.g. wavelets
• CPC Class Codes: H04N 5/9261 involving data reduction
• CPC Class Codes: H04N 9/797 for recording the signal in a plurality of channels, the bandwidth of each channel being less than the bandwidth of the signal H04N9/804, H04N9/81, H04N9/82 take precedence
• CPC Class Codes: H04N 9/808 involving pulse code modulation of the composite colour video-signal

Abstract

An image processing method is described for the hierarchical storage and display of high resolution digital images in a multiuse environment. The method makes reduced resolution versions of the original image available for quick display on video monitors while providing access to the full resolution image for making photographic quality hardcopies. This multiresolution method also provides for the efficient storage of the data resulting from the use of this method via a hybrid coding scheme. Several embodiments of the method are described.

Claims

1. A hierarchical storage method comprising the steps of:

a) forming a digital representation of an image;

b) decomposing said digital representation into multiple subband images each comprised of a band of spatial frequencies at one or more resolution levels, the series ranging from the lowest spatial frequency subband, to the highest defined by a);

c) further decomposing the lowest frequency subband of step b) into a plurality of lower resolution images according to the following steps;

1. subsampling the even-numbered pixels on the even-numbered lines to create a first partitioned image;

2. subsampling the odd-numbered pixels on the even-numbered lines to create a second partitioned image;

3. subsampling the even-numbered pixels on the odd-numbered lines to create a third partitioned image;

4. subsampling the odd-numbered pixels on the odd-numbered lines to create the fourth partitioned image;

d) encoding and storing the partitioned images of step c); and

e) encoding and storing the remaining subbands of step b).

2. A hierarchical display method according to claim 1 and further comprising the steps of:

retrieving and decoding one of said lower resolution images of step c); and

displaying said one retrieved image.

3. A hierarchical display method according to claim 2 and further comprising the steps of:

retrieving and decoding at least one of the remainder of said lower resolution images of step c);

combining all of said retrieved images to form a higher resolution image for display; and

displaying said combined retrieved image.

4. A hierarchical display method according to claim 1 and further comprising the steps of:

retrieving and decoding all of said lower resolution images of step c);

combining all of said retrieved lower resolution images to form a higher resolution image for display; and

displaying said combined retrieved image.

5. A hierarchical display method according to claim 4 and further comprising the steps of:

retrieving and decoding the subbands at one or more resolution levels;

combining said combined retrieved image with said retrieved and decoded subbands to form a higher resolution image for display; and

displaying said formed higher resolution image.

6. A hierarchical display method according to claim 5 and further comprising the steps of:

iterating the steps of claim 5 until a full resolution representation of the image of step a) is reconstructed and displayed.

7. A hierarchical storage method comprising the steps of:

a) forming a digital representation of an image;

b) decomposing said digital representation into multiple subband images, each comprised of a band of spatial frequencies, at one or more resolution levels ranging from the lowest spatial frequency subband to the highest defined by the digital representation of a);

c) further decomposing the lowest frequency subband of b) into a plurality of lower resolution images by;

iteratively lowpass filtering and subsampling the subband to create a plurality of lower resolution images;

encoding and storing the lower resolution images; and

encoding and storing the remaining subbands of step b).

8. A hierarchical display method according to claim 7 and further comprising the steps of:

retrieving and decoding one of said lower resolution images of step c); and

displaying said retrieved image.

9. A hierarchical display method according to claim 8 and further comprising the steps of:

retrieving and decoding the lowest frequency subband of step b); and

displaying said retrieved image.

10. A hierarchical display method according to claim 9 and further comprising the steps of:

retrieving and decoding the subbands at one or more resolution levels;

combining said retrieved image with said retrieved and decoded subbands to form a higher resolution image for display; and

displaying said higher resolution image.

11. A hierarchical display method according to claim 10 and further comprising the step of:

iterating the steps of claim 10 until a full resolution representation of the image of step a) is reconstructed and displayed.

12. A hierarchical storage method comprising the steps of:

a) forming a digital representation of an image;

b) decomposing said digital representation into multiple subband images, each comprised of a band of spatial frequencies at one or more resolution levels, ranging from the lowest spatial frequency subband to the highest defined by the digital representation of a);

c) further decomposing the lowest frequency subband of b) into a one or more lower resolution images by iteratively lowpass filtering and subsampling the subband;

d) encoding and storing the lowest resolution image of c);

e) further decomposing the remaining lower resolution images of c) according to the following steps;

1. decoding the lowest resolution image of d);

2. interpolating or replicating said image to the dimensions of the next higher resolution level to form a prediction image;

14. A hierarchical display method according to claim 12 and further comprising the steps of:

retrieving and decoding said lowest resolution image of step c); and

displaying said retrieved image.

16. A hierarchical display method according to claim 14 and further comprising the steps of:

iterating the steps of claim 14 for each remaining residual of e) until the lowest frequency subband image of b) is reconstructed; and

displaying said reconstructed image.

18. A hierarchical display method according to claim 16 and further comprising the step of:

iterating the steps of claim 16 until a full resolution representation of the image of step a) is reconstructed and displayed.

21. A hierarchical display method according to claim 18 and further comprising the steps of:

retrieving and decoding said lowest resolution image of step c); and

displaying said retrieved image.

24. A hierarchical display method according to claim 21 and further comprising the steps of:

iterating the steps of claim 21 for the remaining residuals of e) until the lowest frequency subband image of b) is reconstructed; and

displaying said reconstructed image.

13. subtracting said prediction image from the next higher resolution image formed in c) to create a residual image;

4. losslessly encoding and storing said residual image; and

5. iterating steps 2, 3, and 4 for each remaining image in c) to create a hierarchy of losslessly encoded residual images.

15. A hierarchical display method according to claim 13 and further comprising the steps of:

interpolating or replicating said retrieved image to the dimensions of the next higher resolution level to form a prediction image;

retrieving and decoding the lowest resolution residual image of step e);

adding said prediction image to said decoded residual image to reconstruct an image for display; and

displaying said reconstructed image.

17. A hierarchical display method according to claim 15 and further comprising the steps of:

retrieving and decoding the subbands at one or more resolution levels;

combining said reconstructed image with said retrieved and decoded subbands to form a higher resolution image for display; and

displaying said formed higher resolution image.

19. A hierarchical storage method comprising the steps of:

a) forming a digital representation of an image;

b) decomposing said digital representation into multiple subband images, each comprised of a band of spatial frequencies at one or more resolution levels, ranging from the lowest spatial frequency subband to the highest defined by a digital representation of a);

c) further decomposing the lowest frequency subband of b) into a one or more lower resolution images by iteratively lowpass filtering and subsampling the subband until the lowest resolution image has dimensions of 256 pixels×

384 lines;

d) encoding and storing the lowest resolution image of c) using the Philips CD-I (Compact Disc-Interactive) real-time video data format;

e) further decomposing the remaining lower resolution images of c) according to the following steps;

22. A hierarchical display method according to claim 19 and further comprising the steps of:

interpolating or replicating said retrieved image to the dimensions of the next higher resolution level to form a prediction image;

retrieving and decoding the CD-I extended resolution residual of step e);

adding said prediction image to said decoded residual image to reconstruct an image for display; and

displaying said reconstructed image.

25. A hierarchical display method according to claim 22 and further comprising the steps of:

retrieving and decoding the subbands at one or more resolution levels;

combining said reconstructed image with said retrieved and decoded subbands to form a higher resolution image for display; and

displaying said formed higher resolution image.

20. decoding the lowest resolution image of d);

2. interpolating or replicating said image to the dimensions of the next higher resolution level to form a prediction image;

3. subtracting said prediction image from the next higher resolution image formed in c) to create a residual image;

4. quantizing said residual image using the Philips CD-I 7-level quantization scheme to form a CD-I extended resolution residual;

5. encoding and storing said CD-I extended resolution residual using the Philips CD-I real-time video data format;

6. subtracting said CD-I extended resolution residual from residual of step 3 to form another residual;

7. losslessly encoding and storing the residual image; and

8. iterating steps 2, 3, and 7 for each remaining image in c) to create a hierarchy of losslessly encoded residual images.

23. A hierarchical display method according to claim 20 and further comprising the steps of:

interpolating or replicating said reconstructed image to the dimensions of the next higher resolution level to form a prediction image;

retrieving and decoding the losslessly encoded residual of step e);

adding said prediction image to said decoded residual image to reconstruct an image for display; and

displaying said reconstructed image.

26. A hierarchical display method according to claim 23 and further comprising the step of:

iterating the steps of claim 23 until a full resolution representation of the image of step a) is reconstructed and displayed.