Image processing apparatus

• US 5,384,869 A
• Filed: 10/07/1992
• Issued: 01/24/1995
• Est. Priority Date: 12/24/1991
• Status: Expired due to Term

• Current Assignee: Sony United Kingdom Limited (Sony Group Corp.)
• Original Assignee: Sony United Kingdom Limited (Sony Group Corp.)
• Inventors: Wilkinson, James H., Stone, Jonathan J., Soloff, Jonathan M., Ludgate, Michael J.
• Primary Examiner(s): Moore, David K.
• Application Number:
  US07/957,159
• Time in Patent Office: 839 Days
• Field of Search: 382/56, 382/27, 358/133, 358/136, 348/398, 348/384, 348/390, 348/424, 348/425, 364/724.1, 364/724.17
• US Class Current: 382/240
• CPC Class Codes: G06F 17/175 of multidimensional data
• CPC Class Codes: H03H 17/0202 Two or more dimensional filters; Filters for complex signals multidimensional convolutions G06F17/153
• CPC Class Codes: H04N 19/122 Selection of transform size, e.g. 8x8 or 2x4x8 DCT; Selection of sub-band transforms of varying structure or type
• CPC Class Codes: H04N 19/186 the unit being a colour or a chrominance component
• CPC Class Codes: H04N 19/635 characterised by filter definition or implementation details

Abstract

Image processing apparatus is described for filtering a digital representation of a raster scanned image into a plurality of sub-bands in the two-dimensional spatial frequency domain, the resolution of the raster scanned image in a first direction (usually the horizontal direction) being greater than the resolution of the raster scanned image in a second direction (usually the vertical direction). The image processing apparatus has a decimation filter means comprising a number of multi-tap digital decimation filters for spatial filtering in the first and second directions. The mean of the filter lengths of the filters used for filtering in the first direction is greater than that of the filters used for filtering in the second direction. Complementary interpolation apparatus for reconstructing the image from the plurality of sub-bands is also described.

Claims

1. Image processing apparatus for filtering a digital representation of a raster scanned image into a plurality of sub-bands in the two-dimensional spatial frequency domain, said raster scanned image having a resolution in a first direction and a resolution in a second direction, said raster scanned image corresponding to a reconstructed image having a resolution in the first direction and a resolution in the second direction and having aliasing distortion and ringing distortion, the aliasing distortion in said second direction being greater than in said first direction, said resolution of said raster scanned image in said first direction being greater than said resolution of said raster scanned image in said second direction such that a portion of the ringing distortion in said first direction is confined to a smaller region of said reconstructed image than a portion of the ringing distortion of equal magnitude in said second direction of said reconstructed image, said image processing apparatus comprising:

decimation filter means having a first forward filter group comprising a first plurality of multi-tap digital decimation filters, each having a filter length, for filtering in said first direction and a second forward filter group comprising a second plurality of multi-tap digital decimation filters, each having a filter length, for filtering in said second direction, said filter lengths of said first plurality of multi-tap digital decimation filters having a mean which is greater than the mean of said filter lengths of said second plurality of multi-tap digital decimation filters such that the aliasing distortion is reduced in said first direction and the ringing distortion is reduced in said second direction without significantly increasing the aliasing distortion in said second direction.

2. Image processing apparatus as claimed in claim 1, in which:

at least one of said first forward filter group and second forward filter group comprises a first and a second filter stage, said first filter stage being operable to generate a decimated output, said decimated output of said first filter stage being supplied to said second filter stage, said first filter stage having a greater resolution than said filter second stage, each of said first filter stage and said second filter stage comprising at least one of said first plurality and at least one of said second plurality of multi-tap digital decimation filters, said filter length of said filters in said first filter stage being greater than said filter length of said filters in said second filter stage such that the ringing distortion of said reconstructed image is further reduced as a function of the respective resolutions of said first filter stage and said second filter stage.

3. Image processing apparatus as claimed in claim 1, in which:

all of said filters in said first plurality of multi-tap digital decimation filters have the same filter length; and

all of said filters in said second plurality of multi-tap digital decimation filters have the same filter length.

4. Image processing apparatus as claimed in claim 1, in which:

said first direction is substantially a direction of line scanning of said raster scanned image; and

said second direction is substantially perpendicular to said first direction.

5. Image processing apparatus as claimed in claim 1, wherein said raster scanned image comprises a luminance component and a chrominance component, and wherein said decimation filter means includes first and second decimation filter means for respective filtering of said luminance and chrominance components of said raster scanned image, each of said first and second decimation filter means having a respective first forward filter group comprising a first plurality of multi-tap digital decimation filters, each having a filter length, for filtering in said first direction and respective second forward filter group comprising a second plurality of multi-tap digital decimation filters, each having a filter length, for filtering in said second direction.

6. Image processing apparatus as claimed in claim 5, wherein a mean of said filter lengths of said first plurality of multi-tap digital decimation filters in said first decimation filter means is greater than a mean of said filter lengths of said first plurality of multi-tap digital decimation filters in said second decimation filter means such that the aliasing distortion and the ringing distortion of said luminance component and the aliasing distortion and the ringing distortion of said chrominance component are respectively reduced.

7. Image processing apparatus as claimed in claim 5, wherein a mean of said filter lengths of said second plurality of multi-tap digital decimation filters in said first decimation filter means is greater than a mean of said filter lengths of said second plurality of multi-tap digital decimation filters in said second decimation filter means such that the aliasing distortion and the ringing distortion of said luminance component and the aliasing distortion and the ringing distortion of said chrominance component are respectively reduced.

8. Image processing apparatus as claimed in claim 5, in which, in said first decimation filter means:

at least one of said first plurality of multi-tap digital decimation filters has relative filter coefficients of -1, 2, 5, -14, -11, 76, 142, 76, -11, -14, 5, 2, -1; and

at least one of said second plurality of multi-tap digital decimation filters has relative filter coefficients of 1, -2, -4, 18, 38, 18, -4, -2, 1.

9. Image processing apparatus as claimed in claim 5, in which, in said first decimation filter means:

at least one of said first plurality of multi-tap digital decimation filters has relative filter coefficients of 1, -2, -4, 18, 38, 18, -4, -2, 1; and

at least one of said second plurality of multi-tap digital decimation filters has relative filter coefficients of -1, 4, 10, 4, -1.

10. Image processing apparatus as claimed in claim 5, in which, in said second decimation filter means:

at least one of said first plurality of multi-tap digital decimation filters has relative filter coefficients of -1, 4, 10, 4, -1; and

at least one of said second plurality of multi-tap digital decimation filters has relative filter coefficients of -1, 4, 10, 4, -1.

11. Image processing apparatus as claimed in claim 1, further comprising interpolation filter means for reconstructing said reconstructed image from said plurality of sub-bands, said interpolation filter means having first reverse filter group comprising a first plurality of multi-tap digital interpolation filters, complementary to said first plurality of multi-tap digital decimation filters of said first forward filter group and each having a filter length, for filtering in said first direction and second reverse filter group comprising a second plurality of multi-tap digital interpolation filters, complementary to said second plurality of multi-tap digital decimation filters of said second forward filter group and each having a filter length, for filtering in said second direction, said filter lengths of said first plurality of multi-tap digital interpolation filters of said first reverse filter group having a mean which is greater than the mean of said filter lengths of said second plurality of multi-tap digital interpolation filters of said second reverse filter group such that the aliasing distortion is reduced in said first direction and the ringing distortion is reduced in said second direction without significantly increasing the aliasing distortion in said second direction.

23. Image data compression apparatus comprising image processing apparatus as claimed in claim 1.

24. Image data decompression apparatus comprising image processing apparatus as claimed in claim 11.

25. Image data storage apparatus comprising image processing apparatus as claimed in claim 1.

12. Image processing apparatus in which a reconstructed digital representation of a raster scanned image is interpolated from a plurality of sub-bands in the two-dimensional spatial frequency domain and having aliasing distortion and ringing distortion, the aliasing distortion in said second direction being greater than in said first direction, said raster scanned image having a resolution in a first direction and a resolution in a second direction, said resolution of said raster scanned image in said first direction being greater than said resolution of said raster scanned image in said second direction such that a portion of the ringing distortion in said first direction is confined to a smaller region of said reconstructed image than a portion of the ringing distortion of equal magnitude in said second direction of said reconstructed image, said image processing apparatus comprising:

interpolation filter means having a first filter group comprising a first plurality of multi-tap digital interpolation filters, each having a filter length, for filtering in said first direction and a second filter group comprising a second plurality of multi-tap digital interpolation filters, each having a filter length, for filtering in said second direction, said filter lengths of said first plurality of multi-tap digital interpolation filters having a mean which is greater than the mean of said filter lengths of said second plurality of multi-tap digital interpolation filters such that the aliasing distortion is reduced in said first direction and the ringing distortion is reduced in said second direction without significantly increasing the aliasing distortion in said second direction.

13. Image processing apparatus as claimed in claim 12, in which:

at least one of said first filter group and second filter group comprises a first and a second filter stage, said first filter stage being operable to generate an interpolated output, said interpolated output of said first filter stage being supplied to said second filter stage, said first filter stage having a greater resolution than said second filter stage, each of said first filter stage and said second filter stage comprising at least one of said first plurality and at least one of said second plurality of multi-tap digital interpolation filters, said filter length of said filters in said second stage being greater than said filter length of said filters in said first stage such that the ringing distortion of said reconstructed image is further reduced as a function of the respective resolutions of said first filter stage and said second filter stage.

14. Image processing apparatus as claimed in claim 12, in which:

all of said filters in said first plurality of multi-tap digital interpolation filters have the same filter length; and

all of said filters in said second plurality of multi-tap digital interpolation filters have the same filter length.

15. Image processing apparatus as claimed in claim 12, in which:

said first direction is substantially a direction of line scanning of said raster scanned image; and

said second direction is substantially perpendicular to said first direction.

16. Image processing apparatus as claimed in claim 12, wherein said reconstructed digital representation of a raster scanned image comprises a luminance component and a chrominance component, and wherein said interpolation filter means includes first interpolation filter means and second interpolation filter means for respective filtering of said luminance and chrominance components of said raster scanned image, each of said first and said second interpolation filter means having respective a first filter group comprising a first plurality of multi-tap digital interpolation filters, each having a filter length, for filtering in said first direction and a respective second filter group comprising a second plurality of multi-tap digital interpolation filters, each having a filter length, for filtering in said second direction.

17. Image processing apparatus as claimed in claim 16, wherein a mean of said filter lengths of said first plurality of multi-tap digital interpolation filters in said first interpolation filter means if greater than a mean of said filter lengths of said first plurality of multi-tap digital interpolation filters in said second interpolation filter means such that the aliasing distortion and the ringing distortion of said luminance component and the aliasing distortion and the ringing distortion of said chrominance component are respectively reduced.

18. Image processing apparatus as claimed in claim 16, wherein a mean of said filter lengths of said second plurality of multi-tap digital interpolation filters in said first interpolation filter means is greater than a mean of said filter lengths of said second plurality of multi-tap digital interpolation filters in said second interpolation filter means such that the aliasing distortion and the ringing distortion of said luminance component and the aliasing distortion and the ringing distortion of said chrominance component are respectively reduced.

19. Image processing apparatus as claimed in claim 16, in which, in said first interpolation filter means:

at least one of said first plurality of multi-tap digital interpolation filters has relative filter coefficients of 3, 6, -21, -54, 89, 364, -779, -906, 4932, 9628, 4932, -906, -779, 364, 89, -54, -21, 6, 3; and

at least one of said second plurality of multi-tap digital interpolation filters has relative filter coefficients of -2, -4, 13, 46, -139, -140, 992, 1924, 992, -140, -139, 46, 13, -4, -2.

20. Image processing apparatus as claimed in any one of claim 16, in which, in said first interpolation filter means:

at least one of said first plurality of multi-tap digital interpolation filters has relative filter coefficients of -2, -4, 13, 46, -139, -140, 992, 1924, 992, -140, -139, 46, 13, -4, -2; and

at least one of said second plurality of multi-tap digital interpolation filters has relative filter coefficients of 1, 4, -16, -20, 135, 272, 135, -20, -16, 4, 1.

21. Image processing apparatus as claimed in claim 16, in which, in said second interpolation filter means:

at least one of said first plurality of multi-tap digital interpolation filters has relative filter coefficients of 1, 4, -16, -20, 135, 272, 135, 20, 16, 4, 1; and

at least one of said second plurality of multi-tap digital interpolation filters has relative filter coefficients of -1, -4, 25, 56, 25, 4, 1.

22. Image processing apparatus as claimed in claim 16, in which, in said second interpolation filter means:

at least one of said first plurality of multi-tap digital interpolation filters has relative filter coefficients of -1, 4, 25, 56, 25, -4, -1; and

at least one of said second plurality of multi-tap digital interpolation filters has relative filter coefficients of -1, -4, 25, 56, 25, -4, -1.

26. A method of filtering a digital representation of a raster scanned image into a plurality of sub-bands in the two-dimensional spatial frequency domain, said raster scanned image having a resolution in a first direction and a resolution in a second direction, said raster scanned image corresponding to a reconstructed image having a resolution in the first direction and a resolution in the second direction and having aliasing distortion and ringing distortion, the aliasing distortion in said second direction being greater than in said first direction, said resolution of said raster scanned image in said first direction being greater than said resolution of said raster scanned image in said second direction such that a portion of the ringing distortion in said first direction is confined to a smaller region of said reconstructed image than a portion of the ringing distortion of equal magnitude in said second direction of said reconstructed image, said method comprising the steps of:

(I) filtering in said first direction with a first plurality of multi-tap digital decimation filters, each having a filter length; and

(II) filtering in said second direction with a second plurality of multi-tap digital decimation filters, each having a filter length, said filter lengths of said first plurality of multi-tap digital decimation filters having a mean which is greater than the mean of the filter lengths of said second plurality of multi-tap digital decimation filters such that the aliasing distortion is reduced in said first direction and the ringing distortion is reduced in said second direction without significantly increasing the aliasing distortion in said second direction.

27. A method of interpolating a reconstructed digital representation of a raster scanned image from a plurality of sub-bands in the two-dimensional spatial frequency domain and having aliasing distortion and ringing distortion, the aliasing distortion in said second direction being greater than in said first direction, said raster scanned image having a resolution in a first direction and a resolution in a second direction, said resolution of said raster scanned image in said first direction being greater than said resolution of the raster scanned image in said second direction such that a portion of the ringing distortion in said first direction is confined to a smaller region of said reconstructed image than a portion of the ringing distortion of equal magnitude in said second direction of said reconstructed image, said method comprising the steps of:

(I) filtering in said first direction with a first plurality of multi-tap digital interpolation filters, each having a filter length; and

(II) filtering in said second direction with a second plurality of multi-tap digital interpolation filters, each having a filter length, said filter lengths of said first plurality of multi-tap digital interpolation filter having a mean which is greater than the mean of said filter lengths of said second plurality of multi-tap digital interpolation filters such that the aliasing distortion is reduced in said first direction and the ringing distortion is reduced in said second direction without significantly increasing the aliasing distortion in said second direction.