Image processing apparatus in which filters having different filtering characteristics can be switched among themselves

• US 5,608,824 A
• Filed: 09/16/1994
• Issued: 03/04/1997
• Est. Priority Date: 01/22/1993
• Status: Expired due to Term

• Current Assignee: Olympus Optical Corporation Limited (Olympus Corporation)
• Original Assignee: Olympus Optical Corporation Limited (Olympus Corporation)
• Inventors: Kobayashi, Shigeru, Shimizu, Kazuo, Aramaki, Shinji, Masuyama, Hideyuki
• Primary Examiner(s): Couso, Jose L.
• Application Number:
  US08/307,648
• Time in Patent Office: 900 Days
• Field of Search: 382/260-265, 382/276-279, 382/272, 382/167, 382/303, 364/723, 364/724.05, 364/724.16, 364/724.19, 364/724.12, 364/728.01, 364/728.02, 364/754
• US Class Current: 382/276
• CPC Class Codes: G06T 5/20 using local operators

Abstract

An image processing apparatus comprising: a spatial filtering section storing coefficients arranged in i rows and j columns, for receiving pixel data items representing the input image and arranged in i rows and j columns, and for multiplying each pixel data item by a corresponding coefficient; a coefficient memory having groups of coefficient registers for storing the coefficients set in the spatial filtering section; a selection data generating section for generating coefficient-selecting data representing coefficients to be read from the coefficient registers of each group and for changing the coefficient-selecting data in accordance with the pixel data items which is to be input to the spatial filtering section; and a coefficient selecting section for receiving the coefficient-selecting data generated by the selecting data generating section, reading coefficients from the coefficient registers of each group in accordance with the coefficient-selecting data, and setting the coefficients in the spatial filtering section.

Claims

1. An image processing apparatus for performing spatial processing on an input image, the apparatus comprising:

spatial filtering means storing coefficients arranged in i rows and j columns, for receiving pixel data items representing the input image and arranged in i rows and j columns, and multiplying each pixel data item by a corresponding coefficient, thereby to perform spatial filtering, thus extracting a particular frequency component of the input image;

coefficient storing means having a plurality of register groups corresponding to i×

j coefficient to be set in said spatial filtering means, each of said register groups having a plurality of coefficient registers each of which stores a numerical value that is one of candidates for a coefficient;

selection data generating means for generating coefficient-selecting data designating the coefficient registers of each register group and changing the coefficient-selecting data in accordance with the pixel data items which is to be input to said spatial filtering means; and

coefficient selecting means for receiving the coefficient-selecting data generated by said selecting data generating means, reading numerical values from the coefficients registers of each register group in accordance with the coefficient-selecting data, and setting the numerical values in said spatial filtering means as the coefficients.

2. The image processing apparatus according to claim 1, wherein:

said selecting data generating means includes coefficient information storing means and coefficient reading means;

said coefficient information storing means stores a plurality of coefficient-selecting data items, each of which is provided for at least one pixel of a spatial region of the input image; and

said coefficient reading means reads the coefficient-selecting data item corresponding to a pixel data item to be processed by said spatial filtering means, from said coefficient storing means at the same time the input image is supplied to said spatial filter means.

3. The image processing apparatus according to claim 1, wherein:

said spatial filtering means has i×

j pixel data holding sections for holding pixel data items, i×

j coefficient holding sections for holding coefficients, i×

j multiplying sections, and an adder section for adding data items output from the multiplying sections;

said pixel data holding sections form i parallel lines, each having j pixel data holding sections connected in series such that a pixel data item input to a pixel data holding section provided at an input end of each line is transferred sequentially to adjacent pixel data holding sections of the same line;

said coefficient holding sections are connected to the corresponding groups of coefficient registers, respectively, and associated with said pixel data holding sections, respectively, for holding the coefficients which have been read from said groups of coefficient registers by said coefficient selecting means; and

said multiplying sections are associated with said pixel data holding sections and said coefficient holding sections, respectively, for multiplying the pixel data item stored in each of said pixel data holding sections by the coefficient held in the coefficient holding section associated with the pixel data holding section.

4. The image processing apparatus according to claim 3, wherein:

(i-1) line buffers for delaying the input image by one line are connected to inputs of the pixel data holding sections provided at the input ends of said lines, respectively; and

pixel data items forming a row are input to the pixel data holding sections provided at the input ends of said lines.

5. The image processing apparatus according to claim 2, wherein said coefficient information storing means has a frame memory which has a storage capacity corresponding to the input image and which stores the coefficient-selecting data items at addresses corresponding to the pixels forming the input image.

6. The image processing apparatus according to claim 1, further comprising:

clock signal generating means for supplying operation clock signals to said spatial filtering means, thereby to cause said spatial filtering means to perform spatial filtering, and for changing operation clock signals supplied to said spatial filtering means in accordance with a ratio at which to enlarge or reduce pixel data which said spatial filtering means is to process;

memory means for storing results of the process performed by said spatial filtering means; and

control means for controlling writing of pixel data into, and reading of pixel data from, said memory means,

wherein said spatial filtering means sets again the coefficients arranged in i rows and j columns, in synchronization with the operation clock signals, multiplies those of the pixel data items arranged in i rows and j columns which are required for interpolation, by the coefficients corresponding to the pixel data items, and adds these pixel data items, thereby generating new interpolated data representing one pixel.

7. The image processing apparatus according to claim 6, wherein:

said coefficient storing means stores a plurality of coefficient patterns for use in enlarging the image;

said clock signal generating means generates high-speed clock signals when the pixel data items to be processed by said spatial filtering means belongs to an image region to be enlarged, said high-speed clock signals corresponding to a ratio at which to enlarge that image region;

said selecting data generating means has coefficient information storing means storing a plurality of image-enlarging coefficient-selecting data items for sequentially setting the plurality of coefficient patterns for use in enlarging the image, for that region of the input image which is to be enlarged, and reads the image-enlarging coefficient-selecting data items sequentially from said coefficient information storing means in synchronization with the high-speed operation clock signals; and

said spatial filtering means performs filtering in accordance with the coefficient patterns in synchronization with the high-speed operation clock signals.

8. The image processing apparatus according to claim 6, wherein:

said clock signal generating means generates low-speed operating clock signals when the pixel data items to be processed by said spatial filtering means belongs to an image region to be reduced, said low-speed clock signals corresponding to a ratio at which to reduce that image region;

said spatial filtering means performs filtering in synchronization with the low-speed operation clock signals, thereby interpolating a number of pixel data items which are required to display one line of a reduced image; and

said control means writes into said memory means interpolated line data corresponding to the ratio at which to reduce the image region.

9. The image processing apparatus according to claim 6, wherein:

said clock signal generating means generates low-speed operating clock signals when the pixel data items to be processed by said spatial filtering means belongs to an image region to be reduced, said low-speed clock signals corresponding to a ratio at which to reduce that image region;

said spatial filtering means performs filtering in synchronization with the low-speed operation clock signals, thereby interpolating a number of pixel data items which are required to display one line of a reduced image; and

said control means writes into said memory means all interpolated line data items output from said spatial filtering means and reads some of the interpolated line data items from said memory means, while removing the remaining interpolated line data items in accordance with the ratio at which to reduce the image region.

10. The image processing apparatus according to claim 6, wherein:

said clock signal generating means generates normal-speed operating clock signals when the pixel data items to be processed by said spatial filtering means belongs to an image region to be reduced; and

said control means writes into said memory means some of interpolated data items output from said spatial filtering means, while removing the remaining interpolated data items in accordance with the ratio at which to reduce the image region.

11. The image processing apparatus according to claim 6, wherein:

said clock signal generating means generates normal-speed operating clock signals when the pixel data items to be processed by said spatial filtering means belongs to an image region to be reduced; and

said control means writes interpolated data items output from said spatial filtering means into said memory means, without removing any one of the interpolated data items, and reads some of the interpolated data items from said memory means, while removing the remaining interpolated line data items in accordance with the ratio at which to reduce the image region.

12. The image processing apparatus according to claim 1, further comprising:

a first image memory for storing an input image to be processed;

a memory controller for reading from said first image memory pixel data items representing the input image, and repeatedly reading those of the pixel data items belonging to an image region to be enlarged or reduced which define the same line, in accordance with a ratio at which to enlarge or reduce that image region;

clock signal generating means for changing operation clock signals to be supplied to said spatial filtering means, in accordance with the ratio at which to enlarge or reduce that image region, when the pixel data items to be processed by said spatial filtering means belongs to that image region; and

a second image memory for storing the input image which has been enlarged or reduced by said spatial filtering means.

13. The image processing apparatus according to claim 1, further comprising:

a first image memory for storing an input image to be processed;

a first memory controller for reading pixel data items representing the input image, from said first image memory;

a second image memory for storing the input image processed by said spatial filtering means; and

a second memory controller for writing pixel data items output from said spatial filtering means, to predetermined addresses in said second image memory, and for writing some of the pixel data items into said second image memory, while removing the remaining pixel data items in accordance with a ratio at which to enlarge or reduce the input image.

14. The image processing apparatus according to claim 1, further comprising:

a first conversion means for converting a color image signal of an input image to a colorimetric system signal; and

a second conversion means for converting pixel data obtained by filtering the colorimetric system signal by means of said spatial filtering means, into the original color image signal,

wherein said spatial filtering means receives the colorimetric system signal from said first conversion means, in the form of pixel data items arranged in i rows and j columns, and said selection data generating means generates coefficient-selecting data in accordance with a hue parameter which changes based on the hue of the input image represented by the colorimetric system signal output from said first conversion means.

15. The image processing apparatus according to claim 1, further comprising:

a first conversion means for converting a color image signal of an input image to a uniform perceptual space signal; and

a second conversion means for converting pixel data obtained by filtering the uniform perceptual space signal by means of said spatial filtering means, into the original color image signal,

wherein said spatial filtering means receives the uniform perceptual space signal from said first conversion means, in the form of pixel data items arranged in i rows and j columns, and said selection data generating means reads the coefficient-selecting data in accordance with a hue parameter which changes based on those of pixel data items which forms the uniform perceptual space signal by said first conversion means.

16. The image processing apparatus according to claim 1, further comprising:

a first conversion means for performing polar coordinate conversion on a color-different signal contained in a color image signal representing an input image; and

a second conversion means for converting pixel data obtained by said spatial filtering means, into an original color image signal,

wherein said spatial filtering means receives the pixel data items from said first conversion means, in the form of pixel data items arranged in i rows and j columns, and said selection data generating means generates coefficient-selecting data in accordance with a hue parameter which changes based on a hue parameter contained in the pixel data subjected to the polar coordinate conversion in said first conversion means.

17. The image processing apparatus according to claim 14, wherein:

said spatial filtering means has a first filtering section for receiving pixel data which is brightness data contained in the colorimetric system signal output from said first conversion means, and pixel data which is a second filtering section for receiving chroma data contained in the colorimetric system signal output from said first conversion means; and

said selecting data generating means compares a plurality of preset reference values with the hue parameter output from said first conversion means, thereby to generate coefficient-selecting data based on the reference value more similar to the hue parameter than any other reference value.

18. The image processing apparatus according to claim 17, wherein said selecting data generating means comprises a first comparator for comparing the preset reference values with the hue parameter output from said first conversion means, thereby to generate coefficient-selecting data designating a coefficient pattern to be set in the first spatial filtering section, and a second comparator for comparing the preset reference values with the hue parameter output from said first conversion means, thereby to coefficient-selecting data designating a coefficient pattern to be set in the second spatial filtering section.

19. The image processing apparatus according to claim 1, wherein said selecting data generating means comprises comparator means for comparing at least one reference value with a luminance value of pixel data to be input to said spatial filtering means, and coefficient memory means storing coefficient-selecting data representing a coefficient pattern optimal for a high-luminance part of the input image and coefficient-selecting data representing a coefficient pattern optimal for a low-luminance part of the input image, and is designed to generate coefficient data for the high-luminance or low-luminance part of the input image in accordance with the result of comparison performed by said comparator means.

20. The image processing apparatus according to claim 19, further comprising reference value generating means for detecting a luminance value of the input image and supplying said comparator means with a reference value corresponding to the luminance value detected.

21. The image processing apparatus according to claim 1, further comprising gradation compressing means for performing gradation compression on the pixel data output from said spatial filtering means, and wherein said selecting data generating means has comparator means for comparing at least one preset reference value with a luminance value of the pixel data to be input to said spatial filtering means.

22. The image processing apparatus according to claim 21, wherein said gradation compression means compresses the high-luminance and low-luminance parts of the input image to a greater degree than any other part of the input image.