Image processing apparatus, image processing method, and image processing program

• US 7,155,069 B2
• Filed: 02/07/2003
• Issued: 12/26/2006
• Est. Priority Date: 03/20/2002
• Status: Expired due to Fees

• Current Assignee: Fuji Xerox Company Limited (Xerox Holdings Corp.)
• Original Assignee: Fuji Xerox Company Limited (Xerox Holdings Corp.)
• Inventors: Ishizaka, Kanya
• Primary Examiner(s): Wu, Jingge
• Assistant Examiner(s): Kassa, Yosef
• Application Number:
  US10/359,643
• Publication Number:
  US 20030179953A1
• Time in Patent Office: 1,418 Days
• Field of Search: 382/190, 382/282, 382/298, 382/256, 382/259, 358/1.2, 358/528, 358/538, 358/537, 358/451
• US Class Current: 382/298
• CPC Class Codes: G06T 3/403 Edge-driven scaling; Edge-based scaling

Abstract

A first image enlargement processing section enlarges an original image to a specified size to generate an initial enlarged image. A domain block extraction section extracts a domain block image from the original image. A range block extraction section extracts a range block image from the neighborhood of the correspondence part of the domain block image in the initial enlarged image. A reduced range block preparation section reduces the range block image to the domain size to generate a reduced range block image. An enlarged range block preparation section enlarges the most similar range block image having the highest degree of similarity to an enlargement size to generate an enlarged pseudo domain block image. An enlarged image acquisition section 676 uses each enlarged pseudo domain block image to generate an enlarged image of the original image.

Claims

1. An image processing apparatus for performing enlargement processing of an original image represented by a large number of pixels to provide an enlarged image, said image processing apparatus comprising:

a first image enlargement processing section for enlarging the original image at a preset enlargement ratio;

a domain block extraction section for dividing the original image in first block units, thereby extracting a plurality of domain block images;

a range block extraction section for extracting a range block image in a second block unit larger than the first block unit from an initial enlarged image provided by said first image enlargement processing section;

an enlarged pseudo domain block preparation section for projecting the range block image extracted by said range block extraction section to an enlarged block unit provided by enlarging the first block unit at a preset enlargement ratio, and converting each of pixel values of the image placed in the enlarged block unit based on the relationship between the domain block image and the range block image, thereby preparing an enlarged pseudo domain block image; and

an enlarged image acquisition section for acquiring an enlarged image provided by enlarging the original image at the preset enlargement ratio using each enlarged pseudo domain block image prepared by said enlarged pseudo domain block preparation section.

2. The image processing apparatus as claimed in claim 1, wherein

said range block extraction section extracts the range block image from a neighborhood of a position in the initial enlarged image, the position where the enlarged pseudo domain block is to be placed corresponding to a position of the domain block.

3. The image processing apparatus as claimed in claim 2, wherein

said range block extraction section extracts the range block image from the initial enlarged image so that the range block includes a part in common with the enlarged pseudo domain block when the enlarged pseudo domain block is placed in the initial enlarged image corresponding to a position of the domain block.

4. The image processing apparatus as claimed in claim 1, wherein

said range block extraction section divides a neighborhood of a position in the initial enlarged image, the position where the enlarged pseudo domain block is to be placed corresponding to a position of the domain block, thereby extracting a plurality of the range block images, said image processing apparatus further comprising:

a similarity degree determination section for determining the degree of similarity between each of the range block images extracted by said range block extraction section and the domain block image extracted by said domain block extraction section, wherein

said enlarged pseudo domain block preparation section enlarges the range block image determined to have a higher degree of similarity with the domain block image by the similarity degree determination section among the plurality of range block images to the enlarged block unit to prepare the enlarged range block image.

5. The image processing apparatus as claimed in claim 4, further comprising:

a reduced range block preparation section for reducing the range block images extracted by said range block extraction section to the first block unit to prepare a plurality of reduced range block images, wherein

said similarity degree determination section determines the degree of similarity using the domain block image and the plurality of reduced range block images prepared by the reduced range block preparation section.

6. The image processing apparatus as claimed in claim 5, wherein

said similarity degree determination section executes pixel value conversion of each pixel value z of the plurality of reduced range block images prepared by said reduced range block preparation section based on a linear transformation expression az+b where a and b are coefficients, and selects the reduced range block image most similar to the domain block image from among the plurality of reduced range block images subjected to the pixel value conversion, and wherein

said enlarged pseudo domain block preparation section projects the range block image on which the reduced range block image selected by said similarity degree determination section is based to the enlarged block unit and executes pixel value conversion of each pixel value of the image based on the linear transformation expression az+b to prepare the enlarged pseudo domain block image.

7. The image processing apparatus as claimed in claim 6, wherein

said enlarged pseudo domain block preparation section uses bp=dp−

a*rp where dp is the pixel value of the correspondence pixel of the domain block image and rp is the pixel value of the correspondence pixel of the reduced range block image as the value of coefficient bp in the linear transformation expression for the each pixel having a position p.

8. The image processing apparatus as claimed in claim 4, further comprising:

a complexity degree determination section for determining the degree of complexity of the range block image, wherein

said similarity degree determination section refers to the degree of complexity of the range block image determined by said complexity degree determination section and determines the degree of similarity.

9. The image processing apparatus as claimed in claim 1, wherein,

said domain block extraction section switches an image read start position in order and divides the original image in the first block units, thereby extracting the domain block image, and wherein

said enlarged image acquisition section has an overlap processing unit for finding pixel values of an overlap part that occur in processing with the image read start position switched in order in each enlarged image corresponding to the original image, found in processing with the image read start position switched in order based on pixel values of pixels of the overlap part.

10. The image processing apparatus as claimed in claim 1, wherein

said enlarged image acquisition section divides a previously specified enlargement ratio into a combination of smaller enlargement ratios, adopts each smaller enlargement ratio as the setup enlargement ratio, and performs enlargement repetition processing of applying the smaller enlargement ratios in order.

11. The image processing apparatus as claimed in claim 10, wherein

at least either of said domain block extraction section and said range block extraction section changes the size of the first block unit each time the smaller enlargement ratio is applied in order.

12. The image processing apparatus as claimed in claim 1, further comprising:

an edge enhancement processing section for performing edge enhancement processing for the enlarged pseudo domain block image generated by said enlarged pseudo domain block preparation section.

13. The image processing apparatus as claimed in claim 12, wherein

said edge enhancement processing section performs the edge enhancement processing based on the relationship between a maximum value and a minimum value of the pixels in the enlarged pseudo domain block.

14. The image processing apparatus as claimed in claim 12, wherein

said edge enhancement processing section calculates an average value of a maximum pixel value and a minimum pixel value in the enlarged pseudo domain block and converts the pixel value larger than the average value into a larger value in response to the distance from the average value and the pixel value smaller than the average value into a smaller value in response to the distance from the average value, in response to the strength of the edge enhancement.

15. The image processing apparatus as claimed in claim 12, wherein

said range block extraction section switches the size of the second block unit in response to a strength degree of the edge enhancement set by said edge enhancement processing section.

16. The image processing apparatus as claimed in claim 1, further comprising:

an iterated processing control section for iterating enlargement processing a predetermined number of times by controlling said range block extraction section so as to re-extract the range block image using the enlarged image acquired by said enlarged image acquisition section in place of the initial enlarged image after said enlarged image acquisition section acquires the enlarged image provided by enlarging the original image at the preset enlargement ratio.

17. The image processing apparatus as claimed in claim 12, further comprising:

an iterated processing control section for iterating enlargement processing a predetermined number of times by controlling said range block extraction section so as to re-extract the range block image from the enlarged image acquired by said enlarged image acquisition section in place of the initial enlarged image after said enlarged image acquisition section acquires the enlarged image provided by enlarging the original image at the preset enlargement ratio.

18. The image processing apparatus as claimed in claim 17, wherein

said iterated processing control section switches at least one of the domain block size, the range block size, and the strength of the edge enhancement in iterating the enlargement processing the predetermined number of times.

19. The image processing apparatus as claimed in claim 1, wherein

said first image enlargement processing section comprises:

a second domain block extraction section for dividing the original image in the first block units, thereby extracting a plurality of domain block images;

a second range block extraction section for extracting a range block image in a second block unit larger than the first block unit and smaller than the enlarged block unit from the original image provided by enlarging the first block unit at the preset enlargement ratio;

an enlarged range block preparation section for enlarging the range block image extracted by said second range block extraction section to the enlarged block unit and converting pixel values of the image enlarged to the enlarged block unit based on the relationship between the domain block image and the range block image, thereby preparing an enlarged range block image; and

a second enlarged image acquisition section for acquiring an enlarged image provided by enlarging the original image at the preset enlargement ratio using each enlarged range block image prepared by said enlarged range block preparation section.

20. The image processing apparatus as claimed in claim 1, wherein

said first image enlargement processing section uses nearest neighbor method to prepare the initial enlarged image.

21. The image processing apparatus as claimed in claim 19, wherein

said second range block extraction section extracts the range block image from the original image so that the range block includes a part in common with the domain block.

22. The image processing apparatus as claimed in claim 1, further comprising:

a control section for controlling so as to select the same range block position for each color components and perform enlargement processing when enlargement processing is performed for a color image.

23. An image processing method for performing image enlargement processing, said image processing method comprising the steps of:

enlarging the original image at a preset enlargement ratio;

dividing the original image in first block units, thereby extracting a plurality of domain block images;

extracting a range block image in a second block unit larger than the first block unit from an initial enlarged image provided by said enlarging step;

placing the range block image in an enlarged block unit provided by enlarging the first block unit at a preset enlargement ratio, and converting each of pixel values of the image placed in the enlarged block unit based on the relationship between the domain block image and the range block image, thereby preparing an enlarged pseudo domain block image; and

acquiring an enlarged image provided by enlarging the original image at the preset enlargement ratio using each enlarged pseudo domain block image.

24. A computer medium or a computer readable medium comprising image enlargement processing of an original image represented by a large number of pixels to provide an enlarged image, said image enlargement processing comprising the steps of:

enlarging the original image at a preset enlargement ratio;

dividing the original image in first block units, thereby extracting a plurality of domain block images;

extracting a range block image in a second block unit larger than the first block unit from an initial enlarged image provided by said enlarging step;

placing the range block image in an enlarged block unit provided by enlarging the first block unit at a preset enlargement ratio, and converting each of pixel values of the image placed in the enlarged block unit based on the relationship between the domain block image and the range block image, thereby preparing an enlarged pseudo domain block image; and

acquiring an enlarged image provided by enlarging the original image at the preset enlargement ratio using each enlarged pseudo domain block image.