Image processing method, image processing apparatus, and image processing program

• US 7,203,362 B2
• Filed: 05/31/2005
• Issued: 04/10/2007
• Est. Priority Date: 07/26/2004
• Status: Active Grant

• Current Assignee: Matsushita Electric Industrial Company Limited (Panasonic Holdings Corporation)
• Original Assignee: Matsushita Electric Industrial Company Limited (Panasonic Holdings Corporation)
• Inventors: Nobori, Kunio, Sato, Satoshi, Takata, Kazutoyo
• Primary Examiner(s): Wu; Jingge
• Assistant Examiner(s): Tabatabai; Abolfazl
• Application Number:
  US11/141,308
• Publication Number:
  US 20060018539A1
• Time in Patent Office: 679 Days
• Field of Search: 382/169, 382/171, 382/172, 382/173, 382/174, 382/175, 382/176, 382/177, 382/178, 382/179, 382/298, 358/447, 358/530, 358/3.23, 358/448, 358/462, 348/584, 348/595, 701/28
• US Class Current: 382/173
• CPC Class Codes: G06T 2207/20021 Dividing image into blocks, subimages or windows
• CPC Class Codes: G06T 5/20 using local operators
• CPC Class Codes: G06T 5/50 using two or more images, e.g. averaging or subtraction
• CPC Class Codes: G06T 5/94 based on local image properties, e.g. for local contrast enhancement
• CPC Class Codes: G06V 10/20 Image preprocessing

Abstract

An image region dividing section (105) partitions each of input images into a small regions, and a small region synthesized image generation section (106) generates a base image of each small region, which is an image including only diffuse reflection, from each input image. An image interpolation section (107) generates by interpolation a base image of a small region of which base image cannot be generated. A linearized image generation section (103) generates a linearized image, which is an image in an ideal state under given lighting condition, using the base image of each small region.

Claims

1. An image processing method comprising:

a first step of obtaining a plurality of input images obtained by shooting a same object;

a second step of dividing each of the obtained input images into a plurality of small regions;

a third step of generating a base image of each of the divided small regions using the input images; and

a fourth step of generating a base image of a small region having been impossible to generate a base image by interpolation processing using a computed value for base image generation in neighbor small regions, the small region and the neighbor small regions being of the divided small regions,

wherein a linearized image of the object under given lighting condition is generated using the generated base images;

wherein the third step includes the steps of;

selecting N base original images from K input images (N is a positive integer smaller than K);

determining a linearization coefficient set for each remaining (K−

N) input image using the N base original images; and

generating N base images by linearizing the N base original images using the determined linearization coefficient set.

2. The method of claim 1, wherein N is 3.

3. The method of claim 1, wherein

the linearization coefficient set determining step includes:

repeating candidate obtaining processing for each input image where a predetermined number of points are selected at random from the input image, a linearization coefficient set candidate is obtained from the predetermined number of points, and a value of an evaluation index indicating likelihood thereof is obtained, and

determining a linearization coefficient set candidate of which value of the evaluation index is most likely as the linearization coefficient set of the input image.

4. The method of claim 3, wherein

the candidate obtaining processing includes judging whether the predetermined number of points are different in normal direction from each other, and

when it is judged that the predetermined number of points selected are same in normal direction in every repetition, the small region is judged as impossible to generate a base image.

5. The method of claim 1, wherein

the fourth step includes interpolating a linearization coefficient set of the small region using a linearization coefficient set obtained in the neighbor small regions.

6. The method of claim 5, wherein

in the interpolation, a value of an evaluation index for a linearization coefficient set of each neighbor small region is used in addition.

7. The method of claim 1, wherein

the third step includes:

generating a linearized image of which lighting condition is the same as that of at least one of the input images, using the N base images.

8. An image processing apparatus comprising:

an image input section that obtains a plurality of images obtained by shooting a same object;

an image region dividing section that divides each of the input images obtained by the image input section into a plurality of small regions;

a small region synthesized image generation section that generates a base image of each of the small regions divided by the image region dividing section using the input images; and

an image interpolation section that generates a base image of a small region having been impossible to generate a base image in the small region synthesized image generation section by interpolation processing using a computed value for base image generation in neighbor regions near to the small region, the small region and the neighbor small regions being of the partitioned small regions,

wherein a linearized image of the object under given lighting condition is generated using the generated base images,

wherein the small region synthesized image generation section performs the steps of;

selecting N base original images from K input images (N is a positive integer smaller than K);

determining a linearization coefficient set for each remaining (K−

N) input image using the N base original images; and

generating N base images by linearizing the N base original images using the determined linearization coefficient set.

9. An image processing program on computer-readable medium for allowing a computer to execute image processing, which allows a computer to execute the steps of:

(a) dividing a plurality of input images obtained by shooting a same object into a plurality of small regions;

(b) generating a base image of each of the divided small regions using the input images;

(c) generating a base image of a small region having been impossible to generate a base image by interpolation processing using a computed value for base image generation in neighbor small regions near to the small region, the small region and the neighbor small region being of the partitioned small regions; and

(d) generating a linearized image of the object under given lighting condition using the generated base images,

wherein the step (b) includes the steps of;

selecting N base original images from K input images (N is a positive integer smaller than K);

determining a linearization coefficient set for each remaining (K−

N) input image using the N base original images; and

generating N base images by linearizing the N base original images using the determined linearization coefficient set.