Image processing apparatus, image processing method, shape diagnostic apparatus, shape diagnostic method and program

• US 7,787,692 B2
• Filed: 09/27/2004
• Issued: 08/31/2010
• Est. Priority Date: 09/25/2003
• Status: Expired due to Fees

• Current Assignee: Fujifilm Corporation (Fujifilm Holdings Corporation)
• Original Assignee: Fujifilm Corporation (Fujifilm Holdings Corporation)
• Inventors: Yoda, Akira, Noguchi, Yukinori, Sugimoto, Yusuke
• Primary Examiner(s): Mehta; Bhavesh M
• Assistant Examiner(s): MOTSINGER, SEAN T
• Application Number:
  US10/949,224
• Publication Number:
  US 20050265598A1
• Time in Patent Office: 2,164 Days
• Field of Search: 382/167, 382/162, 382/165, 382/274, 382/108, 345582-592
• US Class Current: 382/167
• CPC Class Codes: G01N 21/8851 Scan or image signal processing specially adapted therefor, e.g. for scan signal adjustment, for detecting different kinds of defects, for compensating for structures, markings, edges G01N21/8806 and G01N21/93 - G01N21/95692 take precedence; optical measurement of dimensions G01B11/00; optical scanning G02B26/10; image transformation G06T3/00; computerised image enhancement G06T5/00; image processing per se for flaw detection G06T7/0002
• CPC Class Codes: G06T 2200/04 involving 3D image data
• CPC Class Codes: G06T 7/001 using an image reference approach
• CPC Class Codes: G06T 7/50 Depth or shape recovery

Abstract

An image processing apparatus for correcting an image of a subject, includes: a first illuminated image acquisition unit for acquiring the first reference member image that is an image a reference member having a plurality of normal directions taken under the first illumination condition; the second illuminated image acquisition unit for acquiring the second reference member image and a subject image that are an image of the reference member and an image of the subject, respectively, taken under the second illumination condition; a shape acquisition unit for acquiring three-dimensional shapes of the reference member and the subject; a normal direction determination unit for determining a normal direction of each region of the first reference member image, the second reference member image and the subject image based on the three-dimensional shapes of the reference member and the subject; a difference calculation unit for calculating a color difference in each region between the first and second reference member images for every normal direction; and a subject image correction unit for correcting a color of each region of the subject image with the color difference for every normal direction.

Claims

1. An image processing apparatus for correcting an image of a subject, comprising:

a first illuminated image capture unit operable to capture a first reference member image that is an image of a reference member having a plurality of normal directions taken under a first illumination condition;

a second illuminated image capture unit operable to capture a second reference member image that is an image of said reference member taken under a second illumination condition, and a subject image that is an image of a given subject taken under said second illumination condition;

a shape capture unit operable to capture three-dimensional shapes of said reference member and said subject;

a normal direction determination unit operable to determine a normal direction of each region in said first reference member image, said second reference member image and said subject image based on said three-dimensional shapes of said reference member and said subject;

a difference calculation unit operable to calculate a color difference in each region between said first and second reference member images for every normal direction; and

a subject image correction unit operable to correct a color of each region in said subject image with said color difference for every normal direction.

2. An image processing apparatus as claimed in claim 1, wherein said reference member is spherical.

3. An image processing apparatus as claimed in claim 1, wherein said reference member and said subject have substantially the same optical characteristics.

4. An image processing apparatus as claimed in claim 1, wherein said first illuminated image capture unit captures said first reference member image under an illumination condition that is ideal for imaging said subject as said first illumination condition.

10. An image processing apparatus as claimed in claim 1, wherein the difference calculation unit calculates the color difference by calculating a difference in chromaticity and a difference in color saturation in each region between said first and second reference images for every normal direction.

5. An image processing apparatus for correcting an image of a subject, comprising:

a first illuminated image capturing unit operable to capture a first reference member image with a first material color under a first illumination condition, said first reference member image being a three-dimensional image of a reference member having a plurality of normal directions;

a second illuminated image capture unit operable to capture a subject image that is an image of a given real subject taken under a second illumination condition that is a given real illumination condition, and a second reference member image that is an image of said reference member having the same color as said subject taken under said second illumination condition;

a shape capture unit operable to capture three-dimensional shapes of said reference member and said subject;

a normal direction determination unit operable to determine a normal direction of each region in said first reference member image, said second reference member image and said subject image based on said three-dimensional shapes of said reference member and said subject;

a difference calculation unit operable to calculate a color difference in each region between said first and second reference member images for every normal direction; and

a subject image correction unit operable to correct a color of each region of said subject image with said color difference for every normal direction.

6. An image processing method for correcting an image of a subject, comprising:

capturing a first reference member image that is an image of a reference member having a plurality of normal directions under a first illumination condition;

capturing a second reference member image that is an image of said reference member taken under a second illumination condition, and a subject image that is an image of a given subject under said second illumination condition;

capturing three-dimensional shapes of said reference member and said subject;

determining a normal direction of each region in said first reference member image, said second reference member image and said subject image based on said three-dimensional shapes of said reference member and said subject;

calculating a color difference in each region between said first and second reference member images for every normal direction; and

correcting a color of each region of said subject image with said color difference for every normal direction.

12. An image processing method as claimed in claim 6, wherein the color difference is calculated by calculating a difference in chromaticity and a difference in color saturation in each region between said first and second reference images for every normal direction.

7. An image processing method for correcting an image of a subject, comprising:

capturing a first reference member image with a first material color under a first illumination condition, said first reference member image being a three-dimensional image of a reference member having a plurality of normal directions;

capturing a subject image that is an image of a given real subject taken under a second illumination condition that is a given real illumination condition, and a second reference member image that is an image of said reference member having the same color as said subject, taken under said second illumination condition;

capturing three-dimensional shapes of said reference member and said subject;

determining a normal direction of each region in said first reference member image, said second reference member image, and said subject image based on said three-dimensional shapes of said reference member and said subject;

calculating a color difference in each region between said first and second reference member images for every normal direction; and

correcting a color of each region of said subject image with said color difference for every normal direction.

8. A tangible non-transitory computer readable medium encoded with a program for use in a computer for correcting an image of a subject, wherein said program makes said computer execute functions of:

capturing a first reference member image that is an image of a reference member having a plurality of normal directions taken under a first illumination condition;

capturing a second reference member image that is an image of said reference member taken under a second illumination condition, and a subject image that is an image of a given subject under said second illumination condition;

capturing three-dimensional shapes of said reference member and said subject;

determining a normal direction of each region in said first reference member image, said second reference member image and said subject image based on said three-dimensional shapes of said reference member and said subject;

calculating a color difference in each region between said first and second reference member images for every normal direction; and

correcting a color in each region of said subject image with said color difference for every normal direction.

14. the tangible computer readable medium as claimed in claim 8, wherein the color difference is calculated by calculating a difference in chromaticity and a difference in color saturation in each region between said first and second reference images for every normal direction.

9. A tangible non-transitory computer readable medium encoded with a program for use in a computer for correcting an image of a subject, wherein said program makes said computer execute functions of:

capturing a first reference member image with a first material color under a first illumination condition, said first reference member image being a three-dimensional image of a reference member having a plurality of normal directions;

capturing a subject image that is an image a given real subject taken under a second illumination condition that is a given real illumination condition, and a second reference member image that is an image of said reference member having the same color as said subject, taken under said second illumination condition;

capturing three-dimensional shapes of said reference member and said subject;

determining a normal direction of each region in said first reference member image, said second reference member image, and said subject image based on said three-dimensional shapes of said reference member and said subject;

calculating a color difference in each region between said first and second reference member images for every normal direction; and

correcting a color of each region of said subject image with said color difference for every normal direction.

11. An image processing apparatus for correcting an image of a subject, comprising:

a first illuminated image generation unit operable to generate a first reference member image with a first material color under a first illumination condition, said first reference member image being a three-dimensional image of a reference member having a plurality of normal directions;

a second illuminated image capture unit operable to capture a subject image that is an image of a given real subject taken under a second illumination condition that is a given real illumination condition, and a second reference member image that is an image of said reference member having the same color as said subject taken under said second illumination condition;

a shape capture unit operable to capture three-dimensional shapes of said reference member and said subject;

a normal direction determination unit operable to determine a normal direction of each region in said first reference member image, said second reference member image and said subject image based on said three-dimensional shapes of said reference member and said subject;

a difference calculation unit operable to calculate a color difference in each region between said first and second reference member images for every normal direction; and

a subject image correction unit operable to correct a color of each region of said subject image with said color difference for every normal direction, wherein the difference calculation unit calculates the color difference by calculating a difference in chromaticity and a difference in color saturation in each region between said first and second reference images for every normal direction.

13. An image processing method for correcting an image of a subject, comprising:

generating a first reference member image with a first material color under a first illumination condition, said first reference member image being a three-dimensional image of a reference member having a plurality of normal directions;

capturing a subject image that is an image of a given real subject taken under a second illumination condition that is a given real illumination condition, and a second reference member image that is an image of said reference member having the same color as said subject, taken under said second illumination condition;

capturing three-dimensional shapes of said reference member and said subject;

determining a normal direction of each region in said first reference member image, said second reference member image, and said subject image based on said three-dimensional shapes of said reference member and said subject;

calculating a color difference in each region between said first and second reference member images for every normal direction; and

correcting a color of each region of said subject image with said color difference for every normal direction, wherein the color difference is calculated by calculating a difference in chromaticity and a difference in color saturation in each region between said first and second reference images for every normal direction.

15. A tangible non-transitory computer readable medium encoded with a program for use in a computer for correcting an image of a subject, wherein said program makes said computer execute functions of:

generating a first reference member image with a first material color under a first illumination condition, said first reference member image being a three-dimensional image of a reference member having a plurality of normal directions;

capturing a subject image that is an image a given real subject taken under a second illumination condition that is a given real illumination condition, and a second reference member image that is an image of said reference member having the same color as said subject, taken under said second illumination condition;

capturing three-dimensional shapes of said reference member and said subject;

determining a normal direction of each region in said first reference member image, said second reference member image, and said subject image based on said three-dimensional shapes of said reference member and said subject;

calculating a color difference in each region between said first and second reference member images for every normal direction; and

correcting a color of each region of said subject image with said color difference for every normal direction, wherein the color difference is calculated by calculating a difference in chromaticity and a difference in color saturation in each region between said first and second reference images for every normal direction.