System, method and apparatus for image processing and image format

• US 7,948,622 B2
• Filed: 07/30/2010
• Issued: 05/24/2011
• Est. Priority Date: 02/13/2007
• Status: Active Grant

• Current Assignee: Panasonic Corporation (Panasonic Holdings Corporation)
• Original Assignee: Panasonic Corporation (Panasonic Holdings Corporation)
• Inventors: Sato, Satoshi, Kanamori, Katsuhiro
• Primary Examiner(s): Le; Vu
• Assistant Examiner(s): LIEW, ALEX KOK SOON
• Application Number:
  US12/846,941
• Publication Number:
  US 20100290713A1
• Time in Patent Office: 298 Days
• Field of Search: 356364-370, 382224-228
• US Class Current: 356/364
• CPC Class Codes: G02B 5/3025 Polarisers, i.e. arrangements capable of producing a definite output polarisation state from an unpolarised input state G02B5/3008, G02B5/3016 take precedence
• CPC Class Codes: G06T 7/514 from specularities

Abstract

According to the present invention, a polarized image is captured, a variation in its light intensity is approximated with a sinusoidal function, and then the object is spatially divided into a specular reflection area (S-area) and a diffuse reflection area (D-area) in Step S402 of dividing a reflection area. Information about the object'"'"'s refractive index is entered in Step S405, thereby obtaining surface normals by mutually different techniques in Steps S406 and S407, respectively. Finally, in Steps S410 and S411, the two normals are matched to each other in the vicinity of the boundary between the S- and D-areas.

Claims

1. An image processing system comprising:

an image capturing section for obtaining, supposing an angle that defines a plane, which includes both a line connecting an imaging viewpoint and an observation point on an object together and a surface normal at the observation point, and that represents the angle of orientation of that plane around the line is identified by Ψ

, polarized images by measuring the polarized light intensities of a light ray that is polarized parallel to the plane defined by the angle Ψ

for multiple different angles Ψ

;

an image processing section for generating an image format by processing the polarized images that have been obtained by the image capturing section, the image format including, as data, a specular reflected image and a diffuse reflected image of the object from which a light intensity image of the object that is an average light intensity value of the polarized images at the multiple angles Ψ

has been separated, surface normal information at respective pixel locations on the object, and light source information obtained at the object'"'"'s position; and

a high-resolution image reproducing section for reconstructing the object'"'"'s shape by processing and synthesizing together the specular reflected and diffuse reflected images of the light intensity image of the object using the image format.

2. An image processing apparatus for use in the image processing system of claim 1, the apparatus comprising:

an input section to enter the image format; and

a high-resolution image reproducing section for reconstructing the object'"'"'s shape by processing and synthesizing together the specular reflected and diffuse reflected images of the object using the image format.

3. An image processing method in relation to polarized images obtained, supposing an angle that defines a plane, which includes both a line connecting an imaging viewpoint and an observation point on an object together and a surface normal at the observation point, and that represents the angle of orientation of that plane around the line is identified by Ψ

, by measuring the polarized light intensities of a light ray that is polarized parallel to the plane defined by the angle Ψ

for multiple different angles Ψ

, the image processing method comprising the steps of;

dividing each said a polarized image into a plurality of areas with different reflection properties including a specular reflection area and a diffuse reflection area;

getting information about a refractive index of the object;

drawing, as a first step of getting an estimated normal, a surface normal to the diffuse reflection area based on polarization information about the diffuse reflection area that has been obtained from the polarized image;

drawing, as a second step of getting an estimated normal, a surface normal to the specular reflection area based on polarization information about the specular reflection area that has been obtained from the polarized image; and

evaluating the degree of continuity between the estimated surface normals that have been drawn in the first and second steps, thereby dispelling the uncertainty of the surface normals,

whereby the surface shape of the object is reconstructed based on the polarized image thereof.

5. A non-transitory storage medium having stored therein a program which, when executed, carries out the steps recited in claim 3.

4. An image processing method comprising the steps of:

capturing polarized images by measuring polarized light intensities of a light ray that is polarized parallel to a plane defined by the angle Ψ

for multiple different angles Ψ

, wherein each of the angles Ψ

defines a plane, which includes both a line connecting an imaging viewpoint and an observation point on an object together and a surface normal at the observation point, and each of the angles Ψ

represents the angle of orientation of that plane around the line;

generating an image format by processing the polarized images that have been obtained by an image capturing section, the image format including, as data, a specular reflected image and a diffuse reflected image of the object from which a light intensity image of the object that is an average light intensity value of the polarized images at the multiple angles Ψ

has been separated, surface normal information at respective pixel locations on the object, and light source information obtained at the object'"'"'s position; and

reconstructing the object'"'"'s shape by processing and synthesizing together the specular reflected and diffuse reflected images of the light intensity image of the object using the image format.