Three-Dimensional Object Imaging Device

• US 20080247638A1
• Filed: 03/26/2008
• Published: 10/09/2008
• Est. Priority Date: 03/26/2007
• Status: Abandoned Application

• Current Assignee: Funai Electric Co., Ltd. (Funai Electric Holdings Company Limited), Osaka University
• Original Assignee: Funai Electric Co., Ltd. (Funai Electric Holdings Company Limited), Osaka University
• Inventors: Toyoda, Takashi, Masaki, Yasuo, Nakao, Yoshizumi, Tanida, Jun
• Application Number:
  US12/055,762
• Publication Number:
  US 20080247638A1
• Time in Patent Office: Days
• US Class Current: 382/154
• CPC Class Codes: G06T 7/557 from light fields, e.g. from plenoptic cameras

Abstract

A three-dimensional object imaging device comprises a compound-eye imaging unit and an image reconstructing unit for reconstructing an image of a three-dimensional object based on multiple unit images captured by the imaging unit. Based on the unit images obtained by the imaging unit, the image reconstructing unit calculates a distance (hereafter “pixel distance”) between the object and the imaging unit for each pixel forming the unit images, and rearranges the unit images pixel-by-pixel on a plane at the pixel distance to create a reconstructed image. Preferably, the image reconstructing unit sums a high-frequency component reconstructed image created from the multiple unit images with a lower noise low-frequency component unit image selected from low-frequency component unit images created from the multiple unit images so as to form a reconstructed image of the three-dimensional object. This makes it possible to obtain a reconstructed image with high definition easily by a simple process.

Claims

1. A three-dimensional object imaging device comprising compound-eye imaging means and image reconstructing means for reconstructing an image of a three-dimensional object based on multiple unit images with pixels captured by the compound-eye imaging means, wherein the image reconstructing means comprises:

distance calculating means for calculating a distance (hereafter referred to as “

pixel distance”

) between the three-dimensional object and the compound-eye imaging means for each pixel forming the unit images; and

reconstructed image creating means for creating a reconstructed image by rearranging the multiple unit images pixel-by-pixel on a plane located at the pixel distance.

2. The three-dimensional object imaging device according to claim 1, wherein the distance calculating means comprises:

temporary reconstructed image creating means for (a) performing a temporary reconstructed image creating process to create a temporary reconstructed image of the multiple unit images on each of multiple planes located at predetermined distances from the pixels of the unit images in which for a first one (hereafter referred to as “

first temporary distance”

) of the predetermined distances, the multiple unit images are rearranged pixel-by-pixel on a first one (hereafter referred to as “

first temporary distance plane”

) of the planes located at the first temporary distance, and (b) repeating the temporary reconstructed image creating process for the other planes (hereafter referred to as “

subsequent temporary distance planes”

) located at the other predetermined distances (hereafter referred to as “

subsequent temporary distances”

), so as to create multiple temporary reconstructed images;

reverse projection image creating means for (a) performing a reverse projection image creating process to create reverse projection images, corresponding to the respective unit images and corresponding also in number to the unit images, on each of the first and subsequent temporary distance planes in which for the first temporary distance, each of the unit images is reversely projected pixel-by-pixel onto the first temporary distance plane, and (b) repeating the reverse projection image creating process for the subsequent temporary distance planes located at the subsequent temporary distances, so as to create multiple reverse projection images for each of the unit images;

comparing means for comparing the first and subsequent temporary distances based on the temporary reconstructed image and the reverse projection images of the respective unit images on each of the first and subsequent temporary distance planes; and

pixel distance determining means for determining the pixel distance based on the comparison by the comparing means.

3. The three-dimensional object imaging device according to claim 2, wherein the reconstructed image creating means comprises:

high-frequency component unit image creating means for creating multiple high-frequency component unit images by extracting a high-frequency component from each of the multiple unit images;

low-frequency component unit image creating means for creating multiple low-frequency component unit images by extracting a low-frequency component from each of the multiple unit images;

high-frequency component reconstructed image creating means for creating a high-frequency component reconstructed image by rearranging, on the plane located at the pixel distance, the multiple high-frequency component unit images created by the high-frequency component unit image creating means;

image selecting means for selecting a low-frequency component unit image with lower noise from the multiple low-frequency component unit images created by the low-frequency component unit image creating means;

low-frequency component reverse projection image creating means for creating a low-frequency component reverse projection image by reversely projecting pixel-by-pixel the low-frequency component unit image selected by the image selecting means onto the plane located at the pixel distance; and

summing means for summing the high-frequency component reconstructed image created by the high-frequency component reconstructed image creating means with the low-frequency component reverse projection image created by the low-frequency component reverse projection image creating means so as to obtain the reconstructed image.

4. The three-dimensional object imaging device according to claim 1, wherein the reconstructed image creating means comprises:

high-frequency component unit image creating means for creating multiple high-frequency component unit images by extracting a high-frequency component from each of the multiple unit images;

low-frequency component unit image creating means for creating multiple low-frequency component unit images by extracting a low-frequency component from each of the multiple unit images;

high-frequency component reconstructed image creating means for creating a high-frequency component reconstructed image by rearranging, on the plane located at the pixel distance, the multiple high-frequency component unit images created by the high-frequency component unit image creating means;

image selecting means for selecting a low-frequency component unit image with lower noise from the multiple low-frequency component unit images created by the low-frequency component unit image creating means;

low-frequency component reverse projection image creating means for creating a low-frequency component reverse projection image by reversely projecting pixel-by-pixel the low-frequency component unit image selected by the image selecting means onto the plane located at the pixel distance; and

summing means for summing the high-frequency component reconstructed image created by the high-frequency component reconstructed image creating means with the low-frequency component reverse projection image created by the low-frequency component reverse projection image creating means so as to obtain the reconstructed image.