Apparatus and method for image configuring

• US 20070160310A1
• Filed: 12/01/2004
• Published: 07/12/2007
• Est. Priority Date: 12/01/2003
• Status: Active Grant

• Current Assignee: Japan Science & Technology Trading Co. Limited
• Original Assignee: Japan Science & Technology Trading Co. Limited
• Inventors: Nitta, Kouichi, Tanida, Jun
• Granted Patent: US 7,657,122 B2
• Time in Patent Office: Days
• US Class Current: 382/276
• CPC Class Codes: G06T 3/40 Scaling of whole images or parts thereof, e.g. expanding or contracting
• CPC Class Codes: H04N 23/55 Optical parts specially adapted for electronic image sensors; Mounting thereof
• CPC Class Codes: H04N 25/00 Circuitry of solid-state image sensors [SSIS]; Control thereof

Abstract

Using image data on a plurality of reduced object images to calculate a shift amount in regard to the gap of relative positions between the reduced object images by a correlation calculation between the reduced object images. A conversion equation is obtained from the shift amount for geometric projection process from the object image to each of the reduced object images. Initial image data on a single object image is generated using image data on the plurality of reduced object images. This and the aforementioned conversion equation, are used to estimate images of each of the reduced object images. A difference between the estimated image of each of the reduced object images and each of the reduced object images is projected in the reverse process of the aforementioned geometric projection process, to update the image data on the single object image. The processes are repeated until the difference satisfies a predetermined condition and a high resolution object image is outputted.

Claims

1. An image configuring apparatus comprising an object image configuring means, which reads image data of a plurality of reduced object images from a reduced image recording means for recording image data of a plurality of reduced object images obtained by photographing an object as using a compound-eye camera that focuses a plurality of reduced object images on a photo detector through micro lens array having a plurality of micro lenses arrayed therein, and configures a single object image based on said image data and then outputs its image data,

said object image configuring means comprising:

a generating means of initial object image for generating an initial image data of a single object image based on an image data of a plurality of said reduced object images;

a reduced image estimating means for estimating an estimated image of each of said reduced object images from an image data of a provided single object image based on a geometric projection process;

an object image updating means for updating an image data of said single object image provided in said reduced image estimating means by projecting a difference between said estimated image of each reduced object images and each of said reduced object images in an inverse process of said geometric projection process; and

an iterative control means for firstly giving said initial image data to said reduced image estimating means as an initial value of an image data of said single object image, and then repetitively conducting a estimating processing of said reduced image estimating means as well as a updating processing of said object image updating means until said difference satisfying a predetermined condition, then outputting an image data of said single object image at the time of said difference satisfying said predetermined condition as a final image data of an object image.

2. An image configuring apparatus according to claim 1, wherein said object image configuring means further comprises a shift amount calculating means for calculating a shift amount in regard to a gap of relative positions between said reduced object images through correlation calculation between said reduced object images by using an image data of a plurality of said reduced object images.

3. An image configuring apparatus according to claim 2, wherein said object image configuring means further comprises a projection process deriving means for obtaining a conversion equation indicating said geometric projection process employed in said reduced image estimating means based on said shift amount obtained in said shift amount calculating means.

4. An image configuring apparatus according to claim 2, wherein said generating means of initial object image in said object image configuring means generates an image data of a single object image by arranging a plurality of said reduced object images onto a same area based on said shift amount obtained in said shift amount calculating means, and then generates an initial image data of said single object image by interpolating blank pixels with respect to said image data.

5. An image configuring method for configuring a single object image based on an image data of a plurality of reduced object images obtained by photographing an object as using a compound-eye camera that focuses a plurality of reduced object images on a photo detector through micro lens array having a plurality of micro lenses arrayed therein, comprising the steps of:

generating an initial image data of a single object image based on an image data of a plurality of said reduced object images;

estimating an estimated image of each of said reduced object images from an image data of a provided single object image based on a geometric projection process;

updating an image data of said single object image provided in said reduced image estimating process by projecting a difference between estimated images of each of said reduced object images and each of said reduced object images in an inverse process of said geometric projection process;

providing said initial image data to said reduced image estimating process as an initial value of an image data of said single object image;

repetitively conducting said reduced image estimating process as well as said object image updating process until said difference satisfying a predetermined condition; and

outputting an image data of said single object image at the time of said difference satisfying said predetermined condition as a final image data of an object image.