Image processing apparatus

• US 6,744,931 B2
• Filed: 12/19/2000
• Issued: 06/01/2004
• Est. Priority Date: 04/09/1992
• Status: Expired due to Fees

• Current Assignee: Olympus Optical Company Ltd. (Olympus Corporation)
• Original Assignee: Olympus Optical Company Ltd. (Olympus Corporation)
• Inventors: Tomabechi, Hideo, Sawaki, Ryoichi, Mori, Takeshi, Komiya, Yasuhiro, Iba, Yoichi, Ebihara, Toshiyuki, Oura, Koutatsu, Nagasaki, Tatsuo
• Primary Examiner(s): CHANG, JON CARLTON
• Application Number:
  US09/740,492
• Publication Number:
  US 20030113034A1
• Time in Patent Office: 1,260 Days
• Field of Search: 382/284, 382/294, 345/629, 345/630, 348/36, 348/37, 352/69, 352/70, 352/71, 396/20
• US Class Current: 382/284
• CPC Class Codes: G06T 5/50 using two or more images, e.g. averaging or subtraction
• CPC Class Codes: H04N 1/19505 Scanning picture elements spaced apart from one another in at least one direction
• CPC Class Codes: H04N 1/19515 in two directions
• CPC Class Codes: H04N 1/19584 Combination of arrays
• CPC Class Codes: H04N 1/3876 Recombination of partial images to recreate the original image
• CPC Class Codes: H04N 2209/048 having several pick-up sensors
• CPC Class Codes: H04N 23/15 Image signal generation with circuitry for avoiding or correcting image misregistration
• CPC Class Codes: H04N 23/60 Control of cameras or camera modules
• CPC Class Codes: H04N 23/698 for achieving an enlarged field of view, e.g. panoramic image capture
• CPC Class Codes: H04N 23/843 Demosaicing, e.g. interpolating colour pixel values
• CPC Class Codes: H04N 25/41 Extracting pixel data from a plurality of image sensors simultaneously picking up an image, e.g. for increasing the field of view by combining the outputs of a plurality of sensors

Abstract

Disclosed herein is an image processing apparatus, in which an object image focused by a lens is split into a plurality of images by means of a light splitting section. These images are converted into image data items by a plurality of imaging devices which are arranged with their imaging area overlapping in part. The image data items are stored temporarily in an image storing section. A displacement detecting section detects displacement coefficients (rotation angle R and parallel displacement S) from the image signals representing the mutual overlap region of two images which are to be combined and which are represented by two image data items read from the image storing section. The position of any specified pixel of the image displayed is identified by the pixel signal generated by the corresponding pixel of any imaging device. An interpolation section performs interpolation on the pixel values of the imaging device, thereby correcting the values of the other pixels of the image displayed and ultimately generating interpolated image signals. The interpolated image signals are combined with the image signals produced by the imaging device, whereby a display section displays a high-resolution image.

Claims

1. An image processing apparatus for combining a plurality of image areas which are obtained as image data by dividing an object image, comprising:

imaging means for imaging an object within each of a plurality of image areas having at least one overlap area; and

image area position detecting means for detecting a positional relationship relating to overlapping between the plurality of image areas within which the object is imaged by said imaging means by calculating correlation between the plurality of image areas;

wherein said imaging means includes;

optical image picking-up means for picking up an image of the object;

light splitting means for splitting an object light received by said optical image picking-up means into a plurality of object lights;

a plurality of groups of imaging elements for obtaining images from the plurality of object lights obtained by said light splitting means, and

said image area position detecting means includes;

displacement determining means for setting a reference area in the image obtained by one of the groups of imaging elements of said imaging means, setting a search area in a position corresponding to the reference area in the image obtained by another one of the groups of imaging elements, and then calculating a displacement between said one of the groups of imaging elements and said another one of the groups of imaging elements by performing a correlation arithmetic with respect to the reference area and the search area, to thereby determine a coefficient for use in interpolation;

storing means for storing the coefficient determined by said displacement determining means;

interpolation means for calculating an image signal associated with a position of said another one of the groups of imaging elements which corresponds to a position of said one of the groups of imaging elements, by using an interpolation arithmetic, in accordance with a value indicated by data stored in said storing means; and

image data synthesizing means for combining a plurality of image data output from said imaging means and said interpolation means.

2. The image processing apparatus according to claim 1, which further comprises (i) first image storing means for storing an object obtained as image data by said imaging means, and (ii) second image storing means for storing a reference image as reference image data in advance, and wherein the image area position detecting means comprises (i) movement vector detecting means for calculating a correlation between the images read out as image data from said first and second storing means, and comparing the images, to thereby detect a movement vector, and (ii) third image storing means for storing the image as the image data which is moved from said first image storing means based on the movement vector detected by said movement vector detecting means.

3. The image processing apparatus according to claim 2, wherein the movement detecting means includes a correlation area selecting means for selecting an area having a high correlation.

4. The image processing apparatus according to claim 1, which further comprises a mirror rotatably provided between the object and said imaging means, and wherein when said imaging means images the object, object images are intermittently obtained as image data, and said mirror is rotated to shift an imaging range over the object, while obtaining the object images.

5. An image processing apparatus for combining a plurality of image areas which are obtained as image data by dividing an object image, comprising:

imaging means for imaging an object within each of a plurality of image areas having at least one overlap area;

image area position detecting means for detecting a positional relationship relating to overlapping between the plurality of image areas within which the object is imaged by said imaging means by calculating correlation between the plurality of image areas;

a finder for displaying in real time an image being obtained by said imaging means, along with that overlap area of an image previously obtained by said imaging means, which is to be made to overlap with the image being obtained by said imaging means when the image being obtained by said imaging means is connected to the image previously obtained by said imaging means,

correlation arithmetic means for performing a correlation arithmetic with respect to an image signal associated with the overlap area of the previously obtained image and a present image signal representing a present image obtained subsequent to the previously obtained image to thereby determine a displacement between the previously obtained image and the present image, and

indicating means for indicating a direction in which said imaging means is to be moved to obtain an image signal that coincides with the image signal associated with the overlap area of the previously obtained image based on the displacement determined by said correlation arithmetic means.

6. The image processing apparatus according to claim 5, wherein said indicating means displays an arrow indicator in the finder to indicate the direction in which the imaging means is to be moved.

7. The image processing apparatus according to claim 5, wherein said indicating means changes color of the arrow indicator displayed in the finder when the present image signal representing the present image obtained subsequent to the previously obtained image coincides with the image signal associated with the overlap area of the previously obtained image.