Digital imaging system using overlapping images to formulate a seamless composite image and implemented using either a digital imaging sensor array

• US 7,215,364 B2
• Filed: 04/10/2003
• Issued: 05/08/2007
• Est. Priority Date: 04/10/2002
• Status: Expired due to Fees

• Current Assignee: Pan-X Imaging Incorporated
• Original Assignee: Pan-X Imaging Incorporated
• Inventors: Wachtel, Robert A., Paulson, Richard, Keable, John
• Primary Examiner(s): Ometz; David
• Assistant Examiner(s): PRABHAKHER, PRITHAM DAVID
• Application Number:
  US10/411,884
• Publication Number:
  US 20040061774A1
• Time in Patent Office: 1,489 Days
• Field of Search: 348/218.1, 348/207.99, 348/39, 348/36, 348/153, 348/159, 348/584, 348/211.11, 348/262, 396/323, 396/335, 382/284
• US Class Current: 348/218.1
• CPC Class Codes: G03B 19/00 Cameras details G03B17/00
• CPC Class Codes: H04N 23/58 Means for changing the camera field of view without moving the camera body, e.g. nutating or panning of optics or image sensors
• CPC Class Codes: H04N 23/60 Control of cameras or camera modules
• CPC Class Codes: H04N 23/698 for achieving an enlarged field of view, e.g. panoramic image capture
• CPC Class Codes: H04N 23/90 Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
• CPC Class Codes: H04N 5/2624 for obtaining an image which is composed of whole input images, e.g. splitscreen
• CPC Class Codes: H04N 5/2627 for providing spin image effect, 3D stop motion effect or temporal freeze effect 2D image animation in general G06T13/80

Abstract

An imaging system for obtaining a wide field of view comprises a plurality of imaging devices each having a defined field of view and each of the imaging devices having a mechanism for capturing an image at a selected time instant. The imaging devices are positioned such that the field of view of each device overlaps the field of view of each adjacent device. A control module simultaneously actuates each of the imaging devices to capturing an image within the field of view of all devices concurrently. The resulting images from each of the devices are merged to produce a wide field of view image.

Claims

1. In an imaging system for obtaining a wide field of view comprising a plurality of imaging devices each having a defined field of view and each of the imaging devices having a mechanism for capturing an image at a selected time instant, apparatus for positioning the plurality of imaging devices in an arcuate array such that the field of view of each device overlaps the field of view of each adjacent device, a control module for simultaneously actuating each of the imaging devices for capturing an image within the field of view of all devices concurrently, a method for combining the images from each of the devices to produce a wide field of view image, comprising:

determining a centroid of the array of imaging devices;

identifying objects that are common to images obtained from adjacent ones of the imaging devices and grouping the common objects based upon distance from the centroid into bins;

performing gross registration of the identified objects using auto-correlation;

selecting points on the identified common objects based upon bin identification;

applying an n-dimensional polynomial to merge the common identified points in one image into alignment with points in an adjacent image; and

creating a continuous image from the merged plurality of adjacent images.

2. The method of claim 1 wherein the step of identifying common objects includes the steps of pre-processing the images by filtering and warping to facilitate identifying common objects.

3. The method of claim 1 and including the step of normalizing concurrent images with respect to color, brightness and contrast.

4. The method of claim 3 and including the step of filtering the continuous image by linear compression over a beginning and ending portion while maintaining the image constant over a middle portion.

5. The method of claim 4 wherein the beginning, ending and middle portions comprise equal portions.

6. The method of claim 5 and including applying a neural network equation to weighted values of selected photographic parameters, changing the weighted value of the parameters, comparing images obtained with original and changed parameter values, selecting a better image transition between adjacent images, and repeating the steps of changing the weighed value and applying the neural network equation to obtain a least noticeable transition between adjacent images.

7. The method of claim 6 the selected parameters are taken from the group consisting of light compensation, high pass filter response, interpolation approach, and special transformations.

8. The method of claim 6 and including adjustment of the values of the neural equation each time a comparison is made so as to “

learn”

the optimum settings.

9. The method of claim 6 wherein the comparisons are measured in five states consisting of much better, slightly better, the same, slightly worse, or much worse.