Digital imaging system and method using multiple digital image sensors to produce large high-resolution gapless mosaic images

• US 20090268983A1
• Filed: 07/25/2006
• Published: 10/29/2009
• Est. Priority Date: 07/25/2005
• Status: Abandoned Application

• Current Assignee: Lawrence Livermore National Security LLC (Government of the United States of America)
• Original Assignee: Regents of the University of California (University of California)
• Inventors: Stone, Gary F., Bloom, David A.
• Application Number:
  US11/493,761
• Publication Number:
  US 20090268983A1
• Time in Patent Office: Days
• US Class Current: 382/284
• CPC Class Codes: H04N 23/698 for achieving an enlarged field of view, e.g. panoramic image capture
• CPC Class Codes: H04N 25/41 Extracting pixel data from a plurality of image sensors simultaneously picking up an image, e.g. for increasing the field of view by combining the outputs of a plurality of sensors
• CPC Class Codes: H04N 5/2624 for obtaining an image which is composed of whole input images, e.g. splitscreen

Abstract

A digital imaging system and method using multiple cameras arranged and aligned to create a much larger virtual image sensor array. Each camera has a lens with an optical axis aligned parallel to the optical axes of the other camera lenses, and a digital image sensor array with one or more non-contiguous pixelated sensors. The non-contiguous sensor arrays are spatially arranged relative to their respective optical axes so that each sensor images a portion of a target region that is substantially different from other portions of the target region imaged by other sensors, and preferably overlaps adjacent portions imaged by the other sensors. In this manner, the portions imaged by one set of sensors completely fill the image gaps found between other portions imaged by other sets of sensors, so that a seamless mosaic image of the target region may be produced.

Claims

1. A digital imaging system comprising:

at least two optic modules having respective optical axes parallel to and offset from each other; and

for each of said optic modules respectively a corresponding set of at least one digital image sensor(s), each sensor spatially arranged relative to the optical axis of the corresponding optic module to image a portion of a target region that is substantially different from other portions of the target region imaged by the other sensor(s) of the system, so that all of said imaged portions together produce a seamless mosaic image of the target region.

2. The digital imaging system of claim 1,

wherein at least one of the sensor sets comprise at least two sensors non-contiguously arranged relative to each other so that the respective portions imaged thereby are separated by image gaps which are filled by the other portions of the target region imaged by the other sensor set(s) of the system.

3. The digital imaging system of claim 2,

wherein each sensor is spatially arranged relative to the optical axis of the corresponding optic module so that the portion of the target region imaged thereby partially overlaps adjacent portions of the target region imaged by the other sensor set(s) of the system.

4. The digital imaging system of claim 3,

wherein said digital image sensors are rectangular in shape.

5. The digital imaging system of claim 4,

wherein for each sensor set having at least two non-contiguous rectangular sensors, the non-contiguous rectangular sensors are aligned to form a matrixed array having rows and columns.

6. The digital imaging system of claim 5,

wherein said digital imaging system comprises at least four optic modules, and for each of said four optic modules respectively the corresponding sensor set comprises at least four rectangular sensors aligned to form a matrixed array having at least two rows and at least two columns.

7. The digital imaging system of claim 1,

wherein each sensor is spatially arranged relative to the optical axis of the corresponding optic module so that the portion of the target region imaged thereby partially overlaps adjacent portions of the target region imaged by the other sensor set(s) of the system.

8. The digital camera system of claim 1,

wherein the digital image sensors of each set are selected from the group consisting of visible, IR, UV, microwave, x-ray, photon, image intensified night vision, and radar imaging digital image sensors.

9. A digital imaging system comprising:

at least four coplanar optic modules having respective optical axes parallel to and offset from each other; and

for each of said optic modules respectively a corresponding set of at least four rectangular pixellated image sensors selected from a group consisting of visible, IR, UV, microwave, x-ray, photon, image intensified night vision, and radar imaging digital image sensors and arranged in a matrixed array having at least two rows and at least two columns, each sensor non-contiguously arranged relative to the other sensors in the respective set and coplanar with all other sensors of the system to image a portion of a target region that is substantially different from other portions of the target region simultaneously imaged by the other image sensors of the system but which partially overlaps with adjacent portions of the target region, so that all of said portions together produce a seamless mosaic image of the target region.

10. A digital imaging system comprising:

at least two cameras, each camera comprising;

a lens having an optical axis parallel to and offset from the optical axes of the other camera lens(es) so that an image circle thereof does not overlap with other image circle(s) of the other camera(s); and

a digital image sensor array having at least two digital image sensors each non-contiguously arranged relative to each other to digitally capture a portion of a target region which is substantially different from other portions of the target region digitally captured by the other sensors in the system but which partially overlaps with adjacent portions of the target region so that all of said portions together optically produce a gapless mosaic image of said target region.

11. The digital imaging system of claim 10,

wherein the digital image system comprises at least four cameras, with each camera having at least four rectangular digital image sensors arranged in a matrixed array with at least two rows and at least two columns.

12. A multi-camera alignment method for producing gapless mosaiced images comprising:

aligning at least two optic modules coplanar to and laterally offset from each other so that respective optical axes thereof are parallel to each other; and

for each of said optic modules respectively, spatially arranging on a common focal plane a corresponding set of at least one pixelated digital image sensor(s) relative to the optical axis of the corresponding optic module to image a portion of a target region that is substantially different from other portions of the target region imaged by the other sensor(s) of the system so that all of said portions together produce a seamless mosaic image of the target region.

13. The multi-camera alignment method of claim 12,

wherein at least one of the sensor sets comprise at least two sensors, and the spatially arranging step includes non-contiguously arranging said at least two non-contiguous sensors relative to each other so that the respective portions imaged thereby are separated by image gaps which are filled by the other portions of the target region imaged by the other sensor set(s) of the system.

14. The multi-camera alignment method of claim 13,

wherein the spatially arranging step includes spatially arranging each sensor relative to the optical axis of the corresponding optic module so that the portion of the target region imaged thereby partially overlaps adjacent portions of the target region imaged by the other sensor set(s) of the system.

15. The multi-camera alignment method of claim 14,

wherein said digital image sensors are rectangular in shape.

16. The multi-camera alignment method of claim 15,

wherein for each sensor set having at least two non-contiguous rectangular sensors, the spatially arranging step includes aligning said non-contiguous rectangular sensors to form a matrixed array having rows and columns.

17. The multi-camera alignment method of claim 16,

wherein the optic module aligning step includes aligning at least four optic modules, and for each of said four optic modules respectively the spatially arranging step includes aligning at least four rectangular sensors to form a matrixed array having at least two rows and at least two columns.

18. The multi-camera alignment method of claim 12,

wherein the step of spatially arranging includes spatially arranging each sensor relative to the optical axis of the corresponding optic module so that the portion of the target region imaged thereby partially overlaps adjacent portions of the target region imaged by the other sensor set(s) of the system.

19. The multi-camera alignment method of claim 16,

wherein the digital image sensors of each set are selected from the group consisting of visible, IR, UV, microwave, x-ray, photon, image intensified night vision, and radar imaging digital image sensors.

20. A multi-camera alignment method for producing gapless mosaiced images comprising:

aligning at least four optic modules coplanar to and laterally offset from each other so that respective optical axes thereof are parallel to each other; and

for each of said optic modules respectively, spatially arranging a corresponding set of at least four rectangular pixellated image sensors selected from a group consisting of visible, IR, UV, microwave, x-ray, photon, image intensified night vision, and radar imaging digital image sensors in a matrixed array having at least two rows and at least two columns, so that each sensor is spaced from the other sensors in the respective set and coplanar with all other sensors of the system to image a portion of a target region that is substantially different from other portions of the target region simultaneously imaged by the other image sensors of the system but which partially overlaps with adjacent portions of the target region, so that all of said portions together produce a seamless mosaic image of the target region.

21. A digital imaging method comprising:

providing at least two optic modules having respective optical axes parallel to and offset from each other, and for each of said optic modules respectively a corresponding set of at least one digital image sensor(s), each sensor spatially arranged relative to the optical axis of the corresponding optic module to image a portion of a target region that is substantially different from other portions of the target region imaged by the other sensor(s) of the system so that all of the portions together image all of the target region without gaps therein;

shuttering the at least two optic modules to digitally capture image data of all the portions of the target region on said sensors; and

processing the digitally captured image data to mosaic all the imaged portions of the target region into a seamless mosaic image thereof.

22. A digital imaging method comprising:

providing at least four coplanar optic modules having respective optical axes parallel to and offset from each other, and for each of said optic modules respectively a corresponding set of at least four rectangular pixellated image sensors selected from the group consisting of visible, IR, UV, microwave, x-ray, photon, image intensified night vision, and radar imaging digital image sensors and arranged in a matrixed array having at least two rows and at least two columns, each sensor non-contiguously arranged relative to the other sensors in the respective set and coplanar with all other sensors of the system to image a portion of a target region that is substantially different from other portions of the target region simultaneously imaged by the other image sensors of the system but which partially overlaps with adjacent portions of the target region, so that all of said portions together image all of the target region without gaps;

simultaneously shuttering the at least four coplanar optic modules to digitally capture image data of all the portions of the target region on said sensors; and

processing the digitally captured image data to mosaic all the imaged portions of the target region into a seamless mosaic image thereof.