Stereoscopic Panoramic imaging system

• US 20080298674A1
• Filed: 05/27/2008
• Published: 12/04/2008
• Est. Priority Date: 05/29/2007
• Status: Abandoned Application

• Current Assignee: Image Masters Incorporated
• Original Assignee: Image Masters Incorporated
• Inventors: Baker, Robert G., Connellan, James A., Baker, Frank A.
• Application Number:
  US12/154,734
• Publication Number:
  US 20080298674A1
• Time in Patent Office: Days
• US Class Current: 382/154
• CPC Class Codes: G03B 35/08 by simultaneous recording
• CPC Class Codes: G03B 37/04 with cameras or projectors providing touching or overlapping fields of view
• CPC Class Codes: G06V 10/147 Details of sensors, e.g. sensor lenses fingerprint or palmprint sensors G06V40/13; vascular sensors G06V40/145; eye sensors G06V40/19
• CPC Class Codes: H04N 13/133 Equalising the characteristics of different image components, e.g. their average brightness or colour balance
• CPC Class Codes: H04N 13/243 using three or more 2D image sensors
• CPC Class Codes: H04N 13/246 Calibration of cameras
• CPC Class Codes: H04N 23/50 Constructional details
• CPC Class Codes: H04N 23/60 Control of cameras or camera modules
• CPC Class Codes: H04N 23/698 for achieving an enlarged field of view, e.g. panoramic image capture
• CPC Class Codes: H04N 23/90 Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums

Abstract

An imaging system for producing stereoscopic panoramic images using multiple coplanar pairs of image capture devices with overlapping fields of view held in a rigid structural frame for long term calibration maintenance. Pixels are dynamically adjusted within the imaging system for position, color, brightness, aspect ratio, lens imperfections, imaging chip variations and any other imaging system shortcomings that are identified during calibration processes. Correction of pixel information is implemented in various combinations of hardware and software. Corrected image data is then available for storage or display or for separate data processing actions such as object distance or volume calculations.

Claims

1. An imaging system, comprising:

a plurality of image capture devices for translating electromagnetic radiation to electrical energy representing pixel data;

a plurality of lenses for focusing said radiation on said image capture devices; and

a framework for positioning said image capture devices and said lenses as coplanar optical subsystem imager pairs held firmly in place in relation to each other and directed as pairs outwardly from a central point to cover at least 360°

of view;

whereby said imaging system produces stereoscopic image data sets covering a panoramic or panospheric field of view.

2. The imaging system of claim 1, wherein said lenses are consistently similar in a given implementation and selected from a group consisting of wide angle, narrow angle, fisheye lenses, zoom or other lenses as are ordinarily used to refract light onto image capture devices.

3. The imaging system of claim 2, wherein the components of each pair of said optical subsystems formed from the combination of two said capture devices and said associated lenses are spaced at normal human interocular separation distances of about 65 mm, thereby minimizing hyperstereo and hypostereo visual effects upon reproduction.

4. The imaging system of claim 1, wherein said framework for positioning said capture devices and said lenses forms a regular polygon and is comprised of:

imager pair board assemblies to which are mounted said capture devices and said lenses;

vertical support members firmly affixed to said assemblies; and

base and top plates, into which said support members are attached;

whereby a rigid framework is established that maintains the relative positions of optical system components for long periods of time, thereby reducing recalibration requirements.

5. The imaging system of claim 1, wherein said framework for positioning said image capture devices and said lenses forms a regular polygon and is comprised of:

a single solid frame onto which said capture devices and their respective circuit boards are attached, and

into which said lenses are attached, said framework of which is further joined to base and top plates with screws or other attachment means,

whereby a rigid framework is established that maintains the relative positions of optical system components for long periods of time, thereby reducing recalibration requirements.

6. An imaging system, comprising:

a plurality of image capture devices for translating electromagnetic radiation to electrical energy representing pixel data;

a plurality of lenses for focusing said radiation on said image capture devices;

a framework for positioning said image capture devices and said lenses as coplanar optical subsystem imager pairs held firmly in place in relation to each other and directed as pairs outwardly from a central point to cover at least 360°

of view; and

processing means for combining said acquired pixel data with image calibration data that has been previously captured to change characteristics of said acquired pixel data, a method called dynamic pixel adjustment;

whereby said imaging system produces corrected stereoscopic image data sets covering a panoramic or panospheric field of view.

7. The imaging system of claim 6, wherein said lenses are consistently similar in a given implementation and selected from a group consisting of wide angle, narrow angle, fisheye lenses, zoom or other lenses as are ordinarily used to refract light onto image capture devices.

8. The imaging system of claim 7, wherein each pair of optical subsystems formed from the combination of two image capture devices and their associated lenses are spaced at normal human interocular separation distances of about 65 mm, thereby minimizing hyperstereo and hypostereo visual effects upon reproduction.

9. The imaging system of claim 6, wherein said framework for positioning said capture devices and said lenses forms a regular polygon and is comprised of:

imager pair board assemblies to which are mounted said capture devices and said lenses;

vertical support members firmly affixed to said assemblies; and

base and top plates, into which said support members are attached;

whereby a rigid framework is established that maintains the relative positions of optical system components for long periods of time, thereby reducing recalibration requirements.

10. The imaging system of claim 6, wherein said framework for positioning said image capture devices and said lenses forms a regular polygon and is comprised of:

a single solid frame onto which said capture devices and their respective circuit boards are attached, and

into which said lenses are attached, said framework of which is further joined to base and top plates with screws or other attachment means,

whereby a rigid framework is established that maintains the relative positions of optical system components for long periods of time, thereby reducing recalibration requirements.

11. The imaging system of claim 6, wherein the method of dynamic pixel adjustment for correcting acquired position, color, and brightness characteristic values of each pixel, comprises:

providing hardware or software means in which said characteristic values are temporarily stored for comparison with calibration values that have been previously determined; and

providing hardware or software means in which said characteristic values are compared with said calibration values to correct said characteristic values for more preferred values; and

for pixels that are not stuck on or off in the image capture device, performing comparisons and correction of pixel position due to lens distortion or flaws, comparison and correction of color for each pixel, and comparison and correction of brightness for each pixel; and

for pixels that are either stuck on or off in the image capture device, determining new values for color and brightness through interpolation of values from adjacent surrounding pixels; and

providing hardware or software means in which said characteristic values for comparable pixel positions between said elements of an imaging pair are balanced for more common brightness values;

whereby said correction steps handle imaging system shortcomings such as lens distortion and flaws, differences from ideal values of color and brightness for pixels of image capture devices, and differences between relative brightness values of individual image capture devices.