Multi-lens array system and method

• US 9,182,228 B2
• Filed: 07/11/2006
• Issued: 11/10/2015
• Est. Priority Date: 02/13/2006
• Status: Expired due to Fees

• Current Assignee: Sony Corporation (Sony Group Corp.), University of Alabama (University of Alabama System)
• Original Assignee: Sony Corporation (Sony Group Corp.), University of Alabama in Huntsville (University of Alabama System)
• Inventors: Egnal, Geoffrey, Pollock, David Boyd, Reardon, Patrick John, Rogers, Theodore Earl, Underwood, Christopher N., Wilburn, Bennett Sampson, Pitalo, Stephen Kenneth
• Primary Examiner(s): Vieaux, Gary C
• Application Number:
  US11/456,745
• Publication Number:
  US 20070188653A1
• Time in Patent Office: 3,409 Days
• Field of Search: 348/373, 348/211.1, 348/218.1, 348/340, 348/117
• US Class Current: 1/1
• CPC Class Codes: G01C 11/02 Picture taking arrangements specially adapted for photogrammetry or photographic surveying, e.g. controlling overlapping of pictures
• CPC Class Codes: G01C 11/06 by comparison of two or more pictures of the same area
• CPC Class Codes: G03B 15/006 Apparatus mounted on flying objects
• CPC Class Codes: G03B 37/04 with cameras or projectors providing touching or overlapping fields of view
• CPC Class Codes: G06T 3/4038 Image mosaicing, e.g. composing plane images from plane sub-images
• CPC Class Codes: G08B 13/19641 Multiple cameras having overlapping views on a single scene
• CPC Class Codes: G08B 13/1965 the vehicle being an aircraft
• CPC Class Codes: G08B 13/19656 Network used to communicate with a camera, e.g. WAN, LAN, Internet
• CPC Class Codes: G08B 13/19693 using multiple video sources viewed on a single or compound screen
• CPC Class Codes: H04N 19/527 Global motion vector estimation
• CPC Class Codes: H04N 21/2146 located in mass transportation means, e.g. aircraft, train or bus flight-deck installations for entertainment or communications B64D11/0015; arrangements specially adapted for transportation systems in broadcast systems H04H20/62; moving wireless networks H04W84/005
• CPC Class Codes: H04N 21/2365 Multiplexing of several video streams
• CPC Class Codes: H04N 21/2665 Gathering content from different sources, e.g. Internet and satellite
• CPC Class Codes: H04N 21/4312 involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
• CPC Class Codes: H04N 21/4314 for fitting data in a restricted space on the screen, e.g. EPG data in a rectangular grid
• CPC Class Codes: H04N 21/4347 Demultiplexing of several video streams
• CPC Class Codes: H04N 21/4348 Demultiplexing of additional data and video streams
• CPC Class Codes: H04N 23/61 based on recognised objects
• CPC Class Codes: H04N 23/62 Control of parameters via user interfaces
• CPC Class Codes: H04N 23/632 for displaying or modifying preview images prior to image capturing, e.g. variety of image resolutions or capturing parameters
• CPC Class Codes: H04N 23/635 : Region indicators; Field of view indicators
• CPC Class Codes: H04N 23/66 : Remote control of cameras or camera parts, e.g. by remote control devices
• CPC Class Codes: H04N 23/68 : for stable pick-up of the scene, e.g. compensating for camera body vibrations
• CPC Class Codes: H04N 23/683 : performed by a processor, e.g. controlling the readout of an image memory
• CPC Class Codes: H04N 23/695 : Control of camera direction for changing a field of view, e.g. pan, tilt or based on tracking of objects
• CPC Class Codes: H04N 23/698 : for achieving an enlarged field of view, e.g. panoramic image capture
• CPC Class Codes: H04N 23/90 : Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums

Abstract

An image capture system comprises a plurality of cameras and a camera mount. The camera mount has a curved portion, and the plurality of cameras are secured to the curved portion. The cameras are oriented radially inward relative to the curved portion of the camera mount, such that the lines of sight of the cameras intersect. Images are captured substantially simultaneously with the plurality of cameras. The captured images are stitched together to form a collective image. The image capture system may be positioned in an aerial vehicle to provide overhead views of an environment, and captured images may be transmitted to a remote location for viewing in substantially real time. A remote user may indicate a region of interest within the collective image, and the image capture system may render a portion of the collective image in accordance with the user'"'"'s indications.

Claims

1. An image capture system, comprising:

a plurality of cameras;

a camera mount comprising a curved portion, the curved portion having an inner concave surface, an outer convex surface, and a plurality of apertures, the plurality of cameras being disposed above the outer convex surface; and

a plurality of collars coupled to the plurality of cameras above the camera mount, wherein;

each of the collars includes a sidewall, an inner recessed portion having an inner shoulder extending radially inward, and an outer recessed portion having an outer shoulder extending radially outward;

the outer shoulder of each collar is adjacent to the outer convex surface of the curved portion of the camera mount and the inner shoulder of each collar is adjacent to an objective end of a lens portion of each of the cameras; and

the plurality of collars are secured to the outer convex surface of the curved portion of the camera mount by inserting the outer recessed portion of each collar into corresponding ones of the plurality of the apertures.

2. The image capture system of claim 1, wherein:

the cameras have corresponding objective ends; and

corresponding portions of the objective ends pass through the curved portion of the camera mount.

3. The image capture system of claim 1, wherein the camera mount is secured to a movable platform.

4. The image capture system of claim 1, wherein the camera mount is secured to an aerial vehicle.

5. The image capture system of claim 4, wherein the camera mount is secured within an interior of a fuselage of the aerial vehicle.

6. The image capture system of claim 4, wherein lines of sight of the cameras intersect at a common point proximate to a window in a bottom portion of a fuselage of the aerial vehicle.

7. The image capture system of claim 6, wherein the curved portion of the camera mount has a diameter, the window has a diameter, and the diameter of the camera mount is greater than the diameter of the window.

8. The image capture system of claim 1, wherein:

sidewalls of the collars include angled portions defining frusto-conical apertures;

the inner recessed portions are configured to secure objective ends of the cameras to the outer convex surface of the curved portion of the camera mount; and

the sidewalls include threaded openings such that the objective ends of the cameras may be secured to the collars by means of inserting and tightening set screws into the corresponding threaded openings.

9. The image capture system of claim 1, wherein:

the cameras have corresponding objective and sensor ends separated by corresponding displacements; and

a first one of the cameras is configured to allow adjustment of a position of the corresponding sensor end, the sensor end position being measured relative to a position of the corresponding objective end.

10. The image capture system of claim 1, wherein:

the cameras have corresponding objective and sensor ends separated by corresponding displacements; and

each of the cameras is configured to allow the displacement between its objective end and its sensor end to be adjusted.

11. The image capture system of claim 1, wherein:

the cameras have corresponding objective and sensor ends separated by corresponding displacements;

at least one of the cameras is configured to allow the displacement between its objective end and its sensor end to be adjusted; and

the cameras include sensor portions configured to sample a field-of-view of the image capture system.

19. The image capture system of claim 10, wherein first and second ones of the plurality of cameras are configured so as to allow modification to a corresponding displacement to align the images captured by the first and second cameras.

12. An image capture system, comprising:

a camera mount comprising a curved portion, the curved portion having an inner concave surface, an outer concave surface, and a plurality of apertures;

a plurality of cameras;

a plurality of collars coupled to the plurality of cameras above the camera mount, the plurality of cameras being disposed above the outer concave surface of the camera mount, wherein the cameras comprise;

lens assemblies comprising barrels and one or more corresponding lens elements, and

sensor portions secured to corresponding ones of the lens assemblies, wherein the sensor portions are operable to capture image data representing views obtained through the lens assemblies, and the sensor portions are separated from the lens assemblies by corresponding displacements; and

a processor in communication with the sensor portions, wherein the processor is configured to create a two-dimensional image from image data captured substantially simultaneously with the sensor portions,

wherein;

at least a portion of views obtained through adjacent lens assemblies overlap;

each of the collars includes a sidewall, an inner recessed portion having an inner shoulder extending radially inward, and an outer recessed portion having an outer shoulder extending radially outward;

the outer shoulder of each collar is adjacent to the outer convex surface of the curved portion of the camera mount and the inner shoulder of each collar is adjacent to an objective end of a lens portion of each of the cameras; and

the plurality of collars are secured to the outer convex surface of the curved portion of the camera mount by inserting the outer recessed portion of each collar into corresponding ones of the plurality of the apertures.

13. The image capture system of claim 12, further comprising a display located remotely relative to the cameras, wherein the display is in communication with the processor, and is operable to display at least a portion of the created two-dimensional image.

14. The image capture system of claim 12, wherein the cameras are associated with corresponding shutters.

15. The image capture system of claim 14, wherein the shutters comprise control logic in communication with the sensor portions of corresponding cameras.

16. The image capture system of claim 15, wherein the shutters comprises at least one global shutter in communication with the sensor portions, the plurality of cameras being operable to capture images simultaneously in accordance with the global shutter.

17. The image capture system of claim 12, wherein:

sidewalls of the collars include angled portions defining frusto-conical apertures;

the inner recessed portions are configured to secure objective ends of the cameras to the outer convex surface of the curved portion of the camera mount; and

the sidewalls include threaded openings such that the objective ends of the cameras may be secured to the collars by means of inserting and tightening set screws into the corresponding threaded openings.

18. The image capture system of claim 12, wherein:

the cameras have corresponding objective and sensor ends separated by corresponding displacements; and

a first one of the cameras is configured to allow adjustment of a position of the corresponding sensor portion, the sensor portion position being measured relative to a position of the corresponding lens assembly.

20. The image capture system of claim 12, wherein:

the cameras have corresponding objective and sensor ends separated by corresponding displacements; and

each of the cameras is configured to allow the displacement between its objective end and its sensor end to be adjusted.

21. The image capture system of claim 20, wherein first and second ones of the plurality of cameras are configured so as to allow the modification to a corresponding displacement to align the image data captured by the first and second cameras.

22. The image capture system of claim 12, wherein:

the cameras have corresponding objective and sensor ends separated by corresponding displacements;

at least one of the cameras is configured to allow the displacement between its objective end and its sensor end to be adjusted; and

the cameras include sensor portions configured to sample a field-of-view of the image capture system.