MULTI-LENS ARRAY SYSTEM AND METHOD

• US 20070188653A1
• Filed: 07/11/2006
• Published: 08/16/2007
• Est. Priority Date: 02/13/2006
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.), University of Alabama (University of Alabama System)
• Original Assignee: University of Alabama (University of Alabama System)
• Inventors: Wilburn, Bennett, Egnal, Geoffrey, Pollock, David, Reardon, Patrick, Pitalo, Stephen, Rogers, Theodore, Underwood, Christopher
• Granted Patent: US 9,182,228 B2
• Time in Patent Office: Days
• US Class Current: 348/373
• CPC Class Codes: G01C 11/02 Picture taking arrangements specially adapted for photogrammetry or photographic surveying, e.g. controlling overlapping of pictures
• CPC Class Codes: G01C 11/06 by comparison of two or more pictures of the same area
• CPC Class Codes: G03B 15/006 Apparatus mounted on flying objects
• CPC Class Codes: G03B 37/04 with cameras or projectors providing touching or overlapping fields of view
• CPC Class Codes: G06T 3/4038 Image mosaicing, e.g. composing plane images from plane sub-images
• CPC Class Codes: G08B 13/19641 Multiple cameras having overlapping views on a single scene
• CPC Class Codes: G08B 13/1965 the vehicle being an aircraft
• CPC Class Codes: G08B 13/19656 Network used to communicate with a camera, e.g. WAN, LAN, Internet
• CPC Class Codes: G08B 13/19693 using multiple video sources viewed on a single or compound screen
• CPC Class Codes: H04N 19/527 Global motion vector estimation
• CPC Class Codes: H04N 21/2146 located in mass transportation means, e.g. aircraft, train or bus flight-deck installations for entertainment or communications B64D11/0015; arrangements specially adapted for transportation systems in broadcast systems H04H20/62; moving wireless networks H04W84/005
• CPC Class Codes: H04N 21/2365 Multiplexing of several video streams
• CPC Class Codes: H04N 21/2665 Gathering content from different sources, e.g. Internet and satellite
• CPC Class Codes: H04N 21/4312 involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
• CPC Class Codes: H04N 21/4314 for fitting data in a restricted space on the screen, e.g. EPG data in a rectangular grid
• CPC Class Codes: H04N 21/4347 Demultiplexing of several video streams
• CPC Class Codes: H04N 21/4348 Demultiplexing of additional data and video streams
• CPC Class Codes: H04N 23/61 based on recognised objects
• CPC Class Codes: H04N 23/62 Control of parameters via user interfaces
• CPC Class Codes: H04N 23/632 for displaying or modifying preview images prior to image capturing, e.g. variety of image resolutions or capturing parameters
• CPC Class Codes: H04N 23/635 : Region indicators; Field of view indicators
• CPC Class Codes: H04N 23/66 : Remote control of cameras or camera parts, e.g. by remote control devices
• CPC Class Codes: H04N 23/68 : for stable pick-up of the scene, e.g. compensating for camera body vibrations
• CPC Class Codes: H04N 23/683 : performed by a processor, e.g. controlling the readout of an image memory
• CPC Class Codes: H04N 23/695 : Control of camera direction for changing a field of view, e.g. pan, tilt or based on tracking of objects
• CPC Class Codes: H04N 23/698 : for achieving an enlarged field of view, e.g. panoramic image capture
• CPC Class Codes: H04N 23/90 : Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums

Abstract

An image capture system comprises a plurality of cameras and a camera mount. The camera mount has a curved portion, and the plurality of cameras are secured to the curved portion. The cameras are oriented radially inward relative to the curved portion of the camera mount, such that the lines of sight of the cameras intersect. Images are captured substantially simultaneously with the plurality of cameras. The captured images are stitched together to form a collective image. The image capture system may be positioned in an aerial vehicle to provide overhead views of an environment, and captured images may be transmitted to a remote location for viewing in substantially real time. A remote user may indicate a region of interest within the collective image, and the image capture system may render a portion of the collective image in accordance with the user'"'"'s indications.

Claims

1. A an image capture system, comprising:

(a) a camera mount having a curved portion, wherein the curved portion of the camera mount has a plurality of apertures formed therethrough, wherein each of the apertures is configured to correspond with a camera of a plurality of cameras, wherein the curved portion has an inner concave surface and an outer convex surface; and

(b) a plurality of cameras, wherein each of the cameras has an objective end and a sensor end, wherein the objective end of each of the cameras is secured to the curved portion of the camera mount, wherein the cameras have intersecting lines of sight, wherein the lines of sight of the cameras diverge beyond an area of intersection through a region of divergence, wherein the cameras are configured to capture images of one or more subjects within the region of divergence.

2. The image capture system of claim 1, wherein a portion of each objective end of each camera passes through the curved portion of the camera mount.

3. The image capture system of claim 1, further comprising a plurality of retaining rings, wherein each of the retaining rings is coupled with the portion of the objective end of a corresponding camera passing through the curved portion of the camera mount.

4. The image capture system of claim 1, further comprising a plurality of collars coupled with the camera mount, wherein each collar is operable to secure a corresponding camera relative to the camera mount.

5. The image capture system of claim 1, wherein the camera mount is secured to a platform, wherein the platform is movable relative to the environment.

6. The image capture system of claim 1, wherein the camera mount is secured to a platform, wherein the platform comprises an aerial vehicle.

7. The image capture system of claim 6, wherein the aerial vehicle has a fuselage, wherein the camera mount is secured within the interior of the fuselage.

8. The image capture system of claim 7, wherein the fuselage has bottom portion and a window provided in the bottom portion.

9. The image capture system of claim 8, wherein the lines of sight of the cameras intersect at a common point proximate to the window.

10. The image capture system of claim 8, wherein the curved portion of the camera mount has a diameter, wherein the window has a diameter, wherein the diameter of the camera mount is greater than the diameter of the window.

11. An image capture system, comprising:

(a) a plurality of cameras, wherein each camera comprises;

(i) a lens assembly comprising a barrel and one or more lens elements, and

(ii) a sensor portion secured to the lens assembly, wherein the sensor portion is operable to capture image data representing a view obtained through the lens assembly,

wherein the plurality of cameras are oriented to have intersecting lines of sight, wherein at least a portion of views obtained through adjacent lens assemblies overlap; and

(b) a processor in communication with the sensor portions, wherein the processor is configured to create a two-dimensional image from image data captured substantially simultaneously with the sensor portions.

12. The image capture system of claim 11, further comprising a camera mount having a curved portion, wherein the cameras are positioned along the curved portion of the camera mount.

13. The image capture system of claim 11, further comprising a display located remotely relative to the cameras, wherein the display is in communication with the processor, wherein the display is operable to display at least a portion of the created two-dimensional image.

14. The image capture system of claim 11, wherein each of the cameras is associated with a shutter.

15. The image capture system of claim 14, wherein the shutter comprises a control logic in communication with each sensor portion corresponding to a respective camera.

16. The image capture system of claim 15, wherein the shutter comprises a global shutter in communication with the sensor portions, wherein the plurality of cameras are operable to capture images simultaneously in accordance with the global shutter.

17. A method of providing an image, the method comprising:

(a) providing a plurality of cameras, wherein the plurality of cameras are positioned to have intersecting lines of sight, wherein each of the cameras has a respective lens, wherein the lines of sight intersect at a common point of intersection;

(b) capturing a plurality of images with the plurality of cameras, wherein the captured images represent views of a subject, wherein the common point of intersection is positioned between the plurality of cameras and the subject, wherein the images are captured substantially simultaneously;

(c) stitching at least a portion of the plurality of images together to form a collective image, wherein the collective image comprises at least portions of images captured by the plurality of cameras at substantially the same time; and

(d) rendering at least a portion of the collective image on a visual display.

18. The method of claim 17, wherein the rendered at least a portion of the collective image corresponds with views obtained through at least two of the cameras.

19. The method of claim 17, further comprising receiving user input indicative of an image region of interest, wherein the rendered at least a portion of the collective image corresponds with the indicated image region of interest.

20. The method of claim 19, wherein the act of stitching comprises stitching only those images corresponding to the indicated image region of interest.