Imaging system for immersive surveillance

• US 9,749,526 B2
• Filed: 04/21/2015
• Issued: 08/29/2017
• Est. Priority Date: 12/16/2010
• Status: Active Grant

• Current Assignee: Massachusetts Institute of Technology
• Original Assignee: Massachusetts Institute of Technology
• Inventors: Chuang, Daniel B., Candell, Lawrence M., Ross, William D., Beattie, Mark E., Fang, Cindy Y., Ren, Bobby, Blanchard, Jonathan P.
• Primary Examiner(s): Kim, Hee-Yong
• Application Number:
  US14/692,482
• Publication Number:
  US 20160014335A1
• Time in Patent Office: 861 Days
• Field of Search: 348 36
• CPC Class Codes: G08B 13/19602 Image analysis to detect motion of the intruder, e.g. by frame subtraction
• CPC Class Codes: G08B 13/19619 Details of casing
• CPC Class Codes: G08B 13/19626 optical details, e.g. lenses, mirrors or multiple lenses
• CPC Class Codes: G08B 13/19643 wherein the cameras play different roles, e.g. different resolution, different camera type, master-slave camera
• CPC Class Codes: H04N 23/62 Control of parameters via user interfaces
• CPC Class Codes: H04N 23/698 for achieving an enlarged field of view, e.g. panoramic image capture
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources

Abstract

Security guards at big facilities, such as airports, monitor multiple screens that display images from individual surveillance cameras dispersed throughout the facility. If a guard zooms with a particular camera, he will lose image resolution, along with perspective on the surrounding area. Embodiments of the inventive Imaging System for Immersive Surveillance (ISIS) solve these problems by combining multiple cameras in one device. When properly mounted, example ISIS systems offer 360-degree, 100-megapixel views on a single screen. (Other resolutions may also be employed.) Image-stitching software merges multiple video feeds into one scene. The system also allows operators to tag and follow targets, and can monitor restricted areas and sound an alert when intruders breach them.

Claims

1. A system comprising:

a first array of cameras, each of which has a first focal length and is disposed to image a respective portion of a wide area scene, the first array of cameras providing a first spatially continuous view of the wide area scene; and

a second array of cameras operably coupled to the first array of cameras, each of which has a second focal length different from the first focal length and is disposed to image a respective portion of the wide area scene, the second array of cameras providing a second spatially continuous view of the wide area scene,

wherein at least a portion of the first spatially continuous view of the wide area scene overlaps with the second spatially continuous view of the wide area scene,

wherein the first array of cameras and the second array of cameras, taken together, are configured to provide a first image of a first target at a first distance in the wide area scene and to provide a second image of a second target at a second distance, different from the first distance, in the wide area, wherein the first image and the second image are at a substantially constant resolution,

wherein the substantially constant resolution is about 1.5 centimeters or less.

2. The system of claim 1,

wherein at least one of the first array of cameras or the second array of cameras is disposed along a curved plane.

3. The system of claim 1, wherein the first focal length is at least 1.5 times greater than the second focal length.

4. The system of claim 1, wherein the second distance is at least 1.5 times greater than the first distance.

5. The system of claim 1, further comprising:

memory, operably coupled to the first array of cameras and the second array of cameras, to store image data acquired by the first array of cameras and the second array of cameras; and

a server, operably coupled to the memory, to serve the image data stored in the memory at a resolution up to and including the substantially constant resolution.

6. The system of claim 5 wherein the memory is configured to store the image data in an image format.

7. The system of claim 1, further comprising:

a fisheye camera configured to image the wide area scene; and

a processor, operably coupled to the first array of cameras, the second array of cameras, and the fisheye camera, to register image data acquired by the first array of cameras and the second array of cameras based on data acquired by the fisheye camera.

8. The system of claim 1, further comprising:

a first module comprising at least one camera from the first array of cameras and/or the second array of cameras; and

a second module comprising at least another camera from the first array of cameras and/or the second array of cameras,

wherein the first module and the second module are communicatively coupled.

9. The system of claim 1, further comprising:

a wide-angle camera to provide reference imagery for image registration.

10. The system of claim 9, wherein the wide-angle camera is configured to image substantially all of the wide area scene.

11. The system of claim 9, wherein the wide-angle camera is configured to image a portion of the wide area scene, wherein the portion of the wide area scene has an angular field of view greater than 90 degrees.

12. The system of claim 9, wherein the first focal length is at least 1.5 times greater than the second focal length.

13. The system of claim 9, wherein each camera in the first array of cameras has a field of view that overlaps with a field of view of at least one other camera in the first array of cameras and with a field of view of at least one camera in the second array of cameras.