SYSTEMS, METHODS AND MEDIA FOR GENERATING A PANORAMIC VIEW

• US 20140267586A1
• Filed: 03/13/2013
• Published: 09/18/2014
• Est. Priority Date: 10/23/2012
• Status: Active Grant

• Current Assignee: Bounce Imaging Inc.
• Original Assignee: Bounce Imaging Inc.
• Inventors: AGUILAR, Francisco, ALVARADO-MOYA, Pablo, FRIDBERG, Mikhail
• Granted Patent: US 9,479,697 B2
• Time in Patent Office: Days
• US Class Current: 348/36
• CPC Class Codes: H04N 23/45 for generating image signals from two or more image sensors being of different type or operating in different modes, e.g. with a CMOS sensor for moving images in combination with a charge-coupled device [CCD] for still images
• CPC Class Codes: H04N 23/55 Optical parts specially adapted for electronic image sensors; Mounting thereof
• CPC Class Codes: H04N 23/63 by using electronic viewfinders
• CPC Class Codes: H04N 23/661 Transmitting camera control signals through networks, e.g. control via the Internet
• CPC Class Codes: H04N 23/695 Control of camera direction for changing a field of view, e.g. pan, tilt or based on tracking of objects
• CPC Class Codes: H04N 23/698 for achieving an enlarged field of view, e.g. panoramic image capture
• CPC Class Codes: H04N 7/183 for receiving images from a single remote source

Abstract

A method is provided for a surveillance system including a remote sensor apparatus a portable receiver. The method includes receiving, at the portable receiver, image data collected simultaneously from a plurality of image sensors installed in the remote sensor apparatus. The method also includes processing, at the portable receiver, the received image data by, for each of the first plurality of captured images, detecting image features and performing feature matches by matching control points across neighboring images based on a control-point assumption that the control points are relevant only in areas of field of view overlap. The areas of field of view are determined by positions of the plurality of image sensors and a field of view of a wide-angle lens fitted with each of the plurality of image sensors. The method further includes generating a panoramic view by blending the processed first plurality of captured images.

Claims

1. In a surveillance system including a remote sensor apparatus for collecting data and a portable receiver for receiving data collected by at least one sensor installed in the remote sensor apparatus, wherein the portable receiver is capable of running an application program for processing the received data and displaying the processed data on a display screen of the portable receiver, wherein the remote sensor apparatus has a spherical housing for containing a processing unit, a plurality of image sensors coupled to the processor and a wireless transceiver and wherein each of the plurality of image sensors is fitted with a wide-angle lens, a method for generating a panoramic view of a scene external to the housing of the remote sensor apparatus, the method comprising:

receiving, at the portable receiver, first image data collected simultaneously from the plurality of image sensors installed in the remote sensor apparatus, wherein the received first image data includes a first plurality of images captured by the plurality of image sensors that are located in fixed positions relative to one another;

processing, at the portable receiver, the first received image data by, for each of the first plurality of captured images, detecting image features and performing feature matches by matching control points across neighboring images based on a control-point assumption that the control points are relevant only in areas of field of view overlap, wherein the areas of field of view are determined by positions of the plurality of image sensors and a field of view of the wide-angle lens fitted with each of the plurality of image sensors; and

generating a panoramic view by blending the processed first plurality of captured images.

2. The method of claim 1, further comprising displaying the panoramic view on the display screen of the portable receiver.

3. The method of claim 1, wherein processing the first received image data further includes, for each of the first plurality of captured images, correcting initial distortions.

4. The method of claim 1, wherein processing the first received image data further includes, for each of the first plurality of captured images, warping the captured image to compensate for effects of capturing an image using a wide-angle lens.

5. The method of claim 1, wherein processing the first received image data further includes, for each of the first plurality of captured images, estimating and compensating an exposure of the captured image.

6. The method of claim 1, further comprising:

receiving, at the portable receiver, second image data collected simultaneously from the plurality of image sensors installed in the remote sensor apparatus subsequent to receiving the first image data, wherein the remote sensor apparatus is on a move and wherein the received second image data includes a second plurality of images captured by the plurality of image sensors;

processing, at the portable receiver, the second received image data by, for each of the second plurality of captured images, detecting image features and performing feature matches by matching control points across neighboring images based on the control-point assumption; and

generating a three-dimensional representation of a space where the remote sensor apparatus is deployed using the first received image data and the second subsequently received image data.

7. In a surveillance system including a remote sensor apparatus for collecting data and a portable receiver for receiving data collected by at least one sensor installed in the remote sensor apparatus, wherein the portable receiver is capable of running an application program for processing the received data and displaying the processed data on a display screen of the portable receiver, wherein the remote sensor apparatus has a spherical housing for containing a processing unit, a plurality of image sensors coupled to the processor and a wireless transceiver and wherein each of the plurality of image sensors is fitted with a wide-angle lens, a method for generating a panoramic view of a scene external to the housing of the remote sensor apparatus, the method comprising:

receiving, at the portable receiver, first image data collected simultaneously from the plurality of image sensors installed in the remote sensor apparatus, wherein the received first image data includes a first plurality of images captured by the plurality of image sensors that are located in fixed positions relative to one another;

processing, at the portable receiver, the first received image data by, for each of the first plurality of captured images, detecting image features and performing feature matches and by stitching the first plurality of captured images without a physical central reference point, wherein a virtual reference point at a center of a projection sphere is assumed for stitching the first plurality of images and wherein a displacement of each of the plurality of image sensor from the virtual reference point is calculated; and

generating a panoramic view by blending the processed first plurality of captured images.