Remote surveillance sensor apparatus

• US 9,426,430 B2
• Filed: 03/13/2013
• Issued: 08/23/2016
• Est. Priority Date: 03/22/2012
• Status: Active Grant

• Current Assignee: Bounce Imaging Inc.
• Original Assignee: Bounce Imaging Inc.
• Inventors: Aguilar, Francisco, Alvarado-Moya, Pablo, Fridberg, Mikhail
• Primary Examiner(s): Velez, Roberto
• Assistant Examiner(s): Segura, Cynthia
• Application Number:
  US13/801,558
• Publication Number:
  US 20140168443A1
• Time in Patent Office: 1,259 Days
• Field of Search: 348/211.2, 348/143
• US Class Current: 1/1
• CPC Class Codes: G01P 15/00 Measuring acceleration; Measuring deceleration; Measuring shock, i.e. sudden change of acceleration
• CPC Class Codes: G01P 15/18 in two or more dimensions
• CPC Class Codes: G03B 2215/0567 Solid-state light source, e.g. LED, laser
• CPC Class Codes: G03B 2217/002 Details of arrangement of components in or on camera body
• CPC Class Codes: G03B 37/04 with cameras or projectors providing touching or overlapping fields of view
• CPC Class Codes: G06V 20/52 Surveillance or monitoring of activities, e.g. for recognising suspicious objects recognising microscopic objects G06V20/69
• CPC Class Codes: H04N 23/45 for generating image signals from two or more image sensors being of different type or operating in different modes, e.g. with a CMOS sensor for moving images in combination with a charge-coupled device [CCD] for still images
• CPC Class Codes: H04N 23/51 Housings
• CPC Class Codes: H04N 23/55 Optical parts specially adapted for electronic image sensors; Mounting thereof
• CPC Class Codes: H04N 23/56 provided with illuminating means
• CPC Class Codes: H04N 23/63 by using electronic viewfinders
• CPC Class Codes: H04N 23/661 Transmitting camera control signals through networks, e.g. control via the Internet
• CPC Class Codes: H04N 23/698 for achieving an enlarged field of view, e.g. panoramic image capture
• CPC Class Codes: H04N 7/183 for receiving images from a single remote source

Abstract

In a surveillance system including a remote sensor apparatus and a portable receiver, a method is provided for collecting and processing data related to a surrounding environment of the remote sensor apparatus including image data for a scene external to the housing of the apparatus. The method includes receiving, at the processing unit, raw image data simultaneously from a plurality of image sensors as the raw image data is being captured by the plurality of image sensors. One or more light sources are placed around a wide-angle lens fitted to each of the image sensor. Infrared or near-infrared light emanating from the plurality of light sources is used in a dark environment. The method also includes processing, at the processing unit, the simultaneously received raw image data to generate pre-processed image data. The method further includes transmitting the pre-processed image data to the portable receiver using the wireless transceiver.

Claims

1. In a surveillance system including a remote sensor apparatus for collecting data and a portable receiver for receiving data collected by at least one sensor installed in the remote sensor apparatus, wherein the portable receiver is capable of running an application program for processing the received data and displaying the processed data on a display screen of the portable receiver, wherein the remote sensor apparatus has a spherical housing for containing a processing unit, a plurality of image sensors coupled to the processor, a plurality of light sources, an inertial measurement unit and a wireless transceiver and wherein each of the plurality of image sensors is fitted with a wide-angle lens, a method for collecting and processing data related to a surrounding environment of the remote sensor apparatus including image data for a scene external to the housing of the remote sensor apparatus, the method comprising:

capturing at a first clock rate, by the plurality of image sensors, raw image data in all directions about the remote sensor apparatus while it is in motion, using a short exposure to minimize motion blur;

combining at the first clock rate˜

portions of the captured raw image data from the plurality of image sensors into a first group of combined raw image data and a second group of combined raw image data;

receiving, at the processing unit at a second clock rate equal to twice the first clock rate used for capturing and combining the raw image data, the first and second groups of combined image data, thereby allowing the processing unit to receive all of the captured image data at the same rate that the raw image data is being captured by the plurality of image sensors; and

transmitting the combined image data to the portable receiver using the wireless transceiver.

2. The method of claim 1, wherein the portable receiver includes a commercially available mobile device that is capable of running the application program.

3. The method of claim 1, further comprising receiving, at the processing unit, information about a plurality of an orientation, an acceleration and a direction travel of the remote sensor apparatus from the inertial measurement unit and transmitting the information to the portable receiver using the wireless transceiver.

4. The method of claim 3, wherein, in the step of receiving, the processing unit simultaneously receives both the combined raw image data and the information from the inertial measurement unit according to the second clock rate, and associates the received inertial measurement unit information with the received combined raw image data.

5. The method of claim 4, wherein the associated inertial measurement unit information allows the portable receiver to understand, at the time the corresponding raw image data was captured, an orientation and direction in which the remote sensor apparatus was moving.

6. The method of claim 4, wherein the portable receiver utilizes the associated inertial measurement unit information to determine how to display the processed data on the display screen.

7. The method of claim 1, wherein the remote sensor apparatus includes a series of counterweights that are configured to shift to propel the sensor apparatus.

8. The method of claim 1, wherein the remote sensor apparatus includes at least one internal motor that is configured to propel the sensor apparatus.

9. The method of claim 1, wherein the remote sensor apparatus includes at least one of an actuator and a canister of compressed gas.

10. The method of claim 1, wherein the spherical housing includes an outer layer and an inner layer and wherein the outer layer includes a rubber or an elastomer shell and the inner layer includes a reinforced shell.

11. The method of claim 1, wherein the short exposure period is from about 1/10,000^th of a second to about 1/100,000^th of a second.

12. The method of claim 1, wherein at least one of the plurality of light sources projects light prior to and during raw image capture to compensate for a relatively low amount of light captured associated with the short exposure time period.

13. The method of claim 1, wherein at least one of the plurality of light sources projects light during raw image capture for capturing the raw image data in a dark environment.

14. The method of claim 1, wherein, in the step of receiving, the first group of combined image data is received at the processing unit on a high level of the first clock signal, and the second group of combined image data is received at the processing unit on a low level of the first clock signal.

15. The method of claim 1, wherein the plurality of images sensors only includes six image sensors.

16. The method of claim 15, wherein the step of combining includes combining captured raw image data from three of the six image sensors into a first and second signals and combining captured raw image data from the other three of the six image sensors into a third and fourth signals, and further combining the first and third signals to form the first group of combined image data and combining the second and fourth signals to form the second group of combined image data.