Occupancy sensor and associated methods

• US 9,648,284 B2
• Filed: 03/05/2013
• Issued: 05/09/2017
• Est. Priority Date: 05/15/2011
• Status: Active Grant

• Current Assignee: Lighting Science Group Corporation (Pegasus Capital Advisors, L.P.)
• Original Assignee: Lighting Science Group Corporation (Pegasus Capital Advisors, L.P.)
• Inventors: Holland, Eric, Irvin, Julia Sharon, Thosteson, Eric, Burns, Benjamin Charles, Beck, John
• Primary Examiner(s): Philippe, Gims
• Assistant Examiner(s): SECHSER, JILL D
• Application Number:
  US13/785,652
• Publication Number:
  US 20130201290A1
• Time in Patent Office: 1,526 Days
• CPC Class Codes: G08B 13/19602 Image analysis to detect motion of the intruder, e.g. by frame subtraction
• CPC Class Codes: G08B 13/19695 Arrangements wherein non-video detectors start video recording or forwarding but do not generate an alarm themselves
• CPC Class Codes: G08B 29/188 Data fusion; cooperative systems, e.g. voting among different detectors
• CPC Class Codes: H04N 13/20 Image signal generators
• CPC Class Codes: H04N 2013/0081 Depth or disparity estimation from stereoscopic image signals
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources
• CPC Class Codes: H04N 7/188 Capturing isolated or intermittent images triggered by the occurrence of a predetermined event, e.g. an object reaching a predetermined position signal generation from motion picture films H04N5/253

Abstract

A device to detect occupancy of an environment includes a sensor to capture video frames from a location in the environment. The device may compare rules with data using a rules engine. The microcontroller may include a processor and memory to produce results indicative of a condition of the environment. The device may also include an interface through which the data is accessible. The device may generate results respective to the location in the environment. The microcontroller may be in communication with a network. The video frames may be concatenated to create an overview to display the video frames substantially seamlessly respective to the location in which the sensor is positioned. The overview may be viewable using the interface and the results of the analysis performed by the rules engine may be accessible using the interface.

Claims

1. A device to detect the location of an occupant, the device comprising:

a plurality of sensors positioned in a cluster to capture images from a common location in the environment, the images being transmittable as data;

rules comparable with the data using a rules engine operable by a microcontroller with a processor and memory to produce results indicative of a condition of certain locations of the environment, the rules being included in the memory; and

an interface through which the data is accessible;

wherein at least part of the rules define an analysis of the data including;

detecting a precedent image,

detecting a subsequent image,

comparing the precedent image with the subsequent image to detect a likelihood of disparity between the images,

creating a detected object image based on the disparity between the images,

comparing the detected object image to known image data acquired from one or more known physical objects to determine if the detected object is one or more known physical objects,

generating the results of the analysis respective to the determination of whether the detected object is one or more known physical objects, the results being storable in memory, and

carrying out an action dependent upon the results;

wherein the results are generated respective to the location in the environment;

wherein an event is definable in the rules to relate to the determination of whether the detected object is one or more known physical objects;

wherein the event is associable with the action;

wherein the action occurs subsequent to detecting the event;

wherein a plurality of locations are includable in the environment, each location of the plurality of locations being within a field of detection of at least one of the plurality sensors;

wherein the field of detection of each sensor of the plurality of sensors is associated with a subset of the plurality of locations;

wherein the microcontroller is in communication with a network using a network interface;

wherein the images captured by each of the plurality of sensors are processed with an image stitching algorithm to create a seamless mosaic;

wherein the seamless mosaic is viewable using the interface;

wherein the results of the analysis performed by the rules engine are accessible using the interface;

wherein the results of the analysis are includable in the seamless mosaic; and

wherein the one or more known physical objects are definable in the rules by placing the one or more known physical objects in a location in the environment and capturing the known image data of the one or more known physical objects using at least one of the plurality of sensors.

2. A device according to claim 1 further comprising a centralized computing device to receive data from the plurality of sensors and operate at least part of the rules engine;

wherein the centralized computing device includes a central processor, central memory, and a central network interface to be in communication with the sensors through the network; and

wherein the results of the analysis performed by the centralized computing device are accessible using the interface.

3. A device according to claim 2 wherein the centralized computing device undergoes an initialization operation to detect the sensors and to define at least part of the rules relative to the locations in the environment within the field of detection of each of the sensors.

4. A device according to claim 3 wherein each of the sensors is coupled to the microcontroller;

and wherein the microcontroller is in communication with the centralized computing device through the network to analyze the data received by each of the sensors.

5. A device according to claim 1 wherein the field of detection of each of the plurality of sensors are configured to cover substantially non-overlapping locations of the environment;

wherein the images are captured by the sensors in an approximately uniform manner; and

wherein the seamless mosaic includes substantially all of the locations in the environment substantially seamlessly.

6. A device according to claim 1 wherein the locations are definable as sections of the images captured by the plurality of sensors.

7. A device according to claim 1 wherein the locations are definable using the interface.

8. A device according to claim 1 wherein the locations are definable to associate with at least one of a lighting system, an HVAC system, an automated door system, a smoke detection system, a security system, an escalator system, and an elevator system.

9. A device according to claim 1 wherein the sensors are positioned to capture the environment using similar viewing angles relative to the environment.

10. A device according to claim 1 wherein a high likelihood of disparity detected in the location is indicative of occupancy of the location;

and wherein a low likelihood of disparity is indicative of no occupancy of the locations.

11. A device according to claim 1 wherein the plurality of sensors intercommunicate through the network using mesh networking.

12. A device according to claim 1 wherein the sensor includes a video capture device.

13. A device according to claim 12 wherein the image is a video frame captured by the video capture device.

14. A device according to claim 1 wherein the action includes generating an alert.

15. A device according to claim 1 wherein the images are concatenated to create a video feed;

and wherein the video feed is accessible using the interface.

16. A device according to claim 1 wherein a portion of the seamless mosaic is viewable using the interface as a field of view;

wherein a wide field of view includes substantially all locations;

wherein a narrow field of view includes one location;

wherein the field of view is scalable between the wide field of view and the narrow field of view.

17. A device according to claim 1 wherein an object is detectable by at least part of the plurality of sensors to create a stereoscopic perspective;

and wherein a parallax among the images in the stereoscopic perspective is used to calculate depth in a three-dimensional space.

18. A device according to claim 1 wherein the plurality of sensors are a first plurality of sensors and a second plurality of sensors;

wherein the first plurality of sensors are positioned in a first cluster to capture images from a first common location in the environment;

wherein the second plurality of sensors are positioned in a second cluster to capture images from a second common location in the environment;

wherein the images are transmittable as data;

wherein the second common location is a location other than the first common location to create a stereoscopic perspective;

wherein an object is detectable by at least one sensor of the first plurality of sensors and by at least one sensor of the second plurality of sensors; and

wherein a parallax among the images in the stereoscopic perspective is used to calculate depth in a three-dimensional space.

19. A device to detect the location of an occupant, the device comprising:

a plurality of video capture devices positioned in a cluster to capture video feed comprising a sequence of video frames that are capturable to define an image, the plurality of video capture device having a common location in the environment, the video feed and the images being transmittable as data;

rules comparable with the data using a rules engine operable by a microcontroller with a processor and memory to produce results indicative of a condition of certain locations of the environment, the rules being included in the memory; and

an interface through which the data is accessible;

wherein at least part of the rules define an analysis of the data including the steps of;

detecting a precedent image,

detecting a subsequent image,

comparing the precedent image with the subsequent image to detect a likelihood of disparity between the images,

creating a detected object image based on the disparity between the images,

comparing the detected object image to known image data acquired from one or more known physical objects to determine if the detected object is one or more known physical objects,

generating the results of the analysis respective to the determination of whether the detected object is one or more known physical objects,

carrying out an action dependent upon the results, and

generating the results of the analysis respective to the likelihood of disparity, the results being storable in memory;

wherein the results are generated respective to the location in the environment;

wherein a plurality of locations are includable in the environment, the plurality of locations being within a field of detection of at least one of the plurality video capture devices;

wherein the plurality of locations are definable as sections of the images;

wherein the plurality of locations are definable using the interface;

wherein the field of detection of each video capture device of the plurality of video capture devices is associated with a subset of the plurality of locations;

wherein the microcontroller is in communication with a network using a network interface;

wherein the images captured by each of the plurality of video capture devices are concatenated to create an overview;

wherein the overview displays the images captured from the plurality of video capture devices substantially seamlessly respective to the field of detection of the video capture device, the overview being viewable using the interface;

wherein the results of the analysis performed by the rules engine are accessible using the interface;

wherein the results of the analysis are includable in the overview;

wherein an event is definable in the rules to relate to the determination of whether the detected object is one or more known objects;

wherein the event is associable with the action;

where the action may occur subsequent to detecting the event; and

wherein the one or more known physical objects are definable in the rules by placing the one or more known physical objects in a location in the environment and capturing the known image data of the one or more known physical objects using at least one of the plurality of sensors.