Intelligent security light and associated methods

• US 9,420,240 B2
• Filed: 05/04/2012
• Issued: 08/16/2016
• Est. Priority Date: 05/15/2011
• Status: Active Grant

• Current Assignee: Lighting Science Group Corporation (Pegasus Capital Advisors, L.P.)
• Original Assignee: Lighting Science Group Corporation (Pegasus Capital Advisors, L.P.)
• Inventors: Holland, Eric, Irvin, Julia Sharon, Thosteson, Eric, Burns, Benjamin Charles, Beck, John
• Primary Examiner(s): Anyikire, Chikaodili E
• Application Number:
  US13/464,292
• Publication Number:
  US 20120287271A1
• Time in Patent Office: 1,565 Days
• Field of Search: 348/143
• US Class Current: 1/1
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 2207/20224 Image subtraction
• CPC Class Codes: G06T 2207/30232 Surveillance
• CPC Class Codes: G06T 7/254 involving subtraction of images
• CPC Class Codes: G08B 13/19602 Image analysis to detect motion of the intruder, e.g. by frame subtraction
• CPC Class Codes: H04N 2013/0081 Depth or disparity estimation from stereoscopic image signals
• CPC Class Codes: H04N 7/188 Capturing isolated or intermittent images triggered by the occurrence of a predetermined event, e.g. an object reaching a predetermined position signal generation from motion picture films H04N5/253

Abstract

A lighting device capable of detecting a condition in an environment includes a sensor to capture a video frame from a location in the environment. The lighting device may include a microcontroller, a processor and memory. The sensor may be electrically connected to the microcontroller, and the video frame may be transmitted to the microcontroller as data. The lighting device may also include a light source electrically connected to and controlled by the microcontroller and a rules engine stored in the memory. The processor may compare the data to rules contained in the rules engine to produce an output. The lighting device may further include an interface through which the output is accessible. After an analysis is conducted, an output may be generated responsive to detection of an anomaly.

Claims

1. A lighting device capable of detecting a condition in an environment comprising:

a video camera to capture an image from a location in the environment;

a microcontroller, further comprising a processor and memory, wherein the sensor is electrically connected to the microcontroller and wherein the image is received by the microcontroller as data;

a light source electrically connected to and controlled by the microcontroller;

a rules engine stored in the memory, wherein the processor compares the data to rules contained in the rules engine to produce an output; and

an interface through which the output is accessible;

wherein at least part of the rules engine defines an analysis of the data including the steps of;

capturing a current image;

capturing a subsequent image;

recording the time of day of the subsequently captured image;

comparing the subsequent image and the current image to a known object relative to the time of day wherein the known object is stored in the memory; and

generating the output of the analysis with respect to a determination of whether the known object is detected in the subsequent image;

wherein at least part of the rules defining detecting the known object in the subsequent image include the steps of;

defining a subsequent background in the subsequent image and a current background in the current image by detecting an unchanging image;

detecting an irregularity between the subsequent background and current background indicating that the known object appears in either the subsequent image or the current image;

comparing the time of day to the detected irregularity so as to disregard expected behavior based on the time of day in which the detected irregularity occurred; and

generating the output responsive to detection of the irregularity;

wherein the output is storable in the memory.

2. A lighting device according to claim 1 wherein the analysis of the data defined by at least part of the rules engine further includes the step of generating the output of the analysis respective to whether the known object is detected at a specific location in the subsequent image.

3. A lighting device according to claim 1 wherein the analysis of the data defined by at least part of the rules engine further includes the step of generating the output of the analysis respective to whether the known object is detected at a plurality of locations in the subsequent image.

4. A lighting device according to claim 1 wherein the microcontroller is electrically connected to a network.

5. A lighting device according to claim 4 wherein the lighting device comprises a plurality of video cameras that are electrically connected to the network.

6. A lighting device according to claim 5 wherein the network is electrically connected to a centralized computing device;

and wherein the centralized computing device analyzes the data transmitted by the plurality of video cameras.

7. A lighting device according to claim 6 wherein each of the plurality of video cameras are positioned at locations throughout the environment in a uniform manner;

wherein the images are captured by each of the plurality of video cameras in the locations throughout the environment in an approximately uniform manner; and

wherein the images are concatenated to create an overview that includes substantially all of the locations throughout the environment substantially seamlessly.

8. A lighting device according to claim 7 wherein the locations throughout the environment are configured relating to an approximately grid based pattern.

9. A lighting device according to claim 5 wherein the plurality of video cameras are positioned to capture the images using similar viewing angles relative to the environment.

10. A lighting device according to claim 5 wherein the plurality of video cameras intercommunicate though the network using mesh networking.

11. A lighting device according to claim 1 wherein the image is a video frame captured by the camera.

12. A lighting device according to claim 1 wherein an event is definable in the rules to relate to the known object being detected in the environment;

wherein the event is associable with an action; and

wherein the action may occur subsequent to detecting the event.

13. A lighting device according to claim 12 wherein the action includes generating an alert.

14. A lighting device according to claim 13 wherein the light source is operated between an on position and an off position responsive to the alert.

15. A lighting device according to claim 4 wherein the image is compressible by the microcontroller;

and wherein the image that is compressed is transmitted through the network.

16. A lighting device according to claim 1 wherein the video camera captures a plurality of images;

wherein the plurality of images are concatenated to create a video feed; and

wherein the video feed is accessible using the interface.

17. A lighting device according to claim 16 wherein the results of the analysis performed by the rules engine are included in the video feed.

18. A lighting device according to claim 1 wherein supplemental data is viewable using the interface.

19. A lighting device according to claim 5 wherein the known object is detectable by at least two of the plurality of video cameras to create a stereoscopic perspective;

and wherein a parallax among the images in the stereoscopic perspective is used to calculate depth in a three-dimensional space.

20. A lighting device according to claim 1 wherein the light source comprises an LED.

21. A lighting device according to claim 1 wherein the light source is operable responsive to the output.

22. A lighting device capable of detecting a condition in the environment comprising:

a camera to capture a video frame from a location in the environment;

a microcontroller including a processor and memory that is electrically connected to the camera by a network and wherein the video frame is transmitted to the microcontroller through the network as data;

a light source electrically connected to and controlled by the microcontroller;

a rules engine stored in the memory, wherein the processor compares the data to rules contained in the rules engine to produce an output, and wherein the output controls the light source; and

an interface through which the output is accessible;

wherein at least part of the rules engine defines an analysis of the data including the steps of;

capturing a current video frame;

recording the brightness level of the video frame;

capturing a subsequent video frame;

recording the time of day of the subsequently captured video frame;

recording the brightness level of the subsequently captured video frame;

comparing the subsequent video frame and the current video frame to a known object relative to the time of day and brightness wherein the known object is stored in the memory; and

generating the output of the analysis respective to whether the known object is detected at a specific location in the subsequent video frame; and

wherein at least part of the rules defining detecting a known object in the subsequent video frame include the steps;

defining a subsequent background in the subsequent video frame and a current background in the current video frame by detecting an unchanging image;

detecting an irregularity from the subsequent background and the current background indicating that the known object appears in either the subsequent video frame or the current video frame;

comparing the time of day and brightness level to the detected irregularity so as to disregard expected light behavior based on the time of day in which the detected irregularity occurred;

generating the output that is storable in the memory;

wherein an event is definable in the rules to relate to the known object being detected in the environment;

wherein the event is associable with an action;

wherein the action may occur subsequent to detecting the event;

wherein the action includes generating an alert; and

wherein the light source is operable responsive to the alert.

23. A lighting device according to claim 22 wherein the analysis of the data defined by at least part of the rules engine further includes the step of generating the output of the analysis respective to whether the known object is detected at a plurality of locations in the subsequent video frame.

24. A lighting device according to claim 22 wherein the network is electrically connected to a centralized computing device;

and wherein the centralized computing device analyzes the data transmitted by the camera.

25. A lighting device according to claim 22 wherein the lighting device comprises a plurality of cameras that are positioned at locations throughout the environment in a uniform manner;

wherein the plurality of cameras capture a plurality of video frames in an approximately uniform manner at the locations; and

wherein the plurality of video frames are concatenated to create an overview that includes substantially all of the locations throughout the environment substantially seamlessly.

26. A lighting device according to claim 23 wherein the plurality of locations are configured relating to an approximately grid based pattern.

27. A lighting device according to claim 23 wherein the plurality of cameras are positioned to capture the video frames using similar viewing angles relative to the environment.

28. A lighting device according to claim 22 wherein the camera includes a plurality of cameras that intercommunicate though the network using mesh networking.

29. A lighting device according to claim 22 wherein the video frame is compressible by the microcontroller, and wherein the video frame that is compressed is transmitted through the network.

30. A lighting device according to claim 22 wherein the video frame comprises a plurality of video frames that are concatenated to create a video feed;

and wherein the video feed is accessible using the interface.

31. A lighting device according to claim 30 wherein the results of the analysis performed by the rules engine is included in the video feed.

32. A lighting device according to claim 22 wherein supplemental data is viewable using the interface.

33. A lighting device according to claim 23 wherein the camera includes a plurality of cameras;

wherein the known object is detectable by at least two of the plurality of cameras to create a stereoscopic perspective; and

wherein a parallax among the video frames in the stereoscopic perspective is used to calculate depth in a three-dimensional space.

34. A method of detecting a condition in an environment comprising:

capturing a video frame from a location in the environment;

transmitting the video frame to a microcontroller as data, wherein the microcontroller comprises a processor and memory;

conducting an analysis of the data by comparing the data to rules contained on a rules engine stored in the memory to produce an output; and

making the output accessible through an interface;

wherein conducting the analysis includes the steps of;

capturing a current video frame;

recording the brightness level of the current video frame;

recording weather conditions of the current video frame;

capturing a subsequent video frame;

recording the time of day of the subsequently captured video frame;

recording the brightness level of the subsequently captured video frame;

recording weather conditions of the subsequently captured video frame;

comparing the subsequent video frame and the current video frame to a known object relative to the time of day wherein the known object is stored in the memory; and

generating the output of the analysis with respect to a determination of whether the known object is detected in the subsequent video frame;

wherein at least part of the rules defining detecting the known object in the subsequent video frame include the steps of;

defining a subsequent background in the subsequent video frame and a current background in the current video frame by detecting an unchanging image;

detecting an irregularity between the subsequent background and current background indicating that the known object appears in either the subsequent video frame or the current video frame;

comparing the time of day, brightness, and weather conditions to the detected irregularity so as to disregard expected behavior and naturally occurring conditions;

generating the output that is storable in the memory responsive to detection of the irregularity;

defining an event in the rules to relate to the known object being detected in the environment;

associating the event with an action; and

executing the action upon detecting an occurrence of the event.

35. A method according to claim 34 wherein conducting the analysis of the data further includes the step of generating the output of the analysis respective to whether the known object is detected at a specific location in the subsequent video frame.

36. A method according to claim 34 wherein conducting the analysis further includes the step of generating the output of the analysis respective to whether the known object is detected at a plurality of locations in the subsequent video frame.

37. A method according to claim 34 wherein a plurality of sensors that are electrically connected to the network are used to capture the video frame;

wherein the network is electrically connected to a centralized computing device; and

further comprising analyzing the data using the centralized computing device.

38. A method according to claim 35 further comprising positioning each of the plurality of sensors at locations throughout the environment in a uniform manner;

capturing the video frame in an approximately uniform manner; and

concatenating the video frames to create an overview that includes substantially all of the locations throughout the environment substantially seamlessly.

39. A method according to claim 36 wherein the locations throughout the environment are configured relating to an approximately grid based pattern.

40. A method according to claim 37 wherein the plurality of sensors each comprise a camera.

41. A method according to claim 34 wherein executing the action further comprises generating an alert.

42. A method according to claim 41 further comprising operating a light source responsive to the alert being generated.

43. A method according to claim 34 further comprising compressing the video frame using the microcontroller;

and transmitting the video frame that is compressed through the network.

44. A method according to claim 34 wherein the video frame includes a plurality of video frames;

and further comprising concatenating the plurality of video frames to create a video feed; and

wherein the video feed is accessible using the interface.

45. A method according to claim 34 wherein the known object is detectable by at least two sensors to create a stereoscopic perspective;

and wherein a parallax among the video frames in the stereoscopic perspective is used to calculate depth in a three-dimensional space.