Occupancy sensing apparatus network

• US 10,078,786 B2
• Filed: 08/31/2016
• Issued: 09/18/2018
• Est. Priority Date: 08/31/2015
• Status: Active Grant

• Current Assignee: Deako, Inc.
• Original Assignee: Deako, Inc.
• Inventors: Richardson, Derek, Prendergast, Patrick, Wilson, Cole, Anderson, Erik, Olson, Dana
• Primary Examiner(s): Huynh, Van D
• Application Number:
  US15/253,811
• Publication Number:
  US 20170116483A1
• Time in Patent Office: 748 Days
• Field of Search: 382103
• CPC Class Codes: G05B 19/048 Monitoring; Safety
• CPC Class Codes: G05B 2219/25011 Domotique, I-O bus, home automation, building automation
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06V 20/52 Surveillance or monitoring of activities, e.g. for recognising suspicious objects recognising microscopic objects G06V20/69
• CPC Class Codes: G06V 40/161 Detection; Localisation; Normalisation
• CPC Class Codes: G06V 40/23 Recognition of whole body movements, e.g. for sport training
• CPC Class Codes: H01R 12/724 containing contact members forming a right angle
• CPC Class Codes: H01R 13/2407 characterized by the resilient means
• CPC Class Codes: H01R 13/447 Shutter or cover plate
• CPC Class Codes: H01R 13/6275 Latching arms not integral with the housing H01R13/6276, H01R13/6277, H01R13/6278 take precedence
• CPC Class Codes: H01R 2107/00 Four or more poles
• CPC Class Codes: H01R 24/62 Sliding engagements with one side only, e.g. modular jack coupling devices
• CPC Class Codes: H02G 3/081 Bases, casings or covers
• CPC Class Codes: H02G 3/12 for flush mounting
• CPC Class Codes: H02G 3/16 structurally associated with support for line-connecting terminals within the box
• CPC Class Codes: H05B 47/115 by determining the presence or movement of objects or living beings
• CPC Class Codes: H05B 47/125 by using cameras
• CPC Class Codes: H05B 47/13 by using passive infrared detectors
• CPC Class Codes: H05B 47/19 via wireless transmission
• CPC Class Codes: Y02B 20/40 Control techniques providing energy savings, e.g. smart controller or presence detection

Abstract

An occupancy-sensing apparatus a device control assembly including a detector configured to generate an image wherein the device control assembly includes one or more illumination sources configured to emit illumination including at least one wavelength of radiation measurable by the detector. The apparatus includes a controller communicatively coupled to the detector configured to detect occupants based on the image generated by the detector, wherein the controller is configured to determine an active state of the detected occupants, the activity state including at least one of a stationary state or moving state.

Claims

1. An occupancy-sensing apparatus, comprising:

a device control assembly configured to be toollessly inserted into or removed from a cavity of a backplate mounted in an electrical junction box by a user, the backplate including backplate electrical contacts connected to electrical wiring within the electrical junction box, the backplate including a user-translatable cover configured to electrically shield the backplate electrical contacts when in a closed position and expose the backplate electrical contacts when in an open position, wherein the backplate includes a lock to maintain the cover in the closed position unless the device control assembly is inserted into the cavity, the device control assembly comprising;

device control assembly electrical contacts configured to couple to the backplate contacts when the cover is in the open position;

a detector configured to generate an image;

one or more illumination sources, the one or more illumination sources configured to emit illumination including at least one wavelength of radiation measurable by the detector; and

a controller communicatively coupled to the detector, the controller configured to;

receive illuminated images from the detector generated with illumination from at least one of the one or more illumination sources;

generate processed images with filtered ambient light by subtracting an ambient image from the illuminated images, the ambient image generated without illumination from the one or more illumination sources;

classify one or more objects in the processed images as one of human or non-human based on shapes of the one or more objects; and

detect occupants when at least one human object is identified in a processed image.

2. The occupancy-sensing apparatus of claim 1, wherein the controller is further configured to:

determine at least one of a location, a direction of motion, or a speed of motion of the detected occupants based on two or more processed images.

3. The occupancy-sensing apparatus of claim 1, wherein the controller is further configured to:

identify a face in a processed image.

4. The occupancy-sensing apparatus of claim 3, wherein the controller is further configured to:

capture a first processed image from the detector based on illumination from a first illumination source of the one or more illumination sources;

detect one or more shadows in the first processed image;

capture a second processed image from the detector based on illumination from a second illumination source of the one or more illumination sources;

detect one or more shadows in the second processed image; and

identify a source of the face as one of a two-dimensional image proximate to the occupancy-sensing apparatus or a human face proximate to the occupancy-sensing apparatus based on at least one of the one or more shadows in the first image or the one or more shadows in the second image.

5. The occupancy-sensing apparatus of claim 1, wherein the controller is further configured to:

identify a retina in a processed image.

6. The occupancy-sensing apparatus of claim 1, wherein the controller is further configured to:

identify a fingerprint in a processed image.

7. The occupancy-sensing apparatus of claim 1, wherein the detected occupants include an occupant, wherein the controller is further configured to:

determine an identity of the occupant.

8. The occupancy-sensing apparatus of claim 7, wherein the controller is further configured to classify the occupant as a known occupant or an unknown occupant based on the identity.

9. The occupancy-sensing apparatus of claim 1, wherein the detected occupants include an occupant, wherein the controller is further configured to:

identify at least one of a pose or a gesture of the detected occupant.

10. The occupancy-sensing apparatus of claim 9, wherein the controller is further configured to:

generate wire frame representations of the detected occupant, wherein identifying at least one of a pose or a gesture of the detected occupant comprises;

identifying one or more body parts of the detected occupant based on the wire frame representations; and

identifying at least one of a pose or a gesture of the detected occupant based on positions of the one or more body parts in the processed images.

11. The occupancy-sensing apparatus of claim 10, wherein identifying at least one of a pose or a gesture of the detected occupants further comprises:

determining whether any of the one or more body parts overlap based on positions of the shapes or lines based on the wire frame representations; and

identifying at least one of a pose or a gesture of the detected occupant based on whether any of the one or more body parts overlap.

12. The occupancy-sensing apparatus of claim 1, further comprising:

a multi-field lens, wherein the multi-field lens is configured to separately image two or more portions of a field of view onto two or more portions of the detector.

13. The occupancy-sensing apparatus of claim 12, wherein the field of view is greater than 170 degrees.

14. The occupancy-sensing apparatus of claim 12, wherein the controller is further configured to:

mitigate distortion in the image induced by the multi-field lens.

15. The occupancy-sensing apparatus of claim 12, wherein the multi-field lens comprises:

a tri-field lens, wherein the tri-field lens is configured to separately image three portions of the field of view onto three portions of the detector.

16. The occupancy-sensing apparatus of claim 1, further comprising:

a microphone, wherein the microphone is configured to detect one or more audio signals, wherein the controller is further configured to detect occupants based on the one or more audio signals.

17. The occupancy-sensing apparatus of claim 1, wherein the detector comprises:

a complementary metal-oxide semiconductor sensor.

18. The occupancy-sensing apparatus of claim 1, wherein the detector further comprises:

a passive infrared sensor.

19. The occupancy-sensing apparatus of claim 1, wherein the detector further comprises:

one or more thermopiles.

20. The occupancy-sensing apparatus of claim 1, wherein the detected occupants comprise:

at least one of a human or an animal.

21. The occupancy-sensing apparatus of claim 1, wherein the illuminated images are generated by modulating the one or more illumination sources with a selected pattern and synchronizing the detector to the selected pattern.

22. The occupancy-sensing apparatus of claim 1, wherein the controller is further configured to:

generate a background image based on one or more images from the detector, wherein the background is free of occupants.

23. The occupancy-sensing apparatus of claim 22, wherein the controller is further configured to:

filter background information from the processed images by subtracting the background image from the processed images.

24. A network of occupancy sensors, comprising:

two or more occupancy sensors configured to detect occupants within two or more detection zones, the two or more occupancy sensors configured to determine locations of detected occupants relative to the two or more occupancy sensors, each occupancy sensor of the two or more occupancy sensors comprising;

a device control assembly configured to be toollessly inserted into or removed from a cavity of a backplate mounted in an electrical junction box by a user, the backplate including backplate electrical contacts connected to electrical wiring within the electrical junction box, the backplate including a user-translatable cover configured to electrically shield the backplate electrical contacts when in a closed position and expose the backplate electrical contacts when in an open position, wherein the backplate includes a lock to maintain the cover in the closed position unless the device control assembly is inserted into the cavity, the device control assembly comprising;

device control assembly electrical contacts configured to couple to the backplate contacts when the cover is in the open position;

a detector configured to generate an image;

one or more illumination sources, the one or more illumination sources configured to emit illumination including at least one wavelength of radiation measurable by the detector; and

a controller communicatively coupled to the detector, the controller configured to;

receive illuminated images from the detector generated with illumination from at least one of the one or more illumination sources;

generate processed images with filtered ambient light by subtracting an ambient image from the illuminated images, the ambient image generated without illumination from the one or more illumination sources;

classify one or more objects in the processed images as one of human or non-human based on shapes of the one or more objects; and

detect occupants when at least one human object is identified in a processed image.

25. The network of occupancy sensors of claim 24, wherein the controller of at least one device control assembly is further configured to:

identify at least one of a direction of motion or a speed of motion of detected occupants based on two or more processed images.

26. The network of occupancy sensors of claim 24, wherein a first occupancy sensor of the two or more occupancy sensors is configured to detect occupants in a first detection zone, wherein a second occupancy sensor of the two or more occupancy sensors is configured to detect occupants in a second detection zone, wherein the two or more occupancy sensors are configured to track a location of a detected occupant as the occupant moves from the first detection zone to the second detection zone.

27. The network of occupancy sensors of claim 26, wherein the first occupancy sensor is configured to detect a direction of motion of the occupant, wherein the first occupancy sensor is configured to transmit data indicative of the direction of motion of the occupant to the second occupancy sensor when the occupant exits the first detection zone.

28. The network of occupancy sensors of claim 24, wherein a first occupancy sensor is configured to determine a distance between the first occupancy sensor and a second occupancy sensor.

29. The network of occupancy sensors of claim 28, wherein the two or more occupancy sensors are configured to determine a position of an object in a processed image relative to the first occupancy sensor and the second occupancy sensor based on the distance between the first occupancy sensor and the second occupancy sensor, and strengths of triangulation signals transmitted by the object and received by the first and second occupancy sensors.

30. The network of occupancy sensors of claim 28, wherein the triangulation signals comprise:

radio-frequency signals.

31. The network of occupancy sensors of claim 28, wherein the two or more occupancy sensors are configured to determine a distance between the first occupancy sensor of the two or more occupancy sensors and the second occupancy sensor based on strengths of a signal transmitted by the first occupancy sensor and received by the second occupancy sensor.

32. The network of occupancy sensors of claim 31, wherein the signal comprises:

a radio-frequency signal.

33. The network of occupancy sensors of claim 24, wherein the controller of at least one device control assembly is further configured to:

identify a face in a processed image.

34. The network of occupancy sensors of claim 33, wherein the controller of at least one device control assembly is further configured to:

capture a first processed image from the detector based on illumination from a first illumination source;

detect one or more shadows in the first processed image;

capture a second processed image from the detector based on illumination from a second illumination source;

detect one or more shadows in the second processed image; and

identify a source of the face as one of a two-dimensional image proximate to the occupancy-sensing apparatus or a human face proximate to the occupancy-sensing apparatus based on at least one of the one or more shadows in the first processed image or the one or more shadows in the second processed image.

35. The network of occupancy sensors of claim 24, wherein the controller of at least one device control assembly is further configured to:

identify a retina in a processed image.

36. The network of occupancy sensors of claim 24, wherein the controller of at least one device control assembly is further configured to:

identify a fingerprint in a processed image.

37. The network of occupancy sensors of claim 24, wherein the detected occupants include an occupant, controller of at least one device control assembly is further configured to:

determine an identity of the occupant.

38. The network of occupancy sensors of claim 37, wherein the controller of at least one device control assembly is further configured to classify the detected occupant as a known occupant or an unknown occupant based on the identity.

39. The network of occupancy sensors of claim 24, wherein the detected occupants include an occupant, wherein the controller of at least one device control assembly is further configured to:

identify at least one of a pose or a gesture of the detected occupant.

40. The network of occupancy sensors of claim 24, further comprising:

a multi-field lens, wherein the multi-field lens is configured to separately image two or more portions of a field of view onto two or more portions of the detector.

41. The network of occupancy sensors of claim 40, wherein the field of view is greater than 170 degrees.

42. The network of occupancy sensors of claim 40, wherein the controller is further configured to:

mitigate distortion in the image induced by the multi-field lens.

43. The network of occupancy sensors of claim 40, wherein the multi-field lens comprises:

a tri-field lens, wherein the tri-field lens is configured to separately image three portions of the field of view onto three portions of the detector.

44. The network of occupancy sensors of claim 24, further comprising:

a microphone, wherein the microphone is configured to detect one or more audio signals, wherein the controller is further configured to detect occupants based on the one or more audio signals.

45. The network of occupancy sensors of claim 24, wherein the detector comprises:

a complementary metal-oxide semiconductor sensor.

46. The network of occupancy sensors of claim 24, wherein the detector further comprises:

a passive infrared sensor.

47. The network of occupancy sensors of claim 24, wherein the detector further comprises:

one or more thermopiles.

48. The network of occupancy sensors of claim 24, wherein the detected occupants comprise:

at least one of a human or an animal.

49. The network of occupancy sensors of claim 24, wherein the illuminated images are generated by modulating the one or more illumination sources with a selected pattern and synchronizing the detector to the selected pattern.

50. An occupancy-sensing apparatus, comprising:

a backplate configured to mount to an electrical junction box, the backplate further configured to connect to electrical wiring within the electrical junction box; and

a device control assembly, the device control assembly configured to be toollessly and interchangeably coupled into a cavity of the backplate the device control assembly configured to receive electrical power from the backplate when inserted into the backplate, the device control assembly comprising;

a detector configured to generate an image;

one or more illumination sources, the one or more illumination sources configured to emit illumination including at least one wavelength of radiation measurable by the detector; and

a controller communicatively coupled to the detector, the controller configured to;

receive illuminated images from the detector generated with illumination from at least one of the one or more illumination sources;

generate processed images with filtered ambient light by subtracting an ambient image from the illuminated images, the ambient image generated without illumination from the one or more illumination sources;

classify one or more objects in the processed images as one of human or non-human based on shapes of the one or more objects; and

detect occupants when at least one human object is identified in a processed image.