Systems and methods for processing ultrasonic inputs

• US 9,679,465 B2
• Filed: 07/17/2014
• Issued: 06/13/2017
• Est. Priority Date: 07/18/2013
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Goldenson, Andrew W., Minich, AJ, Modi, Yash, Matsuoka, Yoky
• Primary Examiner(s): POPE, DARYL C
• Application Number:
  US14/334,233
• Publication Number:
  US 20150029019A1
• Time in Patent Office: 1,062 Days
• Field of Search: 340501, 340506, 340301, 340517, 340521
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06V 40/103 Static body considered as a whole, e.g. static pedestrian or occupant recognition
• CPC Class Codes: G08B 17/10 Actuation by presence of smoke or gases , e.g. automatic alarm devices for analysing flowing fluid materials by the use of optical means
• CPC Class Codes: G08B 17/113 Constructional details
• CPC Class Codes: G08B 25/001 Alarm cancelling procedures or alarm forwarding decisions, e.g. based on absence of alarm confirmation
• CPC Class Codes: G08B 25/008 Alarm setting and unsetting, i.e. arming or disarming of the security system
• CPC Class Codes: G08B 25/10 using wireless transmission systems G08B25/009 takes precedence
• CPC Class Codes: G08B 29/00 Checking or monitoring of signalling or alarm systems; Prevention or correction of operating errors, e.g. preventing unauthorised operation
• CPC Class Codes: G08B 29/02 Monitoring continuously signalling or alarm systems
• CPC Class Codes: G08B 29/185 Signal analysis techniques for reducing or preventing false alarms or for enhancing the reliability of the system
• CPC Class Codes: H04L 12/282 based on user interaction within the home receiver circuitry for displaying additional information being controlled by a remote control apparatus H04N21/42204

Abstract

Hazard detection systems and methods according to embodiments described herein are operative to enable a user to interface with the hazard detection system by performing a touchless gesture. The touchless gesture can be performed in a vicinity of the hazard detection system without requiring physical access to the hazard detection system. This enables the user to interact with the hazard detection system even if it is out of reach. The hazard detection system can detect gestures and perform an appropriate action responsive to the detected gesture. In one embodiment, the hazard detection system can silence its audible alarm or pre-emptively turn off its audible alarm in response to a detected gesture. Gestures can be detected using one or more ultrasonic sensors, or gestures can be detected using a motion detector in combination with one or more ultrasonic sensors.

Claims

1. A hazard detection system, comprising:

at least one hazard detection sensor;

alarm generation circuitry operative to sound an audible alarm in response to a hazard event detected by the at least one hazard detection sensor;

a passive infrared (PIR) sensor having a wide field of view for detecting movement of at least one object; and

at least one ultrasonic sensor having a narrow field of view for detecting presence of at least one object, wherein the narrow field of view is less than the wide field of view; and

control circuitry operative to;

process data acquired by the PIR sensor and the ultrasonic sensor;

detect that a gesture event exists in the processed data, wherein the gesture event is detected when the processed data represents that the PIR sensor detected movement of the at least one object while the at least one ultrasonic sensor detected presence of the at least one object; and

cease the sound of the audible alarm when the gesture event is detected.

2. The hazard detection system of claim 1, wherein the narrow field of view of each of the at least one ultrasonic sensor exists within the wide field of view.

3. The hazard detection system of claim 1, wherein the gesture event comprises movement of the at least one object while at least one object is within the narrow field of view.

4. The hazard detection system of claim 1, wherein the control circuitry is operative to increase a sample rate of data acquired from the PIR sensor when the at least one object is present within the narrow field of view.

5. The hazard detection system of claim 1, wherein the at least one ultrasonic sensor comprises a plurality of ultrasonic sensors, and wherein the control circuitry is operative to process data acquired from the plurality of ultrasonic sensors.

6. The hazard detection system of claim 1, further comprising:

a power bus; and

power gating circuitry that selectively couples and de-couples the at least one ultrasonic sensor to the power bus, wherein the control circuitry is further operative to;

selectively couple and de-couple the ultrasonic sensor to the power bus based on whether the at least one hazard detection sensor monitors a hazard event.

7. The hazard detection system of claim 1, further comprising a speaker operative to playback a recorded message.

8. The hazard detection system of claim 7, wherein the control circuitry is operative to instruct the speaker to playback the recorded message during the detected hazard event.

9. The hazard detection system of claim 7, wherein the control circuitry is operative to instruct the speaker to playback the recorded message during the detected hazard event and in response to detecting presence of the at least one object within the narrow field of view.

10. The hazard detection system of claim 7, wherein the control circuitry is operative to instruct the speaker to playback the recorded message in response to a pre-alarm hazard event detected by the at least one hazard detection sensor.

11. The hazard detection system of claim 10, wherein the control circuitry is operative to cause the speaker to at least temporarily cease playback of the recorded message when the gesture event is determined to exist.

12. A method for silencing a hazard alarm, the method implemented by a hazard detection system, the method comprising:

emitting an audible alarm in response to a detected hazard event;

playing back a recording that provides instructions on how to at least temporarily silence the audible alarm;

detecting an object moving in a vicinity of the hazard detection system in accordance with the instructions of the recording; and

at least temporarily silencing the audible alarm in response to detecting the object moving in accordance with the instructions of the recording.

13. The method of claim 12, further comprising monitoring at least one ultrasonic detection field for presence of the object.

14. The method of claim 13, wherein the recording is played back when the object is present in the at least one ultrasonic detection field.

15. The method of claim 12, wherein the detecting the object comprises monitoring a passive infrared detection field for movement of the object.

16. The method of claim 12, further comprising:

playing back a pre-alarm recording in response to a detected pre-alarm event; and

detecting a moving object during the detected pre-alarm event, wherein playback of the pre-alarm is temporarily halted in response to detecting the moving object.

17. A gesture detection system, comprising:

a passive infrared (PIR) sensor operative to detect movement of at least one object;

an ultrasonic sensor operative to detect presence of at least one object; and

circuitry operative to;

use the ultrasonic sensor to create a static environmental model;

use the ultrasonic sensor to produce a dynamic environmental model; and

compare the dynamic model to the static model to determine whether at least one new object is present.

18. The system of claim 17 where the static model comprises a first matrix of detected distances, wherein each detected distance is represented by a distance range.

19. The system of claim 18, wherein the static model comprises a second matrix of variances for each detected distance.

20. The system of claim 19, wherein the dynamic model comprises a third matrix of detected distances, wherein each detected distance is represented by a correspondingly similar distance range as each distance range in the first matrix.

21. The system of claim 20, wherein the circuitry is operative to determine confidence values based on the first, second, and third matrices, wherein if the confidence value associated with a distance exceeds a variance threshold, an object is detected as present at that distance.

22. The system of claim 17, wherein after at least one object is detected as present, the circuitry is operative to analyze PIR data to determine whether a gesture is detected.

23. The system of claim 22, wherein the circuitry is operative to analyze motion events in the PIR data, wherein each motion event is analyzed according to at least one of amplitude characteristics and period characteristics.

24. The system of claim 17, wherein the static environmental model comprises a calibrated histogram of distance buckets, wherein each distance bucket exists between a range of distances, each separated by a fixed interval, and wherein each bucket comprises a binary number representing whether an object is detected at the distance associated with that bucket.

25. The system of claim 24, wherein the dynamic environmental model comprises a non-calibrated histogram of distance buckets, wherein each distance bucket exists between a range of distances, each separated by a fixed interval, and wherein each bucket comprises a binary number representing whether an object is detected at the distance associated with that bucket.

26. The system of claim 25, wherein the circuitry is further operative to compare the calibrated and non-calibrated histograms to determine a number of added and lost objects, wherein an object is added if the non-calibrated histogram indicates the presence of an object at a particular distance bucket that did not exist in the calibrated histogram, and wherein an object is lost if it exists as an object in the calibrated histogram, but is no longer detected in the non-calibrated histogram.

27. The system of claim 26, wherein the circuitry is operative to indicate that an object is present if the number exceeds a threshold.

28. The system of claim 27, wherein the threshold changes depending on orientation of the system.

29. The system of claim 17, wherein the circuitry is operative to selectively analyze PIR data when the new object is determined to be sufficiently settled.

30. The system of claim 29, wherein after at least one object is detected and determined to be settled, the circuitry is operative to analyze gesture events in the PIR data to determine whether a gesture is detected.

31. The system of claim 30, wherein the circuitry is operative to determine peaks in the PIR data, an amplitude between adjacent peaks and a period between adjacent peaks.

32. The system of claim 31, wherein the circuitry is operative to use one of slope change detection or zero-cross detection to determine the peaks.

33. The system of claim 31, wherein the circuitry is operative to:

determine whether the amplitude and period meet predefined criteria; and

store the amplitude and period as a gesture event in a rolling buffer if the predefined criteria are met.

34. The system of claim 33, wherein when the rolling buffer has at least two gesture events stored therein, the circuitry is operative to use data associated with two gesture events to determine whether their data satisfies matched gesture pair conditions to qualify as a detected gesture.