Personal computer-based home security system

• US 6,064,303 A
• Filed: 11/25/1997
• Issued: 05/16/2000
• Est. Priority Date: 11/25/1997
• Status: Expired due to Term

• Current Assignee: Mei California, Inc. (Micron Technology, Inc.)
• Original Assignee: Micro Electronics Incorporated
• Inventors: Stevenson, Greg, Klein, Dean
• Primary Examiner(s): POPE, DARYL C
• Application Number:
  US08/978,246
• Time in Patent Office: 903 Days
• Field of Search: 340/506, 340/825.06, 340/825.36, 704/273, 704/274, 704/275, 700/17, 708/139, 345/168
• US Class Current: 340/506
• CPC Class Codes: G06F 3/023 Arrangements for converting discrete items of information into a coded form, e.g. arrangements for interpreting keyboard generated codes as alphanumeric codes, operand codes or instruction codes

Abstract

A PC-based home security system for monitoring the environment surrounding a PC in order to detect suspicious or uncharacteristic events. The PC-based home security system first monitors the environment, listening and watching for a threshold event. When a threshold event is detected, the PC-based home security system then conducts close surveillance of the environment in order to detect and characterize additional events. When the accumulated detected events exceed some threshold value, the PC-based home security system determines that a suspicious or uncharacteristic set of events has occurred, diagnoses those events, and takes a remedial action appropriate to the diagnosed set of suspicious circumstances.

Claims

1. The personal computer-based home security system implemented as a software program that runs on commercially available personal computers that include a modem, a microphone, and a video camera, the personal computer-based home security system monitoring an environment to detect and remedy unusual circumstances that occur in the environment, the personal computer-based home security system comprising:

a monitoring component configured to sample data collected by the microphone and video camera to detect, without human assistance, threshold events that represent a change in the environment based on the sampled data;

a close surveillance component that is launched by the personal computer-based home security system following the detection of a threshold event by the monitoring component, the close surveillance component more frequently sampling data collected by the microphone and video camera in order to detect, characterize, and record events that represent differences between the sampled data and data normally collected from the environment; and

a remedy component that is launched by the personal computer-based home security when the close surveillance component has detected sufficient events to initiate an appropriate remedial action.

2. The personal computer-based home security system of claim 1 wherein the monitoring component compares audio data input from the microphone and video data input from the video camera to expected background audio and video data for the environment and detects as a threshold event a discrepancy between the input data and expected background data greater than a threshold value.

3. The personal computer-based home security system of claim 2 wherein an increase in the amplitude of input audio data above the amplitude of the expected background audio data over a short time interval is a discrepancy between the input data and expected background data.

4. The personal computer-based home security system of claim 2 wherein detection of movement within in the input video data is a discrepancy between the input data and expected background data.

5. The personal computer-based home security system of claim 2 wherein an increase in the brightness of input video data above the brightness of the expected background video data over a short time interval is a discrepancy between the input data and expected background data.

6. The personal computer-based home security system of claim 2 wherein a decrease in the brightness of input video data above the brightness of the expected background video data over a short time interval is a discrepancy between the input data and expected background data.

7. The personal computer-based home security system of claim 2 wherein a decrease in the contrast of input video data above the contrast of the expected background video data over a short time interval is a discrepancy between the input data and expected background data.

8. The personal computer-based home security system of claim 2 wherein the input audio data and input video data are correlated with the time of day of input and compared to audio data and video data expected for that time of day.

9. The personal computer-based home security system of claim 2 wherein the input audio data and input video data are correlated with the time of day and the day of the week of input and compared to audio data and video data expected for that time of day and day of the week.

10. The personal computer-based home security system of claim 2 wherein the personal computer-based home security system is first trained by exposing it to the environment so that the personal computer-based home security system can detect and store a representation of the expected background input for the environment.

11. The personal computer-based home security system of claim 1, further including data patterns that define and categorize types of events.

12. The personal computer-based home security system of claim 11 wherein the close surveillance component monitors and records audio data input from the microphone and video data input from the video camera, detects differences in the input data from expected background, compares the detected differences with input patterns to determine the type of event that produced the differences, and computes a metric that describes a suspicion level corresponding to the detected events.

13. The personal computer-based home security system of claim 12 where the computed metric that describes a suspicion level is a sum of the number of different events detected by the close surveillance component.

14. The personal computer-based home security system of claim 12 including an event collection that contains information for each type of event that indicates to the close surveillance component how to compute a severity metric for that event, the information used by the close surveillance component to compute a severity metric in the indicated manner for each detected event.

15. The personal computer-based home security system of claim 12 where the computed metric that describes a suspicion level is a sum of the of the severity metrics computed for the different events detected by the close surveillance component.

16. The personal computer-based home security system of claim 12 where the computed metric that describes a suspicion level is a sum of the of the severity metrics computed for the different events detected by the close surveillance component along with a sum of correlations between pairs of events.

17. The personal computer-based home security system of claim 11 wherein the close surveillance component stores indications of detected events into detected event collections.

18. The personal computer-based home security system of claim 1, further including a diagnosis collection that contains indications of different types of diagnoses correlated with different event and event sequences.

19. The personal computer-based home security system of claim 18 wherein event sequences are lists of events ordered by time of occurrence.

20. The personal computer-based home security system of claim 18, further including a remedy collection that contains indications of remedial actions that should be initiated following determination of a particular diagnosis of events that have occurred in the environment and that have been detected by the close surveillance component.

21. The personal computer-based home security system of claim 20 wherein the remedy component compares the events that have been detected by the close surveillance component to the different event and event sequences stored in the diagnosis collection in order to match the detected events with a most likely diagnosis, selects actions from the remedy collection consistent with the most likely diagnosis, and initiates the selected actions.

22. The personal computer-based home security system of claim 1 wherein a remedial action directs the personal computer-based home security system to call a specific telephone number via the modem and send a specific message through the modem to a receiving party, the remedy collection storing an indication of the type of receiving party to expect for each telephone number, including a human, a fax machine, and another modem.

23. The personal computer-based home security system of claim 1, further including data patterns that defines and categorize types of events.

24. The personal computer-based home security system of claim 23 wherein the close surveillance component monitors and records audio data input from the microphone, detects differences in the input data from expected background, compares the detected differences with input patterns to determine the type of event that produced the differences, and computes a metric that describes a suspicion level corresponding to the detected events.

25. The personal computer-based home security system of claim 24 where the computed metric that describes a suspicion level is a sum of the number of different events detected by the close surveillance component.

26. The personal computer-based home security system of claim 24 including an event collection that contains information for each type of event that indicates to the close surveillance component how to compute a severity metric for that event, the information used by the close surveillance component to compute a severity metric in the indicated manner for each detected event.

27. The personal computer-based home security system of claim 24 where the computed metric that describes a suspicion level is a sum of the of the severity metrics computed for the different events detected by the close surveillance component.

28. The personal computer-based home security system of claim 24 where the computed metric that describes a suspicion level is a sum of the of the severity metrics computed for the different events detected by the close surveillance component along with a sum of correlations between pairs of events.

29. The personal computer-based home security system of claim 24 wherein the close surveillance component stores indications of detected events into a detected event collection.

30. The personal computer-based home security system implemented as a software program that runs on commercially available personal computers that include a modem, a microphone, the personal computer-based home security system monitoring an environment to detect and remedy unusual circumstances that occur in the environment, the personal computer-based home security comprising:

a monitoring component configured to sample data collected by the microphone to detect, without human assistance, threshold events that represent a change in the environment based on the sampled data;

a close surveillance component that is launched by the personal computer-based home security system following the detection of a threshold event by the monitoring component, the close surveillance component more frequently sampling data collected by the microphone in order to detect, characterize, and record events that represent differences between the sampled data and data normally collected from the environment; and

a remedy component that is launched by the personal computer-based home security when the close surveillance component has detected sufficient events to initiate an appropriate remedial action.

31. The personal computer-based home security system of claim 30 wherein the monitoring component compares audio data input from the microphone to expected background audio data for the environment and detects as a threshold event a discrepancy between the input audio data and expected background audio data greater than a threshold value.

32. The personal computer-based home security system of claim 30 wherein an increase in the amplitude of input audio data above the amplitude of the expected background audio data over a short time interval is a discrepancy between the input data and expected background data.

33. The personal computer-based home security system of claim 30 wherein the input audio data is correlated with the time of day of input and compared to audio data expected for that time of day.

34. The personal computer-based home security system of claim 30 wherein the input audio data is correlated with the time of day and the day of the week of input and compared to audio data expected for that time of day and day of the week.

35. The personal computer-based home security system of claim 30 wherein the personal computer-based home security system is first trained by exposing it to the environment so that the personal computer-based home security system can detect and store a representation of the expected background input for the environment.

36. The personal computer-based home security system of claim 30, further including a diagnosis collection that contains indications of different types of diagnoses correlated with different event and event sequences.

37. The personal computer-based home security system of claim 36 wherein event sequences are lists of events ordered by time of occurrence.

38. The personal computer-based home security system of claim 36, further including a remedy collection that contains indications of remedial actions that should be initiated following determination of a particular diagnosis of events that have occurred in the environment and that have been detected by the close surveillance component.

39. The personal computer-based home security system of claim 38 wherein the remedy component compares the events that have been detected by the close surveillance component to the different event and event sequences stored in the diagnosis collection in order to match the detected events with a most likely diagnosis, selects actions from the remedy collection consistent with the most likely diagnosis, and initiates the selected actions.

40. The personal computer-based home security system of claim 30 wherein a remedial action directs the personal computer-based home security system to call a specific telephone number via the modem and send a specific message through the modem to a receiving party, the remedy collection storing an indication of the type of receiving party to expect for each telephone number, including a human, a fax machine, and another modem.

41. A personal computer-based home security implemented as a software program that runs on commercially available personal computers that include a modem, and video camera, the personal computer-based home security system monitoring an environment to detect and remedy unusual circumstances that occur in the environment, the personal computer-based home security system comprising:

a monitoring component configured to sample data collected by the microphone to detect, without human assistance, threshold events that represent a change in the environment based on the sampled data;

a close surveillance component that is launched by the personal computer-based home security system following the detection of a threshold event by the monitoring component, the close surveillance component more frequently sampling data collected by the microphone in order to detect, characterize, and record events that represent differences between the sampled data and data normally collected from the environment; and

a remedy component that is launched by the personal computer-based home security when the close surveillance component has detected sufficient events to initiate an appropriate remedial action.

42. The personal computer-based home security system of claim 41 wherein the monitoring component compares video data input from the video camera to expected background video data for the environment and detects as a threshold event a discrepancy between the input video data and expected background video data greater than a threshold value.

43. The personal computer-based home security system of claim 41 wherein detection of movement within in the input video data is a discrepancy between the input data and expected background data.

44. The personal computer-based home security system of claim 42 wherein an increase in the brightness of input video data above the brightness of the expected background video data over a short time interval is a discrepancy between the input data and expected background data.

45. The personal computer-based home security system of claim 42 wherein a decrease in the brightness of input video data above the brightness of the expected background video data over a short time interval is a discrepancy between the input data and expected background data.

46. The personal computer-based home security system of claim 42 wherein a decrease in the contrast of input video data above the contrast of the expected background video data over a short time interval is a discrepancy between the input data and expected background data.

47. The personal computer-based home security system of claim 42 wherein the input video data is correlated with the time of day of input and compared to video data expected for that time of day.

48. The personal computer-based home security system of claim 42 wherein the input video data is correlated with the time of day and the day of the week of input and compared to video data expected for that time of day and day of the week.

49. The personal computer-based home security system of claim 42 wherein the personal computer-based home security system is first trained by exposing it to the environment so that the personal computer-based home security system can detect and store a representation of the expected background input for the environment.

50. The personal computer-based home security system of claim 41, further including data patterns that define and categorize types of events.

51. The personal computer-based home security system of claim 50 wherein the close surveillance component monitors and records video data input from the video camera, detects differences in the input data from expected background, compares the detected differences with input patterns to determine the type of event that produced the differences, and computes a metric that describes a suspicion level corresponding to the detected events.

52. The personal computer-based home security system of claim 51 where the computed metric that describes a suspicion level is a sum of the number of different events detected by the close surveillance component.

53. The personal computer-based home security system of claim 51 including an event collection that contains information for each type of event that indicates to the close surveillance component how to compute a severity metric for that event, the information used by the close surveillance component to compute a severity metric in the indicated manner for each detected event.

54. The personal computer-based home security system of claim 51 where the computed metric that describes a suspicion level is a sum of the of the severity metrics computed for the different events detected by the close surveillance component.

55. The personal computer-based home security system of claim 51 where the computed metric that describes a suspicion level is a sum of the of the severity metrics computed for the different events detected by the close surveillance component along with a sum of correlations between pairs of events.

56. The personal computer-based home security system of claim 50 wherein the close surveillance component stores indications of detected events into detected event collections.

57. The personal computer-based home security system of claim 56, further including a diagnosis collection that contains indications of different types of diagnoses correlated with different event and event sequences.

58. The personal computer-based home security system of claim 57 wherein event sequences are lists of events ordered by time of occurrence.

59. The personal computer-based home security system of claim 57, further including a remedy collection that contains indications of remedial actions that should be initiated following determination of a particular diagnosis of events that have occurred in the environment and that have been detected by the close surveillance component.

60. The personal computer-based home security system of claim 59 wherein the remedy component compares the events that have been detected by the close surveillance component to the different event and event sequences stored in the diagnosis collection in order to match the detected events with a most likely diagnosis, selects actions from the remedy collection consistent with the most likely diagnosis, and initiates the selected actions.

61. The personal computer-based home security system of claim 41 wherein a remedial action directs the personal computer-based home security system to call a specific telephone number via the modem and send a specific message through the modem to a receiving party, the remedy collection storing an indication of the type of receiving party to expect for each telephone number, including a human, a fax machine, and another modem.