Arming and/or altering a home alarm system by specified positioning of everyday objects within view of a security camera

• US 10,452,963 B2
• Filed: 04/17/2017
• Issued: 10/22/2019
• Est. Priority Date: 05/12/2016
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google LLC (Alphabet Inc.)
• Inventors: Tannenbaum, Harry, Sayadi, Shayan
• Primary Examiner(s): Lee, Jonathan S
• Application Number:
  US15/489,424
• Publication Number:
  US 20170330060A1
• Time in Patent Office: 918 Days
• Field of Search: 382103
• CPC Class Codes: G06F 18/00 Pattern recognition
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 2207/10024 Color image
• CPC Class Codes: G06T 2207/20081 Training; Learning
• CPC Class Codes: G06T 2207/30196 Human being; Person
• CPC Class Codes: G06T 2207/30232 Surveillance
• CPC Class Codes: G06T 7/254 involving subtraction of images
• CPC Class Codes: G06V 10/44 Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components
• CPC Class Codes: G06V 10/758 Involving statistics of pixels or of feature values, e.g. histogram matching
• CPC Class Codes: G06V 20/52 Surveillance or monitoring of activities, e.g. for recognising suspicious objects recognising microscopic objects G06V20/69
• CPC Class Codes: G08B 13/19656 Network used to communicate with a camera, e.g. WAN, LAN, Internet
• CPC Class Codes: G08B 19/005 combined burglary and fire alarm systems
• CPC Class Codes: G08B 25/008 Alarm setting and unsetting, i.e. arming or disarming of the security system

Abstract

A method and system for controlling a home security system. A processor may be trained to recognize an image standard for a scene, wherein the training comprises creating a profile of the image standard. Operational imaging of the scene may be performed to create an operational image. A profile of the operational image may be created. Profiles of the image standard and the operational image may be compared. A state of a security system may be changed as a result of a comparison of the profiles of the image standard and the operational image.

Claims

1. A method comprising:

training a processor to recognize an image standard for an object within a scene, wherein the training comprises creating a profile of the image standard;

performing operational imaging of the scene including the object to create an operational image;

creating a profile of the operational image;

comparing the profiles of the image standard and the operational image;

changing a state of a security system as a result of a comparison of the profiles of the image standard and the operational image such that the security system is placed in an armed state when the object in the standard image is in a first position and the object in the operational image is in a second position, wherein the first position and the second position are different positions relative to one another, and the security system is placed in a disarmed state when the object in both the standard image and the operational image is in the first position.

2. The method of claim 1, wherein the training comprises:

acquiring the image standard of the scene;

performing pre-processing of the image standard;

performing feature extraction on the pre-processed image standard;

performing segmentation of the extracted features of the pre-processed image standard; and

creating the profile of the image standard based on the segmented extracted features.

3. The method of claim 2, wherein each of the profile of the image standard and the profile of the operational image comprises identifications of extracted features from the respective image standard and the operational image.

4. The method of claim 3, wherein each of the profile of the image standard and the profile of the operational image comprises data relating to each feature in the respective image standard and the operational image, wherein the data relates to one or more of:

feature type,

feature size,

feature location, and

feature color.

5. The method of claim 1, wherein the comparing of the profiles comprises:

comparing data in the profile of the image standard with corresponding data in the profile of the operational image to determine if one or more resulting differences exceeds one or more corresponding respective threshold values.

6. The method of claim 5, wherein the state of the security system is changed when at least one of the resulting differences exceeds at least one of the corresponding respective threshold values.

7. The method of claim 1, wherein the comparing of the profiles comprises an application of fuzzy logic to determine one or more resulting differences.

8. The method of claim 1, wherein the changing of the state of the security system comprises one of setting an alarm, resetting the alarm, and asserting the alarm.

9. The method of claim 1, wherein the image standard includes an image of an object that is not present in the operational image.

10. The method of claim 1, wherein the operational image includes an image of an object that is not present in the image standard.

11. A system comprising:

a processor; and

a memory in communication with the processor, wherein the memory stores instructions that, when executed by the processor, cause the processor to;

training a processor to recognize an object within an image standard for a scene, wherein the training comprises creating a profile of the image standard;

performing operational imaging of the scene including the object to create an operational image;

creating a profile of the operational image;

comparing the profiles of the image standard and the operational image; and

changing a state of a security system as a result of a comparison of the profiles of the image standard and the operational image such that the security system is placed in an armed state when the object in the standard image is in a first position and the object in the operational image is in a second position, wherein the first position and the second position are different positions relative to one another, and the security system is placed in a disarmed state when the object in both the standard image and the operational image is in the first position.

12. The system of claim 11, wherein the training comprises:

acquiring the image standard of the scene;

performing pre-processing of the image standard;

performing feature extraction on the pre-processed image standard;

performing segmentation of the extracted features of the pre-processed image standard; and

creating the profile of the image standard based on the segmented extracted features.

13. The system of claim 12, wherein each of the profile of the image standard and the profile of the operational image comprises identifications of extracted features from the respective image standard and the operational image.

14. The system of claim 13, wherein each of the profile of the image standard and the profile of the operational image comprises data relating to each feature in the respective image standard and the operational image, wherein the data relates to one or more of:

feature type,

feature size,

feature location, and

feature color.

15. The system of claim 11, wherein the comparing of the profiles comprises:

comparing data in the profile of the image standard with corresponding data in the profile of the operational image to determine if one or more resulting differences exceeds one or more corresponding respective threshold values.

16. The system of claim 15, wherein the state of the security system is changed when at least one of the resulting differences exceeds at least one of the corresponding respective threshold values.

17. The system of claim 11, wherein the comparing of the profiles comprises an application of fuzzy logic to determine one or more resulting differences.

18. The system of claim 11, wherein the changing of the state of the security system comprises one of setting an alarm, resetting the alarm, and asserting the alarm.

19. The system of claim 11, wherein the image standard includes an image of an object that is not present in the operational image.

20. The system of claim 11, wherein the operational image includes an image of an object that is not present in the image standard.