Enhanced doorbell camera interactions

• US 10,586,114 B2
• Filed: 01/05/2018
• Issued: 03/10/2020
• Est. Priority Date: 01/13/2015
• Status: Active Grant

• Current Assignee: Vivint Incorporated (NRG Energy, Inc.)
• Original Assignee: Vivint Incorporated (NRG Energy, Inc.)
• Inventors: Potter, Tanner Hawkes, Frisby, Wes, Child, Michael D., Nugent, Spencer J., Zundel, Michelle Bea, Crebs, Max Benjamin
• Primary Examiner(s): Dang, Philip P.
• Application Number:
  US15/863,837
• Publication Number:
  US 20180129885A1
• Time in Patent Office: 795 Days
• CPC Class Codes: G06V 20/52 Surveillance or monitoring of activities, e.g. for recognising suspicious objects recognising microscopic objects G06V20/69
• CPC Class Codes: G06V 40/166 using acquisition arrangements
• CPC Class Codes: G06V 40/172 Classification, e.g. identification
• CPC Class Codes: G08B 13/19602 Image analysis to detect motion of the intruder, e.g. by frame subtraction
• CPC Class Codes: G08B 13/19628 of wide angled cameras and camera groups, e.g. omni-directional cameras, fish eye, single units having multiple cameras achieving a wide angle view
• CPC Class Codes: G08B 13/19656 Network used to communicate with a camera, e.g. WAN, LAN, Internet
• CPC Class Codes: G08B 15/002 with occupancy simulation
• CPC Class Codes: G08B 3/10 using electric transmission; using electromagnetic transmission
• CPC Class Codes: H04M 11/025 Door telephones adapted for television H04N7/186
• CPC Class Codes: H04N 7/186 Video door telephones

Abstract

Techniques are described for enhanced interactions for a security automation system using a doorbell camera. One method includes detecting, by the doorbell camera, an object located within a pre-determined distance from the doorbell camera; identifying, by the doorbell camera, a suggested security action for the security and automation system to perform based at least in part on the detecting; transmitting the suggested action to the security and automation system based at least in part on the identifying; and transmitting, in response to identifying the suggested security action, a message to a user associated with the security automation system regarding the suggested security action.

Claims

1. A method of monitoring an entry to a structure for a security and automation system using a doorbell camera, comprising:

detecting, by the doorbell camera, an object located within a first pre-determined distance from the doorbell camera based at least in part on a movement of the object within the first pre-determined distance, wherein the movement of the object is at least in part towards the entry of the structure;

analyzing images of the object captured by the doorbell camera to identify the object, triggered by the detecting that the object is located at the first pre-determined distance from the entry of the structure, wherein the analyzing is irrespective of a manual interaction with a security automation component, wherein the analyzing comprises identifying an email delivery confirmation, identifying a tracking number in the email delivery confirmation, and confirming a validity of the email delivery confirmation and the tracking number;

identifying, by the doorbell camera, a suggested security action for the security and automation system to perform based at least in part on the analyzing;

transmitting the suggested security action to the security and automation system; and

transmitting, in response to identifying the suggested security action, a message to a user associated with the security and automation system regarding the suggested security action, wherein transmitting the message comprises receiving a written message, translating the written message into a verbal message, and broadcasting the verbal message at or near the entry to the structure.

2. The method of claim 1, wherein detecting the object located within the first pre-determined distance from the doorbell camera further comprises:

detecting a presence of the object located within zero degrees, inclusive, to 90 degrees, inclusive, downward from a midline horizontal viewing plane of a lens coupled to the doorbell camera.

3. The method of claim 1, wherein detecting the object located within the first pre-determined distance from the doorbell camera further comprises:

detecting a presence of the object located within 90 degrees, inclusive, to 180 degrees, inclusive, upward from a midline horizontal viewing plane of a lens coupled to the doorbell camera.

4. The method of claim 1, wherein detecting the object located within the first pre-determined distance from the doorbell camera further comprises:

detecting a presence of the object located within a range inclusive of 90 degrees on either side of a midline vertical viewing plane of a lens coupled to the doorbell camera.

5. The method of claim 1, wherein detecting the object located within the first pre-determined distance from the doorbell camera further comprises:

detecting a presence of the object located within six inches from a lens coupled to the doorbell camera.

6. The method of claim 1, wherein detecting the object further comprises:

receiving data from a sensor coupled to the doorbell camera, the sensor capturing images at an aspect ratio of 4 to 3.

7. The method of claim 6, further comprising:

converting the images captured at the aspect ratio of 4 to 3 into images having an aspect ratio of 1 to 1.

8. The method of claim 7, further comprising:

transmitting the converted images to the user prior to determining the suggested security action.

9. The method of claim 7, further comprising:

transmitting the converted images to the user after determining the suggested security action.

21. The method of claim 1, wherein the movement of the object is at least in part towards the doorbell camera.

22. The method of claim 1, wherein the doorbell camera is located at the structure, and wherein the first pre-determined distance and a second pre-determined distance are within an area associated with the structure.

23. The method of claim 1, wherein the detecting the object further comprises detecting a person and a package.

24. The method of claim 1, wherein the analyzing of the object further comprises identifying a person.

10. A doorbell camera for monitoring an entry to a structure of a security and automation system, comprising:

a processor;

a memory in electronic communication with the processor; and

instructions stored in the memory, the instructions being executable by the processor to;

detect, by the doorbell camera, an object located within a first pre-determined distance from the doorbell camera based at least in part on a movement of the object within the first pre-determined distance, wherein the movement of the object is at least in part towards the entry of the structure;

analyze images of the object captured by the doorbell camera to identify the object, triggered by the detecting that the object is located at the first pre-determined distance from the entry of the structure, wherein the analyzing is irrespective of a manual interaction with a security automation component, wherein the analyzing comprises identifying an email delivery confirmation, identifying a tracking number in the email delivery confirmation, and confirming a validity of the email delivery confirmation and the tracking number;

identify, by the doorbell camera, a suggested security action for the security and automation system to perform based at least in part on the analyzing;

transmit the suggested security action to the security and automation; and

transmit, in response to identifying the suggested security action, a message to a user associated with the security and automation system regarding the suggested security action, wherein transmitting the message comprises receiving a written message, translating the written message into a verbal message, and broadcasting the verbal message at or near the entry to the structure.

11. The doorbell camera of claim 10, further comprising:

a lens coupled to the processor, the lens comprising a 180-degree field of view around a midline horizontal viewing plane; and

the lens further comprising a 180-degree field of view around a midline vertical viewing plane.

12. The doorbell camera of claim 10, further comprising:

at least one infrared light emitting diode coupled to an exterior housing of the doorbell camera.

13. The doorbell camera of claim 10, wherein when the processor detects the object, the instructions are further executable to instruct the processor to:

detect a presence of the object located within 90 degrees, inclusive, to 180 degrees, inclusive, upward from a midline horizontal viewing plane of a lens coupled to the doorbell camera.

14. The doorbell camera of claim 10, wherein when the processor detects the object, the instructions are further executable to instruct the processor to:

detect a presence of the object located within a range inclusive of 90 degrees on either side of a midline vertical viewing plane of a lens coupled to the doorbell camera.

15. The doorbell camera of claim 10, wherein when the processor detects the object, the instructions are further executable to instruct the processor to:

detect a presence of the object located within zero degrees, inclusive, to 90 degrees, inclusive, downward from a midline horizontal viewing plane of a lens coupled to the doorbell camera.

16. The doorbell camera of claim 10, wherein when the processor detects the object, the instructions are further executable to instruct the processor to:

detect a presence of the object located within six inches from a lens coupled to the doorbell camera.

17. The doorbell camera of claim 10, wherein when the processor detects the object, the instructions are further executable to instruct the processor to:

receive data from a sensor coupled to the doorbell camera, the sensor capturing images at an aspect ratio of 4 to 3.

18. The doorbell camera of claim 17, wherein when the processor receives data, the instructions are further executable to instruct the processor to:

convert the images captured at the aspect ratio of 4 to 3 into images having an aspect ratio of 1 to 1.

19. The doorbell camera of claim 18, wherein the instructions are further executable to instruct the processor to:

transmit the converted images to the user.

20. A non-transitory computer-readable medium storing computer-executable code for security and/or automation systems, the code executable by a processor to:

detect, by a doorbell camera, an object located within a first pre-determined distance from the doorbell camera based at least in part on a movement of the object within the first pre-determined distance, wherein the movement of the object is at least in part towards the entry of the structure;

analyze images of the object captured by the doorbell camera to identify the object, triggered by the detecting that the object is located at the first pre-determined distance from the entry of the structure, wherein the analyzing is irrespective of a manual interaction with a security automation component, wherein the analyzing comprises identifying an email delivery confirmation, identifying a tracking number in the email delivery confirmation, and confirming a validity of the email delivery confirmation and the tracking number;

identify, by the doorbell camera, a suggested security action for the security and automation system to perform based at least in part on the analyzing;

transmit the suggested security action to the security and automation system; and

transmit, in response to identifying the suggested security action, a message to a user associated with the security and automation system regarding the suggested security action, wherein transmitting the message comprises receiving a written message, translating the written message into a verbal message, and broadcasting the verbal message at or near the entry to the structure.