Methods and systems for home monitoring and control

• US 10,393,589 B2
• Filed: 05/07/2018
• Issued: 08/27/2019
• Est. Priority Date: 09/21/2012
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google LLC (Alphabet Inc.)
• Inventors: Fadell, Anthony M., Rogers, Matthew L., Matsuoka, Yoky, Sloo, David, Veron, Maxime, Guenette, Isabel I., Honjo, Shigefumi
• Primary Examiner(s): Ramakrishnaiah, Melur
• Application Number:
  US15/972,648
• Publication Number:
  US 20180252588A1
• Time in Patent Office: 477 Days
• Field of Search: 348 1401- 1416, 348142, 348152
• CPC Class Codes: G01J 5/025 Interfacing a pyrometer to an external device or network; User interface
• CPC Class Codes: G01J 5/041 Mountings in enclosures or in a particular environment
• CPC Class Codes: G01J 5/0806 Focusing or collimating elements, e.g. lenses or concave mirrors
• CPC Class Codes: G06V 40/103 Static body considered as a whole, e.g. static pedestrian or occupant recognition
• CPC Class Codes: G08B 13/193 using focusing means
• CPC Class Codes: G08B 17/00 Fire alarms; Alarms responsive to explosion
• CPC Class Codes: G08B 17/10 Actuation by presence of smoke or gases , e.g. automatic alarm devices for analysing flowing fluid materials by the use of optical means
• CPC Class Codes: G08B 17/11 using an ionisation chamber for detecting smoke or gas
• CPC Class Codes: G08B 17/113 Constructional details
• CPC Class Codes: H01H 9/02 Bases, casings, or covers accommodating more than one switch or a switch and another electrical component H02B1/26
• CPC Class Codes: H02J 13/00 Circuit arrangements for providing remote indication of network conditions, e.g. an instantaneous record of the open or closed condition of each circuitbreaker in the network; Circuit arrangements for providing remote control of switching means in a power distribution network, e.g. switching in and out of current consumers by using a pulse code signal carried by the network
• CPC Class Codes: H02J 3/00 Circuit arrangements for ac mains or ac distribution networks
• CPC Class Codes: H04L 12/282 based on user interaction within the home receiver circuitry for displaying additional information being controlled by a remote control apparatus H04N21/42204
• CPC Class Codes: H04L 12/2834 Switching of information between an external network and a home network access arrangements H04L12/2856
• CPC Class Codes: H04L 2012/2841 Wireless
• CPC Class Codes: H05B 47/19 via wireless transmission
• CPC Class Codes: H05B 47/195 the transmission using visible or infrared light
• CPC Class Codes: Y02B 70/30 Systems integrating technologies related to power network operation and communication or information technologies for improving the carbon footprint of the management of residential or tertiary loads, i.e. smart grids as climate change mitigation technology in the buildings sector, including also the last stages of power distribution and the control, monitoring or operating management systems at local level
• CPC Class Codes: Y02D 30/70 in wireless communication networks
• CPC Class Codes: Y04S 20/20 End-user application control systems
• CPC Class Codes: Y10T 29/49002 : Electrical device making

Abstract

This application is directed to a method of home monitoring and control implemented by a doorbell installed at a door of a home, an application executable by a monitoring device, and a remote server. The doorbell has a button that, upon being touched, depressed or activated, wirelessly causes an audio speaker of an electronic device to sound an audible notification and/or a message to be sent to a monitoring device associated with an occupant of the home to indicate presence of a person at the door. The doorbell also has a camera that captures video data within a field of view. The remote server receives the video data from the doorbell and relays them to the monitoring device. The application receives and displays at least a portion of the video data captured by the camera.

Claims

1. A method, comprising:

(1) at a doorbell installed at a door of a home, wherein the doorbell includes a button, a camera, a doorbell speaker, a processor and a communication component;

in response to the button being touched, depressed or activated, wirelessly sending a first communication to cause an audio speaker of an electronic device to sound an audible notification and/or a message to be sent to a monitoring device associated with an occupant of the home to indicate presence of a person at the door;

in response to a detection via a remote server that an unknown individual is approaching the home, broadcasting to the unknown individual via the doorbell speaker an audible notice;

capturing video data within a field of view by the camera; and

causing, by the processor, the communication component to wirelessly stream via a remote server the video data captured by the camera to a monitoring device;

(2) at the monitoring device;

executing an application;

receiving from the doorbell via the remote server at least a portion of the video data captured by the camera of the doorbell; and

displaying the received video data captured by the camera of the doorbell; and

(3) at the remote server, wherein the remote server is located remotely from the doorbell, the monitoring device and the audio speaker;

receiving from the doorbell via the communication component the video data captured by the camera and streamed to the remote server;

storing the received video data; and

relaying the received video data to the monitoring device.

2. The method of claim 1, further comprising:

receiving by the remote server the message indicating the presence of the person at the door; and

relaying the message to the monitoring device by the remote server.

3. The method of claim 1, wherein the electronic device is distinct from the doorbell and is configured to communicate wirelessly with the doorbell, further comprising:

in response to the first communication, sounding the audible notification via the audio speaker in response to the first communication from the doorbell.

4. The method of claim 3, wherein the audio speaker is located in a room, further comprising:

in accordance with a determination that the room is occupied by at least a person, sounding the audible notification within the room.

5. The method of claim 1, wherein the doorbell further includes a speaker, further comprising, at the doorbell:

in accordance with a determination that the person is within a predetermined distance from the door, broadcasting via the speaker a question asking whether the person is a delivery person;

receiving a response from the person via a user interface on the doorbell; and

in accordance with a determination that the person is a delivery person based on the response, presenting a user instruction to instruct the person to place a package to be delivered in a location proximate to the doorbell.

6. The method of claim 1, wherein the audible notification is configured to be sounded within a room in accordance with a determination that the room is occupied by one or more occupants having a predetermined relationship with the person at the door.

7. The method of claim 1, wherein the audible notification includes one or more songs, and the audio speaker is configured to play a distinct one of the one or more songs identified according to an identity of the occupant or an identity of the person at the door.

8. The method of claim 1, further comprising:

receiving by the doorbell air quality information from a detector via the remote server.

9. The method of claim 1, wherein the doorbell further includes a battery configured to at least partially power and enable operations of the doorbell.

10. The method of claim 1, further comprising:

identifying the person based on one or more facial features or one or more personal gaits by the doorbell; and

storing by the remote server profile data about people approaching the doorbell, wherein the profile data include the one or more facial features or the one or more personal gaits of the person.

11. The method of claim 1, wherein the doorbell further includes a speaker, further comprising, at the doorbell:

in accordance with a determination that the person is within a predetermined distance from the door, broadcasting via the speaker a question inquiring about an identity of the person; and

in response to the question, receiving from the person a physical gesture response in the video data captured by the camera, wherein the monitoring device is configured to identify the person based on the physical gesture response, display the identity and/or image of the person, and receive a user instruction to grant an access right to the person.

12. The method of claim 11, further comprising:

receiving by a lock to the door the user instruction to unlock the door for the person, wherein the lock is configured to receive the user instruction from the monitoring device via the remote server.

13. The method of claim 1, wherein the doorbell further includes a microphone and a speaker, further comprising, at the doorbell:

in accordance with a determination that the person is within a predetermined distance from the door, broadcasting via the speaker a question inquiring about an identity of the person; and

in response to the question, receiving from the person an audible response captured by the microphone, wherein the monitoring device is configured to identify the person based on the audible response, display the identity of the person to a user of the monitoring device, and receive a user instruction to grant an access right to the person.

14. The method of claim 1, wherein the remote server is configured to determine a location of a child in the field of view based on the video data captured by the camera, and the audible notification includes information of the location of the child and is sent to the monitoring device.

15. The method of claim 1, wherein the electronic device includes a first electronic device, further comprising:

at a second electronic device, wherein the second electronic device includes a second audio speaker and has wireless capability;

communicating wirelessly with the doorbell to sound a second audible notification in response to the doorbell being touched, depressed or activated, concurrently with the sounding of the audible notification by the audio speaker of the first electronic device.

16. A home monitoring and control system, comprising:

a doorbell installed at a door of a home including;

a button configured to, upon being touched, depressed or activated, wirelessly initiate a first communication to cause an audio speaker of an electronic device to sound an audible notification and/or a message to be sent to a monitoring device associated with an occupant of the home to indicate presence of a person at the door;

a camera configured to capture video data within a field of view;

a doorbell speaker configured to broadcasting to the unknown individual an audible notice in response to a detection via a remote server that an unknown individual is approaching the home; and

a processor and a communication component, wherein the processor is configured to cause the communication component to wirelessly stream via a remote server the video data captured by the camera to the monitoring device; and

an application executable by the monitoring device, the application being configured to, when executed by the monitoring device, receive from the doorbell via the remote server at least a portion of the video data captured by the camera of the doorbell, and display the received video data captured by the camera of the doorbell;

wherein the audio speaker is distinct from the doorbell, and is configured to communicate wirelessly with the doorbell to sound the audible notification in response to the first communication from the doorbell;

wherein the remote server is located remotely from the doorbell, the monitoring device and the audio speaker, and the remote server is configured to;

receive from the doorbell via the communication component the video data captured by the camera and streamed to the remote server;

receive the message indicating the presence of the person at the door;

store the received video data; and

relay the received video data and the message to the monitoring device.

17. The home monitoring and control system of claim 16, wherein the doorbell includes an RFID scanner, and the processor is configured to obtain identification information of the person by the RFID scanner, and wherein the monitoring device is configured to identify the person based on the identification information collected by the RFID scanner and receive a user instruction to grant an access right to the person based on the identification information collected by the RFID scanner.

18. The home monitoring and control system of claim 16, wherein the processor is configured to detect a visitor activity including whether the person is approaching or leaving the door and generate a security control signal to control settings of a security system according to the detected visitor activity.

19. The home monitoring and control system of claim 18, wherein the processor is configured to in accordance with the settings of the security system, activate the security system when the person is approaching the door and deactivate the security system when the person is leaving the door.

20. The method home monitoring and control system of claim 16, wherein the audible notice broadcast by the doorbell to the unknown individual includes a notice that he or she is being monitored by a home monitoring and control system.