Interacting with a detected visitor at an entryway to a smart-home

• US 9,640,055 B2
• Filed: 12/31/2014
• Issued: 05/02/2017
• Est. Priority Date: 09/21/2012
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Fadell, Anthony Michael, Rogers, Matthew Lee, Matsuoka, Yoky, Sloo, David, Honjo, Shigefumi, McGaraghan, Scott A., Plitkins, Michael, Veron, Maxime, Guenette, Isabel
• Primary Examiner(s): Nwugo, Ojiako
• Application Number:
  US14/587,599
• Publication Number:
  US 20150116109A1
• Time in Patent Office: 853 Days
• Field of Search: 340501, 348143
• CPC Class Codes: G06Q 10/0631 Resource planning, allocation, distributing or scheduling for enterprises or organisations
• CPC Class Codes: G06Q 10/083 Shipping
• CPC Class Codes: G08B 19/005 combined burglary and fire alarm systems
• CPC Class Codes: G08B 25/008 Alarm setting and unsetting, i.e. arming or disarming of the security system
• CPC Class Codes: G08B 27/003 Signalling to neighbouring houses
• CPC Class Codes: G08B 29/185 Signal analysis techniques for reducing or preventing false alarms or for enhancing the reliability of the system

Abstract

This patent specification relates to apparatus, systems, methods, and related computer program products for providing home security/smart home objectives. More particularly, this patent specification relates to a plurality of devices, including intelligent, multi-sensing, network-connected devices, that communicate with each other and/or with a central server or a cloud-computing system to provide any of a variety of useful home security/smart home objectives.

Claims

1. A method of handling a visitor at a smart environment that comprises a plurality of smart devices, the method comprising:

detecting visitor information associated with the visitor at the smart environment using a first smart device of the plurality of smart devices;

analyzing the detected visitor information using a computing system that is communicatively coupled to the first smart device; and

based on the analyzing, providing feedback from the computing system to the visitor via a second smart device of the plurality of smart devices, wherein;

the feedback comprises

a pre-recorded system message from the computing system to the visitor;

the method further comprises, prior to the providing the feedback, automatically selecting, with the computing system, the pre-recorded message from a plurality of pre-recorded messages based on the analyzing;

the analyzing comprises determining at least one of the following;

the specific identity of the visitor;

an identity of a visitor class with which the visitor is a member; and

an intention of the visitor; and

when the determining comprises determining that the visitor is a solicitor, the selected pre-recorded message is indicative of instructions for the visitor to do at least one of the following;

leave the smart environment; and

record a message using a third smart device of the plurality of smart devices.

2. The method of claim 1, wherein, when the determining comprises determining that the visitor is a solicitor, the selected pre-recorded message is indicative of instructions for the visitor to leave the smart environment.

3. The method of claim 1, wherein, when the determining comprises determining that the visitor is a solicitor, the selected pre-recorded message is indicative of instructions for the visitor to record a message using a third smart device of the plurality of smart devices.

4. The method of claim 1, wherein the pre-recorded message is stored on the second smart device.

5. The method of claim 1, wherein the method further comprises, prior to the providing the feedback, transmitting the selected pre-recorded message from the computing system to the second smart device.

6. The method of claim 1, wherein the analyzing comprises determining an intention of the visitor.

7. The method of claim 1, wherein, when the determining comprises determining that the visitor has a package for delivery, the selected pre-recorded message is indicative of instructions for the visitor to deposit the package at the smart environment.

8. The method of claim 1, wherein, when the determining comprises determining that the visitor is a solicitor, the selected pre-recorded message is indicative of instructions for the visitor to do each one of the following:

leave the smart environment; and

record a message using a third smart device of the plurality of smart devices.

9. The method of claim 1, wherein the feedback further comprises a user message from a user of the smart environment to the visitor.

10. A method of handling a visitor at a smart environment that comprises a plurality of smart devices, the method comprising:

detecting visitor information associated with the visitor at the smart environment using a first smart device of the plurality of smart devices;

analyzing the detected visitor information using a computing system that is communicatively coupled to the first smart device; and

based on the analyzing, providing feedback from the computing system to the visitor via a second smart device of the plurality of smart devices, wherein;

the feedback comprises a pre-recorded system message from the computing system to the visitor;

the method further comprises, prior to the providing the feedback, automatically selecting, with the computing system, the pre-recorded message from a plurality of pre-recorded messages based on the analyzing;

the analyzing comprises determining at least one of the following;

the specific identity of the visitor;

an identity of a visitor class with which the visitor is a member; and

an intention of the visitor;

when the determining comprises determining that the visitor is an emergency responder, the selected pre-recorded message is indicative of instructions for the visitor to access an entryway to a portion of the smart environment; and

the method further comprises, prior to the providing, identifying, using the computing system, that a third smart device of the plurality of smart devices detected a hazard condition at the smart environment within a particular amount of time.

11. The method of claim 10, wherein the feedback further comprises information indicative of the detected hazard condition.

12. A system for handling a visitor at a smart environment, the system comprising:

a plurality of smart devices at the smart environment; and

a computing system operative to;

receive visitor data from at least one sensor of a first smart device of the plurality of smart devices, wherein the visitor data is associated with the visitor at the smart environment;

process at least a portion of the received visitor data to determine that the visitor is an emergency responder;

based on the processed visitor data, provide feedback from the computing system to the visitor via a second smart device of the plurality of smart devices; and

prior to providing the feedback, identify that a third smart device of the plurality of smart devices detected a hazard condition at the smart environment, wherein the feedback comprises;

a pre-recorded system message from the computing system to the visitor indicative of instructions for the visitor to access an entryway to a portion of the smart environment; and

information indicative of the detected hazard condition.

13. The system of claim 12, wherein

the second smart device is an entryway interface smart device positioned at an entryway to a portion of the smart environment;

and

the entryway interface smart device comprises;

an output component operative to provide the feedback to the visitor; and

a doorbell component operative to be interacted with by a user for generating a request to contact an occupant of the smart environment.

14. The system of claim 13, wherein

the first smart device is the entryway interface smart device;

and

the entryway interface smart device further comprises at least one sensing component operative to detect the visitor data.

15. The system of claim 12, wherein the first smart device is the second smart device.