Personal intermediary access device

• US 10,573,106 B1
• Filed: 03/22/2017
• Issued: 02/25/2020
• Est. Priority Date: 03/22/2017
• Status: Active Grant

• Current Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Original Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Inventors: Brady, Tye Michael, Mishra, Pragyana K.
• Primary Examiner(s): Williams, Jeffery A
• Application Number:
  US15/466,723
• Time in Patent Office: 1,070 Days
• Field of Search: 348156
• CPC Class Codes: B25J 19/021 Optical sensing devices
• CPC Class Codes: B25J 19/023 including video camera means
• CPC Class Codes: G05B 19/048 Monitoring; Safety
• CPC Class Codes: G05B 2219/2642 Domotique, domestic, home control, automation, smart house
• CPC Class Codes: G06F 21/32 using biometric data, e.g. fingerprints, iris scans or voiceprints
• CPC Class Codes: G06Q 10/083 Shipping
• CPC Class Codes: G06V 20/52 Surveillance or monitoring of activities, e.g. for recognising suspicious objects recognising microscopic objects G06V20/69
• CPC Class Codes: G06V 40/1365 Matching; Classification
• CPC Class Codes: G06V 40/166 using acquisition arrangements
• CPC Class Codes: G06V 40/172 Classification, e.g. identification
• CPC Class Codes: G07C 2009/00865 remotely by wireless communication
• CPC Class Codes: G07C 9/00309 operated with bidirectional data transmission between data carrier and locks
• CPC Class Codes: G07C 9/00563 using personal physical data of the operator, e.g. finger prints, retinal images, voicepatterns
• CPC Class Codes: G07C 9/00571 operated by interacting with a central unit
• CPC Class Codes: G07C 9/00896 specially adapted for particular uses
• CPC Class Codes: G07C 9/20 involving the use of a pass
• CPC Class Codes: G10L 17/00 Speaker identification or verification techniques
• CPC Class Codes: G10L 17/22 Interactive procedures; Man-machine interfaces
• CPC Class Codes: H04W 4/14 Short messaging services, e.g. short message services [SMS] or unstructured supplementary service data [USSD]
• CPC Class Codes: H04W 4/21 for social networking applications
• CPC Class Codes: H04W 4/38 : for collecting sensor information
• CPC Class Codes: H04W 4/80 : Services using short range communication, e.g. near-field communication [NFC], radio-frequency identification [RFID] or low energy communication
• CPC Class Codes: H04W 84/12 : WLAN [Wireless Local Area Networks]

Abstract

An intermediary device may be configured to allow an authorized visitor to access a secure facility (such as a home) on behalf of an owner. The intermediary device may generate an authenticator and provide the authenticator to a service provider, who may then present the authenticator to the intermediary device upon arriving at the facility. The intermediary device may unlock or open, or lock and close, any doors within the facility as necessary in order to grant access to a specific portion of the facility and restrict access to other portions of the facility. The intermediary device may also capture, or cause the capture of, images or other data regarding actions taken by the service provider, and establish a communications channel with the owner for the exchange of information or data regarding such actions, or any events or conditions of the facility.

Claims

1. A home comprising:

a structure defining an interior comprising a plurality of rooms;

a first door between the interior of the structure and an exterior of the structure, wherein the first door comprises a first electromechanical lock that may be configured in at least one of a locked state or an unlocked state;

a second door associated with a first one of the plurality of rooms, wherein the second door comprises a second electromechanical lock that may be configured in at least one of a locked state or an unlocked state;

an intermediary device provided within the home, wherein the intermediary device comprises at least one computer processor, at least one memory component, at least one transceiver and at least one power source disposed within a housing, wherein the at least one transceiver is configured to communicate according to at least;

a first communications protocol over at least a first network comprising at least a portion of the Internet; and

a second communications protocol over a second network, wherein the second network is a wireless personal area network; and

wherein the at least one computer processor of the intermediary device is in communication with at least the first electromechanical lock and the second electromechanical lock, and

wherein the at least one computer processor is configured to at least;

determine that a delivery of an item is to occur on at least one of a first day or a first time, wherein the item is to be delivered from a fulfillment center to the first one of the plurality of rooms;

generate an authenticator associated with the delivery of the item;

transmit at least a first electronic message comprising the authenticator to at least one of the fulfillment center or a worker associated with the fulfillment center over at least the first network according to the first communications protocol;

receive at least a second electronic message from a mobile device of the worker over the second network according to the second communications protocol;

determine that the second electronic message comprises the authenticator; and

in response to determining that the second electronic message comprises the authenticator,

configure the first electromechanical lock in the unlocked state; and

configure the second electromechanical lock in the unlocked state.

2. The home of claim 1, further comprising at least one imaging device including at least a portion of the interior of the structure within a field of view,

wherein the at least one computer processor of the intermediary device is in communication with the at least one imaging device, and

wherein the at least one computer processor is further configured to at least:

capture imaging data by the at least one imaging device.

3. The home of claim 1, further comprising:

a third door associated with a second one of the plurality of rooms, wherein the third door comprises a third electromechanical lock that may be configured in at least one of a locked state or an unlocked state,

wherein the at least one computer processor of the intermediary device is in communication with at least the third electromechanical lock, and

wherein the at least one computer processor is configured to at least;

in response to determining that the second electronic message comprises the authenticator,

configure the third electromechanical lock in the locked state.

4. A computer-implemented method comprising:

receiving, by an intermediary device provided within a secure facility, a first electronic message from a mobile device of a worker associated with a service provider,

wherein the intermediary device comprises at least one computer processor, at least one memory component, and at least one transceiver disposed within a housing,

wherein the at least one transceiver is configured to communicate according to at least a first communications protocol over a wireless personal area network and a second communications protocol over at least a portion of the Internet, and

wherein the first electronic message is transmitted according to the first communications protocol;

authenticating, by the intermediary device, the worker based at least in part on the first electronic message;

determining, by the intermediary device, that at least one of the first electronic message or the worker is associated with a predetermined task to be performed within an interior of the secure facility on behalf of the service provider;

identifying, by the intermediary device, a location within the interior of the secure facility associated with the predetermined task; and

causing, by the intermediary device, at least a first portal between an exterior of the secure facility and the interior of the secure facility to be unlocked or opened.

5. The computer-implemented method of claim 4, wherein the housing is mounted to at least one wall separating the exterior of the secure facility and the interior of the secure facility.

6. The computer-implemented method of claim 4, further comprising:

determining, by the intermediary device, that the predetermined task is to be performed at the location;

generating, by the intermediary device, an authenticator associated with one of the predetermined task or the service provider; and

transmitting, by the intermediary device, a second electronic message comprising the authenticator to the service provider, wherein the second electronic message is transmitted according to the second communications protocol, and

wherein authenticating the worker comprises;

determining whether the first electronic message comprises the authenticator,

wherein the worker is authenticated in response to determining that the first electronic message comprises the authenticator.

7. The computer-implemented method of claim 4, further comprising:

receiving, by the intermediary device, a third electronic message from a computer device of an occupant of at least the location within the interior of the secure facility, wherein the third electronic message identifies the predetermined task and at least one of;

a date associated with the predetermined task;

a time associated with the predetermined task;

or

the location within the interior of the secure facility,

wherein the third electronic message is transmitted according to one of the first communications protocol or the second communications protocol, and

wherein the authenticator is generated in response to the third electronic message.

8. The computer-implemented method of claim 4, wherein the intermediary device further comprises at least one imaging device, and

wherein authenticating the worker further comprises:

capturing imaging data by the at least one imaging device;

determining, by the intermediary device, that the imaging data includes at least one face; and

recognizing, by the intermediary device, the at least one face as corresponding to the worker according to at least one recognition technique.

9. The computer-implemented method of claim 4, wherein the intermediary device further comprises at least one microphone, and

wherein authenticating the worker further comprises:

receiving acoustic data by the at least one microphone; and

determining, by the intermediary device, that the acoustic data comprises vocal signals corresponding to the worker by at least one recognition technique.

10. The computer-implemented method of claim 4, wherein the intermediary device further comprises at least one imaging device, and

wherein authenticating the worker further comprises:

receiving contact by at least one finger of the worker with at least a portion of the intermediary device; and

recognizing, by the intermediary device, a fingerprint of the worker based at least in part on the contact,

wherein the work is authenticated based at least in part on the fingerprint.

11. The computer-implemented method of claim 4, wherein the first communications protocol is one of:

Bluetooth;

or

near field communication, and

wherein the second communications protocol is one of;

wireless fidelity;

or

SMS or MMS text messaging.

12. The computer-implemented method of claim 4, wherein the predetermined task is a delivery of at least one item to the interior of the secure facility.

13. The computer-implemented method of claim 4, further comprising:

receiving, by the intermediary device, a request for an authorization associated with the predetermined task, wherein the request is at least one of;

at least one spoken word requesting the authorization;

or

at least a second electronic message requesting the authorization, wherein the second electronic message is transmitted according to at least one of the first communications protocol or the second communications protocol;

transmitting, by the intermediary device, a third electronic message comprising the request to a computer device of an occupant of the secure facility, wherein the third electronic message is transmitted according to at least one of the first communications protocol or the second communications protocol; and

receiving, by the intermediary device, a fourth electronic message from the computer device of the occupant, wherein the fourth electronic message is transmitted according to at least one of the first communications protocol or the second communications protocol,

wherein the fourth electronic message comprises the authorization.

14. The computer-implemented method of claim 13, wherein the authorization is for at least one of labor or materials associated with the predetermined task.

15. The computer-implemented method of claim 4, wherein causing at least the first portal between the exterior of the secure facility and the interior of the secure facility to be unlocked or opened further comprises:

determining, by the intermediary device, a path between the first portal and the location within the interior of the secure facility.

16. The computer-implemented method of claim 15, wherein causing at least the first portal between the exterior of the secure facility and the interior of the secure facility to be unlocked or opened further comprises:

identifying, by the intermediary device, at least a third portal not along the path; and

causing, by the intermediary device, at least the third portal to be locked or closed.

17. The computer-implemented method of claim 15, further comprising:

activating, by the intermediary device, at least one appliance within a vicinity of the path.

18. The computer-implemented method of claim 4, further comprising:

identifying, by the intermediary device, an environmental condition associated with the predetermined task; and

establishing, by the intermediary device, the environmental condition within the interior of the secure facility.

19. The computer-implemented method of claim 15, further comprising:

identifying, by the intermediary device, at least one imaging device including at least a portion of the path or the location within the interior of the secure facility within a field of view of the at least one imaging device; and

operating, by the intermediary device, the at least one imaging device to capture imaging data regarding at least the portion of the path or the location.

20. The computer-implemented method of claim 4, further comprising:

determining, by the intermediary device, that the predetermined task is complete;

determining, by the intermediary device, that the worker has departed the secure facility;

causing, by the intermediary device, at least the first portal to be locked or closed;

generating, by the intermediary device, information regarding the completion of the predetermined task; and

transmitting, by the intermediary device, a second electronic message to a computer device of an occupant of the secure facility, wherein the second electronic message comprises at least some of the information regarding the completion of the predetermined task, and

wherein the second electronic message is transmitted according to the second communications protocol.

21. The computer-implemented method of claim 15, further comprising:

capturing imaging data by at least one imaging device, wherein the at least one imaging device includes at least a portion of the path or the location within the interior of the secure facility within a field of view of the at least one imaging device,

wherein the at least one imaging device is associated with at least one of;

the intermediary device;

the worker;

or

an autonomous mobile robot within the secure facility; and

transmitting, by the intermediary device, a second electronic message to a computer device of an occupant of the secure facility, wherein the second electronic message comprises at least some of the information regarding the completion of the predetermined task,

wherein the second electronic message comprises at least one of;

at least some of the imaging data;

or

a link to at least some of the imaging data, and

wherein the second electronic message is transmitted according to the second communications protocol.

25. The computer-implemented method of claim 15, wherein causing at least the first portal between the exterior of the secure facility and the interior of the secure facility to be unlocked or opened further comprises:

identifying, by the intermediary device, at least a second portal along the path; and

causing, by the intermediary device, at least the second portal to be unlocked or opened.

22. An intermediary device comprising:

a housing having at least one computer processor, at least one transceiver and at least one data store disposed therein,

wherein the intermediary device is configured for operation within a secure facility,

wherein the at least one transceiver is configured to communicate according to at least;

a first communications protocol over at least a first network comprising at least a portion of the Internet; and

a second communications protocol over a second network, wherein the second network is a wireless personal area network, and

wherein the at least one computer processor is configured to at least;

receive, by the at least one transceiver, a first electronic message indicative of a task to be performed in association with the facility, wherein the first electronic message is received according to one of the first communications protocol or the second communications protocol;

generate an authenticator associated with the task;

transmit, by the at least one transceiver, a second electronic message comprising the authenticator to at least one service provider, wherein the second electronic message is transmitted according to the first communications protocol;

receive, by the at least one transceiver, a third electronic message from a mobile device of a worker associated with the service provider, wherein the third electronic message is received according to the second communications protocol;

determine that the third electronic message comprises the authenticator;

authenticate the worker based at least in part on the third electronic message;

transmit, by the at least one transceiver, a fourth electronic message to an electromechanical lock, wherein the fourth electronic message comprises an instruction to unlock a portal, and wherein the fourth electronic message is transmitted according to the second communications protocol; and

grant access to the facility to the worker.

23. The intermediary device of claim 22, further comprising an imaging device including at least a portion of the entrance within a field of view,

wherein the at least one computer processor is configured to at least:

in response to receiving the third electronic message,

capture, by the imaging device, at least one image frame, and

wherein authenticating the worker further comprises;

recognizing a face of the worker in the at least one image frame.

24. The intermediary device of claim 22, wherein the first communications protocol is a Wireless Fidelity protocol, and

wherein the second communications protocol is a Bluetooth protocol.