Wireless integration of security camera and door lock

• US 10,750,128 B2
• Filed: 02/20/2019
• Issued: 08/18/2020
• Est. Priority Date: 04/23/2018
• Status: Active Grant

• Current Assignee: Kuna systems corporation
• Original Assignee: Kuna systems corporation
• Inventors: Fu, Sai-Wai, Sampson, Harold G., Huang, Haomiao
• Primary Examiner(s): Findley, Christopher G
• Application Number:
  US16/280,377
• Publication Number:
  US 20190327448A1
• Time in Patent Office: 545 Days
• Field of Search: None
• CPC Class Codes: G08B 13/19613 Recognition of a predetermined image pattern or behaviour pattern indicating theft or intrusion
• CPC Class Codes: G08B 25/001 Alarm cancelling procedures or alarm forwarding decisions, e.g. based on absence of alarm confirmation
• CPC Class Codes: G08B 3/10 using electric transmission; using electromagnetic transmission
• CPC Class Codes: H04N 7/0806 the signals being two or more video signals H04N7/0803, H04N7/081 take precedence
• CPC Class Codes: H04N 7/142 Constructional details of the terminal equipment, e.g. arrangements of the camera and the display
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources
• CPC Class Codes: H04N 7/186 Video door telephones

Abstract

An apparatus includes an audio output device, an audio input device and a processor. The audio output device may be configured to generate an audio message. The audio input device may be configured to receive audio input. The processor may be configured to analyze the audio input to perform a first authentication of a user and determine a command corresponding to the audio input, determine a confidence level of a classification of a user based on the first authentication and authenticate the user if the confidence level is above a pre-determined threshold. The classification may correspond to an approved list of users. The confidence level may be adjusted in response to one or more authentication factors. If the user is authenticated, the processor may be configured to perform the command.

Claims

1. An apparatus comprising:

an audio output device configured to generate an audio message;

an audio input device configured to receive audio input;

and

a processor configured to (i) analyze said audio input to (a) determine a first authentication factor of a user, (b) determine a second authentication factor of said user and (c) determine a command corresponding to said audio input, (ii) determine a classification of said user based on a comparison of the first authentication factor with one or more stored values, (iii) determine a confidence level of said classification of said user based on an aggregate of said first authentication factor and said second authentication factor and (iv) authenticate said user if said confidence level is above a pre-determined threshold, wherein (a) said classification corresponds to an approved list of users, (b) said confidence level is adjusted in response to said authentication factors, (c) said first authentication factor and said second authentication factor are based on said analysis of said audio input, and (d) if said user is authenticated, said processor is configured to perform said command.

2. The apparatus according to claim 1, wherein (i) said apparatus further comprises a video capture device configured to capture video frames of an area, (ii) said processor is further configured to (a) perform video analysis on said video frames to detect an object in said area and (b) determine an adjustment to said confidence level based on said object detected in said video frames and (iii) said video analysis comprises generating a third authentication factor comprising one or more passive characteristics and one or more active characteristics, said third authentication factor to aggregate with said first and second authentication factors to generate said confidence level.

3. The apparatus according to claim 2, wherein said video capture device comprises (i) a first camera configured to capture a first field of view, (ii) a second camera configured to capture a second field of view, (iii) said video frames comprise video data captured by said first camera and said second camera and (iv) together said first field of view and said second field of view are configured to provide a head to toe coverage of a person.

4. The apparatus according to claim 2, wherein if said user is not authenticated, (i) said processor is configured to select said audio message to be output by said audio output device and (ii) said selection of said audio message is based on said video analysis.

5. The apparatus according to claim 1, wherein said apparatus further comprises a plurality of sensors, each configured to capture sensor data.

6. The apparatus according to claim 5, wherein (a) said processor is configured to implement sensor fusion to make inferences about said authentication factors received from said sensor data and (b) said confidence level is further determined based on said sensor fusion.

7. The apparatus according to claim 6, wherein said sensor fusion is used to analyze said authentication factors independently.

8. The apparatus according to claim 7, wherein said confidence level is adjusted in response to said sensor fusion based on at least one of said one or more stored values representing 2D face analysis, 3D face analysis, height estimation using triangulation from multiple cameras, a smartphone MAC address, visitor gait detection, vehicle sounds, a seashell effect, said audio input or a response to a request from said audio message.

9. The apparatus according to claim 8, wherein said sensor fusion is configured to implement two-factor authentication.

10. The apparatus according to claim 1, wherein (i) said approved list comprises a whitelist comprising a plurality of groups and categories of users, (ii) a blacklist comprises a plurality of groups and categories of users and (iii) said command is performed only if said user is in said whitelist that has permission to execute said command.

11. The apparatus according to claim 1, wherein said command is configured to control a device connected wirelessly to said apparatus.

12. The apparatus according to claim 11, wherein said device comprises at least one of a door lock, a garage door opener, an irrigation system, outdoor lighting or an alarm.

13. The apparatus according to claim 11, wherein said device comprises a sensor configured to capture sensor data.

14. The apparatus according to claim 13, wherein (i) said device is configured to communicate said sensor data to said apparatus wirelessly and (ii) said sensor data is used as one of said authentication factors.

15. The apparatus according to claim 1, wherein said apparatus is configured to (i) wirelessly connect to a plurality of outdoor devices and (ii) provide an internet connection for one or more of said plurality of outdoor devices.

16. The apparatus according to claim 15, wherein said apparatus implements a wireless outdoor hub configured to provide said command to said plurality of outdoor devices if said user is authenticated.

17. The apparatus according to claim 15, wherein (i) said apparatus is configured to receive input from an app via said internet connection and (ii) determine said command from said input.

18. The apparatus according to claim 1, wherein (i) said audio input is a voice command and (ii) said processor is configured to (a) determine said command from said audio input by comparing to said one or more stored values and (b) perform said authentication based on said audio input.

19. The apparatus according to claim 18, wherein (i) said voice command further comprises a passphrase and (ii) said passphrase is one of said stored values.

20. The apparatus according to claim 1, wherein (i) one of said stored values comprises a unique identifier implemented by an object in the possession of said user and (ii) said processor is configured to adjust said confidence level above said pre-determined threshold without analyzing said audio input in response to said unique identifier.