Video recognition in frictionless access control system

• US 9,865,144 B2
• Filed: 05/20/2016
• Issued: 01/09/2018
• Est. Priority Date: 08/19/2014
• Status: Active Grant

• Current Assignee: Tyco Fire & Security GmbH (Johnson Controls International plc)
• Original Assignee: Sensormatic Electronics LLC (Johnson Controls International plc)
• Inventors: Trani, James
• Primary Examiner(s): Bocure, Tesfaldet
• Application Number:
  US15/160,753
• Publication Number:
  US 20160267760A1
• Time in Patent Office: 599 Days
• Field of Search: 340 53, 340 521, 340 561, 340 564
• CPC Class Codes: G06V 40/172 Classification, e.g. identification
• CPC Class Codes: G06V 40/25 Recognition of walking or running movements, e.g. gait recognition
• CPC Class Codes: G07C 2009/00769 with data transmission performed by wireless means
• CPC Class Codes: G07C 9/00174 Electronically operated locks; Circuits therefor; Nonmechanical keys therefor, e.g. passive or active electrical keys or other data carriers without mechanical keys mechanical locks with electric permutation E05B49/00; arrangements for sensing or reading record carriers G06K7/00; electronic switching H03K17/00
• CPC Class Codes: G07C 9/00563 using personal physical data of the operator, e.g. finger prints, retinal images, voicepatterns
• CPC Class Codes: G07C 9/28 the pass enabling tracking or indicating presence
• CPC Class Codes: G08B 13/19695 Arrangements wherein non-video detectors start video recording or forwarding but do not generate an alarm themselves
• CPC Class Codes: H04B 7/04 using two or more spaced independent antennas
• CPC Class Codes: H04L 63/0861 using biometrical features, e.g. fingerprint, retina-scan cryptographic mechanisms or cryptographic arrangements for entity authentication using biological data H04L9/3231
• CPC Class Codes: H04W 12/08 Access security
• CPC Class Codes: H04W 12/63 Location-dependent; Proximity-dependent
• CPC Class Codes: H04W 4/021 Services related to particular areas, e.g. point of interest [POI] services, venue services or geofences
• CPC Class Codes: H04W 4/029 Location-based management or tracking services

Abstract

A system and method for video recognition of users in a frictionless access control system are disclosed. The access control system includes a positioning unit that tracks locations of users carrying user devices relative to an access point of a premises, where the user devices transmit user information identifying the users via wireless signals. The system determines whether the users are authorized to pass through the access point based on the wireless signals from the user devices. One or more video cameras also capture video data of the users when the users are preferably located within a threshold area of the access point. Then, the system confirms the identity of each authorized user by comparing video identification information of the user determined from the video data, such as facial recognition information, to stored video identification information for each user. Confirmed users can then pass through the access point.

Claims

1. An access control system for monitoring an access point, comprising:

a positioning unit for tracking locations of users carrying user devices relative to the access point based on wireless signals from the user devices;

one or more video cameras that generate video data of the users;

wherein the access control system determines whether the users are authorized to pass through the access point based on the wireless signals from the user devices, confirms identities of authorized users based upon video identification information of the users determined from the video data, and enables confirmed users to pass through the access point.

2. The system of claim 1, wherein the video identification information includes facial image information of the users.

3. The system of claim 1, wherein the video identification information includes gait information of the users.

4. The system of claim 1, wherein at least one of the video cameras generates video data of the users when the users are within a threshold area of the access point.

5. The system of claim 1, further comprising a video analysis system that analyzes the video data from the video cameras to determine the video identification information of the users from the video data.

6. The system of claim 1, further comprising a system controller including a system controller database which stores a user account for each of the users, and wherein each user account includes:

user information for each user;

video identification information for each user; and

authorization information for each user that indicates if the user can enter the access point.

7. The system of claim 1, wherein the positioning unit includes at least one antenna that determines the locations of the user devices from wireless signals sent by the user devices, wherein the user devices send user information for identifying the users in the wireless signals.

8. The system of claim 1, wherein the access control system determines whether the users are authorized to pass through the access point based on the wireless signals from the user devices by:

extracting user information that identifies the users sent from wireless signals sent by the user devices;

matching the received user information to stored user information for the users; and

determining that the matched user information is referenced within stored authorization information for the users that indicates which users can enter the access point.

9. The system of claim 1, wherein the access control system confirms the identities of the authorized users based upon the video identification information of the users determined from the video data by matching the video identification information of the users determined from the video data to stored video identification information for each user.

10. The system of claim 1, wherein the access control system sends event information in response to determining whether the authorized users are confirmed users or non-confirmed users.

11. A method for controlling access of users to an access point, comprising:

a positioning unit tracking locations of users carrying user devices relative to the access point based on wireless signals from the user devices;

one or more video cameras generating video data of the users; and

determining whether the users are authorized to pass through the access point based on the wireless signals from the user devices;

confirming identities of the authorized users to determine whether the authorized users are confirmed users based upon video identification information of the users determined from the video data; and

enabling the confirmed users to pass through the access point.

12. The method of claim 11, further comprising the video identification information including facial image information of the users.

13. The method of claim 11, further comprising the video identification information including gait information of the users.

14. The method of claim 11, further comprising at least one of the video cameras generating video data of the users when the users are within a threshold area of the access point.

15. The method of claim 11, further comprising a video analysis system analyzing the video data from the video cameras to determine the video identification information of the users from the video data.

16. The method of claim 11, further comprising the positioning unit including at least one antenna that determines the locations of the user devices from wireless signals sent by the user devices, wherein the user devices send user information for identifying the users in the wireless signals.

17. The method of claim 11, wherein determining whether the users are authorized to pass through the access point based on the wireless signals from the user devices comprises:

receiving user information that identifies the users sent from the positioning unit, which the positioning unit extracts from wireless signals sent by the user devices;

matching the received user information to stored user information for the users; and

determining that the matched user information is referenced within stored authorization information for the users that indicates which users can enter the access point.

18. The method of claim 11, wherein confirming the identities of the authorized users based upon the video identification information of the users determined from the video data comprises matching the video identification information of the users determined from the video data to stored video identification information for each user.

19. The method of claim 11, further comprising sending event information in response to determining whether the authorized users are confirmed users or non-confirmed users.