Accessing a secure region of an environment using visually identified behaviors relative to an access control device

• US 10,032,326 B1
• Filed: 01/25/2017
• Issued: 07/24/2018
• Est. Priority Date: 01/25/2017
• Status: Active Grant

• Current Assignee: Toshiba Global Commerce Solutions Holdings Corporation (Toshiba Corporation)
• Original Assignee: Toshiba Global Commerce Solutions Holdings Corporation (Toshiba Corporation)
• Inventors: Landers, Jr., John David, Herring, Dean Frederick, Wilson, Paul Morton, Steiner, David John, Wood, Kimberly Ann
• Primary Examiner(s): Nwugo, Ojiako
• Application Number:
  US15/415,309
• Publication Number:
  US 20180211460A1
• Time in Patent Office: 545 Days
• Field of Search: 340 5- 57
• CPC Class Codes: G06F 18/24 Classification techniques
• CPC Class Codes: G06V 20/52 Surveillance or monitoring of activities, e.g. for recognising suspicious objects recognising microscopic objects G06V20/69
• CPC Class Codes: G06V 40/161 Detection; Localisation; Normalisation
• CPC Class Codes: G06V 40/173 face re-identification, e.g. recognising unknown faces across different face tracks
• CPC Class Codes: G06V 40/20 Movements or behaviour, e.g. gesture recognition recognition of facial expressions G06V40/16
• CPC Class Codes: G07C 9/37 using biometric data, e.g. fingerprints, iris scans or voice recognition
• CPC Class Codes: G07C 9/38 with central registration

Abstract

A method, computer program product, and system are disclosed for facilitating access by a first person to a secure region within an environment having a plurality of items, wherein the secure region is at least partly defined by an access control device. The method acquires, using at least one visual sensor disposed within the environment, first image information including the first person and the access control device. The method identifies the first person using image analysis performed on the first image information. Further, the method identifies, using image analysis a first behavior of the first person relative to the access control device. Upon determining the first behavior corresponds to a predefined visual access behavior, and the security level of the first person satisfies a predetermined threshold security level associated with the access control device, deactivating a security element to permit the first person to physically access the secure region.

Claims

1. A computer-implemented method of facilitating access by a first person to a secure region within an environment having a plurality of items, wherein the secure region is at least partly defined by an access control device, the method comprising:

acquiring, using at least one visual sensor disposed within the environment, first image information including the first person and the access control device;

identifying, using one or more computer processors coupled with the at least one visual sensor, the first person using image analysis performed on the first image information, wherein identifying the first person comprises associating the first person with a security level selected from a plurality of predetermined security levels;

identifying, using the image analysis, a first behavior of the first person relative to the access control device; and

upon determining that the first behavior corresponds to a predefined visual access behavior, and that the security level of the first person satisfies a predetermined threshold security level associated with the access control device, transmitting a first control signal to a security element of the access control device, thereby deactivating the security element and permitting the first person to physically access the secure region through the access control device,

wherein the predefined visual access behavior is selected from a group comprising one or more of;

(1) reaching toward a handle, knob, or lever of the access control device,

(2) performing a predefined gesture mimicking operating a handle, knob, or lever of a door while in proximity of the access control device,

(3) performing a predefined gesture mimicking opening an enclosure with dual doors while in proximity of the access control device,

(4) reaching toward the access control device,

(5) waving towards the access control device,

(6) performing a predefined hand gesture indicating approval while in proximity of the access control device, and

(7) mouthing a predefined word while in proximity of the access control device.

2. The computer-implemented method of claim 1, the method further comprising:

acquiring, using at least one visual sensor disposed within the environment, second image information including the first person and the access control device;

identifying, using image analysis performed on the second image information, a second behavior of the first person relative to the access control device; and

upon determining, based on the second behavior, that the first person is no longer physically accessing the secure region, transmitting a second control signal to the security element of the access control device, thereby activating the security element to prevent subsequent unauthorized attempts to physically access the secure region.

3. The computer-implemented method of claim 1, wherein identifying the first person further comprises:

accessing known persons data stored in a computer-readable memory coupled with the one or more computer processors, wherein the known persons data identifies a plurality of known persons having a predefined association with the environment; and

determining, based on the known persons data, that the plurality of known persons includes the first person,

wherein associating the first person with a security level comprises determining the security level based on the known persons data.

4. The computer-implemented method of claim 1, wherein identifying the first person further comprises:

accessing known persons data stored in a computer-readable memory coupled with the one or more computer processors, wherein the known persons data identifies a plurality of known persons having a predefined association with the environment; and

determining, based on the known persons data, that the plurality of known persons does not include the first person,

wherein associating the first person with a security level comprises determining the security level based on one or more characteristics of the first person visually determined using the image analysis.

5. The computer-implemented method of claim 1, wherein identifying the first person further comprises determining a class of the first person, the class selected from one of a predefined customer class, a predefined employee class, and a predefined vendor class,

wherein the security level is based at least in part on the determined class of the first person.

6. The computer-implemented method of claim 1, further comprising:

upon determining that the predefined visual access behavior corresponds to a predefined emergency behavior indicating the first person is in distress, communicating an emergency message.

7. A system for facilitating access by a first person to a secure region within an environment having a plurality of items, wherein the secure region is at least partly defined by an access control device, the system comprising:

a plurality of visual sensors located throughout the environment;

a controller configured to;

acquire, using at least one visual sensor disposed within the environment, first image information including the first person and the access control device;

identify, using one or more computer processors coupled with the at least one visual sensor, the first person using image analysis performed on the first image information, wherein identifying the first person comprises associating the first person with a security level selected from a plurality of predetermined security levels;

identify, using the image analysis, a first behavior of the first person relative to the access control device; and

upon determining that the first behavior corresponds to a predefined visual access behavior, and that the security level of the first person satisfies a predetermined threshold security level associated with the access control device, transmit a first control signal to a security element of the access control device, thereby deactivating the security element and permitting the first person to physically access the secure region through the access control device,

wherein the predefined visual access behavior is selected from a group comprising one or more of;

(1) reaching toward a handle, knob, or lever of the access control device,

(2) performing a predefined gesture mimicking operating a handle, knob, or lever of a door while in proximity of the access control device,

(3) performing a predefined gesture mimicking opening an enclosure with dual doors while in proximity of the access control device,

(4) reaching toward the access control device,

(5) waving towards the access control device,

(6) performing a predefined hand gesture indicating approval while in proximity of the access control device, and

(7) mouthing a predefined word while in proximity of the access control device.

8. The system of claim 7, the controller further configured to:

acquire, using at least one visual sensor disposed within the environment, second image information including the first person and the access control device;

identify, using image analysis performed on the second image information, a second behavior of the first person relative to the access control device; and

upon determining, based on the second behavior, that the first person is no longer physically accessing the secure region, transmit a second control signal to the security element of the access control device, thereby activating the security element to prevent subsequent unauthorized attempts to physically access the secure region.

9. The system of claim 7, wherein identifying the first person further comprises:

accessing known persons data stored in a computer-readable memory coupled with the one or more computer processors, wherein the known persons data identifies a plurality of known persons having a predefined association with the environment; and

determining, based on the known persons data, that the plurality of known persons includes the first person,

wherein associating the first person with a security level comprises determining the security level based on the known persons data.

10. The system of claim 7, wherein identifying the first person further comprises:

accessing known persons data stored in a computer-readable memory coupled with the one or more computer processors, wherein the known persons data identifies a plurality of known persons having a predefined association with the environment; and

determining, based on the known persons data, that the plurality of known persons does not include the first person,

wherein associating the first person with a security level comprises determining the security level based on one or more characteristics of the first person visually determined using the image analysis.

11. The system of claim 7, wherein identifying the first person further comprises determining a class of the first person, the class selected from one of a predefined customer class, a predefined employee class, and a predefined vendor class,

wherein the security level is based at least in part on the determined class of the first person.

12. The system of claim 7, the controller further configured to:

upon determining that the predefined visual access behavior corresponds to a predefined emergency behavior indicating the first person is in distress, communicate an emergency message.

13. A computer program product to facilitate access by a first person to a secure region within an environment having a plurality of items, wherein the secure region is at least partly defined by an access control device, the computer program product comprising:

a non-transitory computer-readable storage medium having computer-readable program code embodied therewith, the computer-readable program code executable by one or more computer processors to perform an operation that includes;

acquiring, using at least one visual sensor disposed within the environment, first image information including the first person and the access control device;

identifying, using one or more computer processors coupled with the at least one visual sensor, the first person using image analysis performed on the first image information, wherein identifying the first person comprises associating the first person with a security level selected from a plurality of predetermined security levels;

identifying, using the image analysis, a first behavior of the first person relative to the access control device; and

upon determining that the first behavior corresponds to a predefined visual access behavior, and that the security level of the first person satisfies a predetermined threshold security level associated with the access control device, transmitting a first control signal to a security element of the access control device, thereby deactivating the security element and permitting the first person to physically access the secure region through the access control device,

wherein the predefined visual access behavior is selected from a group comprising one or more of;

(1) reaching toward a handle, knob, or lever of the access control device,

(2) performing a predefined gesture mimicking operating a handle, knob, or lever of a door while in proximity of the access control device,

(3) performing a predefined gesture mimicking opening an enclosure with dual doors while in proximity of the access control device,

(4) reaching toward the access control device,

(5) waving towards the access control device,

(6) performing a predefined hand gesture indicating approval while in proximity of the access control device, and

(7) mouthing a predefined word while in proximity of the access control device.

14. The computer program product of claim 13, further comprising:

acquiring, using at least one visual sensor disposed within the environment, second image information including the first person and the access control device;

identifying, using image analysis performed on the second image information, a second behavior of the first person relative to the access control device; and

upon determining, based on the second behavior, that the first person is no longer physically accessing the secure region, transmitting a second control signal to the security element of the access control device, thereby activating the security element to prevent subsequent unauthorized attempts to physically access the secure region.

15. The computer program product of claim 13, wherein identifying the first person further comprises:

accessing known persons data stored in a computer-readable memory coupled with the one or more computer processors, wherein the known persons data identifies a plurality of known persons having a predefined association with the environment; and

determining, based on the known persons data, that the plurality of known persons includes the first person,

wherein associating the first person with a security level comprises determining the security level based on the known persons data.

16. The computer program product of claim 13, wherein identifying the first person further comprises:

accessing known persons data stored in a computer-readable memory coupled with the one or more computer processors, wherein the known persons data identifies a plurality of known persons having a predefined association with the environment; and

determining, based on the known persons data, that the plurality of known persons does not include the first person,

wherein associating the first person with a security level comprises determining the security level based on one or more characteristics of the first person visually determined using the image analysis.

17. The computer program product of claim 13, wherein identifying the first person further comprises determining a class of the first person, the class selected from one of a predefined customer class, a predefined employee class, and a predefined vendor class,

wherein the security level is based at least in part on the determined class of the first person.