Systems and methods of access control in security systems with augmented reality

• US 10,339,738 B2
• Filed: 02/16/2016
• Issued: 07/02/2019
• Est. Priority Date: 02/16/2016
• Status: Active Grant

• Current Assignee: Ademco Inc. (Resideo Technologies, Inc.)
• Original Assignee: Ademco Inc. (Resideo Technologies, Inc.)
• Inventors: Hosey, Mark, D'Agostino, Paul, Osborne, Kenneth
• Primary Examiner(s): Tung, Kee M
• Assistant Examiner(s): Valdez, Patrick F
• Application Number:
  US15/044,818
• Publication Number:
  US 20170236348A1
• Time in Patent Office: 1,232 Days
• Field of Search: None
• CPC Class Codes: G06T 11/00 2D [Two Dimensional] image generation
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06V 20/20 in augmented reality scenes
• CPC Class Codes: G07C 9/22 in combination with an identity check of the pass holder
• CPC Class Codes: G07C 9/32 in combination with an identity check
• CPC Class Codes: G07C 9/37 using biometric data, e.g. fingerprints, iris scans or voice recognition
• CPC Class Codes: H04W 12/08 Access security

Abstract

Systems and methods of access control in security systems with augmented reality are provided. Some methods can include receiving an image of an exterior of a secured area, displaying the received image on a display device, identifying at least one artifact associated with the received image, and superimposing at least one computer generated image of the identified artifact on the displayed image, thereby augmenting the displayed image.

Claims

1. A method comprising:

an imaging device capturing a static image of an exterior of a secured area;

a user device receiving the static image from the imaging device;

the user device displaying the static image on a display of the user device;

the user device determining whether the static image includes a predetermined portion of the exterior of the secured area, the predetermined portion of the exterior of the secured area corresponding to a location within the static image where at least one computer generated image of at least one artifact associated with the static image is to be displayed;

when the static image includes the predetermined portion of the exterior of the secured area, the user device identifying the at least one artifact associated with the static image from a database of the user device;

the user device identifying a current distance of the user device from the secured area;

the user device retrieving a predetermined distance from the database of the user device;

the user device determining whether the current distance of the user device from the secured area is less than or equal to the predetermined distance by comparing the current distance to the predetermined distance; and

responsive to the current distance of the user device from the secured area being less than or equal to the predetermined distance and the static image including the predetermined portion of the exterior of the secured area, the user device superimposing the at least one computer generated image of the at least one artifact at the location within the static image as displayed on the display of the user device.

2. The method of claim 1 further comprising:

the user device receiving user input interacting with the at least one computer generated image of the at least one artifact; and

the user device producing a local output responsive to the user input.

3. The method of claim 1 further comprising:

the user device receiving user input interacting with the at least one computer generated image of the at least one artifact; and

the user device transmitting a signal representative of the user input to a control panel for determining whether access to the secured area is authorized.

4. The method of claim 1 further comprising:

the user device receiving user input interacting with the at least one computer generated image of the at least one artifact; and

the user device determining whether the user input corresponds to an authorized action to access the secured area and, responsive thereto, transmitting a signal to grant the access to the secured area.

5. The method of claim 1 wherein identifying the at least one artifact associated with the static image and superimposing the at least one computer generated image of the at least one artifact at the location within the static image as displayed on the display of the user device are responsive to identifying an authorized password received by the user device.

6. The method of claim 1 further comprising identifying the current distance of the user device from the secured area by identifying a GPS location of the user device.

7. The method of claim 6 further comprising identifying the at least one artifact as being associated with the GPS location of the user device.

8. The method of claim 1 wherein identifying the at least one artifact associated with the static image and superimposing the at least one computer generated image of the at least one artifact at the location within the static image as displayed on the display of the user device are responsive to determining whether a current time is within an authorized predetermined period of time.

9. A user device comprising:

an imaging device;

a database device;

a display device; and

a programmable processor,

wherein the imaging device captures a static image of an exterior of a secured area,

wherein the display device displays the static image,

wherein the programmable processor determines whether the static image includes a predetermined portion of the exterior of the secured area,

wherein the predetermined portion of the exterior of the secured area corresponds to a location within the static image where at least one computer generated image of at least one artifact associated with the static image is to be displayed,

wherein, when the static image includes the predetermined portion of the exterior of the secured area, the programmable processor identifies the at least one artifact associated with the static image from the database device,

wherein the programmable processor identifies a current distance of the user device from the secured area, retrieves a predetermined distance from the database of the user device, and determines whether the current distance of the user device from the secured area is less than or equal to the predetermined distance by comparing the current distance to the predetermined distance, and

wherein, responsive to the current distance of the user device from the secured area being less than or equal to the predetermined distance and the static image including the predetermined portion of the exterior of the secured area, the programmable processor superimposes the at least one computer generated image of the at least one artifact at the location within the static image as displayed on the display device.

10. The user device of claim 9 wherein the display device receives user input interacting with the at least one computer generated image of the at least one artifact, and wherein the programmable processor transmits a signal to produce a local output responsive to the user input.

11. The user device of claim 9 further comprising:

a transceiver,

wherein the display device receives user input interacting with the at least one computer generated image of the at least one artifact, and

wherein the programmable processor transmits, via the transceiver, a signal representative of the user input for determining whether access to the secured area is authorized.

12. The user device of claim 9 further comprising:

a transceiver,

wherein the display device receives user input interacting with the at least one computer generated image of the at least one artifact, and

wherein the programmable processor determines whether the user input corresponds to an authorized action to access the secured area and, responsive thereto, transmits a signal, via the transceiver, to grant the access to the secured area.

13. The user device of claim 9 wherein the programmable processor identifies the at least one artifact associated with the static image and superimposes the at least one computer generated image of the at least one artifact at the location within the static image as displayed on the display device responsive to the programmable processor identifying an authorized password received by the display device.

14. The user device of claim 9 further comprising:

a GPS device,

wherein the GPS device identifies a first GPS location of the user device,

wherein the programmable processor identifies a second GPS location of the secured area stored in the database device, and

wherein the programmable processor uses the first GPS location of the user device and the second GPS location of the secured area to determine the current distance of the user device from the secured area.

15. The user device of claim 9 further comprising:

a GPS device,

wherein the GPS device identifies a GPS location of the user device,

wherein the programmable processor uses the GPS location of the user device to determine the current distance of the user device from the secured area, and

wherein the programmable processor identifies the at least one artifact as being associated with the GPS location of the user device.

16. The user device of claim 9 wherein the programmable processor identifies the at least one artifact associated with the static image and superimposes the at least one computer generated image of the at least one artifact at the location within the static image as displayed on the display device responsive to the programmable processor determining whether a current time is within an authorized predetermined period of time.