Method and system for visual authentication

• US 9,965,612 B2
• Filed: 04/19/2016
• Issued: 05/08/2018
• Est. Priority Date: 04/19/2016
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Lighthouse AI, Inc.
• Inventors: Teichman, Alexander William
• Primary Examiner(s): Parsons, Theodore C
• Assistant Examiner(s): DE JESUS LASSALA, CARLOS MANUEL
• Application Number:
  US15/132,513
• Publication Number:
  US 20170300685A1
• Time in Patent Office: 749 Days
• CPC Class Codes: G06F 21/31 User authentication
• CPC Class Codes: G06F 21/36 by graphic or iconic representation
• CPC Class Codes: G06T 2207/10012 Stereo images
• CPC Class Codes: G06T 2207/10024 Color image
• CPC Class Codes: G06T 2207/30232 Surveillance
• CPC Class Codes: G06T 7/593 from stereo images
• CPC Class Codes: G06T 7/73 using feature-based methods
• CPC Class Codes: H04L 63/0853 using an additional device, e.g. smartcard, SIM or a different communication terminal cryptographic mechanisms or cryptographic arrangements for entity authentication involving additional secure or trusted devices H04L9/3234
• CPC Class Codes: H04N 23/00 Cameras or camera modules comprising electronic image sensors; Control thereof
• CPC Class Codes: H04N 5/2226 Determination of depth image, e.g. for foreground/background separation determining depth by image analysis in general G06T7/50; segmentation by image analysis in general G06T7/10
• CPC Class Codes: H04W 12/65 Environment-dependent, e.g. using captured environmental data

Abstract

A method for visual authentication with a monitoring system. The method includes pre-provisioning the monitoring system with a reference visual authentication element, obtaining an image of a user-presented visual authentication element and generating a validation result by validating the user-presented visual authentication element against the reference visual authentication element. The method further includes, based on the validation result, making a determination that the user-presented visual authentication element matches the reference visual authentication element, and taking an action affiliated with the reference visual authentication element.

Claims

1. A non-transitory computer readable medium comprising instructions that enable a monitoring system to:

pre-provision the monitoring system with a first reference visual authentication element and a second reference visual authentication element, the first reference visual authentication element comprises a visual feature and a text content element, wherein the first reference visual authentication element and the second reference visual authentication element are obtained from a user;

storing the first reference visual authentication element;

obtain, after the pre-provisioning and, from the user, an image of a first user-presented visual authentication element;

generate a first validation result by validating the first user-presented visual authentication element against the first reference visual authentication element,

wherein the first validation result is a matching score that quantifies the goodness of fit obtained from performing matching on the first user-presented visual authentication element with the first reference visual authentication element; and

based on the first validation result;

make a first determination that the first user-presented visual authentication element matches the first reference visual authentication element; and

based on the first determination;

disarm the monitoring system;

obtain, after the pre-provisioning and, from the user, an image of a second user-presented visual authentication element;

generate a second validation result by validating the second user-presented visual authentication element against the second reference visual authentication element; and

based on the second validation result;

make a second determination that the second user-presented visual authentication element matches the second reference visual authentication element; and

based on the second determination;

trigger a silent alarm.

2. The non-transitory computer readable medium of claim 1, further comprising instructions to:

based on the second determination;

disarm the monitoring system.

3. The non-transitory computer readable medium of claim 1, further comprising instructions to:

based on the second determination;

keep a video recording function of the monitoring system enabled.

4. The non-transitory computer readable medium of claim 1, wherein obtaining the first reference visual authentication element comprises:

capturing an image of the first user-presented visual authentication element; and

isolating, in the captured image of the first user-presented visual authentication element, the first user-presented visual authentication element,

wherein the isolated first user-presented visual authentication element is the first reference visual authentication element.

5. The non-transitory computer readable medium of claim 1, wherein the first user-presented visual authentication element is an image displayed on a portable device.

6. The non-transitory computer readable medium of claim 5, wherein the image displayed on the portable device is sent to the portable device prior to performing the visual authentication.

7. The non-transitory computer readable medium of claim 6, wherein pre-provisioning the monitoring system with the first reference visual authentication element comprises selecting the image displayed on the portable device from a plurality of visual images.

8. A method for visual authentication with a monitoring system, comprising:

pre-provisioning the monitoring system with a first reference visual authentication element and a second reference visual authentication element, the first reference visual authentication element comprises a visual feature and a text content element, wherein the first reference visual authentication element and the second reference visual authentication element are obtained from a user;

storing the first reference visual authentication element;

obtaining, after the pre-provisioning and, from the user, an image of a first user-presented visual authentication element;

generating a first validation result by validating the first user-presented visual authentication element against the first reference visual authentication element,

wherein the first validation result is a matching score that quantifies the goodness of fit obtained from performing matching on the first user-presented visual authentication element with the first reference visual authentication element; and

based on the first validation result;

making a first determination that the first user-presented visual authentication element matches the first reference visual authentication element; and

based on the first determination;

disarming the monitoring system;

obtaining, after the pre-provisioning and, from the user, an image of a second user-presented visual authentication element;

generating a second validation result by validating the second user-presented visual authentication element against the second reference visual authentication element; and

based on the second validation result;

making a second determination that the second user-presented visual authentication element matches the second reference visual authentication element; and

based on the second determination;

triggering a silent alarm.

9. The method of claim 8, further comprising:

based on the second determination;

disarming the monitoring system.

10. The method of claim 8, further comprising:

based on the second determination;

keeping a video recording function of the monitoring system enabled.

11. The method of claim 8, wherein obtaining the first reference visual authentication element comprises:

capturing an image of the first user-presented visual authentication element; and

isolating, in the captured image of the first user-presented visual authentication element, the first user-presented visual authentication element,

wherein the isolated first user-presented visual authentication element is the first reference visual authentication element.

12. The method of claim 8, wherein the first user-presented visual authentication element is an image displayed on a portable device.

13. The method of claim 12, wherein the image displayed on the portable device is sent to the portable device prior to performing the visual authentication.

14. The method of claim 13, wherein pre-provisioning the monitoring system with the first reference visual authentication element comprises selecting the image displayed on the portable device from a plurality of visual images.