User authentication on augmented reality display device

• US 9,092,600 B2
• Filed: 11/05/2012
• Issued: 07/28/2015
• Est. Priority Date: 11/05/2012
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Scavezze, Mike, Scott, Jason, Steed, Jonathan, McIntyre, Ian, Krauss, Aaron, McCulloch, Daniel, Latta, Stephen, Geisner, Kevin, Mount, Brian
• Primary Examiner(s): Lubit, Ryan A
• Application Number:
  US13/669,255
• Publication Number:
  US 20140125574A1
• Time in Patent Office: 995 Days
• Field of Search: 345 7- 9, 345156-184
• US Class Current: 1/1
• CPC Class Codes: G06F 21/31 User authentication
• CPC Class Codes: G06F 21/34 involving the use of external additional devices, e.g. dongles or smart cards
• CPC Class Codes: G06F 21/36 by graphic or iconic representation
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: H04L 63/08 for authentication of entities cryptographic mechanisms or cryptographic arrangements for entity authentication H04L9/32
• CPC Class Codes: H04W 12/06 Authentication
• CPC Class Codes: H04W 12/33 using wearable devices, e.g. using a smartwatch or smart-glasses
• CPC Class Codes: H04W 12/61 Time-dependent
• CPC Class Codes: H04W 12/63 Location-dependent; Proximity-dependent
• CPC Class Codes: H04W 12/68 Gesture-dependent or behaviour-dependent

Abstract

Embodiments are disclosed that relate to authenticating a user of a display device. For example, one disclosed embodiment includes displaying one or more virtual images on the display device, wherein the one or more virtual images include a set of augmented reality features. The method further includes identifying one or more movements of the user via data received from a sensor of the display device, and comparing the identified movements of the user to a predefined set of authentication information for the user that links user authentication to a predefined order of the augmented reality features. If the identified movements indicate that the user selected the augmented reality features in the predefined order, then the user is authenticated, and if the identified movements indicate that the user did not select the augmented reality features in the predefined order, then the user is not authenticated.

Claims

1. A method for authenticating a user of a computing system comprising a display device, comprising:

displaying one or more virtual images on the display device wherein a set of augmented reality features includes the one or more virtual images and one or more real objects in a field of view of the user;

identifying one or more movements of the user via data received from a sensor of the computing system;

comparing the identified movements of the user to a predefined set of authentication information for the user that links user authentication to a predefined order of the augmented reality features;

when the identified movements indicate that the user selected the augmented reality features in the predefined order, then authenticating the user; and

when the identified movements indicate that the user did not select the augmented reality features in the predefined order, then not authenticating the user.

2. The method of claim 1, wherein the sensor comprises an inertial motion sensor, and wherein the data comprises inertial motion data.

3. The method of claim 1, wherein the sensor comprises an eye tracking sensor system, and wherein the data comprises eye movement data.

4. The method of claim 1, wherein the predefined order of the augmented reality features is user-selected.

5. The method of claim 1, wherein the one or more virtual images are displayed in a similar location each time the user is authenticated.

6. The method of claim 1, wherein the one or more virtual images are displayed in a different location in different authentication sessions.

7. The method of claim 1, further comprising outputting an indication that the user has selected an augmented reality feature when an identified movement of the user matches a movement associated with the augmented reality feature.

8. The method of claim 1, further comprising determining a confidence score reflecting a level of confidence that the user selected augmented reality features in the predefined order.

9. The method of claim 8, further comprising, when the confidence score is greater than a threshold, then authenticating the user, and when the confidence score is less than the threshold, then not authenticating the user.

10. The method of claim 9, wherein the threshold is based on a location of the user.

11. The method of claim 9, wherein the threshold varies based on a number of augmented reality features.

15. The method of claim 10, wherein the threshold is based on a determined ability of the sensor to identify the one or more movements of the user.

12. A method for authenticating a user of a head-mounted display device, the method comprising:

displaying one or more virtual images on the head-mounted display device, wherein a set of augmented reality features includes the one or more virtual images and one or more real objects in a field of view of the user;

identifying one or more movements of the user via a sensor of the head-mounted display device;

comparing the identified movements of the user to a predefined set of expected movements associated with a predefined order of the augmented reality features;

assigning a confidence score to the identified movements, the confidence score reflecting a level of confidence that the user selected the augmented reality features in the predefined order based on a difference between the identified movements and the set of expected movements;

when the confidence score is greater than a threshold, then authenticating the user; and

when the confidence score is not greater than the threshold, then not authenticating the user.

13. The method of claim 12, wherein the sensor comprises one or more of an inertial motion sensor and an eye tracking sensor, and wherein when the location of the virtual images changes during different authentication sessions, the expected movements change.

14. The method of claim 12, wherein the threshold is based on a location of the user, and further comprising applying different thresholds at different locations.

16. A computing system comprising:

a display device;

a processor; and

a storage device storing instructions executable by the processor to

display one or more virtual images on the display device, wherein a set of augmented reality features includes the one or more virtual images and one or more real objects in a field of view;

identify one or more movements of a user via data received from a sensor of the computing system;

compare the identified movements of the user to a predefined set of authentication information for the user that links user authentication to a predefined order of the augmented reality features;

when the identified movements indicate that the user selected the augmented reality features in the predefined order, then authenticate the user; and

when the identified movements indicate that the user did not select the augmented reality features in the predefined order, then not authenticate the user.

17. The computing system of claim 16, wherein the sensor comprises an inertial motion sensor, and wherein the data comprises inertial motion data.

18. The computing system of claim 16, wherein the sensor comprises an eye tracking sensor system, and wherein the data comprises eye movement data.

19. The computing system of claim 16, wherein the instructions are executable to display the one or more virtual images in a similar location each time the user is authenticated.

20. The computing system of claim 16, wherein the instructions are executable to display the one or more virtual images in different locations in different authentication sessions.