Multi-input user authentication on display device

• US 9,977,882 B2
• Filed: 07/22/2015
• Issued: 05/22/2018
• Est. Priority Date: 11/05/2012
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Scavezze, Mike, Scott, Jason, Steed, Jonathan, McIntyre, Ian, Krauss, Aaron, McCulloch, Daniel, Latta, Stephen, Geisner, Kevin, Mount, Brian
• Primary Examiner(s): Lubit, Ryan A
• Application Number:
  US14/805,685
• Publication Number:
  US 20150324562A1
• Time in Patent Office: 1,035 Days
• CPC Class Codes: G06F 21/31 User authentication
• CPC Class Codes: G06F 21/34 involving the use of external additional devices, e.g. dongles or smart cards
• CPC Class Codes: G06F 21/36 by graphic or iconic representation
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: H04L 63/08 for authentication of entities cryptographic mechanisms or cryptographic arrangements for entity authentication H04L9/32
• CPC Class Codes: H04W 12/06 Authentication
• CPC Class Codes: H04W 12/33 using wearable devices, e.g. using a smartwatch or smart-glasses
• CPC Class Codes: H04W 12/61 Time-dependent
• CPC Class Codes: H04W 12/63 Location-dependent; Proximity-dependent
• CPC Class Codes: H04W 12/68 Gesture-dependent or behaviour-dependent

Abstract

Embodiments are disclosed that relate to authenticating a user of a display device. For example, one disclosed embodiment includes displaying one or more virtual images on the display device, wherein the one or more virtual images include a set of augmented reality features. The method further includes identifying one or more movements of the user via data received from a sensor of the display device, and comparing the identified movements of the user to a predefined set of authentication information for the user that links user authentication to a predefined order of the augmented reality features. If the identified movements indicate that the user selected the augmented reality features in the predefined order, then the user is authenticated, and if the identified movements indicate that the user did not select the augmented reality features in the predefined order, then the user is not authenticated.

Claims

1. A method for authenticating a user of a computing system, the method comprising:

detecting a voice input via a microphone;

detecting one or more of a position and an orientation of a display device via data received from one or more of a position sensor and an orientation sensor;

detecting two or more user gaze locations via a gaze sensor, the two or more user gaze locations selecting one or more virtual images and one or more real objects; and

authenticating the user using voice recognition of the voice input, the one or more of the position and the orientation of the display device, and the two or more user gaze locations.

2. The method of claim 1, further comprising comparing the two or more user gaze locations to a predefined order of gaze locations.

3. The method of claim 2, wherein authenticating the user comprises authenticating the user upon determining the two or more user gaze locations were input in the predefined order.

4. The method of claim 1, wherein the one or more of the position sensor and the orientation sensor comprise one or more of an image sensor and a motion sensor.

5. The method of claim 4, wherein detecting one or more of the position and the orientation of the display device comprises detecting one or more of the position and the orientation based upon the presence of a physical object at a predetermined location in a background viewable through the display device.

6. The method of claim 1, wherein one or more of the two or more user gaze locations correspond to locations of one or more augmented reality features displayed via the display device.

7. The method of claim 1, further comprising detecting one or more user movements, and wherein authenticating the user comprises authenticating the user further based upon the one or more user movements.

8. A computing system comprising:

a display device;

a microphone;

one or more position sensors;

a processor; and

a storage device storing instructions executable by the processor to

detect a voice input via the microphone;

detect one or more of a position and an orientation of the display device via the one or more position sensors;

detect two or more movements of a user via the one or more position sensors, the two or more movements selecting one or more virtual images and one or more real objects; and

authenticate the user using voice recognition of the voice input, the one or more of the position and the orientation of the display device, and the two or more movements.

9. The computing system of claim 8, wherein the instructions are further executable to compare the two or more movements of the user to a predefined set of movements.

10. The computing system of claim 9, wherein the instructions are executable to authenticate the user upon determining the two or more movements of the user match the predefined set of movements.

11. The computing system of claim 8, wherein the one or more position sensors comprise one or more of a depth camera and a two-dimensional camera.

12. The computing system of claim 8, wherein the one or more position sensors comprise an inertial motion sensor.

13. The computing system of claim 8, further comprising a gaze sensor, and wherein the instructions are further executable to detect one or more user gaze locations via the gaze sensor and authenticate the user further based upon the one or more user gaze locations.

14. The computing system of claim 8, wherein the computing system comprises a head-mounted display system.

15. A computing system comprising:

a display device;

a microphone;

one or more image sensors;

one or more motion sensors;

a gaze sensor;

a processor; and

a storage device storing instructions executable by the processor to

detect a voice input via a signal received from the microphone;

detect one or more of a position and an orientation of the display device via at least one of the one or more image sensors and the one or more motion sensors;

detect two or more user gaze locations via the gaze sensor, the two or more user gaze locations selecting one or more virtual images and one or more real objects; and

authenticate the user using voice recognition of the voice input, the one or more of the position and the orientation of the display device, and the two or more user gaze locations.

16. The computing system of claim 15, wherein the instructions are further executable to compare the two or more user gaze locations to a predefined set of user inputs.

17. The computing system of claim 16, wherein the instructions are executable to authenticate the user upon determining the two or more user gaze locations match the predefined set of user inputs.

18. The computing system of claim 15, wherein the instructions are further executable to receive one or more user inputs via a communication subsystem of the computing system, the communication subsystem configured to communicatively couple the computing system with one or more other computing devices, and wherein the one or more user inputs received via the communication subsystem comprise one or more touch inputs received via the communication subsystem.

19. The computing system of claim 15, wherein the one or more image sensors comprise one or more of a depth camera and a two-dimensional camera, and wherein the one or more motion sensors comprise an inertial motion sensor.

20. The computing system of claim 15, wherein the computing system comprises a see-through head-mounted display system.