SYSTEMS AND METHODS FOR MULTI-MODAL USER DEVICE AUTHENTICATION

• US 20200134151A1
• Filed: 12/23/2019
• Published: 04/30/2020
• Est. Priority Date: 12/23/2019
• Status: Active Grant

• Current Assignee: Intel Corporation
• Original Assignee: Intel Corporation
• Inventors: Magi, Aleksander, Cooper, Barnes, Kumar, Arvind, Zamora Esquivel, Julio, Paranjape, Vivek, Lewis, William, Bartscherer, Marko, Raffa, Giuseppe
• Granted Patent: US 11,809,535 B2
• Time in Patent Office: Days
• CPC Class Codes: G06F 21/31 User authentication
• CPC Class Codes: G06F 21/32 using biometric data, e.g. fingerprints, iris scans or voiceprints
• CPC Class Codes: G06F 21/35 communicating wirelessly
• CPC Class Codes: G06V 40/166 using acquisition arrangements
• CPC Class Codes: G06V 40/168 Feature extraction; Face representation
• CPC Class Codes: G06V 40/172 Classification, e.g. identification
• CPC Class Codes: G06V 40/70 Multimodal biometrics, e.g. combining information from different biometric modalities
• CPC Class Codes: G10L 17/00 Speaker identification or verification techniques
• CPC Class Codes: G10L 17/06 Decision making techniques; Pattern matching strategies

Abstract

Systems and methods for multi-modal user device authentication are disclosed. An example electronic device includes a first sensor, a microphone, a first camera, and a confidence analyzer to authenticate a subject as the authorized user in response to a user presence detection analyzer detecting a presence of the subject and one or more of (a) an audio data analyzer detecting a voice of an authorized user or (b) an image data analyzer detecting a feature of the authorized user. The example electronic device includes a processor to cause the electronic device to move from a first power state to a second power state in response to the confidence analyzer authenticating the user as the authorized user. The electronic device is to consume a greater amount of power in the second power state than the first power state.

Claims

1. An electronic device comprising:

a first sensor;

a microphone;

a first camera;

a user presence detection analyzer to analyze first sensor data generated by the first sensor to detect a presence of a subject proximate to the electronic device;

an audio data analyzer to analyze audio data generated by the microphone to detect a voice of an authorized user of the electronic device in the audio data;

an image data analyzer to analyze image data generated by the first camera to detect a feature of the authorized user in the image data;

a confidence analyzer to authenticate the subject as the authorized user in response to the user presence detection analyzer detecting the presence of the subject and one or more of (a) the audio data analyzer detecting the voice of the authorized user or (b) the image data analyzer detecting the feature of the authorized user; and

a processor to cause the electronic device to move from a first power state to a second power state in response to the confidence analyzer authenticating the subject as the authorized user, the electronic device to consume a greater amount of power in the second power state than the first power state.

2. The electronic device as defined in claim 1, further including:

an ambient light sensor; and

an ambient light analyzer to analyze third sensor data generated by the ambient light sensor to determine a lighting condition of an environment including the electronic device, the confidence analyzer to authenticate the subject based on the audio data analyzer detecting the voice of the authorized user and the image data analyzer detecting the feature of the authorized user in response to the lighting condition.

4. The electronic device as defined in claim 1, further including a sensor manager to activate the first camera in response to the user presence detection analyzer detecting the presence of the subject.

6. The electronic device as defined in claim 1, further including a push notification controller to receive a request from a second electronic device, the confidence analyzer to authenticate the subject in response to a user input indicating acceptance of the request.

8. The electronic device as defined in claim 1, wherein the audio data analyzer is to generate a prediction in response to the detection of the voice in the audio data and assign a confidence score the prediction, the confidence analyzer to compare the confidence score to a threshold to authenticate the subject.

9. The electronic device as defined in claim 1, further including an authentication device analyzer to detect a presence of an authentication device, the processor to authenticate the subject as the authorized user in response to the user presence detection analyzer detecting the presence of the subject, the detection of the presence of the authentication device, and one of (a) the audio data analyzer detecting the voice of the authorized user or (b) the image data analyzer detecting the feature of the authorized user.

10. The electronic device as defined in claim 1, wherein the feature includes a facial feature of the subject.

3. (canceled)

5. (canceled)

7. (canceled)

11. A non-transitory computer readable medium comprising instructions that, when executed, cause a computing device to at least:

detect a presence of a user proximate to the computing device based on first sensor data generated by a first sensor of the computing device;

instruct a camera to generate image data in response to detection of the user;

generate a first prediction of a match between the user and an authorized user of the computing device based on the image data;

generate audio data via a microphone in response to detection of an audio input;

generate a second prediction of a match between a voice of the user and a voice of the authorized user based on the audio data; and

authenticate the user as the authorized user based on the first prediction and the second prediction.

12. The non-transitory computer readable medium as defined in claim 11, wherein the instructions, when executed, further cause the computing device to:

assign a first confidence score to the first prediction; and

perform a first comparison of the first confidence score to a threshold for authentication the user based on the image data.

13. The non-transitory computer readable medium as defined in claim 12, wherein the instructions, when executed, further cause the computing device to:

assign a second confidence score to the second prediction;

perform a second comparison of the second confidence score to a threshold for authentication the user based on the audio data; and

authenticate the user as the authorized user based on the first comparison and the second comparison.

14. The non-transitory computer readable medium as defined in claim 11, wherein the instructions, when executed, further cause the computing device to:

output a notification in response to receipt of a request from a second computing device;

instruct the camera to generate image data in response to detection of a user input indicating acceptance of the request; and

instruct the computing device to perform an action in response to the authentication of the user as the authorized user.

15. The non-transitory computer readable medium as defined in claim 14, wherein the action includes causing a display controller to move from a first power state to a second power state to display content on a display screen of the computing device.

17. The non-transitory computer readable medium as defined in claim 11, wherein the instructions, when executed, further cause the computing device to:

detect an ambient lighting condition in an environment including the computing device; and

instruct the camera to generate the image data in response to the detection of the ambient lighting condition.

16. (canceled)

18. (canceled)

19. A computing device comprising:

a camera to generate image data;

a microphone to generate audio data in response to detection of an audio input; and

at least one processor to control a power state of the computing device based on the image data generated by the camera and the audio data generated by the microphone.

20. The computing device as defined in claim 19, wherein the power state includes a connected standby state and a working power state.

21. The computing device as defined in claim 20, further including a display controller, the at least one processor to instruct the display controller to cause content to be displayed via a display screen of the computing device based on the image data and the audio data.

22. The computing device as defined in claim 21, wherein the at least one processor is to maintain the computing device in the connected standby state when the content is displayed via the display screen.

23. The computing device as defined in claim 19, wherein the at least one processor is to detect a feature of an authorized user of the computing device in the image data.

24. The computing device as defined in claim 23, wherein the at least one processor is to detect a voice of the authorized user in the audio data.

25. The computing device as defined in claim 19, wherein the camera is to generate the image data in response to at least one of (a) detection of a presence of a user proximate to the computing device or (b) receipt of a request from a second computing device.

26-33. -33. (canceled)