Systems and methods for identifying users of devices and customizing devices to users

• US 9,299,350 B1
• Filed: 03/15/2013
• Issued: 03/29/2016
• Est. Priority Date: 03/15/2013
• Status: Active Grant

• Current Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Original Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Inventors: Dumont, Michael David, Keljo, Jonathan White, Sridharan, Srinivasan, Froment, Arnaud Marie, Awad, Nadim, Kiraly, Kenneth Paul, Dolbakain, Levon
• Primary Examiner(s): Opsasnick, Michael N
• Application Number:
  US13/838,572
• Time in Patent Office: 1,110 Days
• Field of Search: 704273-275
• US Class Current: 1/1
• CPC Class Codes: G06F 21/32 using biometric data, e.g. fingerprints, iris scans or voiceprints
• CPC Class Codes: G06F 3/0414 using force sensing means to determine a position
• CPC Class Codes: G06F 3/0416 Control or interface arrangements specially adapted for digitisers
• CPC Class Codes: G06V 40/176 Dynamic expression
• CPC Class Codes: G10L 17/06 Decision making techniques; Pattern matching strategies
• CPC Class Codes: G10L 17/10 Multimodal systems, i.e. based on the integration of multiple recognition engines or fusion of expert systems
• CPC Class Codes: G10L 17/22 Interactive procedures; Man-machine interfaces
• CPC Class Codes: G10L 21/055 for synchronising with other signals, e.g. video signals
• CPC Class Codes: G10L 25/48 specially adapted for particular use

Abstract

A system and method for identifying a user of a device includes comparing audio received by a device with acoustic fingerprint information to identify a user of the device. Image data, video data and other data may also be used in the identification of the user. Once the user is identified, operation of the device may be customized based on the user. Further, once the user is identified, data can be associated with the user, for example, usage data, location data, gender data, age data, dominant hand data of the user, and other data. This data can then be used to further customize the operation of the device to the specific user.

Claims

1. A method for identifying a current user of a device and customizing the device to the user, comprising:

receiving speech input of the user into the device;

matching the speech input to previously stored voice fingerprint information corresponding to the user stored in one or more user profiles;

storing touch characteristic data corresponding to the user, the touch characteristic data including at least one of an acceleration of the device, a velocity of the device, an orientation of the device, an amount of pressure on the device or a grip of the user on the device when the user touches the device while operating the device;

matching the touch characteristic data to previously stored comparison touch data characteristic corresponding to the user stored in the one or more user profiles;

identifying the user based on the matching of the speech input and the matching of the touch characteristic data;

customizing operation of the device to the user based on the identifying and on historical usage information corresponding to the user stored in the one or more user profiles, wherein the customizing includes customizing a user interface of the device based on the historical usage information; and

determining an updated user profile based at least in part on the touch characteristic data and a user profile of the one or more user profiles associated with the user.

2. The method of claim 1, wherein collecting the touch characteristic data includes measuring the at least one of the acceleration, the velocity, or the orientation of the device using an inertial sensor.

3. The method of claim 1, further comprising:

receiving video data corresponding to the user of the device, wherein the video data includes the user speaking the speech input; and

comparing mouth and lip movements of the user depicted in the video data to the speech input to determine that the speech input corresponds to the mouth and lip movements of the user.

4. A method, comprising:

receiving speech input from a user of a device;

detecting more than one voice in the speech input;

comparing the speech input to one or more voice fingerprints;

determining an identity of the user of the device when the speech input corresponds to a voice fingerprint of the user;

categorizing at least one voice as a non-user voice;

indicating the identity of the user for customizing use of the device based on the identity and the non-user voice; and

associating the non-user voice with a user profile of the user of the device.

5. The method of claim 4, further comprising confirming the identity of the user by:

collecting an image of the user using a camera of the device;

comparing the collected image with a stored image associated with the user; and

determining the collected image matches the stored image.

6. The method of claim 4, further comprising confirming the identity of the user by:

receiving a video of the user speaking the speech input;

comparing facial movements of the user with the speech input; and

determining the facial movements correspond to the speech input.

7. The method of claim 4, further comprising confirming the identity of the user by:

collecting touch characteristic data of the user using a sensor of the device, wherein the touch characteristic data includes at least one of an amount of pressure the user touches the device with, acceleration of the device, velocity of the device, vibration of the device, or orientation of the device;

comparing the collected touch characteristic data with stored touch characteristic data associated with the user; and

determining the collected touch characteristic data matches the stored touch characteristic data.

8. The method of claim 4, wherein the determining the identity of the user is further based at least in part on one or more of image data, video data, touch characteristic data, location data, velocity data of the device, vibration data of the device or orientation data of the device.

9. The method of claim 4, further comprising sending an indication of the identity of the user to the device.

10. The method of claim 4, further comprising customizing operation of the device based on the indicated identity of the user.

11. The method of claim 10, wherein customizing operation of the device is performed using one or more of usage data corresponding to the identified user, location data, velocity data of the device, vibration data of the device, orientation data of the device, touch pressure data of the user, data corresponding to a length in time of the touch of the user, gender data of the identified user, age data of the identified user, height data of the identified user, weight data of the identified user, dominant hand data of the identified user, personal interest data of the identified user, user contact information or user calendar information.

12. The method of claim 10, wherein customizing operation of the device comprises one or more of customizing a user interface, customizing a user interface, activating contact information associated with the user, activating calendar information associated with the user, adjusting a touch input based on the user, or adjusting a display output based on the user.

13. The method of claim 4, further comprising customizing operation of the device based at least in part on the non-user voice.

14. A computing device, comprising:

at least one processor;

a memory device including instructions operable to be executed by the at least one processor to perform a set of actions, configuring the at least one processor;

to receive speech input from a user of a device;

to detect more than one voice in the speech input;

to compare the speech input to one or more voice fingerprints;

to determine an identity of the user of the device when the speech input corresponds to a voice fingerprint of the user;

to categorize at least one voice as a non-user voice;

to indicate the identity of the user for customizing use of the device based on the identity and the non-user voice; and

to associate the non-user voice with a user profile of the user of the device.

15. The computing device of claim 14, in which the at least one processor is further configured:

to collect an image of the user using a camera of the device;

to compare the collected image with a stored image associated with the user; and

to determine the collected image matches the stored image.

16. The computing device of claim 14, in which the at least one processor is further configured:

to receive a video of the user speaking the speech input;

to compare facial movements of the user with the speech input; and

to determine the facial movements correspond to the speech input.

17. The computing device of claim 14, in which the at least one processor is further configured:

to collect touch characteristic data of the user using a sensor of the device, wherein the touch characteristic data includes at least one of an amount of pressure the user touches the device with, acceleration of the device, velocity of the device, vibration of the device, or orientation of the device;

to compare the collected touch characteristic data with stored touch characteristic data associated with the user; and

to determine the collected touch characteristic data matches the stored touch characteristic data.

18. The computing device of claim 14, in which the at least one processor is configured to identify the user is further based at least in part on one or more of image data, video data, touch characteristic data, location data, velocity data of the device, vibration data of the device or orientation data of the device.

19. The computing device of claim 14, in which the at least one processor is further configured to send an indication of the identity of the user to the device.

20. The computing device of claim 14, in which the at least one processor is further configured to customize operation of the device based on the indicated identity of the user.

21. The computing device of claim 20, in which the at least one processor is further configured to customize operation of the device using one or more of usage data corresponding to the identified user, location data, velocity data of the device, vibration data of the device, orientation data of the device, touch pressure data of the user, data corresponding to a length in time of the touch of the user, gender data of the identified user, age data of the identified user, height data of the identified user, weight data of the identified user, dominant hand data of the identified user, personal interest data of the identified user, user contact information or user calendar information.

22. The computing device of claim 20, in which the at least one processor is further configured to customize operation of the device by customizing a user interface, customizing a user interface, activating contact information associated with the user, activating calendar information associated with the user, adjusting a touch input based on the user, or adjusting a display output based on the user.

23. The computing device of claim 14, in which the at least one processor is further configured to customize operation of the device based at least in part on the non-user voice.