User identification by gesture recognition

• US 8,693,726 B2
• Filed: 06/29/2011
• Issued: 04/08/2014
• Est. Priority Date: 06/29/2011
• Status: Active Grant

• Current Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Original Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Inventors: Karakotsios, Kenneth M., Ivanchenko, Volodymyr V.
• Primary Examiner(s): Bhatnagar, Anand
• Application Number:
  US13/172,727
• Publication Number:
  US 20130004016A1
• Time in Patent Office: 1,014 Days
• Field of Search: 382/100, 382/103, 382/106, 382/107, 382/115, 382/116, 382/117, 382/118, 382/181, 382/190, 382/195, 382/203, 382/206, 348169-172, 348/154, 348/155, 902 3- 5, 340/5.1, 340/5.2, 340/5.21, 340/5.82, 340/5.83, 283 67- 69
• US Class Current: 382/103
• CPC Class Codes: G06F 21/32 using biometric data, e.g. fingerprints, iris scans or voiceprints
• CPC Class Codes: G06V 40/172 Classification, e.g. identification
• CPC Class Codes: G06V 40/28 Recognition of hand or arm movements, e.g. recognition of deaf sign language static hand signs G06V40/113
• CPC Class Codes: G06V 40/37 based only on signature signals such as velocity or pressure, e.g. dynamic signature recognition

Abstract

A user can be identified and/or authenticated to an electronic device by analyzing aspects of a motion or gesture made by that user. At least one imaging element of the device can capture image information including the motion or gesture, and can determine time-dependent information about that motion or gesture in two or three dimensions of space. The time-dependent information can be used to identify varying speeds, motions, and other such aspects that are indicative of a particular user. The way in which a gesture or motion is made, in addition to the motion or gesture itself, can be used to authenticate an individual user. While other persons can learn the basic gesture or motion, the way in which each person makes that gesture or motion will generally be at least slightly different, which can be used to prevent unauthorized access to sensitive information, protected functionality, or other such content.

Claims

1. A computer-implemented method of identifying an authorized user of a computing device, comprising:

capturing image information using at least one image capture element of the computing device;

analyzing, by the computing device, the image information to identify a position of at least one feature of a person near the computing device;

tracking the at least one feature over a period of time in the image information;

determining, by the computing device, a set of points including both position and time information for the at least one feature during at least a portion of the period of time;

comparing the set of points to at least one gesture pattern stored for the authorized user of the computing device, the at least one gesture pattern including;

(a) a path of movement for a gesture, (b) at least one of relative timing, acceleration, or velocity information for a plurality of points along the path of movement, and (c) one or more user-specific measurements relating to a manner of the authorized user performing the gesture; and

providing an indication that the person is the authorized user of the computing device when the set of points matches the at least one gesture pattern stored for the authorized user with at least a minimum level of certainty.

2. The computer-implemented method of claim 1, wherein capturing image information is performed in response to detecting motion near the computing device.

3. The computer-implemented method of claim 1, further comprising:

authenticating an identity of the user;

prompting the user to perform the gesture;

capturing first image information corresponding to the user performing the gesture;

analyzing the first image information to determine (a) the path of movement for the gesture, (b) the at least one of relative timing, acceleration, or movement for the gesture, and (c) the one or more user-specific measurements relating to the manner of performing the gesture; and

storing gesture information to be used in subsequent identification of the user, the gesture information including at least one of (a) the path of movement for the gesture, (b) the at least one of relative timing, acceleration, or movement for the gesture, or (c) the one or more user-specific measurements relating to the manner of performing the gesture.

4. The computer-implemented method of claim 1, wherein the at least one gesture pattern stored for the authorized user further includes at least one of a continuous function, a set of trajectories, or at least one fit curve.

5. The computer-implemented method of claim 1, wherein the set of points includes position information in three dimensions.

6. The computer-implemented method of claim 1, wherein the at least one feature includes at least one of a hand, finger, eye, elbow, arm, or held object.

7. A computer-implemented method of identifying a user, comprising:

under control of one or more computing devices including executable instructions,

obtaining image information captured using at least one image capture element of a computing device;

analyzing the image information to identify a position of at least one feature of a person near the computing device;

obtaining tracked position information by tracking the position of the at least one feature over a period of time in the image information;

comparing the tracked position information to gesture information stored for at least one gesture associated with the user, the gesture information including at least;

(a) a path of movement associated with the at least one gesture, (b) relative timing information for at least portions of the path of movement, and (e) one or more measurements relating to a manner of the user performing the at least one gesture; and

providing information indicating that the user is identified when the tracked position information matches the gesture information stored for the at least one gesture associated with the user.

8. The computer-implemented method of claim 7, wherein the image information includes at least one of ambient light image information or reflected infrared image information.

9. The computer-implemented method of claim 8, further comprising:

subtracting a weighted amount of the ambient light image information from the reflected infrared image information in order to substantially remove background information from the reflected infrared image information.

10. The computer-implemented method of claim 7, wherein analyzing the image information to identify the position of the at least one feature of the person uses at least one of image recognition, proximity detection, or intensity analysis.

11. The computer-implemented method of claim 7, wherein the gesture is a static gesture for the period of time.

12. The computer-implemented method of claim 7, wherein the gesture includes motion over the period of time.

13. The computer-implemented method of claim 7, wherein the position of the at least one feature is capable of being determined in two or three dimensions.

14. The computer-implemented method of claim 7, wherein the person is denied access to at least some content or functionality on the computing device when the tracked position information does not match the gesture information stored for the user with at least a minimum level of certainty.

15. The computer-implemented method of claim 7, further comprising:

causing at least one source of illumination to be activated during at least a portion of the period of time in which the tracked position information is obtained.

16. The computer-implemented method of claim 15 wherein the at least one source of illumination includes at least one of a white light or an infrared source of illumination, each of which is activated continuously or periodically during the period of time.

17. The computer-implemented method of claim 7, wherein at least one feature includes at least one of a hand, finger, eye, elbow, arm, or held object.

18. The computer-implemented method of claim 7, further comprising:

storing the image information in a rolling buffer,

wherein analyzing the image information occurs after a fixed period of time of storing the image information.

19. The computer-implemented method of claim 7, further comprising:

fitting a curve or function to the tracked position information before comparing the tracked position information to the gesture information.

20. The computer-implemented method of claim 7, further comprising:

deactivating a gesture input mode if no gesture is detected within a specified period of inactivity.

21. The computer-implemented method of claim 7, wherein the position of the at least one feature of the person near the computing device is further capable of being identified and tracked over the period of time using a capacitive screen operable to detect position and motion within a given distance of the capacitive screen.

22. A computing device, comprising:

a device processor;

at least one image capture element; and

a memory device including instructions operable to be executed by the processor to perform a set of actions, enabling the computing device to;

obtain image information captured using the at least one image capture element;

analyze the image information to identify a position of at least one feature of a person near the computing device;

obtain tracked position information by tracking the position of the at least one feature over a period of time in the image information;

compare the tracked position information to gesture information stored for at least one gesture associated with a user, the gesture information including at least;

(a) a path of movement associated with the at least one gesture, (b) relative timing information for at least portions of the path of movement, and (c) one or more measurements relating to a manner of the user performing the at least one gesture; and

provide information indicating that the user is identified when the tracked position information matches the gesture information stored for the at least one gesture associated with the user.

23. The computing device of claim 22, further comprising:

at least one source of illumination operable to provide at least one of a white light or infrared radiation, each of which is continuously or periodically activated during the period of time at which the image information is obtained.

24. The computing device of claim 22, further comprising:

a rolling data buffer operable to store the image information,

wherein the instructions when executed to cause the processor to analyze the information occurs after a fixed period of time at which the image information is stored.

25. A non-transitory computer-readable storage medium storing instructions that, when executed by a processor, cause the processor to:

obtain image information captured using at least one image capture element of a computing device;

analyze the image information to identify a position of at least one feature of a person near the computing device;

obtain tracked position information by tracking the position of the at least one feature over a period of time in the image information;

compare the tracked position information to gesture information stored for at least one gesture associated with a user, the gesture information including at least;

(a) a path of movement associated with the at least one gesture, (b) relative timing information for at least portions of the path of movement, and (c) one or more measurements relating to a manner of the user performing the at least one gesture; and

provide information indicating that the user is identified when the tracked position information matches the gesture information stored for the at least one gesture associated with the user.

26. The non-transitory computer-readable storage medium of claim 25, wherein the image information includes ambient light image information and reflected infrared image information, and the instructions when executed further cause the processor to:

subtract a weighted amount of the ambient light image information from the reflected infrared image information in order to substantially remove background information from the reflected infrared image information.

27. The non-transitory computer-readable storage medium of claim 25, wherein the instructions when executed further cause the processor to determine the position of the at least one feature in two or three dimensions.