Gesture detection

• US 10,241,584 B2
• Filed: 09/28/2016
• Issued: 03/26/2019
• Est. Priority Date: 09/28/2016
• Status: Active Grant

• Current Assignee: Lenovo Singapore Pte Limited (Lenovo Group Ltd.)
• Original Assignee: Lenovo Singapore Pte Limited (Lenovo Group Ltd.)
• Inventors: Schantz, Daniel Jordan, Geary, Matthew Joseph, Luttrell, Wesley Abram, Osborne, Christopher Miles
• Primary Examiner(s): Taylor, Jr., Duane N
• Application Number:
  US15/278,474
• Publication Number:
  US 20180088672A1
• Time in Patent Office: 909 Days
• Field of Search: None
• CPC Class Codes: G06F 3/005 Input arrangements through a video camera
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback

Abstract

Apparatuses, methods, systems, and program products are disclosed for gesture detection. A method includes detecting an auditory cue associated with a predefined gesture based on input received from one or more sensors. The method includes detecting a gesture in response to the auditory cue based on gesture input received from the one or more sensors. The method includes performing an action associated with the detected gesture in response to determining the detected gesture is the predefined gesture associated with the auditory cue.

Claims

1. An apparatus comprising:

one or more sensors;

a processor;

a memory that stores code executable by the processor to;

detect an auditory cue based on input received from the one or more sensors;

determine that the auditory cue is registered as an auditory cue that is associated with a particular gesture in a predefined auditory cue/gesture pairing;

detect a gesture directly in response to determining that the detected auditory cue is a registered auditory cue based on gesture input received from the one or more sensors;

determine an identity of the user providing the auditory cue and the gesture; and

perform an action associated with the detected auditory cue/gesture pairing in response to;

determining that the detected gesture is the particular gesture associated with the registered auditory cue; and

determining that the identity of the user providing the auditory cue and the gesture matches a previously registered user identity associated with the auditory cue/gesture pairing.

2. The apparatus of claim 1, wherein the auditory cue comprises a predefined phrase.

3. The apparatus of claim 1, wherein the auditory cue comprises a predefined sound.

4. The apparatus of claim 1, wherein the predefined gesture comprises a body gesture.

5. The apparatus of claim 1, wherein the predefined gesture comprises a facial gesture.

6. The apparatus of claim 1, wherein the predefined gesture comprises a combination of a body gesture and touch gesture.

7. The apparatus of claim 1, wherein the detected gesture is detected one of before and simultaneously with detection of the auditory cue.

8. The apparatus of claim 1, wherein the code is further executable by the processor to associate the auditory cue with the predefined gesture.

9. The apparatus of claim 1, wherein the code is further executable by the processor to associate a combination of the auditory cue and the predefined gesture with the action.

10. The apparatus of claim 1, wherein the one or more sensors is selected from the group consisting of a digital camera, an infrared camera, a capacitance sensor, a microphone, a vibration sensor, and a noise field sensor.

11. A method comprising:

detecting, by use of a processor, an auditory cue based on input received from the one or more sensors;

determining that the auditory cue is registered as an auditory cue that is associated with a particular gesture in a predefined auditory cue/gesture pairing;

detecting a gesture directly in response to determining that the detected auditory cue is a registered auditory cue based on gesture input received from the one or more sensors;

determining an identity of the user providing the auditory cue and the gesture; and

performing an action associated with the detected auditory cue/gesture pairing in response to;

determining that the detected gesture is the particular gesture associated with the registered auditory cue; and

determining that the identity of the user providing the auditory cue and the gesture matches a previously registered user identity associated with the auditory cue/gesture pairing.

12. The method of claim 11, wherein the auditory cue comprises one of a predefined phrase and a predefined sound.

13. The method of claim 11, wherein the predefined gesture comprises one of a body gesture and a facial gesture.

14. The method of claim 11, wherein the predefined gesture comprises a combination of a body gesture and touch gesture.

15. The method of claim 11, wherein the detected gesture is detected one of before and simultaneously with detection of the auditory cue.

16. The method of claim 11, further comprising associating the auditory cue with the predefined gesture.

17. The method of claim 11, further comprising associating a combination of the auditory cue and the predefined gesture with the action.

18. A program product comprising a computer readable storage medium that stores code executable by a processor, the executable code comprising code to perform:

detecting an auditory cue based on input received from the one or more sensors;

determining that the auditory cue is registered as an auditory cue that is associated with a particular gesture in a predefined auditory cue/gesture pairing;

detecting a gesture directly in response to determining that the detected auditory cue is a registered auditory cue based on gesture input received from the one or more sensors;

determining an identity of the user providing the auditory cue and the gesture; and

performing an action associated with the detected auditory cue/gesture pairing in response to;

determining that the detected gesture is the particular gesture associated with the registered auditory cue; and

determining that the identity of the user providing the auditory cue and the gesture matches a previously registered user identity associated with the auditory cue/gesture pairing.