Methods and apparatuses for gesture-based user input detection in a mobile device

• US 9,007,304 B2
• Filed: 08/04/2011
• Issued: 04/14/2015
• Est. Priority Date: 09/02/2010
• Status: Active Grant

• Current Assignee: Qualcomm, Inc.
• Original Assignee: Qualcomm, Inc.
• Inventors: Bevilacqua, Mathew William, Harrat, Newfel, Ring, Peter
• Primary Examiner(s): Bolotin, Dmitriy
• Application Number:
  US13/198,455
• Publication Number:
  US 20120056801A1
• Time in Patent Office: 1,349 Days
• Field of Search: 345156-184
• US Class Current: 345/158
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text

Abstract

Methods and apparatuses are provided that may be implemented in a mobile device to: determine whether the mobile device is in a gesture command input ready state based, at least in part, on a display portion of the mobile device remaining in a horizontal viewable position for a threshold period of time; with the mobile device in a gesture command input ready state, determine whether a detected movement of the mobile device represents a gesture command input; and in response to the determined gesture command input, affect a user perceivable output.

Claims

1. A method comprising, at a mobile device:

subsequent to initiation of a user perceivable output, determining whether said mobile device is in a gesture command input ready state based, at least in part, on a display portion of said mobile device remaining within a threshold angle of a horizontal viewable position for a threshold period of time and an estimated location of said mobile device indicating that said mobile device is in an environment where movements of said mobile device corresponding to gesture command inputs are likely to be distinguishable from movements of said mobile device that do not correspond to gesture command inputs;

with said mobile device in said gesture command input ready state, determining whether a detected movement of said mobile device represents a gesture command input; and

in response to a determination that said detected movement represents said gesture command input, affecting said user perceivable output.

2. The method as recited in claim 1, and further comprising, at said mobile device:

determining whether said mobile device is in said gesture command input ready state based further, at least in part, on a current user motion state.

3. The method as recited in claim 2, wherein said mobile device is determined to be in said gesture command input ready state in response to said current user motion state indicating that a user is not walking.

4. The method as recited in claim 1, and further comprising, at said mobile device:

determining whether said mobile device is in said gesture command input ready state based further, at least in part, on a second threshold period of time since receiving a user input.

5. The method as recited in claim 1, and further comprising, at said mobile device:

determining whether said display portion of said mobile device is within the threshold angle of said horizontal viewable position based, at least in part, on an orientation of said mobile device with respect to a detected gravitational acceleration.

6. The method as recited in claim 1, and further comprising, at said mobile device:

determining whether said display portion of said mobile device is within the threshold angle of said horizontal viewable position based, at least in part, on an orientation of said mobile device with respect to a detected external light source.

7. The method as recited in claim 1, and further comprising, at said mobile device:

in response to affecting said user perceivable output, initiating an additional user perceivable output.

8. The method as recited in claim 1, wherein affecting said user perceivable output comprises stopping said user perceivable output.

9. The method as recited in claim 1, and further comprising, at said mobile device:

producing said user perceivable output by generating at least one of;

an audible output, a visual output, or a tactile output.

10. An apparatus for use in a mobile device, the apparatus comprising:

means for initiating a user perceivable output;

means for determining whether said mobile device is in a gesture command input ready state subsequent to initiating said user perceivable output based, at least in part, on a display portion of said mobile device remaining within a threshold angle of a horizontal viewable position for a threshold period of time and an estimated location of said mobile device indicating that said mobile device is in an environment where movements of said mobile device corresponding to gesture command inputs are likely to be distinguishable from movements of said mobile device that do not correspond to gesture command inputs;

means for detecting movement of said mobile device;

means for determining whether said detected movement of said mobile device represents a gesture command input with said mobile device in said gesture command input ready state; and

means for affecting said user perceivable output, in response to said determined gesture command input.

11. The apparatus as recited in claim 10, and further comprising:

means for determining a current user motion state; and

means for determining whether said mobile device is in said gesture command input ready state based further, at least in part, on said determined current user motion state.

12. The apparatus as recited in claim 11, wherein said mobile device is determined to be in said gesture command input ready state in response to said determined current user motion state indicating that a user is not walking.

13. The apparatus as recited in claim 10, and further comprising:

means for estimating a location of said mobile device.

14. The apparatus as recited in claim 10, and further comprising:

means for receiving a user input other than said gesture command input;

means for determining whether a second threshold period of time has passed since receiving said user input; and

wherein said means for determining whether said mobile device is in said gesture command input ready state based further, at least in part, on a determination that said second threshold period of time has passed since receiving said user input.

15. The apparatus as recited in claim 10, and further comprising, at said mobile device:

means for detecting a gravitational acceleration;

means for determining an orientation of said mobile device with respect to said detected gravitational acceleration; and

means for determining whether said display portion of said mobile device is within the threshold angle of said horizontal viewable position based, at least in part, on said orientation of said mobile device with respect to said detected gravitational acceleration.

16. The apparatus as recited in claim 10, and further comprising, at said mobile device:

means for detecting an external light source;

means for determining an orientation of said mobile device with respect to said detected external light source; and

means for determining whether said display portion of said mobile device is within the threshold angle of said horizontal viewable position based, at least in part, on said orientation of said mobile device with respect to said detected external light source.

17. The apparatus as recited in claim 10, and further comprising, at said mobile device:

means for initiating an additional user perceivable output via said means for providing said user perceivable output, in response to affecting said user perceivable output.

18. The apparatus as recited in claim 10, wherein affecting said user perceivable output comprises stopping said user perceivable output.

19. The apparatus as recited in claim 10, wherein said user perceivable output comprises at least one of:

an audible output, a visual output, or a tactile output.

20. A mobile device comprising:

one or more output devices, comprising at least a display device;

one or more inertial sensors; and

a processing unit configured to, subsequent to initiation of a user perceivable output via at least one of said one or more output devices;

determine whether said mobile device is in a gesture command input ready state based, at least in part, on said display device remaining within a threshold angle of a horizontal viewable position for a threshold period of time and an estimated location of said mobile device indicating that said mobile device is in an environment where movements of said mobile device corresponding to gesture command inputs are likely to be distinguishable from movements of said mobile device that do not correspond to gesture command inputs;

determine whether a movement of said mobile device represents a gesture command input with said mobile device in said gesture command input ready state, said movement being based, at least in part, on at least one signal associated with at least one of said one or more said inertial sensors; and

affect said user perceivable output, in response to said determined gesture command input.

21. The mobile device as recited in claim 20, said processing unit, subsequent to said initiation of said user perceivable output, to further:

obtain current user motion state; and

determine whether said mobile device is in said gesture command input ready state based further, at least in part, on said current user motion state.

22. The mobile device as recited in claim 21, wherein said mobile device is determined to be in said gesture command input ready state in response to said current user motion state indicating that a user is not walking.

23. The mobile device as recited in claim 20, said processing unit, subsequent to said initiation of said user perceivable output, to further:

obtain the estimated location of said mobile device.

24. The mobile device as recited in claim 20, said processing unit, subsequent to said initiation of said user perceivable output, to further:

determine a time of a previous user input other than said gesture command input;

determine whether a second threshold period of time has passed since receiving said previous user input; and

determine whether said mobile device is in said gesture command input ready state based further, at least in part, on a determination that said second threshold period of time has passed since receiving said previous user input.

25. The mobile device as recited in claim 20, said processing unit, subsequent to said initiation of said user perceivable output, to further:

determine an orientation of said mobile device with respect to a detected gravitational acceleration based, at least in part, on said at least one signal associated with said at least one of said one or more said inertial sensors; and

determine whether said display device is within the threshold angle of said horizontal viewable position based, at least in part, on said orientation of said mobile device with respect to said detected gravitational acceleration.

26. The mobile device as recited in claim 20, and further comprising, at said mobile device:

a sensor to detect light from an external light source; and

wherein said processing unit, subsequent to said initiation of said user perceivable output, to further;

determine whether said display device is within the threshold angle of said horizontal viewable position based, at least in part, on an orientation of said mobile device with respect to said detected light.

27. The mobile device as recited in claim 20, said processing unit, subsequent to said initiation of said user perceivable output, to further:

initiate an additional user perceivable output via at least one of said one or more output devices, in response to affecting said user perceivable output.

28. The mobile device as recited in claim 20, said processing unit to further:

affect said user perceivable output by stopping said user perceivable output.

29. The mobile device as recited in claim 20, wherein at least one of said one or more output devices generates at least one of:

an audible output, a visual output, or a tactile output.

30. An article comprising:

a non-transitory computer readable medium having stored therein computer executable instructions executable by a processing unit of a mobile device to, subsequent to initiation of a user perceivable output;

determine whether said mobile device is in a gesture command input ready state based, at least in part, on a display portion of said mobile device remaining within a threshold angle of a horizontal viewable position for a threshold period of time and an estimated location of said mobile device indicating that said mobile device is in an environment where movements of said mobile device corresponding to gesture command inputs are likely to be distinguishable from movements of said mobile device that do not correspond to gesture command inputs;

with said mobile device in said gesture command input ready state, determine whether a detected movement of said mobile device represents a gesture command input; and

in response to a determination that said detected movement represents said gesture command input, affect said user perceivable output.

31. The article as recited in claim 30, said computer executable instructions being further executable by said processing unit to:

determine whether said mobile device is in said gesture command input ready state based further, at least in part, on a current user motion state.

32. The article as recited in claim 31, wherein said mobile device is determined to be in said gesture command input ready state in response to said current user motion state indicating that a user is not walking.

33. The article as recited in claim 30, said computer executable instructions being further executable by said processing unit to:

determine whether said mobile device is in said gesture command input ready state based further, at least in part, a second threshold period of time since receiving a user input.

34. The article as recited in claim 30, said computer executable instructions being further executable by said processing unit to:

determine whether said display portion of said mobile device is within the threshold angle of said horizontal viewable position based, at least in part, on an orientation of said mobile device with respect to a detected gravitational acceleration.

35. The article as recited in claim 30, said computer executable instructions being further executable by said processing unit to:

determine whether said display portion of said mobile device is within the threshold angle of said horizontal viewable position based, at least in part, on an orientation of said mobile device with respect to a detected external light source.

36. The article as recited in claim 30, said computer executable instructions being further executable by said processing unit to:

in response to affecting said user perceivable output, initiate an additional user perceivable output.

37. The article as recited in claim 30, wherein said processing unit affects said user perceivable output by stopping said user perceivable output.

38. The article as recited in claim 30, wherein said user perceivable output comprises at least one of:

an audible output, a visual output, or a tactile output.