Methods and apparatuses for gesture-based user input detection in a mobile device

• US 9,513,714 B2
• Filed: 04/08/2015
• Issued: 12/06/2016
• Est. Priority Date: 09/02/2010
• Status: Active Grant

• Current Assignee: Qualcomm, Inc.
• Original Assignee: Qualcomm, Inc.
• Inventors: Bevilacqua, Mathew William, Harrat, Newfel, Ring, Peter
• Primary Examiner(s): Bolotin, Dmitriy
• Application Number:
  US14/681,738
• Publication Number:
  US 20150277577A1
• Time in Patent Office: 608 Days
• Field of Search: 345156-184
• US Class Current: 1/1
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text

Abstract

Methods and apparatuses are provided that may be implemented in a mobile device to: determine whether the mobile device is in a gesture command input ready state based, at least in part, on a display portion of the mobile device remaining in a horizontal viewable position for a threshold period of time; with the mobile device in a gesture command input ready state, determine whether a detected movement of the mobile device represents a gesture command input; and in response to the determined gesture command input, affect a user perceivable output.

Claims

1. A method comprising, at a mobile device:

subsequent to initiation of a user perceivable output, determining whether said mobile device is in a gesture command input ready state based, at least in part, on a display portion of said mobile device remaining within a threshold angle of a horizontal viewable position for a threshold period of time and input from an inertial sensor and/or an environmental sensor of said mobile device indicating motion of said mobile device;

with said mobile device in said gesture command input ready state, determining whether a detected movement of said mobile device represents a gesture command input; and

in response to a determination that said detected movement represents said gesture command input, affecting said user perceivable output.

2. The method as recited in claim 1, and further comprising, at said mobile device:

determining whether said mobile device is in said gesture command input ready state based further, at least in part, on a current user motion state.

3. The method as recited in claim 2, wherein said mobile device is determined to be in said gesture command input ready state in response to said current user motion state indicating that a user is not walking.

4. The method as recited in claim 1, wherein determining whether said mobile device is in said gesture command input ready state is further based, at least in part, on an estimated location of said mobile device.

5. The method as recited in claim 1, and further comprising, at said mobile device:

determining whether said mobile device is in said gesture command input ready state based further, at least in part, on a second threshold period of time since receiving a user input.

6. The method as recited in claim 1, and further comprising, at said mobile device:

determining whether said display portion of said mobile device is in said horizontal viewable position based, at least in part, on an orientation of said mobile device with respect to a detected gravitational acceleration.

7. The method as recited in claim 1, and further comprising, at said mobile device:

determining whether said display portion of said mobile device is in said horizontal viewable position based, at least in part, on an orientation of said mobile device with respect to a detected external light source.

8. The method as recited in claim 1, and further comprising, at said mobile device:

in response to affecting said user perceivable output, initiating an additional user perceivable output.

9. The method as recited in claim 1, wherein affecting said user perceivable output comprises stopping said user perceivable output.

10. The method as recited in claim 1, and further comprising, at said mobile device:

producing said user perceivable output by generating at least one of;

an audible output, a visual output, or a tactile output.

11. An apparatus for use in a mobile device, the apparatus comprising:

means for initiating a user perceivable output;

means for determining whether said mobile device is in a gesture command input ready state subsequent to initiating said user perceivable output based, at least in part, on a display portion of said mobile device remaining within a threshold angle of a horizontal viewable position for a threshold period of time and input from an inertial sensor and/or an environmental sensor of said mobile device indicating motion of said mobile device;

means for detecting movement of said mobile device;

means for determining whether said detected movement of said mobile device represents a gesture command input with said mobile device in said gesture command input ready state; and

means for affecting said user perceivable output, in response to said determined gesture command input.

12. The apparatus as recited in claim 11, and further comprising:

means for determining a current user motion state; and

means for determining whether said mobile device is in said gesture command input ready state based further, at least in part, on said determined current user motion state.

13. The apparatus as recited in claim 12, wherein said mobile device is determined to be in said gesture command input ready state in response to said determined current user motion state indicating that a user is not walking.

14. The apparatus as recited in claim 11, and further comprising:

means for estimating a location of said mobile device; and

wherein said means for determining whether said mobile device is in said gesture command input ready state is further based, at least in part, on said estimated location of said mobile device.

15. A mobile device comprising:

one or more output devices, comprising at least a display device;

one or more inertial sensors and one or more environmental sensors; and

a processing unit configured to, subsequent to initiation of a user perceivable output via at least one of said one or more output devices;

determine whether said mobile device is in a gesture command input ready state based, at least in part, on said display device remaining within a threshold angle of a horizontal viewable position for a threshold period of time and input from said one or more inertial sensors and/or said one or more environmental sensors indicating motion of said mobile device;

determine whether a movement of said mobile device represents a gesture command input with said mobile device in said gesture command input ready state, said movement being based, at least in part, on at least one signal associated with at least one of said one or more inertial sensors; and

affect said user perceivable output, in response to said determined gesture command input.

16. The mobile device as recited in claim 15, wherein said processing unit, subsequent to said initiation of said user perceivable output, is further configured to:

obtain a current user motion state; and

determine whether said mobile device is in said gesture command input ready state based further, at least in part, on said current user motion state.

17. The mobile device as recited in claim 16, wherein said mobile device is determined to be in said gesture command input ready state in response to said current user motion state indicating that a user is not walking.

18. The mobile device as recited in claim 15, wherein said processing unit, subsequent to said initiation of said user perceivable output, is further configured to:

obtain an estimated location of said mobile device; and

determine whether said mobile device is in said gesture command input ready state further based, at least in part, on said estimated location of said mobile device.

19. The mobile device as recited in claim 15, wherein said processing unit, subsequent to said initiation of said user perceivable output, is further configured to:

determine a time of a previous user input other than said gesture command input;

determine whether a second threshold period of time has passed since reception of said previous user input; and

determine whether said mobile device is in said gesture command input ready state based further, at least in part, on said determination that said second threshold period of time has passed since reception of said previous user input.

20. The mobile device as recited in claim 15, wherein said processing unit, subsequent to said initiation of said user perceivable output, is further configured to:

determine an orientation of said mobile device with respect to a detected gravitational acceleration based, at least in part, on said at least one signal associated with said at least one of said one or more inertial sensors; and

determine whether said display device is in said horizontal viewable position based, at least in part, on said orientation of said mobile device with respect to said detected gravitational acceleration.

21. The mobile device as recited in claim 15, and further comprising, at said mobile device:

a sensor to detect light from an external light source; and

wherein said processing unit, subsequent to said initiation of said user perceivable output, is further configured to;

determine whether said display device is in said horizontal viewable position based, at least in part, on an orientation of said mobile device with respect to said detected light.

22. The mobile device as recited in claim 15, wherein said processing unit, subsequent to said initiation of said user perceivable output, is further configured to:

initiate an additional user perceivable output via at least one of said one or more output devices, in response to said user perceivable output being affected.

23. The mobile device as recited in claim 15, wherein said processing unit is further configured to:

affect said user perceivable output by stopping said user perceivable output.

24. The mobile device as recited in claim 15, wherein at least one of said one or more output devices generates at least one of:

an audible output, a visual output, or a tactile output.

25. An article comprising:

a non-transitory computer readable medium having stored therein computer executable instructions executable by a processing unit of a mobile device to, subsequent to initiation of a user perceivable output, cause said processing unit to;

determine whether said mobile device is in a gesture command input ready state based, at least in part, on a display portion of said mobile device remaining within a threshold angle of a horizontal viewable position for a threshold period of time and input from an inertial sensor and/or an environmental sensor of said mobile device indicating motion of said mobile device;

with said mobile device in said gesture command input ready state, determine whether a detected movement of said mobile device represents a gesture command input; and

in response to a determination that said detected movement represents said gesture command input, affect said user perceivable output.

26. The article as recited in claim 25, said computer executable instructions being further executable by said processing unit to cause said processing unit to:

determine whether said mobile device is in said gesture command input ready state based further, at least in part, on a current user motion state.

27. The article as recited in claim 26, wherein said mobile device is determined to be in said gesture command input ready state in response to said current user motion state indicating that a user is not walking.

28. The article as recited in claim 25, wherein said determination of whether said mobile device is in said gesture command input ready state is further based, at least in part, on an estimated location of said mobile device.

29. The article as recited in claim 25, said computer executable instructions being further executable by said processing unit to cause said processing unit to:

determine whether said mobile device is in said gesture command input ready state based further, at least in part, on a second threshold period of time since reception of a user input.