Performing an action associated with a motion based input

• US 10,353,484 B2
• Filed: 09/17/2018
• Issued: 07/16/2019
• Est. Priority Date: 05/28/2013
• Status: Active Grant

• Current Assignee: Malikie Innovations Limited (Key Patent Innovations Limited)
• Original Assignee: Blackberry Limited
• Inventors: Chen, Zhe, Almalki, Nazih
• Primary Examiner(s): Gupta, Parul H
• Application Number:
  US16/132,598
• Publication Number:
  US 20190018500A1
• Time in Patent Office: 302 Days
• Field of Search: None
• CPC Class Codes: G06F 2201/81 Threshold
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: H04M 1/72454 according to context-related or environment-related conditions

Abstract

A method implemented by a computing device having a memory and a motion sensor detection sensor is disclosed. The memory stores an input model associated with a gesture input. The method includes detecting a motion of the computing device; matching the detected motion with the input model; and determining a confidence level associated with the match. If the confidence level is above a pre-determined threshold, an action associated with the gesture input is performed automatically by the processor; and if the confidence level is below the pre-determined threshold, the action is performed by the processor responsive to receiving a positive confirmation of the gesture input.

Claims

1. A method implemented by a computing device comprising a processor, and a memory, a motion detection sensor and a proximity sensor coupled to the processor, the method comprising:

measuring, using the motion detection sensor, motion data representing a detected motion of the computing device at regular intervals;

measuring, using the proximity sensor, proximity data representing a proximity of the computing device to an object at regular intervals over a duration of the detected motion;

matching the measured motion data and measured proximity data to a gesture, the gesture comprising a pattern of motion representing changes in position of the computing device over the duration of the gesture and a pattern of proximity representing changes in proximity of the computing device to an object over the duration of the gesture;

determining an action associated with the gesture based on a context of the computing device when at the time the motion as detected; and

performing the action associated with the gesture.

2. The method of claim 1, further comprising:

selecting an input model, from a plurality of input models, based on a state of an application when the motion data was measured.

3. The method of claim 1, wherein the context comprises a state of an application when the motion as detected.

4. The method of claim 1, wherein the action associated with the gesture is only performed when a confidence level of the match is above a threshold.

5. The method of claim 1, further comprising:

determining a confidence level associated with the match based on how closely the measured motion data matches the pattern of motion defined by the plurality of criteria in the input model and how closely the measured proximity data matches the pattern of proximity defined by the plurality of criteria in the input model;

when the confidence level is above a threshold, performing the action associated with the gesture;

when the confidence level is below the threshold,

prompting for designated confirmatory input, wherein the designated confirmatory input is different from the gesture, and

performing the action associated with the gesture in response to receiving designated confirmatory input indicating a positive confirmation to perform the action.

6. The method of claim 5, further comprising:

updating the input models with the measured motion data and the measured proximity data in response to receiving the designated confirmatory input indicating a positive confirmation to perform the action or designated confirmatory input indicating a negative confirmation to not perform the action.

7. The method of claim 5, wherein prompting comprises displaying a message on a display of the computing device, and wherein designated confirmatory input indicating a positive confirmation to perform the action or designated confirmatory input indicating a negative confirmation to not perform the action is received via a touchscreen or keyboard of the computing device.

8. The method of claim 1, wherein the prompting comprises announcing, via a speaker of the computing device, a voice prompt;

wherein designated confirmatory input indicating a positive confirmation to perform the action or designated confirmatory input indicating a negative confirmation to not perform the action comprises a voice input received via a microphone of the computing device.

9. The method of claim 1, wherein the pattern of motion data is defined by a displacement of the measured motion correlated to a distance the computing device is moved when the gesture input is performed, a speed of the measured motion correlating a speed at which the computing device is moved when the gesture input is performed, a direction of the displaced distance, and a frequency response of the measured motion.

10. The method of claim 1, wherein each criterion in the plurality of criteria of each input model is compared individually against the motion data or proximity data.

11. The method of claim 10, wherein a weighing function is applied to each criterion in the plurality of criteria of the input model based on the significance of the criterion.

12. The method of claim 1, wherein the pattern of proximity defines at least one of decreasing proximity to the object over the duration of the respective gesture or increasing proximity to the object over the duration of the respective gesture.

13. The method of claim 1, wherein the measured motion data and measured proximity data are matched to an input model for a gesture comprising moving the computing device towards a user'"'"'s ear when matching criteria in the plurality of criteria includes the measured proximity data matching a pattern of proximity defining decreasing proximity to the object over the duration of the respective gesture.

14. The method of claim 1, further comprising:

increasing a sampling rate of the proximity sensor in response to the detected motion;

wherein the pattern of proximity defines at least one of decreasing proximity to the object over the duration of the respective gesture and increasing proximity to the object over the duration of the respective gesture.

15. The method of claim 1, further comprising:

prior to measuring the motion data and proximity data, receiving a selection indicating selection of a contact entry, the contact entry having a plurality of phone numbers stored in memory; and

wherein performing the action comprises;

prompting a user to select a phone number of the plurality of phone numbers for dialing;

receiving a voice input selecting the phone number; and

dialing the phone number.

16. A computing device comprising:

a processor;

a memory, proximity sensor and motion detection sensor each coupled to the processor, the memory storing executable instructions that, when executed by the processor, cause the computing device to;

measure, using the motion detection sensor, motion data representing a detected motion of the computing device at regular intervals;

measure, using the proximity sensor, proximity data representing a proximity of the computing device to an object at regular intervals over a duration of the detected motion;

match the measured motion data and measured proximity data to a gesture, the gesture comprising a pattern of motion representing changes in position of the computing device over the duration of the gesture and a pattern of proximity representing changes in proximity of the computing device to an object over the duration of the gesture;

determine an action associated with the gesture based on a context of the computing device when at the time the motion as detected; and

perform the action associated with the gesture.

17. The computing device of claim 16, wherein the executable instructions, when executed by the processor, cause the computing device to:

select an input model, from a plurality of input models, based on a state of an application when the motion data was measured.

18. The computing device of claim 16, wherein the context comprises a state of an application when the motion as detected.

19. The computing device of claim 16, wherein the action associated with the gesture is only performed when a confidence level of the match is above a threshold.

20. A non-transitory machine readable medium having tangibly stored thereon executable instructions for execution by a processor of a computing device, the computing device comprising a processor, memory, motion detection sensor and proximity sensor each coupled to the processor, wherein the executable instructions, when executed by the processor of the computing device, cause the computing device to:

measure, using the motion detection sensor, motion data representing a detected motion of the computing device at regular intervals;

measure, using the proximity sensor, proximity data representing a proximity of the computing device to an object at regular intervals over a duration of the detected motion;

match the measured motion data and measured proximity data to a gesture, the gesture comprising a pattern of motion representing changes in position of the computing device over the duration of the gesture and a pattern of proximity representing changes in proximity of the computing device to an object over the duration of the gesture;

determine an action associated with the gesture based on a context of the computing device when at the time the motion as detected; and

perform the action associated with the gesture.