Using movement of a computing device to enhance interpretation of input events produced when interacting with the computing device

• US 8,982,045 B2
• Filed: 12/17/2010
• Issued: 03/17/2015
• Est. Priority Date: 12/17/2010
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Hinckley, Kenneth P., Pahud, Michel, Shen, Wenqi
• Primary Examiner(s): Mengistu, Amare
• Assistant Examiner(s): Figueroa-Gibson, Gloryvid
• Application Number:
  US12/970,943
• Publication Number:
  US 20120154294A1
• Time in Patent Office: 1,551 Days
• Field of Search: 345/649, 345/660, 345/672, 345156-184, 715/788, 715/815, 715/863, 715/864, 455/566
• US Class Current: 345/156
• CPC Class Codes: G06F 1/1649 the additional display being independently orientable, e.g. for presenting information to a second user
• CPC Class Codes: G06F 1/1677 for detecting open or closed state or particular intermediate positions assumed by movable parts of the enclosure, e.g. detection of display lid position with respect to main body in a laptop, detection of opening of the cover of battery compartment
• CPC Class Codes: G06F 1/169 the I/O peripheral being an integrated pointing device, e.g. trackball in the palm rest area, mini-joystick integrated between keyboard keys, touch pads or touch stripes G06F1/1643 takes precedence; constructional details of pointing devices G06F3/033
• CPC Class Codes: G06F 1/1694 the I/O peripheral being a single or a set of motion sensors for pointer control or gesture input obtained by sensing movements of the portable computer
• CPC Class Codes: G06F 2203/04806 Zoom, i.e. interaction techniques or interactors for controlling the zooming operation
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/0416 Control or interface arrangements specially adapted for digitisers
• CPC Class Codes: G06F 3/0483 Interaction with page-structured environments, e.g. book metaphor
• CPC Class Codes: G06F 3/0485 Scrolling or panning
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus

Abstract

A computing device is described herein which collects input event(s) from at least one contact-type input mechanism (such as a touch input mechanism) and at least one movement-type input mechanism (such as an accelerometer and/or gyro device). The movement-type input mechanism can identify the orientation of the computing device and/or the dynamic motion of the computing device. The computing device uses these input events to interpret the type of input action that has occurred, e.g., to assess when at least part of the input action is unintentional. The computing device can then perform behavior based on its interpretation, such as by ignoring part of the input event(s), restoring a pre-action state, correcting at least part of the input event(s), and so on.

Claims

1. A computing device, comprising:

plural input mechanisms for responding to an input action, including;

at least one contact-type input mechanism for receiving at least one contact input event that indicates contact with the computing device; and

at least one movement-type input mechanism for receiving at least one movement input event that indicates one or more of orientation and motion of the computing device;

an interpretation and behavior selection module (IBSM) configured to detect a type of the input action that has occurred using a combination of said at least one contact input event and said at least one movement input event; and

wherein the IBSM is further configured to detect and respond to one or more unintentional input actions by automatically adjusting a timing at which the at least one contact input event is considered to have been received relative to a timing at which the at least one movement input event is actually received.

2. The computing device of claim 1, wherein the computing device is a handheld computing device.

3. The computing device of claim 1, wherein said at least one contact-type input mechanism comprises a touch input mechanism for sensing contact of a hand with the computing device.

4. The computing device of claim 1, wherein said at least one movement-type input mechanism comprises one or more of an accelerometer and a gyro device.

5. The computing device of claim 1, wherein the IBSM is configured to repeatedly analyze contact input events and movement input events in a course of the input action to improve a level of confidence at which the IBSM detects the type of input action.

6. The computing device of claim 1, wherein the IBSM is configured to conclude that at least part of the input action is unintentional when said at least one movement input event exceeds a prescribed threshold.

7. The computing device of claim 6, wherein the input action is associated with picking up or setting down the computing device.

8. The computing device of claim 6, wherein the IBSM is configured to also conclude that said at least part of the input action is unintentional based on an output of a light sensor.

9. The computing device of claim 1, wherein the IBSM is configured to conclude that at least part of the input action is unintentional when said at least one movement input event exhibits noise-like motion characteristics indicative of operation of the computing device in a noisy environment.

10. The computing device of claim 1, wherein the IBSM is configured to conclude that at least part of the input action is unintentional due to unintentional movement that occurs during application or removal of a touch contact.

11. The computing device of claim 1, wherein the IBSM is configured to detect a type of gesture associated with the input action based on a combination of said at least one contact input event and said at least one movement input event.

12. The computing device of claim 1, wherein the IBSM is configured to determine whether the input action is associated with an unintentional application of a touch contact based on a determined orientation of the computing device.

13. The computing device of claim 1, wherein the IBSM is further configured to execute a behavior in response to detection of the type of the input action, and wherein, as one behavior, the IBSM is configured to reject at least part of said at least one contact input event when the IBSM determines that at least part of the input action is unintentional.

14. The computing device of claim 1, wherein the IBSM is further configured to execute a behavior in response to detection of the type of the input action, and wherein, as one behavior, the IBSM is configured to restore a prior state when the IBSM determines that at least part of the input action is unintentional.

15. The computing device of claim 1, wherein the IBSM is further configured to execute a behavior in response to detection of the type of the input action, and wherein, as one behavior, the IBSM is configured to correct an interpretation of said at least one contact input event to remove effects of said at least one movement input event when the IBSM determines that at least part of the input action is unintentional.

16. A method for controlling a computing device in response to unintentional movement of the computing device, comprising:

receiving at least one contact input event from at least one touch input mechanism in response to contact with the computing device in a prescribed manner;

receiving at least one movement input event from at least one movement-type input mechanism in response to movement of the computing device;

detecting a type of input action associated with the contact with the computing device based on said at least one contact input event and said at least one movement input event;

rejecting at least part of said at least one contact input event when at least part of the input action is determined to correspond to an unintentional movement of the computing device; and

automatically adjusting an indication of a location on the computing device at which at least one contact input event was received to change an interpretation of the at least one contact input event to account for the unintentional movement of the computing device.

17. The method of claim 16, wherein the input action is associated with picking up or setting down the computing device.

18. The method of claim 16, further comprising restoring a state prior to application of the input action.

19. The method of claim 16, further comprising repeatedly performing said detecting to improve a level of confidence at which the type of input action is detected.

20. A computer readable storage device for storing computer readable instructions, the computer readable instructions providing an interpretation and behavior selection module (IBSM) when executed by one or more processing devices, the computer readable instructions comprising:

logic configured to receive at least one contact input event from at least one touch input mechanism in response to contact with a computing device in a prescribed manner;

logic configured to receive at least one movement input event from at least one movement-type input mechanism in response to movement of the computing device;

logic configured to detect a type of input action associated with the contact with the computing device based on said at least one contact input event and said at least one movement input event; and

logic configured to correct an interpretation of said at least one contact input event by automatically adjusting an indication of a timing at which the at least one contact input event was received to change an interpretation of the at least one contact input event to account for said at least one movement input event when it is determined that at least part of the input action is unintentional.