Classifying the intent of user input

• US 9,946,307 B2
• Filed: 05/14/2012
• Issued: 04/17/2018
• Est. Priority Date: 03/02/2012
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Lutz, III, Moshe R., Dietz, Paul Henry
• Primary Examiner(s): Yodichkas, Aneeta
• Application Number:
  US13/471,336
• Publication Number:
  US 20130229380A1
• Time in Patent Office: 2,164 Days
• Field of Search: 345173-178
• CPC Class Codes: E05D 11/1064 with a coil spring perpendicular to the pivot axis
• CPC Class Codes: E05F 5/08 with springs
• CPC Class Codes: E05Y 2201/46 Magnets
• CPC Class Codes: F16M 11/38 by folding , e.g. pivoting or scissors tong mechanisms
• CPC Class Codes: G05B 11/01 electric
• CPC Class Codes: G06F 1/1616 with folding flat displays, e.g. laptop computers or notebooks having a clamshell configuration, with body parts pivoting to an open position around an axis parallel to the plane they define in closed position
• CPC Class Codes: G06F 1/1618 the display being foldable up to the back of the other housing with a single degree of freedom, e.g. by 360° rotation over the axis defined by the rear edge of the base enclosure
• CPC Class Codes: G06F 1/1637 Details related to the display arrangement, including those related to the mounting of the display in the housing
• CPC Class Codes: G06F 1/1654 the display being detachable, e.g. for remote use
• CPC Class Codes: G06F 1/1656 Details related to functional adaptations of the enclosure, e.g. to provide protection against EMI, shock, water, or to host detachable peripherals like a mouse or removable expansions units like PCMCIA cards, or to provide access to internal components for maintenance or to removable storage supports like CDs or DVDs, or to mechanically mount accessories mounting of accessories to a computer display G06F1/1607; display hoods G06F1/1603; cooling arrangements for portable computers G06F1/203
• CPC Class Codes: G06F 1/166 related to integrated arrangements for adjusting the position of the main body with respect to the supporting surface, e.g. legs for adjusting the tilt angle
• CPC Class Codes: G06F 1/1662 Details related to the integrated keyboard
• CPC Class Codes: G06F 1/1669 Detachable keyboards
• CPC Class Codes: G06F 1/1681 Details related solely to hinges hinge details related to the transmission of signals or power are classified in G06F1/1683
• CPC Class Codes: G06F 1/1683 for the transmission of signal or power between the different housings, e.g. details of wired or wireless communication, passage of cabling
• CPC Class Codes: G06F 1/1684 Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675
• CPC Class Codes: G06F 1/1686 the I/O peripheral being an integrated camera
• CPC Class Codes: G06F 11/3089 Monitoring arrangements determined by the means or processing involved in sensing the monitored data, e.g. interfaces, connectors, sensors, probes, agents software debugging using additional hardware using a specific debug interface G06F11/3656; performance evaluation by tracing or monitoring G06F11/3466
• CPC Class Codes: G06F 13/102 where the programme performs an interfacing function, e.g. device driver G06F13/105 takes precedence; scheduling within device drivers G06F9/52; contention policies within device drivers G06F9/4881
• CPC Class Codes: G06F 3/002 Specific input/output arrangements not covered by G06F3/01 - G06F3/16 other optical apparatus G02B27/00
• CPC Class Codes: G06F 3/01 : Input arrangements or combined input and output arrangements for interaction between user and computer G06F3/16 takes precedence
• CPC Class Codes: G06F 3/02 : Input arrangements using manually operated switches, e.g. using keyboards or dials
• CPC Class Codes: G06F 3/0202 : Constructional details or processes of manufacture of the input device
• CPC Class Codes: G06F 3/0219 : Special purpose keyboards
• CPC Class Codes: G06F 3/023 : Arrangements for converting discrete items of information into a coded form, e.g. arrangements for interpreting keyboard generated codes as alphanumeric codes, operand codes or instruction codes
• CPC Class Codes: G06F 3/0233 : Character input methods
• CPC Class Codes: G06F 3/0414 : using force sensing means to determine a position
• CPC Class Codes: G06F 3/0416 : Control or interface arrangements specially adapted for digitisers
• CPC Class Codes: G06F 3/0487 : using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
• CPC Class Codes: G06F 3/0488 : using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04886 : by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
• CPC Class Codes: G06F 9/541 : via adapters, e.g. between incompatible applications
• CPC Class Codes: H01H 11/00 : Apparatus or processes specially adapted for the manufacture of electric switches processes specially adapted for manufacture of rectilinearly movable switches having a plurality of operating members associated with different sets of contacts, e.g. keyboards, H01H13/88
• CPC Class Codes: H01H 13/14 : Operating parts, e.g. push-button
• CPC Class Codes: H01H 13/702 : with contacts carried by or formed from layers in a multilayer structure, e.g. membrane switches
• CPC Class Codes: H01H 13/703 : characterised by spacers between contact carrying layers
• CPC Class Codes: H01H 13/704 : characterised by the layers, e.g. by their material or structure H01H13/703 takes precedence
• CPC Class Codes: H01H 13/78 : characterised by the contacts or the contact sites
• CPC Class Codes: H01H 13/785 : characterised by the material of the contacts, e.g. conductive polymers
• CPC Class Codes: H01H 13/79 : characterised by the form of the contacts, e.g. interspersed fingers or helical networks
• CPC Class Codes: H01H 13/807 : characterised by the spatial arrangement of the contact sites, e.g. superimposed sites
• CPC Class Codes: H01H 13/82 : characterised by contact space venting means
• CPC Class Codes: H01H 2201/036 : Variable resistance
• CPC Class Codes: H01H 2203/02 : Interspersed fingers
• CPC Class Codes: H01H 2203/036 : to solve particular problems
• CPC Class Codes: H01H 2203/058 : Contact area function of position on layered keyboard
• CPC Class Codes: H01H 2205/006 : mounted on spacer
• CPC Class Codes: H01H 2211/004 : Adhesive
• CPC Class Codes: H01H 2211/006 : Individual areas
• CPC Class Codes: H01H 2213/016 : in adhesive layer
• CPC Class Codes: H01H 2217/004 : Larger or different actuating area
• CPC Class Codes: H01H 2217/006 : Different feeling for different switch sites
• CPC Class Codes: H01H 2217/01 : Off centre actuation
• CPC Class Codes: H01H 2227/032 : Operating force
• CPC Class Codes: H01H 9/26 : for interlocking two or more switches H01H13/568 takes precedence; by a detachable member H01H9/28 ; for electromagnetic relays H01H50/323
• CPC Class Codes: H04M 1/0216 : Foldable in one direction, i.e. using a one degree of freedom hinge
• CPC Class Codes: H04M 1/0245 : using open/close detection
• CPC Class Codes: H04M 1/0254 : comprising one or a plurality of mechanically detachable modules
• CPC Class Codes: H04M 1/72409 : by interfacing with external accessories hands-free H04M1/60
• CPC Class Codes: H05K 5/0226 : Hinges
• CPC Class Codes: H05K 5/0234 : Feet; Stands; Pedestals, e.g. wheels for moving casing on floor
• CPC Class Codes: Y02D 10/00 : Energy efficient computing, e.g. low power processors, power management or thermal management
• CPC Class Codes: Y10T 29/49826 : Assembling or joining

Abstract

Different types of user inputs can be input by a user via a keyboard of an input device. These different types of user inputs include, for example, key strikes, multi-touch interactions, single finger motions, and/or mouse clicks. Touch information regarding the pressure applied to the keys of a pressure sensitive keyboard over time (or the contact area of the user input for other types of keyboards over time) is used to classify the intent of the user input as one of the various types of user inputs.

Claims

1. A method comprising:

obtaining touch information regarding a single finger touching a keyboard of an input device, the input device supporting multiple different user intents for the single finger touching the keyboard, the obtaining comprising obtaining force information; and

automatically determining, based on the touch information, which of the multiple different user intents is intended for the single finger touching the keyboard, the multiple different user intents including a key strike, a mouse click, and a single finger motion, the determining including;

determining that the user intent intended for the single finger touching the keyboard is the key strike in response to the touch information conforming to characteristics of the key strike,

determining that the user intent intended for the single finger touching the keyboard is the mouse click in response to the touch information conforming to characteristics of the mouse click, the characteristics of the key strike indicating that the force applied by the single finger touching the keyboard rises faster than the characteristics of the mouse click indicate,

determining that the user intent intended for the single finger touching the keyboard is the single finger motion in response to the touch information conforming to characteristics of the single finger motion.

2. The method as recited in claim 1, the input device comprising multiple pressure sensors that sense the single finger touching the keyboard, and the obtaining comprising obtaining force information.

3. The method as recited in claim 1, the input device comprising a capacitive system that senses the single finger touching the keyboard, and the obtaining comprising obtaining contact information.

4. The method as recited in claim 1, the determining that the user intent is the single finger motion comprising determining that the user intent is the single finger motion in response to the single finger travelling a threshold distance across the keyboard.

5. The method as recited in claim 1, the determining that the user intent is the single finger motion comprising determining that the user intent is the single finger motion in response to the single finger having a threshold velocity across the keyboard.

6. The method as recited in claim 1, the input device comprising an input device that is physically separate from and communicatively removable from a computing device.

7. The method as recited in claim 1, the determining comprising determining which of the multiple different user intents is intended by comparing the touch information to one or more graphs representing user input intents, and determining whether the key strike or the mouse click is intended based on an intent associated with the one of the one or more graphs with which the touch information conforms.

8. The method as recited in claim 1, the determining comprising determining which of the multiple different user intents is intended for the single finger touching the keyboard in the absence of another option or button selection by a user to indicate which of the multiple different user intents is intended.

9. The method as recited in claim 1, further comprising:

using the touch information to identify a location of the keyboard touched by the single finger touching the keyboard; and

recording a user selection of a key associated with the location in response to determining that the user intent intended for the single finger touching the keyboard is the key strike, but not recording the user selection of the key associated with the location in response to determining that the user intent intended for the single finger touching the keyboard is the mouse click or the single finger motion.

10. An apparatus comprising an input device configured to provide an output that indicates touch information regarding a single finger touching a keyboard of the input device, the touch information including force information, the input device supporting multiple different user intents for the single finger touching the keyboard of the input device, the multiple different user intents including a key strike, a mouse click, and a single finger motion, the output being usable by one or more modules to automatically classify the user intent for the single finger touching the keyboard as the key strike in response to the touch information conforming to characteristics of the key strike, classify the user intent for the single finger touching the keyboard as the mouse click in response to the touch information conforming to characteristics of the mouse click, and classify the user intent for the single finger touching the keyboard as the single finger motion in response to the touch information conforming to characteristics of the single finger motion, the characteristics of the key strike indicating that the force applied by the single finger touching the keyboard rises faster than the characteristics of the mouse click indicate.

11. The apparatus as recited in claim 10, the input device comprising a pressure sensitive input device.

12. The apparatus as recited in claim 11, the touch information comprising information indicating changes in locations where pressure is applied to the keyboard of the pressure sensitive input device over time as well as changes in pressure applied to the keyboard over time.

13. The apparatus as recited in claim 10, the apparatus including the one or more modules.

14. The apparatus as recited in claim 10, the output being usable by the one or more modules to automatically classify the user intent for the single finger touching keyboard in the absence of another option or button selection by a user to indicate which of the multiple different user intents is intended.

15. The apparatus as recited in claim 10, the input device comprising an input device that is physically separate from and communicatively removable from a computing device.

16. The apparatus as recited in claim 10, further comprising:

the output being usable by the one or more modules to record a user selection of a key associated with a location of the keyboard touched by the single finger in response to classifying the user intent for the single finger touching the keyboard as the key strike, but not record the user selection of the key associated with the location in response to classifying the user intent for the single finger touching the keyboard as the mouse click or the single finger motion.

17. An apparatus comprising:

a hardware processor; and

computer-readable storage devices having stored thereon multiple instructions that, responsive to execution by the processor, cause the processor to perform operations comprising;

obtaining touch information regarding a single finger touching a keyboard of an input device, the touch information comprising force information, the input device supporting multiple different user intents for the single finger touching the keyboard; and

automatically determining, based on the touch information, which of the multiple different user intents is intended for the single finger touching the keyboard, the multiple different user intents including a key strike, a mouse click, and a single finger motion, and the determining including;

determining that the user intent intended for the single finger touching the keyboard is the key strike in response to the touch information conforming to characteristics of a key strike,

determining that the user intent intended for the single finger touching the keyboard is the mouse click in response to the touch information conforming to characteristics of the mouse click, the characteristics of the key strike indicating that the force applied by the single finger touching the keyboard rises faster than the characteristics of the mouse click indicate, and

determining that the user intent intended for the single finger touching the keyboard is the single finger motion in response to the touch information conforming to characteristics of the single finger motion.

18. The apparatus as recited in claim 17, the apparatus including the input device.

19. The apparatus as recited in claim 17, the single finger touching the keyboard comprising a single touch user input, and the touch information comprising force information indicating pressure applied to the keyboard by the single touch user input.

20. The apparatus as recited in claim 17, the single finger touching the keyboard comprising a single touch user input, and the touch information comprising contact information indicating an area of the keyboard that is touched by the single touch user input.