Virtual keyboard system with automatic correction

• US 8,441,454 B2
• Filed: 06/19/2009
• Issued: 05/14/2013
• Est. Priority Date: 05/27/1999
• Status: Expired due to Fees

• Current Assignee: Cerence Operating Company (Cerence Inc.)
• Original Assignee: Tegic Communications, Inc. (Microsoft Corporation)
• Inventors: Longe, Michael R., Van Meurs, Pim
• Primary Examiner(s): Mengistu, Amare
• Assistant Examiner(s): XAVIER, ANTONIO J
• Application Number:
  US12/488,375
• Publication Number:
  US 20090284471A1
• Time in Patent Office: 1,425 Days
• Field of Search: None
• US Class Current: 345/173
• CPC Class Codes: G06F 3/0237 using prediction or retrieval techniques
• CPC Class Codes: G06F 3/0238 Programmable keyboards key guide holders G06F3/0224
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
• CPC Class Codes: G06F 3/0489 using dedicated keyboard keys or combinations thereof
• CPC Class Codes: G06F 40/232 Orthographic correction, e.g. spell checking or vowelisation
• CPC Class Codes: G06F 40/274 Converting codes to words; Guess-ahead of partial word inputs
• CPC Class Codes: G06F 40/40 Processing or translation of natural language natural language analysis G06F40/20; semantic analysis G06F40/30

Abstract

An enhanced text entry system uses word-level analysis to correct inaccuracies automatically in user keystroke entries on reduced-size or virtual keyboards. One or more alternate textual interpretations each sequence of inputs detected within a designated auto-correcting region. Actual interaction locations for keystrokes may occur outside the boundaries of specific keyboard key regions associated with actual characters of the word interpretations proposed or offered for selection, where the distance from each interaction location to each corresponding intended character may increase with the expected frequency of the intended the language or in a particular context. In a virtual keyboard system, keys actuated may differ from keys actually associated with letters of the word interpretations. Each such sequence corresponds to a complete word, and the user can select the intended word from among generated interpretations.

Claims

1. A text entry system comprising:

a user input device comprising;

an auto-correcting keyboard region comprising a plurality of the characters of a character set, wherein locations having known coordinates in the auto-correcting keyboard region are associated with one or more of the character set members, wherein a location is determined when a user interacts with the user input device within the auto-correcting keyboard region and the determined interaction location is added to a current input sequence; and

a memory containing a plurality of objects, wherein one or more objects comprise a string of one or a plurality of characters forming all or part of a word or phrase;

an output device; and

a processor coupled to the user input device, memory, and output device, said processor comprising;

a distance value calculation component which, for a determined interaction location in said current input sequence, calculates a set of distance values between the interaction location and the known coordinate locations corresponding to one or a plurality of characters within the auto-correcting region;

an object evaluation component which, for said current input sequence, identifies one or a plurality of candidate objects in memory, and for one or more identified candidate objects, evaluates identified candidate objects by calculating a matching metric for each candidate object by summing the distance values calculated from each interaction location in the input sequence to the location assigned to the character in the corresponding position of the candidate object and applying a weighting function, wherein the weighting function comprises multiplying the sum of the distance values by the base 2 logarithm of the ordinal ranking of the object, and, if more than one candidate object is identified, ranks the evaluated candidate objects based on the calculated matching metric values; and

a selection component for identifying candidate objects according to their evaluated ranking, presenting any identified objects to the user, and enabling the user to select from among any presented objects for output to the output device.

2. The system of claim 1, wherein one or more of the plurality of objects in said memory is further associated with one or a plurality of predefined groupings of objects.

3. The system of claim 1, wherein one or more of the plurality of objects in said memory are further associated with one or a plurality of modules, wherein each module comprises or generates a set of objects having one or a plurality of common characteristics.

4. The system of claim 1, wherein the character set members are arranged on the auto-correcting keyboard region in approximately alphabetic order for a language.

5. The system of claim 1, wherein the character set members are arranged on the auto-correcting keyboard region in approximately any standard keyboard layout.

6. The system of claim 1, wherein the auto-correcting keyboard region comprises one or a plurality of known locations associated with one or a plurality of punctuation characters and/or diacritic marks, and wherein the memory comprises one or a plurality of objects which include one or a plurality of the punctuation characters and/or diacritic marks associated with locations in said region.

7. The system of claim 1, further comprising:

means for providing feedback to the user identifying the character set members near a current interaction location.

8. The system of claim 7, wherein the feedback is presented visually on the output device and one or more character set members corresponding to known locations closest to the current interaction location are indicated by one or more of:

size, color, background shading, and font attribute.

9. The system of claim 1, wherein the user input device further comprises means for changing some or all of the auto-correcting keyboard region to a determined key state, wherein a character set member is determined when a user interacts with one of the keys in the changed region and a representation of the determined character set member is added to said current input sequence.

10. The system of claim 1, wherein the word evaluation component determines, for a determined interaction location in said current input sequence, a closest known location corresponding to a character set member, and constructs an exact typing object composed of said corresponding and other determined character set members in an order corresponding to said current input sequence.

11. The system of claim 1, wherein the selection component identifies a highest ranked candidate object and presents the identified object on the output device.

12. The system of claim 11, wherein the selection component presents the identified object on the output device at or near the current interaction location.

13. The system of claim 11, further comprising a user input region or device that is associated with an object selection function, wherein an interaction with said device replaces the object presented on the output device with a next highest ranked object of the identified one or a plurality of candidate objects.

14. The system of claim 1, wherein the set of distance values calculated by the distance value calculation component are weighted or scaled based on any of:

the calculated distance from the determined interaction location to the known coordinate location corresponding to each character set member relative to a determined value, said calculated distance relative to the shortest distance to a known coordinate location corresponding to a character set member, and a promotion value associated with each character set member.

15. The system of claim 14, wherein the word evaluation component calculates the matching metric for each candidate object based on the product of the distance values calculated for each character set member in the corresponding position of the candidate object.

16. The system of claim 15, wherein ranking of the evaluated candidate objects by the word evaluation component is a function of their calculated matching metric value and the product of the most significant distance values of the sets calculated for all of the determined interaction locations in said current input sequence.

17. The system of claim 15, wherein ranking of the evaluated candidate objects by the word evaluation component is a function of the calculated matching metric value and an associated promotion value.

18. The system of claim 1, wherein for a character set member corresponding to a known coordinate location in the auto-correcting region, a region is predefined around one or a plurality of said known coordinate locations, wherein the distance between an input interaction location falling within said predefined region and the known coordinate location within said predefined region is calculated as a distance of zero.

19. The system of claim 1, wherein at least one of the locations with known coordinates in the auto-correcting region corresponds to a plurality of characters of a character set, one or a plurality of which comprise at least one diacritic mark, wherein the plurality of character set members comprise variant forms of another character set member and wherein objects in memory contain said variant forms.

20. The system of claim 1, wherein a candidate is selected through an alternate input modality.

21. The system of claim 1, wherein user inputs for said current input sequence are provided through a combination of different modalities.

22. The system of claim 1, wherein the selection component detects a distinctive manner of selection that is used to select a candidate object;

wherein upon detecting that an object has been selected through said distinctive manner, the system replaces a current input sequence with an input sequence composed of representations of the determined characters comprising the selected object; and

wherein a next interaction in the auto-correcting region is appended to the current input sequence.

23. The system of claim 22, wherein said distinctive manner of selection eliminates all candidates except those candidates that incorporate said selected object.

24. The system of claim 1, wherein the processor further comprises:

a frequency promotion component for adjusting a promotion value associated with each object in memory as a function of the number of times the object is selected by the user for output on the output device.

25. The system of claim 24, wherein the frequency promotion component analyzes additional information files that are accessible to the text entry system to identify new objects contained in said files that are not included among the objects already in said memory of said text entry system;

and wherein said newly identified objects are added to the objects in memory.

26. The system of claim 1, wherein one or a plurality of objects in memory are associated with a secondary object in memory, and wherein when the selection component identifies one of said objects for presentation to the user based on the matching metric calculated by the word evaluation component, the selection component presents the associated secondary object for selection.

27. The system of claim 1, wherein the user input device comprises any of:

a mouse, a trackball, a trackpad, a joystick, an eye- or body-movement tracking device, and a device for decoding brainwaves.

28. The system of claim 1, further comprising:

a linguistic model comprising any of;

frequency of occurrence of a linguistic object in formal or conversational written text;

frequency of occurrence of a linguistic object when following a preceding linguistic object or linguistic objects;

proper or common grammar of the surrounding sentence;

application context of current linguistic object entry; and

frequency of use or repeated use of the linguistic object by the user or within an application program.

29. The system of claim 28, further comprising:

means for providing visual feedback of the user'"'"'s interaction with said user input device.

30. The system of claim 28, further comprising:

means for providing proportional scaling to improve accuracy.

31. The system of claim 28, further comprising:

means for displaying magnified visual feedback of a character set member associated with a user interaction location.

32. The system of claim 1 wherein the user interaction comprises one or more pressure measurements at one or more locations within the auto-correcting keyboard region.

33. The system of claim 1 further comprising:

means for dynamically changing character set member locations or sub-regions within the auto-correcting keyboard region.

34. The system of claim 33, wherein said means for dynamically changing either assigns more sub-region area to character set members that are more frequent to decrease their ambiguity based on the user'"'"'s own vocabulary or pattern of use, or visually reflects cumulative inaccuracy adjustments by moving character set members and reshaping their sub-regions.

35. The system of claim 33, wherein said means for dynamically changing assigns more sub-region area to a character set member based on the frequency of said character set member at a given position in said strings of said plurality of objects in memory.