Directional input system with automatic correction

• US 7,778,818 B2
• Filed: 09/21/2007
• Issued: 08/17/2010
• Est. Priority Date: 05/26/2000
• Status: Expired due to Fees

• Current Assignee: Cerence Operating Company (Cerence Inc.)
• Original Assignee: Tegic Communications, Inc. (Microsoft Corporation)
• Inventors: Palmer, Brian, Hullfish, Keith Charles, Brams, Doug, Longe, Michael R.
• Primary Examiner(s): Hudspeth; David R
• Assistant Examiner(s): Spooner; Lamont M
• Application Number:
  US11/859,505
• Publication Number:
  US 20080015841A1
• Time in Patent Office: 1,061 Days
• Field of Search: 704 1- 10, 345/161, 345/164, 345/168, 345/173, 341/22, 708/145, 715/256, 715/257, 715/261
• US Class Current: 704/9
• CPC Class Codes: G06F 3/018 Input/output arrangements for oriental characters
• CPC Class Codes: G06F 3/02 Input arrangements using manually operated switches, e.g. using keyboards or dials
• CPC Class Codes: G06F 3/0236 using selection techniques to select from displayed items
• CPC Class Codes: G06F 3/0237 using prediction or retrieval techniques
• CPC Class Codes: G06F 3/0354 with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
• CPC Class Codes: G06F 3/04897 Special input arrangements or commands for improving display capability
• CPC Class Codes: G06F 40/232 Orthographic correction, e.g. spell checking or vowelisation
• CPC Class Codes: G06F 40/253 Grammatical analysis; Style critique
• CPC Class Codes: G06F 40/274 Converting codes to words; Guess-ahead of partial word inputs
• CPC Class Codes: G06V 30/1423 the instrument generating sequences of position coordinates corresponding to handwriting preprocessing or recognising digital ink G06V30/32

Abstract

A system associated with a text entry application, such as email or instant messaging, comprises an optional onscreen representation of a circular keyboard, a list of potential linguistic object matches, and a message area where the selected words are entered. The circular keyboard is manipulated via a hardware joystick or game-pad with analog joystick or omni-directional rocker switch built therein. The user points the joystick in the general direction of the desired letter, and then continues pointing roughly to each letter in the desired word. Once all letters have been roughly selected, buttons are used to select a specific word from the list of potential matches and send the selected word to the message area.

Claims

1. A text entry input system, comprising:

a direction selector to individually point in a direction of letters to collectively form an intended linguistic object, where each letter comprises a linguistic object subcomponent;

a collection of linguistic objects;

an output device with a text display area;

a processor, comprising;

a difference calculation module configured to output, for each act of pointing, various letters based upon factors including at least a vector difference between an actual direction indicated by the directional selector and pre-assigned directions of said letters;

an object search engine configured to construct at least one predicted linguistic object based on the output letters; and

a selection component to facilitate user selection of a desired linguistic object.

2. The system of claim 1, further comprising an on-screen keyboard representation of an array of letters in each writing system.

3. The system of claim 2, wherein said on-screen keyboard is of any shape selected from a group comprising circle, square, oval, and polygon.

4. The system of claim 1, further comprising a set of compass point letters, said compass point letters being placed in an on-screen compass area.

5. The system of claim 1, wherein each letter comprises any subcomponent or combination of one or more of the following forming an incomplete part of one of the linguistic objects:

an alphabetic letter, numeric digit, symbol, character;

a sub-word component from a non-English language including one or more strokes, radicals, jamos, kana, punctuation symbols, digits.

6. The system of claim 1, wherein said linguistic objects are ordered according to a linguistic model.

7. The system of claim 6, where said linguistic model includes one or more of:

frequency of occurrence of a linguistic object in formal or conversational written text;

frequency of occurrence of a linguistic object when following a preceding linguistic object or linguistic objects;

proper or common grammar of the surrounding sentence;

application context of current linguistic object entry; and

recency of use or repeated use of the linguistic object by the user or within an application program.

8. The system of claim 1, wherein said list of predicted linguistic objects are ordered by a combination value of a calculated weighted difference value and a linguistic model.

9. The system of claim 8, wherein said linguistic model comprises one or more of:

frequency of occurrence of a linguistic object in formal or conversational written text;

frequency of occurrence of a linguistic object when following a preceding linguistic object or linguistic objects;

proper or common grammar of the surrounding sentence;

application context of current linguistic object entry; and

recency of use or repeated use of the linguistic object by the user or within an application program.

10. The system of claim 1, further comprising a means for extending a selected linguistic object with completions.

11. The system of claim 1, further comprising a means for precisely selecting said letters of said linguistic object.

12. The system of claim 1, wherein an exact spelling sequence is displayed in said text display area.

13. The system of claim 1, wherein the last entered letter is indicated in said exact spelling sequence.

14. The system of claim 1, wherein the last entered letter is indicated in said on-screen keyboard.

15. The system of claim 1, further comprises a smart punctuation symbol, said smart punctuation symbol when selected is automatically interpreted as a punctuation symbol, diacritic mark or tonal indication at the place in the input sequence where a matching punctuation symbol, diacritic mark or tonal indication occurs in predicted linguistic objects.

16. A text input method using a directional input device, wherein each direction entered corresponds, directly or indirectly, to one or more linguistic object subcomponents according to a predetermined mapping, said method comprising the steps of:

for each user act of pointing the directional input device, preparing an output of candidate linguistic object subcomponents based upon factors including at least a vector difference between directions indicated by the directional input device and pre-assigned directions of said linguistic object subcomponents according to the predetermined mapping;

using the output to predict at least one linguistic object;

facilitating user selection of a desired linguistic object.

17. The method of claim 16, wherein the candidate linguistic object subcomponents can be one of any number of letters or symbols near the direction entered.

18. The method of claim 16, further comprising utilizing a linguistic model to order said list of predicted linguistic objects according to likelihood of intended selection by the user.

19. The method of claim 18, wherein the order of said list of predicted linguistic objects is based on a combination of weightings and the linguistic model.

20. The method of claim 18, wherein the linguistic model comprises one or more of:

frequency of occurrence of a linguistic object in formal or conversational written text;

frequency of occurrence of a linguistic object when following a preceding linguistic object or linguistic objects;

proper or common grammar of the surrounding sentence;

application context of current linguistic object entry; and

recency of use or repeated use of the linguistic object by the user or within an application program.

21. The method of claim 16, wherein said directional input device is associated with an on-screen keyboard.

22. The method of claim 16, wherein the user selects a partial linguistic object and continues with more directional inputs.

23. The method of claim 22, wherein said list of predicted linguistic objects is filtered to include only linguistic objects that begin with said selected partial linguistic object.

24. The method of claim 16, wherein a set of buttons or a second directional input device can be used alone or with said directional input device, separately or simultaneously, to switch or choose input modes, to change from input to word selection, or to invoke other functions.

25. The method of claim 16, further comprising the steps of:

invoking an undo means after selecting a linguistic object from a list of predicted linguistic objects; and

re-displaying said list.

26. The method of claim 16, further comprising the steps of:

selecting a linguistic object from a text message; and

displaying subcomponents of said linguistic object as if said subcomponents had been entered exactly and constructing a predicted list of linguistic objects based on the displayed subcomponents.

27. A text entry input module for use with user interface components including a direction indicator and a output device with a text display area, the text entry input module comprising:

a database of linguistic objects;

a predetermined set of linguistic object subcomponents;

where a predetermined relationship exists between said linguistic object subcomponents and different assigned vector values of the direction indicator;

a calculation module to apply the predetermined relationship to each user-submitted direction entered via the direction indicator to provide an output, said output including multiple predicted linguistic object subcomponents including a group of linguistic object subcomponents whose assigned vector values are nearest the user-submitted directions;

an object search engine configured to use the output to retrieve from the database at least one predicted linguistic object potentially representative of the user-submitted directions; and

a selection component to facilitate user selection of a desired linguistic object.

28. A text entry input module for use with user interface components including a direction indicator and an output device with a display, the text entry input module comprising:

a vocabulary database of linguistic objects;

a mapping between vector values of the direction indicator and linguistic object subcomponents;

a calculation module to apply the mapping to each user-submitted direction entered via the direction indicator to provide an output including multiple potentially user-intended linguistic object subcomponents;

an object search engine configured to retrieve at least one predicted linguistic object from the vocabulary database based upon said calculation module output; and

a selection component to facilitate user selection of a desired linguistic object.

29. A computer readable storage medium tangibly embodying a program of instructions executable by a digital data processing machine to perform text input operations comprising the steps of:

receiving machine-readable signals representing a series of user-submitted directional inputs entered via a directional input tool, the series having an order;

where directional inputs of the directional input tool correspond to different linguistic object subcomponents according to a predetermined mapping;

for each user-submitted directional input, based upon that directional input alone, estimating multiple corresponding subcomponents that the user might have intended by such directional input;

assembling the different ones of the estimated subcomponents to construct multiple different proposed linguistic objects that the user might have intended by the series of directional inputs, where each proposed object includes one estimated subcomponent for each user-submitted directional input, the subcomponents occurring in the proposed object in the same order as the series of user-submitted directional inputs;

facilitating selection of a desired one of the proposed objects.

30. The medium of claim 29, where each linguistic object subcomponent comprises at least one of the following:

an alphabetic letter, numeric digit, symbol, character;

a sub-word component from a non-English language including one or more strokes, radicals;

jamos, kana, punctuation symbols, digits;

a subcomponent or combination of one or more of the foregoing.

31. The medium of claim 29, the assembling operation further comprising:

ordering proposed linguistic objects according to considerations including one or more of the following;

presence in a predetermined vocabulary, presence in a user-defined list, frequency of general usage.

32. The medium of claim 29, the estimating operation further comprising:

for each user-submitted directional input, identifying linguistic object subcomponents within a predetermined angular range thereof according to the predetermined mapping;

limiting the estimated subcomponents to those identified.

33. The medium of claim 29, further comprising the step of providing a weighting value comprising at least one of the following:

providing a weighting value for each linguistic object subcomponent according to angular proximity between the subcomponent'"'"'s corresponding actual user-submitted directional input and the directional input exactly mapped to the subcomponent;

providing a weighting value depending at least in part on frequency of general usage of the subcomponent.

34. The medium of claim 29, where the assembling operation further comprises ordering the proposed linguistic objects according to one or more of the following:

word length, ordinal ranking, weighting value of proposed linguistic object subcomponents, frequency of general usage, recency of use, appearance in a user-defined list.

35. A computer programmed to facilitate operations for text entry, the operations comprising the steps of:

by using a joystick having predefined mapping between different actual radial directions and different text characters, a user sequentially pointing in an intended radial direction toward intended characters of at least part of an intended word;

the computer determining angular similarity between each actual pointing direction and radial directions of different characters in the mapping, and using the determined angular similarity to compute different possible combinations of intended characters that could form the intended word, and presenting a list of potential matching words to the user, where the presentation favors potential matching words according to factors including an aggregate angular similarity of constituent characters of a potential matching word to the actual pointing directions;

the user selecting the intended word from the list;

the computer displaying the selected word in a human-readable message composition display area.