System and method for a user interface for text editing and menu selection

• US 7,542,029 B2
• Filed: 07/03/2007
• Issued: 06/02/2009
• Est. Priority Date: 09/20/2005
• Status: Active Grant

• Current Assignee: Cerence Operating Company (Cerence Inc.)
• Original Assignee: Swype, Inc. (Microsoft Corporation)
• Inventors: Kushler, Cliff
• Primary Examiner(s): Shankar; Vijay
• Application Number:
  US11/824,950
• Publication Number:
  US 20080316212A1
• Time in Patent Office: 700 Days
• Field of Search: 345168-183, 178 1801- 1807, 178 1901- 1906, 715/773, 715/863, 715/864
• US Class Current: 345/168
• CPC Class Codes: G06F 2203/04807 Pen manipulated menu
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
• CPC Class Codes: G06F 40/166 Editing, e.g. inserting or deleting

Abstract

Methods and system to enable a user of an input action recognition text input system to edit any incorrectly recognized text without re-locating the text insertion position to the location of the text to be corrected. The System also automatically maintains correct spacing between textual objects when a textual object is replaced with an object for which automatic spacing is generated in a different manner. The System also enables the graphical presentation of menu choices in a manner that facilitates faster and easier selection of a desired choice by performing a selection gesture requiring less precision than directly contacting the sub-region of the menu associated with the desired choice.

Claims

1. An apparatus comprising:

an output display device on which two or more choices for selection are graphically presented;

an input device which detects one or more input actions performed by a user to position, move, and activate or de-activate a control point on said display; and

a processor coupled to the input device, and the output device, the processor comprising;

a first component for displaying a graphical presentation of said two or more choices within a defined, bounded region on said display;

a second component for defining one or more distinct segments of the boundary of said bounded region;

a third component for uniquely associating each of one or more of said defined segments with a distinct one of said graphically presented choices;

a fourth component for detecting an activation of said control point within said bounded region;

a fifth component for detecting a subsequent movement of said activated control point such that said activated control point exits said bounded region;

a sixth component for identifying one of said distinct boundary segments through which said activated control point is moved in exiting said bounded region; and

a sixth component for determining one of said graphically presented choices based on said identified boundary segment.

2. The apparatus of claim 1, wherein said processor further comprises:

a seventh component for presenting each said choice within a distinct bounded sub-region within said bounded region;

an eighth component for defining said distinct boundary segments as the boundary segments that coincide with a boundary segment of one of said sub-regions; and

a ninth component for associating said choice presented within said sub-region with said coinciding boundary segment.

3. The apparatus of claim 1, wherein said processor further comprises:

a seventh component for graphically presenting one or more of said choices using one or more of a color, graphical pattern, or shading and for graphically presenting each said uniquely associated defined distinct boundary segment using a comparable one or more of a color, graphical pattern, or shading.

4. The apparatus of claim 1, wherein said processor further comprises:

a seventh component for modifying the graphical presentation of said defined, bounded region upon detecting an activation of said control point within said bounded region.

5. The apparatus of claim 1, wherein the relation between the lengths of two or more of said defined boundary segments is related to the relation between determined probabilities that a user will select each of said graphically presented choices uniquely associated with each of said two or more defined boundary segments.

6. A method of graphically presenting two or more choices for selection within a defined, bounded region on an electronic display wherein a user can position, move, and activate or de-activate a control point on said display, the method comprising:

displaying a graphical presentation of said two or more choices within said bounded region;

defining one or more distinct segments of the boundary of said bounded region;

uniquely associating each of one or more of said defined segments with a distinct one of said graphically presented choices;

detecting an activation of said control point within said bounded region;

detecting a subsequent movement of said activated control point such that said activated control point exits said bounded region;

identifying one of said distinct boundary segments through which said activated control point is moved in exiting said bounded region; and

determining one of said graphically presented choices based on said identified boundary segment.

7. The method of claim 6, wherein each said choice is presented within a distinct bounded sub-region within said bounded region, and wherein said defined distinct boundary segments are defined as the boundary segments that coincide with a boundary segment of one of said sub-regions, and wherein the choice presented within said sub-region is uniquely associated with said coinciding boundary segment.

8. The method of claim 6, wherein one or more of said choices is graphically presented using one or more of a color, graphical pattern, or shading and wherein each said uniquely associated defined distinct boundary segment is presented using a comparable one or more of a color, graphical pattern, or shading.

9. The method of claim 6, further comprising modifying the graphical presentation of said defined, bounded region upon detecting an activation of said control point within said bounded region.

10. The method of claim 6, wherein the relation between the lengths of two or more of said defined boundary segments is related to the relation between determined probabilities that a user will select each of said graphically presented choices uniquely associated with each of said two or more defined boundary segments.

11. A method of inputting and editing text on an electronic device with a user interface comprising at least one input system which detects input actions of a user to generate and edit text, and at least one text presentation system through which said text is presented to said user, the method comprising:

recording the location of a text insertion position within said text presentation system where a next generated textual object will be output;

detecting a distinctive input action to identify one or more of said textual objects previously output to said text presentation system;

identifying one or more of said textual objects previously output based on the detected distinctive input action;

determining one or more alternate textual objects that correspond to one or more detected input actions from which said identified one or more textual objects was previously determined;

replacing said identified previously output one or more textual objects with one or more of said determined alternate textual objects; and

restoring said text insertion position to a location recorded prior to said detecting of said distinctive input action.

12. The method of claim 11, further comprising presenting one or more of said determined one or more alternate textual objects on the text presentation system to the user for selection of one of the presented textual objects for replacing said identified previously output one or more textual objects.

13. The method of claim 11, further comprising determining a location within said text presentation system associated with said distinctive input action, and identifying a textual object previously output to said text presentation system that is closest to said determined location.

14. The method of claim 11, further comprising automatically generating one or more spaces between one or more output textual objects.

15. The method of claim 14, further comprising identifying two or more textual objects as belonging to two or more classes of textual objects, wherein each of said two or more classes of textual objects differs from other said classes in the manner in which one or more spaces are automatically generated at least one of preceding or following the output of a textual object belonging to said class.

16. The method of claim 15, further comprising at least one of automatically inserting or automatically deleting spaces located at least one of preceding or following a textual object that replaces a textual object belonging to a different class of said classes of textual objects.

17. The method of claim 15, further comprising detecting changes in the location of said text insertion position, and modifying the manner in which one or more spaces are automatically generated at least one of preceding or following the output of a next textual object at said changed text insertion position with respect to the said classes of textual objects associated with the textual objects immediately adjacent to said changed text insertion position and with respect to any spaces immediately adjacent to said changed text insertion position.

18. The method of claim 14, further comprising detecting a distinctive user input action and disabling said automatic generation of spaces associated with the output of a next generated textual object, and automatically re-enabling said automatic generation of spaces following the output of said next generated textual object.

19. The method of claim 14, further comprising detecting a distinctive user input action and deleting the most recently generated one of said automatically generated spaces.

20. The method of claim 11, further comprising presenting two or more of said determined alternate textual objects on the text presentation system and detecting a selection by the user to identify said alternate textual object which replaces said indicated textual object.

21. The method of claim 20, wherein said user performs one or more other input actions prior to selecting any of said presented alternate textual objects as a replacement for said identified textual object, and said restoring of said text insertion position is not performed, and said identified textual object is selected as said text insertion position, such that the result of said one or more other input actions modifies or replaces said indicated textual object.

22. The method of claim 11, further comprising automatically identifying one of said determined alternate textual objects which replaces said identified textual object as being the alternate textual object that is determined to be the next most closely corresponding textual object to said detected input actions.

23. The method of claim 11, further comprising not restoring said text insertion position within said text presentation system to a location recorded prior to said detecting of said distinctive input action when said location is not located within the text that is currently visible on said text presentation system.

24. A text input and editing apparatus comprising:

one or more input devices which detect one or more input actions of a user to generate and edit text;

an output device on which generated text is presented to a user; and

a processor coupled to the input device, and the output device, the processor comprising;

a first component for recording the location of a text insertion position where a next generated textual object will be output;

a second component for detecting a distinctive input action identify one or more of said textual objects previously output to said output device;

a third component for identifying one or more of said textual objects previously output based on the detected distinctive input action;

a fourth component for determining one or more alternate textual objects that correspond to said one or more detected input actions from which said identified one or more textual objects was previously determined;

a fifth component for replacing said identified previously output one or more textual objects with one or more of said determined alternate textual objects; and

a sixth component for restoring said text insertion position to a location recorded prior to said detecting of said distinctive input action.

25. The apparatus of claim 24, wherein said processor further comprises:

a seventh component for presenting one or more of said determined one or more alternate textual objects on said output device to the user for selection of one of the presented textual objects for replacing said identified previously output one or more textual objects.

26. The apparatus of claim 24, wherein said processor further comprises:

a seventh component for determining a location within said output device associated with said distinctive input action; and

an eighth component for identifying a textual object previously output to said output device that is closest to said determined location.

27. The apparatus of claim 24, wherein said processor further comprises:

a seventh component for automatically generating one or more spaces between one or more output textual objects.

28. The apparatus of claim 27, wherein said processor further comprises:

an eighth component for identifying two or more textual objects as belonging to two or more classes of textual objects, wherein each of said two or more classes of textual objects differs from other said classes in the manner in which one or more spaces are automatically generated at least one of preceding or following the output of a textual object belonging to said class.

29. The apparatus of claim 28, wherein said processor further comprises:

a ninth component for at least one of automatically inserting or automatically deleting spaces located at least one of preceding or following a textual object that replaces a textual object belonging to a different class of said classes of textual objects.

30. The apparatus of claim 28, wherein said processor further comprises:

a ninth component for detecting changes in the location of said text insertion position, and modifying the manner in which one or more spaces are automatically generated at least one of preceding or following the output of a next textual object at said changed text insertion position with respect to the said classes of textual objects associated with the textual objects immediately adjacent to said changed text insertion position and with respect to any spaces immediately adjacent to said changed text insertion position.

31. The apparatus of claim 27, wherein said processor further comprises:

an eighth component for detecting a distinctive user input action and disabling said automatic generation of spaces associated with the output of a next generated textual object, and automatically re-enabling said automatic generation of spaces following the output of said next generated textual object.

32. The apparatus of claim 27, wherein said processor further comprises:

an eighth component for detecting a distinctive user input action and deleting the most recently generated one of said automatically generated spaces.

33. The apparatus of claim 24, wherein said processor further comprises:

a seventh component for presenting two or more of said determined alternate textual objects on said output device; and

an eighth component for detecting a selection by the user to identify said alternate textual object which replaces said indicated textual object.

34. The apparatus of claim 33, wherein said processor further comprises:

a ninth component for detecting one or more other input actions performed by said user prior to selecting any of said presented alternate textual objects as a replacement for said identified textual object; and

a tenth component for selecting said identified textual object as said text insertion position, such that the result of said one or more other input actions modifies or replaces said indicated textual object and such that said text insertion position is not restored to said prior location.

35. The apparatus of claim 24, wherein said processor further comprises:

a seventh component for automatically identifying one of said determined alternate textual objects which replaces said identified textual object as being the alternate textual object that is determined to be the next most closely corresponding textual object to said detected input actions from which said identified textual object was generated.

36. The apparatus of claim 24, wherein said processor further comprises:

a seventh component for determining whether said location of said text insertion position recorded prior to said detecting of said distinctive input action is not located within the text that is currently visible on said output device; and

an eighth component for preventing said sixth component from restoring said text insertion position to said location recorded prior to said detecting of said distinctive input action when said seventh component determines that said recorded location is not located within the text that is currently visible on said output device.