System and process for selectable input with a touch screen

• US 8,237,682 B2
• Filed: 10/22/2010
• Issued: 08/07/2012
• Est. Priority Date: 04/09/2003
• Status: Expired due to Term

• Current Assignee: Cerence Operating Company (Cerence Inc.)
• Original Assignee: Tegic Communications, Inc. (Microsoft Corporation)
• Inventors: Stephanick, James, James, Christina, Bradford, Ethan R., Longe, Michael R.
• Primary Examiner(s): Kumar, Srilakshmi K
• Application Number:
  US12/910,684
• Publication Number:
  US 20110037718A1
• Time in Patent Office: 655 Days
• Field of Search: 345173-179, 178 1801- 2004, 341/5
• US Class Current: 345/173
• CPC Class Codes: G06F 3/0236 using selection techniques to select from displayed items
• CPC Class Codes: G06F 3/0237 using prediction or retrieval techniques
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus

Abstract

A selective input system and associated method is provided which tracks the motion of a pointing device over a region or area. The pointing device can be a touchpad, a mouse, a pen, or any device capable of providing two or three-dimensional location. The region or area is preferably augmented with a printed or actual keyboard/pad. Alternatively, a representation of the location of the pointing device over a virtual keyboard/pad can be dynamically shown on an associated display. The system identifies selections of items or characters by detecting parameters of motion of the pointing device, such as length of motion, a change in direction, a change in velocity, and or a lack of motion at locations that correspond to features on the keyboard/pad. The input system is preferably coupled to a text disambiguation system such as a T9® or Sloppytype™ system, to improve the accuracy and usability of the input system.

Claims

1. A process for selectable input with a touch screen having a plurality of selectable regions therein, the process comprising the steps of:

tracking motion that corresponds to interaction of a user in relation to the touch screen, wherein the tracked motion defines a path comprising path data, wherein the path data comprises sequential positions and corresponding times;

for each sequential position, comparing the current position and corresponding time to the path data;

detecting if the current position meets a threshold of a selectable position along the defined path, wherein the defined path comprises at least two selectable positions,

wherein the threshold of a selectable position in relation to the touch screen comprises any of starting the defined path, looping the defined path, changing direction of the defined path, changing velocity of the defined path, pausing motion in the defined path, and ending the defined path, and

wherein the threshold of changing direction comprises any of a curve having an estimated radius that is less than a threshold geometry, a comparison of the defined path direction before and after a curve, a sharp cusp edge in the defined path, and a comparison of path direction before and after a cusp;

determining which of the detected selectable positions along the defined path correspond to one of the selectable regions; and

adding a selection that corresponds to the detected selectable region to a sequence of selections that corresponds to the defined path.

2. The process of claim 1, wherein the motion associated with the user interaction comprises motion of any of a stylus, an input device, or at least a portion of the body of the user.

3. The process of claim 2, wherein the portion of the body of the user comprises one or more fingers.

4. The process of claim 1, wherein the selectable regions are associated with any of characters, numbers, tasks, actions, functions, decisions, priorities, outcomes, or points.

5. The process of claim 1, further comprising the step of:

dynamically showing a representation of the location of the path on a display.

6. The process of claim 1, further comprising the step of:

disambiguating at least one subsequent position that does not clearly indicate a selectable region within the touch screen.

7. The system of claim 1, wherein the touch screen is associated with any of a portable digital assistant, a portable telephone, a mobile telephone, a portable computer, and a portable game device.

8. The process of claim 1, further comprising the step of:

disambiguating at least one determined position that corresponds to an alternate selection.

9. The process of claim 8, wherein the disambiguation step comprises the steps of:

displaying the alternate selection; and

entering a choice selected by the user between the determined position and the alternate selection.

10. The process of claim 1, further comprising the step of:

disambiguating at least one subsequent position based upon a contextual comparison between the subsequent position and stored information.

11. A process for selectable input for a device, comprising the steps of:

tracking motion that corresponds to interaction of a user with a touch screen having a plurality of selectable regions therein, wherein the tracked motion defines a path comprising path data, wherein the path data comprises sequential positions and corresponding times;

for each sequential position, comparing the current position and corresponding time to the path data;

determining if the current position meets a threshold of a selectable position along the defined path;

wherein when the current position of the device meets the threshold of a selectable position along the path, the process determines if the selectable position corresponds to a selectable region; and

adding a selection that corresponds to the selectable region to a sequence of selections that corresponds to the defined path.

12. The process of claim 11, wherein the motion corresponding to interaction of the user comprises motion of any of a stylus, an input device, or at least a portion of the body of the user.

13. The process of claim 12, wherein the portion of the body of the user comprises one or more fingers.

14. The process of claim 11, wherein the selectable regions are associated with any of characters, numbers, tasks, actions, functions, decisions, priorities, outcomes, or points.

15. The process of claim 11, further comprising the step of:

dynamically showing a representation of the path on a display.

16. The process of claim 11, further comprising the step of:

disambiguating at least one subsequent position that does not clearly indicate a selectable region within the touch screen.

17. The process of claim 11, wherein the selectable position comprises any of starting the path, looping the path, changing direction of the path, changing velocity of the path, pausing motion in the path, and ending the path.

18. The process of claim 17, wherein the selectable position of changing direction comprises any of a curve having an estimated radius that is less than a threshold geometry, a comparison of the path direction before and after a curve, a sharp cusp edge in the path, and a comparison of path direction before and after a cusp.

19. The process of claim 11, wherein the touch screen is associated with any of a portable digital assistant, a portable telephone, a mobile telephone, a portable computer, and a portable game device.

20. The process of claim 11, further comprising the step of:

disambiguating at least one determined position that corresponds to an alternate selection.

21. The process of claim 20, wherein the disambiguation step comprises the steps of:

displaying the alternate selection; and

entering a choice selected by the user between the determined position and the alternate selection.

22. The process of claim 11, further comprising the step of:

disambiguating at least one subsequent position based upon a contextual comparison between the subsequent position and stored information.

23. A system for selectable input in relation to a touch screen having a plurality of selectable regions therein, the system comprising:

a mechanism for tracking motion associated with the interaction of a user in relation to the touch screen, wherein the tracked motion defines a path comprising path data, wherein the path data comprises sequential positions and corresponding times; and

at least one processor programmed for

comparing the current position and corresponding time for each sequential position to the path data; and

determining if the current position meets a threshold of a selectable position along the defined path,

wherein when the current position of the device meets the threshold of a selectable position along the path, the processor is programmed to determine if the selectable position corresponds to a selectable region, and wherein the processor is programmed to add a selection that corresponds to the selectable region to a sequence of selections that corresponds to the defined path.

24. The system of claim 23, wherein the motion corresponding to user interaction comprises motion of any of a stylus, an input device, or at least a portion of the body of the user.

25. The system of claim 24, wherein the portion of the body of the user comprises one or more fingers.

26. The system of claim 23, wherein the selectable regions are associated with any of characters, numbers, tasks, actions, functions, decisions, priorities, outcomes, or points.

27. The system of claim 23, wherein the at least one processor is further programmed to disambiguate at least one subsequent position which does not clearly indicate a selectable region within the touch screen.

28. The system of claim 23, wherein the at least one processor is further programmed to disambiguate at least one determined position which corresponds to an alternate selectable region.

29. The system of claim 23, wherein the selectable position comprises any of starting the path, looping the path, changing direction of the path, changing velocity of the path, pausing motion in the path, and ending the path.

30. The system of claim 29, wherein the selectable position of changing direction comprises any of a curve having an estimated radius that is less than a threshold geometry, a comparison of the path direction before and after a curve, a sharp cusp edge in the path, and a comparison of path direction before and after a cusp.