Selective input system and process based on tracking of motion parameters of an input object

• US 8,237,681 B2
• Filed: 07/02/2010
• Issued: 08/07/2012
• Est. Priority Date: 04/09/2003
• Status: Expired due to Term

• Current Assignee: Cerence Operating Company (Cerence Inc.)
• Original Assignee: Tegic Communications, Inc. (Microsoft Corporation)
• Inventors: Stephanick, James, James, Christina, Bradford, Ethan R., Longé, Michael R.
• Primary Examiner(s): Kumar, Srilakshmi K
• Application Number:
  US12/830,185
• Publication Number:
  US 20100271299A1
• Time in Patent Office: 767 Days
• Field of Search: 345173-179, 178 1801- 2004, 341/5
• US Class Current: 345/173
• CPC Class Codes: G06F 3/0236 using selection techniques to select from displayed items
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus

Abstract

A selective input system and associated method is provided which tracks the motion of a pointing device over a region or area. The pointing device can be a touchpad, a mouse, a pen, or any device capable of providing two or three-dimensional location. The region or area is preferably augmented with a printed or actual keyboard/pad. Alternatively, a representation of the location of the pointing device over a virtual keyboard/pad can be dynamically shown on an associated display. The system identifies selections of items or characters by detecting parameters of motion of the pointing device, such as length of motion, a change in direction, a change in velocity, and or a lack of motion at locations that correspond to features on the keyboard/pad. The input system is preferably coupled to a text disambiguation system such as a T9® or Sloppytype™ system, to improve the accuracy and usability of the input system.

Claims

1. A process for selectable input based on motion of an object associated with a user in relation to an input region having a plurality of selectable regions therein, the process comprising the steps of:

tracking the motion of the object in relation to the input region;

determining an object path of the object, comprising a plurality of positions and corresponding times, based upon the tracked motion;

for subsequent positions and corresponding times, comparing to path data;

detecting positions that meet at least one threshold of a selected position along the determined object path, wherein the determined object path comprises at least two selected positions,

wherein the threshold of a selected position within the region comprises any of starting the object path, looping the object path, changing direction of the object path, changing velocity of the object path, pausing motion in the object path, and ending the object path,

wherein the threshold of changing direction comprises any of a curve having an estimated radius that is less than a threshold geometry, a comparison of the object path direction before and after a curve, a sharp cusp edge in the object path, and a comparison of path direction before and after a cusp;

determining which of the detected selected positions along the determined object path correspond to a selectable region; and

entering each of the detected selected positions that correspond to one of the selectable regions.

2. The process of claim 1, wherein the input region comprises any of a one-dimensional region, a two dimensional region or a three dimensional volume.

3. The process of claim 1, wherein the object associated with the user comprises any of a stylus, an input device, a personal digital assistant (PDA), a cell phone, a laser pointer, a light pen, an accessory, a tool, an article of clothing, a ring, a bracelet, a toy, a sword, a wand, or at least a portion of the body of the user.

4. The process of claim 3, wherein the portion of the body of the user comprises any of a finger, a hand, a foot, a head, or an appendage.

5. The process of claim 1, wherein the selectable regions are associated with any of characters, tasks, actions, functions, decisions, priorities, outcomes, or points.

6. The process of claim 1, further comprising the step of:

dynamically showing a representation of the location of the object associated with the user on a display.

7. The process of claim 1, further comprising the step of:

disambiguating at least one subsequent position that does not clearly indicate a selectable region within the input region.

8. The process of claim 1, further comprising the step of:

disambiguating at least one determined position that corresponds to an alternate selectable region.

9. The process of claim 8, wherein the disambiguation step comprises the steps of:

displaying the alternate selectable region; and

providing a selectable choice by the user between the determined selectable region and the alternate selectable region.

10. A process for selectable input based on motion of an object associated with a user in relation to an input region having a plurality of selectable regions therein, the process comprising the steps of:

tracking the motion of the object in relation to the input region, wherein the tracked motion defines an object path comprising at least two selected positions;

determining which of the selected positions along the object path correspond to at least one of the selectable regions; and

detecting a characteristic motion of the object, the characteristic motion corresponding to at least one of the selected positions along the object path that correspond to at least one of the selectable regions, wherein the characteristic motion comprises any of starting the object path, looping the object path, changing direction of the object path, changing velocity of the object path, pausing motion in the object path, and ending the object path, and wherein the characteristic motion of changing direction comprises any of a curve having an estimated radius that is less than a threshold geometry, a comparison of the object path direction before and after a curve, a sharp cusp edge in the object path, and a comparison of path direction before and after a cusp.

11. The process of claim 10, wherein the input region comprises any of a one-dimensional region, a two dimensional region or a three dimensional volume.

12. The process of claim 10, wherein the object associated with the user comprises any of a stylus, an input device, a personal digital assistant (PDA), a cell phone, a laser pointer, a light pen, an accessory, a tool, an article of clothing, a ring, a bracelet, a toy, a sword, a wand, or at least a portion of the body of the user.

13. The process of claim 12, wherein the portion of the body of the user comprises any of a finger, a hand, a foot, a head, or an appendage.

14. The process of claim 10, wherein the selectable regions are associated with any of characters, tasks, actions, functions, decisions, priorities, outcomes, or points.

15. The process of claim 10, further comprising the step of:

dynamically showing a representation of the location of the object associated with the user on a display.

16. The process of claim 10, further comprising the step of:

disambiguating at least one subsequent position that does not clearly indicate a selectable region within the input region.

17. A system for selectable input based on motion of an object associated with a user in relation to an input region having a plurality of selectable regions therein, the system comprising:

a mechanism for tracking the motion of the object in relation to the input region, wherein the tracked motion defines an object path comprising at least two selected positions; and

at least one processor programmed for

determining which of the selected positions along the object path correspond to at least one of the selectable regions, and

detecting a characteristic motion of the object, the characteristic motion corresponding to at least one of the selected positions along the object path that correspond to at least one of the selectable regions, wherein the characteristic motion comprises any of starting the object path, looping the object path, changing direction of the object path, changing velocity of the object path, pausing motion in the object path, and ending the object path, and wherein the characteristic motion of changing direction comprises any of a curve having an estimated radius that is less than a threshold geometry, a comparison of the object path direction before and after a curve, a sharp cusp edge in the object path, and a comparison of path direction before and after a cusp.

18. The system of claim 17, wherein the input region comprises any of a one-dimensional region, a two dimensional region or a three dimensional volume.

19. The system of claim 17, wherein the object associated with the user comprises any of a stylus, an input device, a personal digital assistant (PDA), a cell phone, a laser pointer, a light pen, an accessory, a tool, an article of clothing, a ring, a bracelet, a toy, a sword, a wand, or at least a portion of the body of the user.

20. The system of claim 19, wherein the portion of the body of the user comprises any of a finger, a hand, a foot, a head, or an appendage.

21. The system of claim 17, wherein the selectable regions are associated with any of characters, tasks, actions, functions, decisions, priorities, outcomes, or points.

22. The system of claim 17, further comprising:

a display for dynamically showing a representation of the location of the object associated with the user.

23. The system of claim 17, wherein the at least one processor is further programmed to disambiguate at least one subsequent position that does not clearly indicate a selectable region within the input region.

24. The system of claim 17, wherein the at least one processor is further programmed to disambiguate at least one determined position that corresponds to an alternate selectable region.

25. The system of claim 24, wherein the disambiguation comprises displaying the alternate selectable region to the user, and providing a selectable choice by the user between the determined selectable region and the alternate selectable region.