Control of a computer through a position-sensed stylus

• US 5,347,295 A
• Filed: 10/31/1990
• Issued: 09/13/1994
• Est. Priority Date: 10/31/1990
• Status: Expired due to Term

• Current Assignee: Go PLC (Emirates International Telecommunications Limited)
• Original Assignee: Go PLC (Emirates International Telecommunications Limited)
• Inventors: Carr, Robert, Ouye, Michael, Kaplan, S. Jerrold, Low, David R., Agulnick, Todd, Hoeber, Tony
• Primary Examiner(s): BRIER, JEFFERY A
• Application Number:
  US07/610,231
• Time in Patent Office: 1,413 Days
• Field of Search: 382/13, 382/14, 382/57, 382/59, 382/40, 178/18, 178/19, 340/706, 340/707, 340/709, 345/156, 345/179
• US Class Current: 345/156
• CPC Class Codes: G06F 1/1626 with a single-body enclosure integrating a flat display, e.g. Personal Digital Assistants [PDAs]
• CPC Class Codes: G06F 1/1643 the display being associated to a digitizer, e.g. laptops that can be used as penpads details related to the relative motion of the display enclosure with respect to the body enclosure, e.g. to move between laptop and tablet PC configuration G06F1/1615
• CPC Class Codes: G06F 15/0225 User interface arrangements, e.g. keyboard, display; Interfaces to other computer systems
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 40/166 Editing, e.g. inserting or deleting

Abstract

A notebook computer which is controlled by a stylus executing gestures on the computer screen. The stylus and the computer include complementary electronic circuitry by which the proximity of the stylus tip to the computer is sensed. The proximity sensing is used to detect to approach of the stylus tip to the computer screen, and gestural commands are then entered on the screen by moving the stylus. The entry of a command is terminated by removing the stylus tip from proximity with the screen, which is detected by the computer, which then implements the command. Alternative methods of implementing the commands include time-outs and command termination buttons.

Claims

1. An apparatus for controlling a computer system, the computer system comprising a screen for displaying information and a stylus having a tip for inputting information into the computer, including:

first detecting means coupled to said computer for detecting a stroke of the stylus tip in contact with the screen;

second detecting means coupled to said computer for detecting a departure of the stylus tip from the screen;

means coupled to said computer for defining termination of a gesture comprising at least one stroke in response to said departure of the stylus tip;

means coupled to said computer for recognizing a plurality of said gestures, said recognizing means including means for comparing each said gesture to at least one predefined shape;

means coupled to said computer for implementing each said recognized gesture, said implementing means including means for performing a predetermined action associated with each said predefined shape, said predetermined action being determined by the context in which said gesture was used, including a first context in which said action is executed upon an operating system level object and a second context in which said action is executed upon an application level object.

2. The apparatus of claim 1, wherein said gesture comprises a plurality of strokes.

3. The apparatus of claim 1, wherein:

said second detecting means includes means for detecting proximity of the stylus tip to the screen; and

said apparatus further includes means coupled to said computer for displaying an indicator of the proximity of the stylus tip to the screen.

4. The apparatus of claim 1, further including third detecting means for detecting a direction of motion of said gesture.

5. The apparatus of claim 1, further including means coupled to said computer for displaying on said screen a predefined shape representing the recognized gesture.

6. The apparatus of claim 1, further including means coupled to said computer for displaying on said screen a shape representing the actual gesture made by a user of the computer.

7. The apparatus of claim 1, wherein said gesture implementation includes input of said recognized gesture as data to be processed by said computer system.

8. The apparatus of claim 7, wherein said recognized gesture comprises a character.

9. The apparatus of claim 7, wherein said recognized gesture comprises a graphics object.

10. The apparatus of claim 1, wherein said implementing means includes means for implementing said second command for performing an operation which is common across a plurality of applications.

11. The apparatus of claim 2, wherein the plurality of strokes are separated by departure of the stylus tip from contact with the screen while the stylus tip is still proximate to the screen.

12. The apparatus of claim 3, further including means for terminating display of said indicator when the stylus tip departs from proximity to the screen.

13. The apparatus of claim 3, wherein said indicator comprises a virtual handle for manipulating an object displayed on the screen.

14. The apparatus of claim 3, wherein said indicator comprises highlighting of information displayed on the screen in proximity to said stylus tip.

15. The apparatus of claim 3, wherein said indicator indicates proximity of said stylus tip to an object displayed on the screen.

16. The apparatus of claim 15, wherein said object comprises at least one character.

17. The apparatus of claim 15, wherein said object comprises at least one graphics object.

18. The apparatus of claim 1, wherein said predetermined action is performed on a target object, said target object being determined by at least one attribute of said gestu.

19. The apparatus of claim 18, wherein said attribute comprises the location of the gesture on the screen.

20. The apparatus of claim 19, wherein said location comprises the location on the screen of the hot point portion of said gesture.

21. The apparatus of claim 18, wherein said attribute comprises the size of the gesture on the screen.

22. The apparatus of claim 1, wherein said predetermined action is performed on a target object, said target object being determined by the context in which said gesture was used.

23. The apparatus of claim 22, wherein said context comprises the application in which said gesture was used.

24. The apparatus of claim 18, further including means coupled to said computer for displaying on said screen a predefined shape representing the recognized gesture.

25. The apparatus of claim 18, further including means coupled to said computer for displaying on said screen a shape representing the actual gesture made by a user of the computer.

26. The apparatus of claim 18, further including means coupled to said computer for displaying on said screen a symbol indicating that the gesture has not been recognized.

27. The apparatus of claim 18, further including means coupled to said computer for displaying on said screen a symbol indicating that the input gesture is not appropriate to the context in which it was used.

28. The apparatus of claim 1,

further including means coupled to said computer for displaying on said screen a predefined shape representing the recognized gesture.

29. The apparatus of claim 1,

further including means coupled to said computer for displaying on said screen a symbol indicating that the gesture has not been recognized.

30. The apparatus of claim 1, wherein said recognizing means is also for comparing each said gesture to at least one predefined shape, for recognizing a first gesture corresponding to a first said predefined shape and a second gesture corresponding to a second said predefined shape, the apparatus further including:

means coupled to said computer for displaying on said screen said predefined shapes;

wherein said first and second predefined shapes are substantially identical but differ in their orientation on the screen when displayed by said displaying means.

31. The apparatus of claim 30, wherein said differences in orientation comprise a rotation on the screen of said substantially identical shapes.

32. The apparatus of claim 30, wherein said differences in orientation comprise an inversion on the screen of said substantially identical shapes.

33. The apparatus of claim 1,

wherein said predetermined action is performed on a target substantially enclosed by its associated said gesture, and wherein said target is selected as a result of the performance of said predetermined action.

34. The apparatus of claim 33, wherein said target comprises a graphics object.

35. The apparatus of claim 33, wherein said target comprises at least one character.

36. The apparatus of claim 35, wherein said character is selected to be edited as a result of the performance of said predetermined action.

37. The apparatus of claim 35, wherein said at least one character is selected to be replaced by at least one other character to be inputted into said computer as a result of the performance of said predetermined action.

38. The apparatus of claim 33, wherein the predetermined shape of said recognized gesture comprises a circle.

39. An apparatus for controlling a computer system, the computer system comprising a screen for displaying information and a stylus having a tip for inputting information into the computer, including:

detecting means coupled to said computer for detecting a stroke of the stylus tip in contact with the screen;

means coupled to said computer for recognizing a gesture comprising at least one stroke and an event indicating termination of the gesture, said recognizing means including means for comparing said gesture to at least one predefined shape and being for recognizing at least a first gesture, a second gesture, and a third gesture comprising said first and second gestures; and

implementing means coupled to said computer for implementing each recognized gesture, said implementing means including means for performing a first predetermined action associated with said first gesture, a second predetermined action associated with said second gesture, and a third predetermined action associated with said third gesture.

40. The apparatus of claim 39, wherein the shapes of said first and second gestures are substantially identical.

41. An apparatus for controlling a computer system, the computer system comprising a screen for displaying information and a stylus having a tip for inputting information into the computer, including:

first detecting means coupled to said computer for detecting a stroke of the stylus tip in contact with the screen;

means coupled to said computer for recognizing a gesture comprising at least one stroke and an event indicating termination of the gesture, said recognizing means including means for comparing said gesture to at least one predefined shape, each stroke of said gesture being located in substantially the same area of the screen;

second detecting means for detecting a direction of motion of the creation of said gesture, wherein the predefined shape of said recognized gesture also represents said direction of motion; and

implementing means coupled to said computer for implementing said recognized gesture, said implementing means including means for performing a predetermined action associated with said predefined shape.

42. The apparatus of claim 41, further including means coupled to said computer for displaying on said screen a predefined shape representing the recognized gesture.

43. The apparatus of claim 41, further including means coupled to said computer for displaying on said screen a shape representing the actual gesture made by a user of the computer.

44. The apparatus of claim 41, further including means coupled to said computer for displaying on said screen a symbol indicating that the gesture has not been recognized.

45. The apparatus of claim 41, further including means coupled to said computer for displaying on said screen a symbol indicating that the input gesture is not appropriate to the context in which it was used.

46. The apparatus of claim 41, wherein said direction of motion of said gesture is associated with said predetermined action.