Method and apparatus for using stylus-tablet input in a computer system

• US 5,534,893 A
• Filed: 12/15/1993
• Issued: 07/09/1996
• Est. Priority Date: 12/15/1993
• Status: Expired due to Term

• Current Assignee: Apple Computer Incorporated (Apple Inc.)
• Original Assignee: Apple Computer Incorporated (Apple Inc.)
• Inventors: Hollowell, J. Rhoads, Gough, Michael L., Hansen, Daniel J. Jr.
• Primary Examiner(s): Brier, Jeffery
• Assistant Examiner(s): CHOW, DOON Y
• Application Number:
  US08/167,709
• Time in Patent Office: 937 Days
• Field of Search: 178/18, 178/19, 178/20, 364/3, 364/13, 345/156, 345/173, 345/174, 345/175, 345/179, 345/180, 382/315
• US Class Current: 345/179
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06V 30/373 using a special pattern or subpattern alphabet

Abstract

A stylus-aware computer system and method are provided for processing information obtained by moving a stylus over a tablet of the type that displays images as well as inputs stylus information. As a user moves the stylus with respect to the tablet, the tablet generates outputs describing the position of the stylus with respect to the tablet. A tablet driver converts this data into standardized packet objects recognized by the computer system and sends the packet objects to a stroke manager. The stroke manager converts the package objects to stroke objects which represent the trajectory of the stylus with respect to the tablet at times between two transitions such as placing the stylus on the tablet and lifting the stylus off the tablet. The stroke manager notifies an application of the stroke object through an event queue. The application may then issue stroke commands which dictate how the stroke is used. The stroke may, for example, be drawn on the tablet, erased from the tablet, removed from memory, etc.

Claims

1. A method of processing outputs from an input tablet, the method comprising the steps of:

forming a plurality of data structures from outputs of an input tablet;

storing said data structures in an ink pool memory of a computer system, the ink pool memory being independent of at least one application program running in the computer system;

creating multiple stroke objects from the data structures in the ink pool memory;

determining whether said at least one application program is stylus-aware; and

issuing one or more stroke commands to the multiple stroke objects within the ink pool if the application is stylus-aware, wherein one or more of the stroke commands include a step of producing an image of a stroke object on a computer display.

2. The method of claim 1 wherein the application issues the stroke commands to the stroke objects in the ink pool and wherein the stroke objects receiving the stroke commands carry out the commands without being copied to the application.

3. The method of claim 1 further comprising a step of sending the stroke object to a cursor control if the application is not stylus-aware, the cursor control moving a cursor on the tablet according to a path defined by the stroke object.

4. The method of claim 1 wherein the step of creating the multiple stroke objects from data structures in said ink pool memory includes the following steps:

receiving outputs from the input tablet;

making packet objects from the outputs, the packet objects including positional information of the stylus with respect to the tablet; and

making the multiple stroke objects from the packet objects.

5. The method of claim 4 wherein the packet objects include an x and a y Cartesian coordinate of the stylus on the tablet.

6. The method of claim 5 wherein the packet object also includes one or more other pieces of information selected from the group consisting of the z Cartesian coordinate, the proximity of the stylus to the tablet, the pressure of the stylus on the tablet, and the tilt of the stylus with respect to the tablet.

7. The method of claim 4 wherein each of the multiple stroke objects and each of the packet objects have a characteristic stroke type and wherein the step of making the one or more stroke objects from the packet objects includes the following steps:

determining the stroke type of each packet object;

appending the packet object to a stroke object being created if the packet object is of the same stroke type as that stroke object; and

creating a new stroke object and closing the stroke object previously being created if the packet object is of a different stroke type than the stroke object previously being created, the packet object being incorporated in the new stroke object.

8. The method of claim 7 wherein the characteristic stroke type is selected from the group consisting of proximity strokes, stylus-down strokes, and stylus-function strokes.

9. The method of claim 8 wherein the stylus-function strokes are initiated by a method that includes a step of pushing a button on the stylus.

10. The method of claim 8 wherein proximity strokes are initiated by a method that includes a step of bringing the stylus to within at most about one inch from the tablet.

11. The method of claim 1 further comprising the following steps:

determining whether a tablet type has been established; and

recognizing the tablet type if it has not been established.

12. The method of claim 11 wherein the tablet type is recognized by comparing tablet outputs with tablet templates from a library of tablet templates wherein the tablet templates represent unique sequences of data particular to each tablet type in the library.

13. The method of claim 1 wherein the step of issuing one or more stroke commands to the one or more stroke objects within the ink pool includes the following steps:

determining which type of stroke command is issued by the application; and

performing the issued stroke command.

14. The method of claim 13 wherein the stroke commands are selected from the group consisting of passing the oldest stroke object pointer, instructing a stroke object to draw itself, instructing the stroke object to erase itself, instructing the stroke object to remove itself, and instructing the stroke object to play itself.

15. The method of claim 14 wherein the stroke commands that instruct a stroke object to perform an operation on itself include the following steps:

sending the stroke command to a process object;

sending instructions from the process object to the particular stroke object to which the stroke command is directed.

16. The method of claim 14 wherein the stroke command of instructing the stroke object to remove itself includes a step of redirecting a pointer within the ink pool from the stroke object to be removed to the next succeeding stroke object within the ink pool.

17. A method of inputting information into a stylus-aware computer system having a stylus and a tablet, the method comprising the following steps:

moving the stylus with respect to the tablet, the movement being divided into strokes separated from one another by stroke events, the strokes being defined by a collection of stylus-tablet interaction parameters between stroke events;

convening the strokes into tablet outputs which include the stroke events and stylus-tablet interaction parameters;

converting the tablet outputs into standardized packet objects containing the stroke events and the stylus-tablet interaction parameters; and

creating stroke objects from the packet objects, each stroke object containing only those packet objects generated from tablet data between two successive stroke events, wherein the stylus-tablet interaction parameters include at least discrete positional information associated with the stroke, and wherein the stroke events include at least moving the stylus within proximity of the tablet, stylus down on the tablet, stylus up from the tablet, and stylus function change, such that each packet object includes at least a discrete position and an associated stroke event.

18. The method of claim 17, wherein stylus function change stroke events are initiated by a method that includes a step of pushing a button on the stylus.

19. The method of claim 17 wherein proximity stroke events are initiated by a method that includes a step of bringing the stylus to within at most about one inch of the tablet.

20. The method of claim 17 wherein multiple styluses are used with the tablet and wherein the tablet output includes a stylus identification.

21. The method of claim 17 wherein the tablet is one of several tablet types, and wherein the method further comprising a step of identifying the tablet type by examining the tablet output.

22. The method of claim 21 wherein the step of identifying the tablet type includes a step of matching fixed amounts of tablet output with tablet templates from a library of tablet templates wherein the tablet templates represent unique sequences of data particular to each tablet type in the library.

23. A computer system comprising:

processing means;

memory means coupled to said processing means;

input tablet means coupled to said processing means;

a computer implemented process running on said processing means and residing, at least in part, in said memory means;

means for determining whether said computer-implemented process is a stylus-aware application; and

means for converting inputs from said input tablets to a form acceptable to said computer-implemented process if it is not of the type which expects inputs from said input tablet, the means for converting inputs including a stroke manager which creates stroke objects from the inputs from the input tablets, the stroke objects containing information used by the computer-implemented process.

24. The computer system of claim 23 further comprising an ink pool storing the stroke objects and residing, at least in part, in the memory means.

25. The computer system of claim 23 wherein the means for converting inputs from the input tablets includes a tablet driver which converts the inputs into packet objects used by the stroke manager to create stroke objects.

26. The computer system of claim 23 further comprising a stroke manager library file which includes information used by the stroke manager to determine how the computer-implemented process treats the inputs which have been converted to a form acceptable to the computer-implemented process.

27. The computer system of claim 26 further comprising means for using the inputs from the input tablets to control a cursor when the stroke manager determines that the computer-implemented process treats the inputs by controlling the cursor.

28. The computer system of claim 23 further comprising an event queue in communication with the computer-implemented process and containing information describing one or more events from input tablet means.

29. The computer system of claim 23 wherein the input tablet is one of a plurality of tablet types and wherein the computer system further comprises means for determining the type of the input tablet.

30. The computer system of claim 23 further comprising

a stylus having one of a plurality of stylus types;

and

means for determining the stylus type of the stylus.