Disambiguating input strokes of a stylus-based input devices for gesture or character recognition

• US 5,784,504 A
• Filed: 01/24/1994
• Issued: 07/21/1998
• Est. Priority Date: 04/15/1992
• Status: Expired due to Term

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Page, Howard Geza, Anthony, Nicos John, Anderson, William Joseph, Chow, Doris Chin, Issadisai, Tanarug, Harrison, Colin George
• Primary Examiner(s): Breene, John E
• Application Number:
  US08/188,600
• Time in Patent Office: 1,639 Days
• Field of Search: 345/179, 345/180, 345/181, 345/182, 345/183, 345/173, 345/7, 345/156, 345/326, 345/358, 382/189, 382/187, 382/160, 382/186, 382/119, 382/181, 382/358, 382/309-311, 395/157, 395/155, 395/804
• US Class Current: 382/309
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 40/166 Editing, e.g. inserting or deleting
• CPC Class Codes: G06V 30/373 using a special pattern or subpattern alphabet

Abstract

An apparatus and method in a tablet computer for disambiguating a handwriting input stream generated by a stylus-based user interface. A tablet application program interface (TAPI) of the present invention receives stroke data generated by a stroke made by a user on a digitizing tablet. The TAPI inserts the stroke data into a database. If the stroke is an editing gesture, the TAPI routes the stroke to a gesture recognizer which identifies an editing dialog. The TAPI then executes the dialog to perform operations on the database. If the application program is expecting text input, the TAPI continues to receive stroke data until it detects a closure event. The TAPI then forms a stroke group entry in the database by grouping all non-gesture stroke data received since the last closure event. The TAPI routes the stroke group data to a character recognizer, which returns candidate characters. The TAPI inserts the candidate characters into the stroke group entry. The TAPI notifies the application program each time it updates the database.

Claims

1. A computer-based method for disambiguating a stylus stroke made on a digitizing tablet, the digitizing tablet being an input device to a computer running at least one application program having one or more application windows, comprising the steps of:

(a) receiving an x-y data representative of the stylus stroke made on the digitizing tablet;

(b) generating stroke events to indicate a pen-up event, a pen-down event, and a stylus position on the digitizing tablet;

(c) converting said x-y data generated between said pen-down event and said pen-up event to relative coordinates of a display device to generate a stroke element entry;

(d) offering said stroke events to an application window for acceptance;

(e) writing said stroke element entry to a database if the application window accepted said stroke events offered in said step (d);

(f) detecting the occurrence of a closure event;

(g) forming a group of all non-gesture strokes received since a previous closure event into an unrecognized stroke group;

(h) providing said unrecognized stroke group to a character recognizer where a recognition algorithm is performed;

(I) receiving results of said recognition algorithm from said character recognizer;

(j) converting said unrecognized stroke group into a recognized stroke group based on said results received from said recognizer;

(k) determining whether there is an existing word entry in said database with which a character comprising said recognized stroke group is associated;

(l) inserting said recognized stroke group into said database, if said recognized stroke group is associated with said existing word entry;

(m) creating a new word entry, if said recognized stroke group is not associated with said existing word entry, without user intervention; and

(n) inserting said recognized stroke group into said new word entry created in said step (m).

2. The method of claim 1, further comprising the steps of:

(o) notifying the application window that said stroke element entry is in said database;

(p) retrieving said positional data from said stroke element entry; and

(q) processing said positional data.

3. The method of claim 2, further comprising the steps of:

(r) writing said database to a file upon a request to suspend said application program; and

(s) restoring said database from said file upon a request to resume said application program.

4. The method of claim 1, further comprising the step of storing said stroke element entry in a stroke data cache while the stroke event is offered in said step (d) and deleting said stroke element entry from said stroke data cache after said stroke element entry is routed in said step (e).

5. The method of claim 1, further comprising the steps of:

(o) inking an inking plane of a display device of the digitizing tablet to display x-y data input by said stylus after said x-y data is received;

(p) erasing said x-y data in said inking plane after said stroke element entry is entered in said database in said step (e); and

(q) displaying the stroke in an application window on said digitizing tablet.

6. A computer-implemented system for disambiguating a stylus stroke made on a digitizing tablet, the digitizing tablet being an input device to a computer running at least one application program having one or more application windows, comprising:

means for receiving an x-y data representative of the stylus stroke made on the digitizing tablet;

means for generating stroke events to indicate a pen-up event, a pen-down event, and a stylus position on the digitizing tablet;

means for converting said x-y data generated between said pen-down event and said pen-up event to relative coordinates of a display device to generate a stroke element entry;

means for offering said stroke events to an application window for acceptance;

means for writing said stroke element entry to a database if the application window accepted said stroke events;

means for detecting the occurrence of a closure event;

means for forming a group of all non-gesture strokes received since a previous closure event into an unrecognized stroke group;

means for providing said unrecognized stroke group to a character recognizer where a recognition algorithm is performed;

means for receiving results of said recognition algorithm from said character recognizer;

means for converting said unrecognized stroke group into a recognized stroke group based on said results received from said recognizer;

means for determining whether there is an existing word entry in said database with which a character comprising said recognized stroke group is associated;

means for inserting said recognized stroke group into said database, if said recognized stroke group is associated with said existing word entry;

means for creating a new word entry, if said recognized stroke group is not associated with said existing word entry, wherein said means for creating a new word entry is without user intervention; and

means for inserting said recognized stroke group into said new word entry.

7. The system of claim 6, further comprising:

means for notifying the application window that said stroke element entry is in said database;

means for retrieving said positional data from said stroke element entry; and

means for processing said positional data.

8. The system of claim 7, further comprising:

means for writing said database to a file upon a request to suspend said application program; and

means for restoring said database from said file upon a request to resume said application program.

9. The system of claim 6, further comprising:

means for comparing said stroke element entry to sample gestures in a sample gesture data set to determine if said stroke element entry matches one of said sample gestures;

means for determining a dialog identification code identifying a dialog associated with a matching sample; and

means for executing said dialog identified by said dialog identification code.

10. The system of claim 9, further comprising:

means for defining a new invocation stroke and a new dialog identification code;

means for inserting in a prototype data set gesture positional data representative of said new invocation stroke; and

means for creating a new dialog, identified by said new dialog identification code, wherein said new dialog comprises database manipulations to be performed when said stroke element entry matches a sample gesture corresponding to said new invocation stroke.

11. The system of claim 9, further comprising:

means for deleting an unwanted invocation stroke;

means for deleting gesture positional data representative of said unwanted invocation stroke; and

means for deleting database manipulations to be performed when said stroke element entry matches a sample gesture corresponding to said unwanted invocation stroke.

12. The system of claim 9, further comprising means for modifying a definition of an invocation stroke and a dialog identification code in a gesture recognizer.

13. The system of claim 9, further comprising means for modifying in a prototype data set positional data representative of an invocation stroke.

14. The system of claim 9, wherein said dialog is a delete dialog and further comprising:

means for determining a character identified by said delete dialog;

means for removing said identified character from an active list of said database;

means for adjusting positional data of remaining entries in said active list; and

means for displaying remaining entries without any gap.

15. The system of claim 9, wherein said dialog is a delete dialog, further comprising:

means for determining a stroke identified by said delete dialog;

means for removing said identified stroke from an active list of said database;

means for adjusting positional data of remaining entries in said active list; and

means for displaying remaining entries without any gap.

16. The system of claim 6, further comprising means for storing said stroke element entry in a stroke data cache while the stroke event is offered to said application window and deleting said stroke element entry from said stroke data cache after said stroke element entry is routed to said application window.

17. The system of claim 6, further comprising:

means for inking an inking plane of a display device of the digitizing tablet to display x-y data input by said stylus after said x-y data is received;

means for erasing said x-y data in said inking plane after said stroke element entry is entered in said database; and

means for displaying the stroke in an application window on said digitizing tablet.