Method and apparatus for recognizing handwriting of different users of a pen-based computer system

• US 5,666,438 A
• Filed: 07/29/1994
• Issued: 09/09/1997
• Est. Priority Date: 07/29/1994
• Status: Expired due to Term

• Current Assignee: Apple Inc.
• Original Assignee: Apple Computer Incorporated (Apple Inc.)
• Inventors: Auguste, Donna M., Meier, John R., Beernink, Ernest H.
• Primary Examiner(s): Boudreau, Leo
• Assistant Examiner(s): KELLEY, CHRISTOPHER S
• Application Number:
  US08/282,785
• Time in Patent Office: 1,138 Days
• Field of Search: 382/161, 382/155, 382/186, 382/187, 382/189
• US Class Current: 382/189
• CPC Class Codes: G06V 30/1423 the instrument generating sequences of position coordinates corresponding to handwriting preprocessing or recognising digital ink G06V30/32
• CPC Class Codes: G06V 30/387 using human interaction, e.g. selection of the best displayed recognition candidate

Abstract

A computer system and method capable of handwriting recognition and user identification are presented. The computer system includes a CPU, a dual-function display assembly and a stylus. The dual-function display assembly senses the relative position of the stylus with respect to the dual-function display. When an appropriate prompt is displayed, a user responds by application of the stylus to the dual-function display to enter user identity, handwriting, handwriting style, handwriting preferences, and other input to the computer system. Using user-specific handwriting preferences and data, improved handwriting recognition for the user is enabled.

Claims

1. A method of recognizing the handwriting of one of several users of a pen-based computer comprising the steps of:

providing a pen-based computer having memory and a dual-function display assembly capable of receiving input and producing output;

providing user-specific handwriting data for a primary user and at least one guest user, said user-specific handwriting data including handwriting style data generically applicable to a corresponding user'"'"'s handwriting, the handwriting style data including at least one handwriting style preference selected from the group consisting of printing, cursive, mixed printing and cursive, and at least one from the group consisting of recognition speed and word separation;

storing said user-specific handwriting data for said primary user and said at least one guest user in said memory;

displaying a handwriting preferences option on said dual-function display assembly;

directing a pointing device to said preferences option to communicate user interactive events to said pen-based computer, said user interactive events including user identification;

identifying the user of the pen-based computer; and

interpreting the handwriting of said user using said user-specific handwriting data appropriate for said user.

2. A method as recited in claim 1 wherein said preferences option identifies the user, and said method further comprises

associating user-specific data with said user, said data including adaptive learning data and handwriting preferences data.

3. A method as recited in claim 2 wherein said handwriting preferences option is displayed on a handwriting preferences screen, said handwriting preferences data is presented on said handwriting preferences screen and said user interactive events include modifying said handwriting preferences data by directing said pointing device to said handwriting preferences screen.

4. A method as recited in claim 3 wherein said memory includes RAM backed up by BBRAM, said method further comprising employing said pointing device to save said modified handwriting preferences data in said memory by actuating a "save handwriting preferences" toggle provided on said handwriting preferences screen.

5. A method as recited in claim 2 wherein said user interactive events include moving said pointing device to actuate a "learning mode" toggle provided on said display assembly and to selectively enable or disable said pen-based computer from automatically updating said adaptive learning data.

6. A method as recited in claim 3 wherein said user interactive events include moving said pointing device to actuate a "return to original settings" toggle presented on said preferences screen and to purge said writing preferences data from said memory, said purged writing preferences data being replaced with default data read from a ROM.

7. A method as recited in claim 2 wherein said user interactive events includes activating a "guest user" toggle provided on said display assembly with said pointing device and identifying the user as either a primary user or a guest user to permit selective operation of said pen-based computer in a primary user mode or a guest user mode, respectively.

8. A method as recited in claim 7 wherein said user is identified as a primary user, said data is primary user data, and said primary user data is updated and saved in said RAM and backed up in said BBRAM when said handwriting is recognized.

9. A method as recited in claim 7 wherein said user is identified as a guest user, said data is guest user data, said handwriting is input to said pen-based computer by said guest user, said guest user data is updated, and said updated guest user data is purged from said RAM when the guest mode toggle is activated to indicate operation by the primary user.

10. A method as recited in claim 8 wherein said adaptive learning data is automatically updated by said pen-based computer and said handwriting preferences data is selectively updated when said pointing device is directed at said display assembly to modify said handwriting preferences data.

11. A method as recited in claim 9 wherein said adaptive learning data is automatically updated by said pen-based computer and said handwriting preferences data is selectively updated by said user when said pointing device is directed at said display assembly to modify said handwriting preferences.

12. A method of identifying a user of a pen-based computer capable of handwriting recognition, said method comprising the steps of:

providing a computer system capable of storing data in memory, a stylus, and a dual-function display assembly including both a liquid crystal display linked to said computer system and an input tablet capable of determining the position of said stylus overlying said liquid crystal display;

displaying an image on said liquid crystal display to query the identity of said user;

determining said identity of said user with said computer system using the position of said stylus with respect to said input tablet;

retrieving data from a database using said computer system, said database having data for a primary user and at least one guest user, said data including handwriting style data generically applicable to said user'"'"'s handwriting, the handwriting style data including at least one handwriting style preference selected from the group consisting of printing, cursive, mixed printing and cursive, and at least one from the group consisting of recognition speed and word separation; and

utilizing said data to facilitate recognition of handwriting applied to said input tablet by said user with said stylus.

14. A method as recited in claim 12 wherein:

said image is a handwriting preferences screen and said data is stored in RAM during operation of said computer system;

said data includes adaptive learning data which is automatically updated during operation of said computer system, and handwriting preferences data, which is displayed upon and selectively updated via said handwriting preferences screen, wherein said handwriting preferences data includes handwriting style, letter style, recognition time or speed, transformation delay, toggle settings, user identity and space between words; and

said handwriting preferences screen includes an "adaptive learning" toggle which is actuated by application of said stylus to said preferences screen to selectively enable or disable automatic update of said adaptive learning data in BBRAM.

15. A method as recited in claim 14, wherein said handwriting preferences screen includes a "save preferences" toggle which is actuated by application of said stylus to said input tablet to save said handwriting preferences data in BBRAM.

16. A method as recited in claim 14 wherein said handwriting preferences screen includes a "guest user" toggle which is actuated by application of said stylus to said input tablet to selectively indicate user identity as a primary user or a guest user to cause said computer system to operate in primary user mode by associating primary user data with said primary user, or in guest user mode by associating guest user data with said guest user, respectively.

17. A method as recited in claim 16 wherein said computer operates in guest user mode, said guest user toggle is actuated from "guest user" to "primary user" setting, said guest user data is purged from RAM and replaced by primary user data stored in BBRAM to facilitate recognition of handwriting applied to said input tablet by a primary user.

18. A method as recited in claim 16 wherein said computer system operates in primary user mode, said guest user toggle is actuated from "primary user" to "guest user" setting, primary user data stored in RAM is purged from RAM and saved in BBRAM, default data stored in ROM is read and stored in RAM to facilitate handwriting recognition of handwriting applied to said input tablet by a guest user.

19. A method as recited in claim 16 wherein said preferences screen includes a "return to original settings" toggle which is actuated by application of said stylus to said display to purge handwriting preferences data stored in RAM and replace said purged data by default data from ROM.

13. A computer readable medium containing program instructions for recognizing the handwriting for one of several users of a pen-based computer including a dual-function display assembly and a memory, said program instructions comprising instructions for:

providing user-specific handwriting data for a primary user and at least one guest user, said user-specific handwriting data including handwriting style data generically applicable to a corresponding user'"'"'s handwriting, the handwriting style data including at least one handwriting style preference selected from the group consisting of printing, cursive, mixed printing and cursive, and at least one from the group consisting of recognition speed and word separation;

storing said user-specific handwriting data for said primary user and said at least one guest user in said memory;

displaying a handwriting preferences option on said dual-function display assembly;

identifying the user of the pen-based computer; and

interpreting the handwriting of said user using said user-specific handwriting data appropriate for said user.

25. A computer readable medium as recited in claim 13, wherein said program instructions further comprise instructions for associating user-specific handwriting data with said user, wherein said user-specific handwriting data includes adaptive learning data and handwriting preferences data.

33. A computer readable medium as recited in claim 25, wherein said program instructions further comprise instructions for selectively enabling or disabling said pen-based computer from automatically updating said adaptive learning data.

34. A computer readable medium as recited in claim 25, wherein said program instructions include instructions for:

displaying a handwriting preferences option on a handwriting preferences screen;

displaying handwriting preferences data on said handwriting preferences screen; and

updating said handwriting preferences data in response to user inputs to said handwriting preferences screen.

35. A computer readable medium as recited in claim 34 wherein said program instructions further comprise instructions for saving said modified handwriting preferences data in said memory by actuating a toggle provided on said handwriting preferences screen.

36. A computer readable medium as recited in claim 35 wherein said program instructions further comprise instructions for purging said writing preferences data from said memory upon activating a toggle presented on said preferences screen, and replacing said purged data with default data stored in said memory.

37. A computer readable medium as recited in claim 13 wherein said program instructions further comprise instructions for identifying the user as either a primary user or a guest user to permit selective operation of said pen-based computer in a primary user mode or a guest user mode.

38. A computer readable medium as recited in claim 37 wherein said program instructions further include instructions for saving and updating primary user data in said memory when said user is identified as a primary user.

39. A computer readable medium as recited in claim 38 wherein said program instructions further include instructions for identifying said user as a guest user, updating said guest user handwriting data, and purging said guest user data from said memory when said user is identified as a primary user.

40. A computer readable medium as recited in claim 39 wherein said program instructions further include instructions for updating said adaptive learning data and said handwriting preferences data.

20. A hand-held pen-based computer capable of identifying a user to facilitate handwriting recognition comprising:

a housing;

a dual-function display mounted in said housing, said dual-function display being pressure sensitive;

an audio system enclosed within said housing for communicating with said user;

a pointing device, said pointing device being formed with a hand grip and a pointed end for application against said display; and

a computer system enclosed within said housing and connected to communicate with said dual-function display and said audio system, said computer system being adapted with appropriate software, memory and processing capacity to store handwriting data specific to a primary user and at least one guest user, to identify the user and to recognize handwriting applied to said dual-function display by said pointing device using said handwriting data specific to said user, wherein said handwriting data specific to said user includes handwriting style data generically applicable to said user'"'"'s handwriting, the handwriting style data including at least one handwriting style preference selected from the group consisting of printing, cursive, mixed printing and cursive, and at least one from the group consisting of recognition speed and word separation.

21. A device as recited in claim 20 wherein:

said computer system associates data with said user, said data being user-specific to facilitate handwriting recognition;

wherein said data includes handwriting preferences data includes word spacing, word recognition speed, handwriting style, input transformation time, space between letters, toggle settings, user identity and letter style, and

said handwriting preferences data is selectively updated by the application of said pointing device against said dual-function display by said user and adaptive learning data which is automatically updated by said computer system during operation.

22. A device as recited in claim 21 wherein said dual-function display includes a liquid crystal display and an input tablet, and wherein a preference screen is presented on said dual-function display, said preference screen including the text "configure for guest user", said pointing device being applied against said preferences screen by the user to identify the user as a primary user or as a guest user.

23. A device as recited in claim 22 wherein said data is guest user data when said user is identified as a guest user and said data is primary user data when said user is identified as a primary user.

24. A device as recited in claim 23 wherein said housing includes a recessed face for protecting said display which is mounted on said recessed face, said housing being formed with rounded edges which surround the periphery of said housing to provide an effective hand grip for multiple users, said housing including a plurality of apertures to permit audio communication between said sound system and the user.

26. A device as recited in claim 21 wherein said data is associated with a guest user and a guest user toggle displayed on said dual-function display is actuated to identify the primary user, said guest user data is purged from RAM and said primary user data replaces said purged guest user data in RAM.

27. A device as recited in claim 21 wherein said data is associated with a primary user and a guest user toggle displayed on said dual-function display is actuated to identify the guest user, said primary user data is purged from RAM and saved in BBRAM, said guest user data is default data and is read from ROM into RAM.

28. A pen-based computer system comprising:

a digital processor;

read/write memory coupled to said digital processor;

a display screen coupled to said digital processor;

a pointing device coupled to said digital processor, said pointing device being operative to enter strokes which are interpreted as electronic ink by said computer system;

a recognizer implemented by said digital processor for recognizing ink created by a user with said pointing device; and

means for identifying said user and associating user-specific handwriting data stored on said pen-based computer system with said user such that said recognizer is able to recognize said ink input by said user with greater accuracy using said user-specific handwriting data, said user-specific handwriting data including handwriting style data generically applicable to said user'"'"'s handwriting, the handwriting style data including at least one handwriting style preference selected from the group consisting of printing, cursive, mixed printing and cursive, and at least one from the group consisting of recognition speed and word separation.

29. A pen-based computer system as recited in claim 28 wherein said user is identified as either a primary user of said pen-based computer system or as a guest user.

30. A pen-based computer system as recited in claim 29 further comprising an input tablet coupled to said display screen and responsive to said pointing device to enter said ink into said pen-based computer system.

31. A pen-based computer system as recited in claim 30 further comprising means for receiving handwriting style preferences from said user, wherein said handwriting style preferences are included in said user-specific data.

32. A pen-based computer system as recited in claim 31 further comprising means for receiving letter style preferences from said user, wherein said letter style preferences are included in said user-specific data.