Handwritten keyboardless entry computer system

• US 6,064,766 A
• Filed: 12/18/1998
• Issued: 05/16/2000
• Est. Priority Date: 07/25/1986
• Status: Expired due to Fees

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: AST Research, Inc. (Samsung Electronics Co. Ltd.)
• Inventors: Sklarew, Ralph
• Primary Examiner(s): MEHTA, BHAVESH M
• Application Number:
  US09/216,099
• Time in Patent Office: 515 Days
• Field of Search: 382/187, 382/189, 382/309-311
• US Class Current: 382/189
• CPC Class Codes: F02B 2075/025 two
• CPC Class Codes: G06F 3/033 Pointing devices displaced or positioned by the user , e.g. mice, trackballs, pens or joysticks; Accessories therefor digitisers characterised by the transducing means G06F3/041
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06V 30/1423 the instrument generating sequences of position coordinates corresponding to handwriting preprocessing or recognising digital ink G06V30/32
• CPC Class Codes: G06V 30/333 Preprocessing; Feature extraction
• CPC Class Codes: G06V 30/373 using a special pattern or subpattern alphabet
• CPC Class Codes: G09B 5/065 Combinations of audio and video presentations, e.g. videotapes, videodiscs, television systems

Abstract

A keyboardless entry computer system includes a transparent input screen that generates positional information when contacted by a stylus, and a display screen mounted physically below the input screen such that a character that is displayed can be seen below the input screen. The system includes a computer that has been programmed to compile the positional information into Strokes, to calculate Stroke characteristics, and then compare the Stroke characteristics with those stored in a database in order to recognize the symbol drawn by the stylus. Key features of the system are: (1) transparent position sensing subsystem; (2) underlying display on which to mimic drawing of sensed positions and to show characters or symbols; (3) means to convert sensed positions first into plotted Points and then into recognized characters or symbols; and (4) means to "learn" to associate sensed input positions with a character or symbol.

Claims

1. A portable apparatus for entering data into a document, said apparatus comprising:

a display screen for displaying a document electronically including both a predetermined data entry area description and a first data entry area associated with said predetermined data entry area description, said first data entry area capable of receiving handwritten data entries which correspond with said data entry area description;

a memory for storing said predetermined data entry area description and data associated with said first data entry area of the document;

hand-held means for use by a user to write or draw a handwritten symbol representative of text or data for entry into said first data entry area on or over the display screen;

position detecting means for detecting the position of the hand-held means on or over the display screen and generating locating signals representative of the handwritten symbol;

means, coupled to the position detecting means and the display screen, for displaying on the display screen an image of the handwritten symbol as it is drawn; and

a processor, coupled to the position detecting means, for identifying whether the hand-held means is positioned on or over said data entry area, and if so, selecting said first data entry area for data entry and storing, in said memory, information corresponding to said locating signals of a handwritten symbol written or drawn within or near said first data entry area.

2. The apparatus set forth in claim 1 wherein a location of said first data entry area is marked by a visible boundary generated by said processor to assist a user writing handwritten characters into said first data entry area.

3. The apparatus set forth in claim 1 wherein said processor further comprises handwriting recognition means for identifying whether the handwritten symbol representative of text or data for entry into said first data entry area of the document matches one of a plurality of predetermined font symbols and, if the handwritten symbol is identified as matching a predetermined font symbol, causing the font symbol to be entered into said first data entry area of the document.

4. The apparatus according to claim 1, in which the processor further includes handwriting recognition means responsive to said locating signals for identifying whether the handwritten symbol written or drawn by a user on or over the display screen matches one of a plurality of predetermined font symbols and, if the handwritten symbol is identified as matching a predetermined font symbol, causing the predetermined font symbol to be displayed on the display screen.

5. The apparatus according to claim 4 wherein if the handwritten symbol is identified as matching a predetermined font symbol, the information stored in the memory is indicative of the predetermined font symbol.

6. The apparatus set forth in claim 1 wherein said display screen displays a plurality of data entry areas associated with the document and wherein said hand-held means is used to write or draw handwritten characters for entry into any of the plurality of data entry areas.

7. An apparatus for entering data into a document, said apparatus comprising:

a display screen for displaying a document electronically including both at least a first handwriting data entry area and predetermined text indicating the type of information to be entered in said data entry area;

a memory for storing said predetermined text and for storing data associated with the document;

hand-held means for use by a user to write or draw a handwritten symbol in said data entry area;

position detecting means, coupled to said display screen, for detecting the position of the hand-held means on or over the display screen and generating locating signals representative of the handwritten symbol;

means, coupled to the position detecting means and the display screen, for displaying on the display screen an image of the handwritten symbol as it is drawn; and

a processor, coupled to the position detecting means, for processing said locating signals to identify whether the handwritten symbol matches one of a plurality of predetermined font symbols, and, if the handwritten symbol matches a predetermined font symbol, displaying the matching font symbol and entering the matching font symbol into said memory.

8. The apparatus according to claim 7 wherein the processor includes a database of characteristics of the plurality of predetermined font symbols and means for comparing a characteristic of a handwritten symbol with the characteristics in the database to identify whether the handwritten symbol matches a predetermined font symbol.

9. The apparatus according to claim 8 wherein the characteristic of a predetermined font symbol stored in the database is a characteristic of a handwritten symbol previously drawn by an individual user to correspond to a given predetermined font symbol.

10. The apparatus according to claim 8 further including means for modifying or adding to the database if writing or drawing a handwritten symbol causes the display of an erroneous font symbol or no match for the handwritten symbol is found in the database.

11. The apparatus according to claim 7 wherein the predetermined text and data entry areas displayed on the display screen are displayed in the style of a form or spreadsheet into which data is to be inserted or in which data is to be corrected or updated, whereby handwritten symbols can be used to insert, correct or update data in the form or spreadsheet.

12. The apparatus according to claim 11 comprising a means operative on identification of a handwritten symbol written over or in the area of a portion of text displayed on the display screen as a predetermined command symbol to change the operating mode of the apparatus to an insert mode, in which additional space is provided on the display screen for entry of handwritten symbols which are to be inserted into the form or spreadsheet.

13. The apparatus according to claim 7 further comprising means to define and display an area on the display screen and to assign a function to the defined area, the function being carried out if the position detecting means detects that the hand-held means is positioned on or over the defined area on the display screen.

14. The apparatus according to claim 13 wherein the function assigned to a defined area at a given position on the display screen can change.

15. An apparatus according to claim 13 wherein a symbol identifying the defined and/or its assigned function is displayed on the display screen.

16. The apparatus according to claim 13 wherein the assigned function is user-defined.

17. The apparatus according to claim 13 wherein when a program is running, an area may temporarily be defined and assigned a function and made available as required for the operation of the program.

18. The apparatus according to claim 13 wherein a plurality of defined areas are displayed simultaneously on the display screen.

19. The apparatus according to claim 7 which permits use while standing or walking.

20. The apparatus according to claim 19 wherein the apparatus comprises a housing having dimensions less than 16 inches by 16 inches by 4 inches and the apparatus weighs less than 15 pounds.

21. The apparatus according to claim 19 further comprising a self-contained power supply.

22. A method of entering text or data into a document comprising the steps of:

displaying a document electronically having data entry areas associated with corresponding text identifying the type of handwritten information to be entered into said data entry areas on a portable computer having a display screen and a memory;

using a hand-held stylus to write or draw a handwritten symbol at a first location on or over at least one of said data entry areas of the displayed document;

generating locating signals representative of the handwritten symbol; and

processing the locating signals to translate the handwritten symbol to identify whether the handwritten symbol matches one of a plurality of predetermined font symbols and, if the handwritten symbol is identified as matching a predetermined font symbol, causing the font symbol to be displayed on the displayed document and entering the font symbol into memory associated with the document.

23. An apparatus for entering data into a document, said apparatus comprising:

a screen for electronically displaying a document including predetermined text, said predetermined text including at least one of a plurality of predetermined font symbols, and handwriting data entry areas associated with said predetermined text, said screen permitting an exemplary handwritten symbol corresponding to said displayed predetermined font symbol to be written or drawn on said screen by an individual user;

a memory for storing said predetermined text, said exemplary handwritten symbol, and data associated with said document;

a stylus;

a digitizer, coupled to said screen to detect the position of said stylus on or over at least a portion of said screen when said stylus is used write or draw a handwritten symbol to be entered into said data entry areas, said digitizer providing output signals indicative of said stylus position;

at least one database stored in said memory, wherein said at least one database contains at least one characteristic of said written or drawn exemplary handwritten symbol, and said at least one database contains a font symbol corresponding to said exemplary handwritten symbol; and

at least one processor coupled to said digitizer, said processor configured to process said output signals and to identify whether said handwritten symbol matches one of said plurality of predetermined font symbols by comparing at least one characteristic of a handwritten symbol with said at least one characteristic in said database, and, if said handwritten symbol matches a predetermined font symbol, causing said matching font symbol to be displayed on said screen.

24. The apparatus according to claim 23, wherein said database is created in a learning mode by an initialization routine in which each of a plurality of predetermined font symbols is displayed on said screen and the individual user writes or draws an exemplary handwritten symbol corresponding to each predetermined font symbol.

25. A computer which accepts handwriting entries, said computer comprising:

a screen for electronically displaying a document;

a data entry area located on said screen, said data entry area configured to accept handwritten input information for said document;

computer-generated text displayed on said screen as part of said document, said text indicating a type of information to be entered into said data entry area;

a memory which stores said text and data entered into said data entry area;

a stylus intended to be used to write or draw a handwritten symbol representative of text or data for entry into said data entry area;

a position sensor which detects the position of said stylus on or over at least a portion of said screen and generates corresponding position signals; and

a processor, coupled to said position sensor, which stores information in said memory corresponding to a handwritten symbol written or drawn within or near said first data entry area.

26. The computer according to claim 25, wherein said text indicating a type of information to be entered includes at least the word "name."

27. The computer according to claim 25, wherein said text indicating a type of information to be entered includes at least the word "room."

28. The computer according to claim 25, wherein said document is a hospital form.

29. The computer according to claim 25, wherein said document is a financial form.

30. An apparatus for entering data into a document, said apparatus comprising:

a screen for electronically displaying predetermined text and handwriting data entry areas associated with said document;

a memory for storing said predetermined text and for storing data associated with said document;

a stylus for use by a user to write or draw a handwritten symbol in said data entry area;

a position detecting sensor, coupled to said screen, which detects the position of said stylus on or over at least a portion of said screen and generates locating signals representative of the handwritten symbol;

a routine which, when executed, defines an area on said screen and assigns a function to said defined area, wherein the display of said defined area changes to reverse video and said function is carried out when said position sensor detects that said stylus is in a position on or over said defined area on said display; and

a processor, coupled to said position sensor, for processing said locating signals to identify whether the handwritten symbol matches one of a plurality of predetermined font symbols, and, if the handwritten symbol matches a predetermined font symbol, displaying said matching font symbol.

31. An apparatus for entering data into a document, said apparatus comprising:

a screen which displays a document electronically on at least a first screen portion, said document including both predetermined and a handwriting data entry area associated with predetermined text;

a memory for storing said predetermined text and for storing input data associated with said document;

a stylus for use by a user to write or draw a handwritten symbol in said data entry area;

a position sensor, coupled to said screen, which detects the position of stylus on or over at least a portion of said screen and generates position signals corresponding the handwritten symbol; and

a processor, coupled to said position sensor, said processor capable of reading a database of characteristics of a plurality of predetermined font symbols, said processor configured to compare a characteristic of a handwritten symbol with characteristics stored in said database to identify whether the handwritten symbol matches a predetermined font symbol, and, if the handwritten symbol matches a predetermined font symbol, displays said matching font symbol, wherein characteristics of the plurality of predetermined font symbols are stored as entries in said database and, depending on the frequency of use of the respective associated handwritten symbols by the user, an order of the entries in the database is swapped or sorted or shuffled so that, when a comparison is made between a characteristic of a handwritten symbol and entries in said database, the comparison is made with the more frequently used database entries first.