Method and system for data entry of handwritten symbols

• US 6,269,187 B1
• Filed: 08/31/1999
• Issued: 07/31/2001
• Est. Priority Date: 06/17/1991
• Status: Expired due to Fees

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Bishop, Bryon Dean, Frink, Lloyd
• Primary Examiner(s): Couso, Jose L.
• Application Number:
  US09/386,248
• Time in Patent Office: 700 Days
• Field of Search: 382/100, 382/187, 382/309, 178/18-20, 345/179-183
• US Class Current: 382/187
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06V 30/1423 the instrument generating sequences of position coordinates corresponding to handwriting preprocessing or recognising digital ink G06V30/32
• CPC Class Codes: G06V 30/32 Digital ink

Abstract

A method and system for data entry of handwritten text into a computer program that is not designed to accept handwritten text is provided. In preferred embodiments, the computer program is designed to operate in a windowing environment. A data entry program receives handwritten data, recognizes the data, and sends the recognized data to the computer program. The computer program processes the recognized data as if it had been entered from the keyboard. According to the present invention, the data entry program overlaps the window of the computer program with an invisible window. To the user, it looks as if the computer program is accepting handwritten data directly.

Claims

1. A computer-readable medium including computer-executable instructions, comprising:

receiving handwriting data;

detecting the end of the handwriting data;

converting the handwriting data to a set of at least one virtual event; and

sending the set of at least one virtual event to a computer program such that the computer program may perform an action corresponding to the handwriting data without having acted to accept input of the handwriting data.

2. The computer-readable medium including computer-executable instructions of claim 1, wherein the set of at least one virtual event includes information corresponding to at least one keystroke.

3. The computer-readable medium including computer-executable instructions of claim 1, wherein the set of at least one virtual event includes information corresponding to at least one mouse event.

4. The computer-readable medium including computer-executable instructions of claim 1, wherein the set of at least one virtual event includes information corresponding to at least one gesture.

5. The computer-readable medium including computer-executable instructions of claim 1, wherein detecting the end of the handwriting data includes determining that handwriting has stopped for a period of time.

6. The computer-readable medium including computer-executable instructions of claim 5, wherein the period of time is predetermined.

7. The computer-readable medium including computer-executable instructions of claim 6, wherein the period of time is variable.

8. The computer-readable medium including computer-executable instructions of claim 7, wherein the period of time depends on the pace of receiving handwriting data.

9. The computer-readable medium including computer-executable instructions of claim 4, wherein the at least one gesture includes an editing command.

10. The computer-readable medium including computer-executable instructions of claim 9, wherein the at least one gesture corresponds to a control character.

11. The computer-readable medium including computer-executable instructions of claim 10, wherein the control character comprises a backspace command.

12. The computer-readable medium including computer-executable instructions of claim 1 wherein detecting the end of the handwriting data detecting a pen up.

13. The computer-readable medium including computer-executable instructions of claim 1, wherein detecting the end of the handwriting data includes detecting selection of a menu item.

16. The computer-readable medium of claim 1 further comprising, performing an action in the computer program based on the set of at least one virtual event.

17. The computer-readable medium of claim 16 wherein performing an action includes outputting a character to a display.

14. The computer-readable medium of claim including further computer-executable instructions for outputting a representation of the handwriting data to a display.

15. The computer-readable medium of claim 14 including further computer-executable instructions for removing the representation of the handwriting data from the display in response to detecting the end of the handwriting data.

18. A method of sending data to a computer program designed to accept codes representing characters and gestures, comprising:

receiving handwriting at data entry software that is separate from the computer program such that the computer program need not directly receive the handwriting;

translating the handwriting into a code that is compatible with the computer program;

providing the code to the computer program; and

processing the code at the computer program.

19. The method of claim 18 wherein the code comprises an ASCII value representing a keyboard event.

20. The method of claim 18 wherein the code represents a value corresponding to a keyboard command.

21. The method of claim 20 wherein the keyboard command comprises a command for editing characters.

22. The method of claim 18 wherein the code corresponds to a mouse event.

23. The method of claim 18 further comprising, detecting an end of receiving the handwriting.

24. The method of claim 23 wherein detecting the end of receiving the handwriting includes detecting a pen up event.

25. The method of claim 23 wherein detecting the end of receiving the handwriting includes determining that the pen is up for a period of time.

26. The method of claim 18 further comprising, outputting a representation of the handwriting data to a display.

27. The method of claim 18 further comprising, outputting a representation of the handwriting data to a display, detecting an end of receiving the handwriting, and removing the representation of the handwriting data from the display in response to detecting the end of receiving the handwriting data.

28. The method of claim 18 wherein processing the code includes outputting a character to a display.

29. A computer-readable medium including computer-executable instructions, comprising:

receiving handwritten data at a writing area;

recognizing the handwritten data as corresponding to a code, the code recognizable by a loaded application program; and

providing the code to the loaded application program for processing without direct handling of the handwritten data by the loaded application program.

30. The computer-readable medium including computer-executable instructions of claim 29, wherein the handwritten data corresponds to a gesture.

31. The computer-readable medium including computer-executable instructions of claim 29, wherein the handwritten data comprises at least one stroke.

32. The computer-readable medium of claim 29 including further computer-executable instructions for detecting an end of receiving the handwritten data.

33. The computer-readable medium including computer-executable instructions of claim 29, wherein the code corresponds to a plurality of strokes.

34. The computer-readable medium including computer-executable instructions of claim 29 further comprising, selecting another application program, receiving other handwritten data at the writing area, recognizing the other handwritten data as corresponding to a code, and send the code to the other application program for processing.

35. The computer-readable medium including computer-executable instructions of claim 29, wherein the writing area is independent of the loaded application program.

36. The computer-readable medium including computer-executable instructions of claim 29, wherein the loaded application program corresponds to a text entry program.

38. The computer system of claim 36 further comprising a display, the computer program outputting a representation of a character corresponding to the symbol code.

37. A computer system, comprising:

a writing area for receiving handwritten data, at least some of the handwritten data comprising symbols, each symbol having a corresponding symbol code of a coding scheme;

a computer program configured to receive symbol codes of a coding scheme, and not configured to directly receive handwritten data; and

a process configured to interpret at least some of the handwritten data as an identified symbol code and send the identified symbol code to the computer program.

39. A computer system, comprising:

a writing area for receiving handwritten data, at least some of the handwritten data corresponding to identified character and gesture codes of a coding scheme;

a plurality of selectable computer programs, at least two of the programs configured to receive character and gesture codes of the coding scheme and not configured to directly receive handwritten data;

a process configured to interpret at least some of the handwritten data received at the writing area as an identified character or gesture, and to provide a corresponding character or gesture code to a selected one of the at least two programs; and

a display configured to output information including text information based on the identified character or gesture code.

40. The computer system of claim 39 wherein the writing area and the display are incorporated into a touch-sensitive display.

41. The computer system of claim 40 wherein at least part of the writing area overlaps at least part of the display.

42. The computer system of claim 40 wherein the writing area is separate from an area corresponding to the display.