System, computer program product, and method for capturing and processing form data

• US 20020107885A1
• Filed: 01/29/2002
• Published: 08/08/2002
• Est. Priority Date: 02/01/2001
• Status: Abandoned Application

• Current Assignee: ADS Software Mgmt LLC (Intellectual Ventures LLC)
• Original Assignee: Advanced Digital Systems Incorporated
• Inventors: Clary, Gregory J., Brooks, Ezekiel
• Application Number:
  US10/059,478
• Publication Number:
  US 20020107885A1
• Time in Patent Office: Days
• US Class Current: 715/505
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 40/174 Form filling; Merging

Abstract

A system for communicating packaged data includes a pen-enabled computing device and a second computing device. The pen-enabled computing device includes a handwriting capture interface, a user interface and a processing element. The handwriting capture interface is capable of receiving and capturing an electronic handwriting input within at least one input field of an electronic form based upon a position of a writing stylus. To facilitate proper operation of the pen-enabled computing device, the user interface is adapted to provide feedback, such as aural, visual and/or vibration feedback, based upon the electronic handwriting input. The pen-enabled computing device is capable of transmitting packaged data including at least one form identifier and processed electronic handwriting input. Thereafter, the second computing device is capable of receiving the packaged data and then verifying the processed electronic handwriting input.

Claims

1. A method of capturing and processing data from an input received by a handwriting capture device, said method comprising:

receiving an electronic handwriting input within at least one field of an electronic form based upon a position of a writing stylus;

detecting a type of input based upon at least one of the electronic handwriting input received and the position of the writing stylus;

capturing and thereafter processing the electronic handwriting input based upon the type of input detected; and

providing feedback based upon at least one of the position of the writing stylus, the electronic handwriting input captured, the type of input detected and a form definition associated with the electronic form.

2. A method according to claim 1, wherein detecting a type of input comprises detecting a type of input from a group consisting of free-form handwriting input, handwriting input for character recognition, at least one checkbox selection and at least one radio button selection.

3. A method according to claim 2, wherein processing the electronic handwriting input comprises at least one of compressing and storing the electronic handwriting input.

4. A method according to claim 2, wherein processing the electronic handwriting input comprises converting the electronic handwriting input into a text representation of the electronic handwriting input when the electronic handwriting input comprises handwriting input for character recognition.

5. A method according to claim 2, wherein processing the electronic handwriting input comprises recording at least one selection when the type of input detected comprises at least one of a checkbox selection and a radio button selection.

6. A method according to claim 1 further comprising:

initiating a form processing action based upon at least one form identifier, wherein the at least one form identifier is associated with at least one electronic form; and

initializing the electronic form based upon the at least one form identifier and at least one form definition associated with the at least one form identifier, wherein initiating a form processing action, and initializing the at least one form occur before receiving an electronic handwriting input.

7. A method according to claim 1, wherein providing feedback comprises providing at least one of aural, visual and vibration feedback.

8. A method according to claim 7, wherein providing visual feedback comprises displaying an image including at least one of a group comprising:

a thumbnail window comprising a sketch of the electronic form including the at least one field, the sketch further including associated electronic handwriting input within at least one field of the electronic form as the electronic handwriting input is captured;

a form identifier field comprising at least one form identifier associated with the electronic form;

a scroll-down window comprising an enlarged representation of the at least one field of the electronic form, wherein the scroll-down window is capable of scrolling depending upon a size of the electronic form; and

an exploded view window comprising at least one selected field of the electronic form, wherein the exploded view window is capable of showing information based on at least a portion of the electronic handwriting input associated with the selected field.

9. A method according to claim 1, wherein providing feedback comprises providing feedback based upon at least one of the electronic handwriting input captured, the type of input detected, the form definition and at least one business rule.

10. A computer program product adapted to execute within a pen-enabled computing device having a handwriting capture device and a writing stylus, said computer program product comprising:

a first executable portion for receiving an electronic handwriting input within at least one field of an electronic form based upon a position of the writing stylus;

a second executable portion for detecting a type of input based upon at least one of the electronic handwriting input received and the position of the writing stylus;

a third executable portion for capturing and thereafter processing the electronic handwriting input based upon the type of input detected; and

a fourth executable portion for providing feedback based upon at least one of the position of the writing stylus, the electronic handwriting input captured by said third executable portion, the type of input detected by said second executable portion and a form definition associated with the electronic form.

11. A computer program product according to claim 10, wherein said second executable portion detects the type of input from a group consisting of free-form handwriting input, handwriting input for character recognition, at least one checkbox selection and at least one radio button selection.

12. A computer program product according to claim 11, wherein said third executable portion processes the electronic handwriting input by at least one of compressing and storing the electronic handwriting input.

13. A computer program product according to claim 11, wherein said third executable portion processes the electronic handwriting input by converting the electronic handwriting input into a text representation of the electronic handwriting input when the electronic handwriting input comprises handwriting input for character recognition.

14. A computer program product according to claim 11, wherein said third executable portion processes the electronic handwriting input by recording at least one selection when the type of input detected comprises at least one of a checkbox selection and a radio button selection.

15. A computer program product according to claim 10 further comprising:

a fifth executable portion for initiating a form processing action based upon at least one form identifier, wherein the at least one form identifier is associated with at least one form definition; and

a sixth executable portion for initializing the electronic form based upon the at least one form identifier and the associated at least one form definition, wherein said fifth executable portion initiates the form processing action and said sixth executable portion initializes the at least one form before said first executable portion receives the electronic handwriting input.

16. A computer program product according to claim 10, wherein said fourth executable portion provides at least one of aural, visual and vibration feedback.

17. A computer program product according to claim 16, wherein said fourth executable portion provides visual feedback by displaying an image including at least one of a group comprising:

a thumbnail window comprising a sketch of the electronic form including the at least one field, the sketch further including associated electronic handwriting input within at least one field of the electronic form as the electronic handwriting input is captured;

a form identifier field comprising at least one form identifier associated with the electronic form;

a scroll-down window comprising an enlarged representation of the at least one field of the electronic form, wherein the scroll-down window is capable of scrolling depending upon a size of the electronic form; and

an exploded view window comprising at least one selected field of the electronic form, wherein the exploded view window is capable of showing information based on at least a portion of the electronic handwriting input associated with the selected field.

18. A computer program product according to claim 10, wherein said fourth executable portion provides feedback based upon at least one of the electronic handwriting input captured by said third executable portion, the type of input detected by said second executable portion, the form definition and at least one business rule.

20. A pen-enabled computing device according to claim 19, wherein said processing element is capable of detecting a type of input from a group consisting of free-form handwriting input, handwriting input for character recognition, at least one checkbox selection and at least one radio button selection.

21. A pen-enabled computing device according to claim 20, wherein said processing element is capable of at least one of compressing and storing the electronic handwriting input.

22. A pen-enabled computing device according to claim 20, wherein said processing element is capable of converting the electronic handwriting input into a text representation of the electronic handwriting input when the electronic handwriting input comprises handwriting input for character recognition.

23. A pen-enabled computing device according to claim 20, wherein said processing element is capable of recording at least one selection when the type of input detected comprises at least one of a checkbox selection and a radio button selection.

24. A pen-enabled computing device according to claim 19, wherein at least one of said handwriting capture interface and said user interface is capable of receiving an initiating action to thereby initiate a form processing action based upon at least one form identifier, wherein the at least one form identifier is associated with at least one form definition, wherein said processing element is further capable of initializing the electronic form based upon the at least one form identifier and the associated at least one form definition.

25. A pen-enabled computing device according to claim 19, wherein said user interface is capable of providing at least one of aural, visual and vibration feedback.

26. A pen-enabled computing device according to claim 25, wherein said user interface includes a display adapted to present the electronic handwriting input, wherein said display is capable of presenting an image comprising at least one of a group comprising:

a thumbnail window comprising a sketch of the electronic form including the at least one field, the sketch further including associated electronic handwriting input within at least one field of the electronic form as the electronic handwriting input is captured;

a form identifier field comprising at least one form identifier associated with the electronic form;

a scroll-down window comprising an enlarged representation of the at least one field of the electronic form, wherein the scroll-down window is capable of scrolling depending upon a size of the electronic form; and

an exploded view window comprising at least one selected field of the electronic form, wherein the exploded view window is capable of showing information based on at least a portion of the electronic handwriting input associated with the selected field.

27. A pen-enabled computing device according to claim 19, wherein said user interface is capable of providing feedback based upon at least one of the electronic handwriting input captured, the type of input detected, the form definition and at least one business rule.

29. A method according to claim 28, wherein when the packaged data includes a text representation of handwriting input for character recognition the packaged data further includes an associated handwriting input for character recognition, and wherein verifying the text representation comprises:

converting the handwriting input for character recognition into at least one additional text representation of the handwriting input;

comparing the at least one additional text representation of the handwriting input and the text representation of the electronic handwriting input; and

selecting an acceptable text representation of the handwriting input based upon the comparison.

30. A method according to claim 29, wherein comparing the at least one additional text representation of the handwriting input and the text representation of the electronic handwriting input comprises:

calculating at least one combined confidence value for the at least one additional text representation of the handwriting input and the text representation of the electronic handwriting input, wherein calculating the at least one combined confidence value comprises combining at least one confidence value associated with the respective text representations of the handwriting input; and

comparing the combined confidence values to determine a combined confidence value having the highest combined confidence value,

wherein selecting an acceptable text representation comprises selecting the text representation associated with the highest combined confidence value.

31. A method according to claim 30, wherein the handwriting input for character recognition includes a plurality of handwritten characters, wherein the text representation of the handwriting input comprises at least one text representation for each handwritten character having respective confidence values, wherein converting the handwriting input for character recognition comprises converting each handwritten character into at least one additional text representation of the handwritten character having respective confidence values, wherein combining the at least one confidence value comprises combining, for each different text representation of a handwritten character, the confidence values for the respective text representation and at least one additional text representation of the handwritten character, and wherein comparing the combined confidence values comprises comparing the combined confidence value for each different text representation of the handwritten character.

32. A method according to claim 29, wherein converting the handwriting input comprises converting the handwriting input into a plurality of additional text representations of the handwriting input according to different respective conversion methods.

33. A method according to claim 28, wherein verifying a selection associated with at least one of a checkbox and a radio button comprises applying at least one business rule to the selection based upon at least one form definition associated with the at least one form identifier.

34. A method according to claim 28, wherein the packaged data further includes compressed free-form handwriting input, said method further comprising at least one of rendering the free-form handwriting input, uncompressing the compressed free-form handwriting input and storing the compressed free-form handwriting input, wherein at least one of uncompressing and storing the compressed free-form handwriting input occur after parsing the packaged data.

35. A method according to claim 28, wherein transmitting the packaged data comprises transmitting the packaged data from a pen-enabled computing device, and wherein receiving, parsing and verifying the processed electronic handwriting input occur at a server computing device located remote from the pen-enabled computing device.

36. A method according to claim 35 further comprising:

capturing handwriting input for character recognition at a pen-enabled computing device and thereafter converting the handwriting input into a text representation of the handwriting input, wherein the processed electronic handwriting input comprises the text representation of the handwriting input and the handwriting input, wherein capturing and converting occur before transmitting the packaged data, and

wherein verifying the text representation comprises;

converting the handwriting input into at least one additional text representation of the handwriting input;

comparing the at least one additional text representation of the handwriting input and the text representation of the electronic handwriting input; and

selecting an acceptable text representation of the handwriting input based upon the comparison.

38. A computer program product according to claim 37, wherein when the packaged data includes a text representation of handwriting input for character recognition the packaged data further includes an associated handwriting input for character recognition, and wherein said third executable portion verifies the text representation according to the following:

converting the handwriting input for character recognition into at least one additional text representation of the handwriting input for character recognition;

comparing the at least one additional text representation of the handwriting input and the text representation of the electronic handwriting input; and

selecting an acceptable text representation of the handwriting input based upon the comparison.

39. A computer program product according to claim 38, wherein said third executable portion compares the at least one additional text representation of the handwriting input and the text representation of the electronic handwriting input comprises by:

calculating at least one combined confidence value for the at least one additional text representation of the handwriting input and the text representation of the electronic handwriting input, wherein calculating the at least one combined confidence value comprises combining at least one confidence value associated with the respective text representations of the handwriting input; and

comparing the combined confidence values to determine a combined confidence value having the highest combined confidence value,

wherein said third executable portion selects the acceptable text representation by selecting the text representation associated with the highest combined confidence value.

40. A computer program product according to claim 39, wherein the handwriting input for character recognition includes a plurality of handwritten characters, wherein the text representation of the handwriting input comprises at least one text representation for each handwritten character having respective confidence values, wherein said third executable portion converting the handwriting input for character recognition by converting each handwritten character into at least one additional text representation of the handwritten character having respective confidence values, wherein said third executable portion combines the at least one confidence value by combining, for each different text representation of a handwritten character, the confidence values for the respective text representation and at least one additional text representation of the handwritten character, and wherein said third executable portion compares the combined confidence values comprises comparing the combined confidence value for each different text representation of the handwritten character.

41. A computer program product according to claim 38, wherein said third executable portion converts the handwriting input by converting the handwriting input into a plurality of additional text representations of the handwriting input according to different respective conversion methods.

42. A computer program product according to claim 38, wherein said third executable portion verifies a selection associated with at least one of a checkbox and a radio button by applying at least one business rule to the selection based upon at least one form definition associated with the at least one form identifier.

43. A computer program product according to claim 38, wherein the packaged data further includes compressed free-form handwriting input, said computer program product further comprising a fourth executable portion for at least one of rendering the free-form handwriting input, uncompressing the compressed free-form handwriting input and storing the compressed free-form handwriting input, wherein at least one of uncompressing and storing the compressed free-form handwriting input occur after parsing the packaged data.

44. A computer program product according to claim 38, wherein said first executable portion transmits the packaged data from a pen-enabled computing device, and wherein said second receives and parses the packaged data and said third executable portion verifies the packaged data at a server computing device located remote from the pen-enabled computing device.

45. A computer program product according to claim 44 further comprising:

a fourth executable portion for capturing handwriting input for character recognition at a pen-enabled computing device and thereafter converting the handwriting input into a text representation of the handwriting input, wherein the processed electronic handwriting input comprises the text representation of the handwriting input and the handwriting input, wherein said fourth executable portion captures and converts the handwriting input occur before said first executable portion transmits the packaged data, and

wherein said third executable portion verifies the text representation by;

converting the handwriting input into at least one additional text representation of the handwriting input;

comparing the at least one additional text representation of the handwriting input and the text representation of the electronic handwriting input; and

selecting an acceptable text representation of the handwriting input based upon the comparison.

47. A system according to claim 46, wherein when the packaged data includes a text representation of handwriting input for character recognition the packaged data further includes an associated handwriting input for character recognition, wherein said second computing device is capable of converting the handwriting input for character recognition into at least one additional text representation of the handwriting input for character recognition, wherein said second computing device is capable of comparing the at least one additional text representation of the handwriting input and the text representation of the electronic handwriting input, and wherein said second computing device is capable of selecting an acceptable text representation of the handwriting input based upon the comparison to thereby verify the text representation of handwriting input for character recognition.

48. A system according to claim 47, wherein said second computing device is capable of comparing the at least one additional text representation of the handwriting input and the text representation of the electronic handwriting input by calculating at least one combined confidence value for the at least one additional text representation of the handwriting input and the text representation of the electronic handwriting input by combining at least one confidence value associated with the respective text representations of the handwriting input, and thereafter comparing the combined confidence values to determine a combined confidence value having the highest combined confidence value, wherein said second computing device is capable of selecting an acceptable text representation by selecting the text representation associated with the highest combined confidence value.

49. A system according to claim 48, wherein the handwriting input for character recognition includes a plurality of handwritten characters, wherein the text representation of the handwriting input comprises at least one text representation for each handwritten character having respective confidence values, wherein said second computing device is capable of converting the handwriting input for character recognition by converting each handwritten character into at least one additional text representation of the handwritten character having respective confidence values, wherein said second computing device is capable of combining the at least one confidence value by combining, for each different text representation of a handwritten character, the confidence values for the respective text representation and at least one additional text representation of the handwritten character, and wherein said second computing device is capable of comparing the combined confidence values by comparing the combined confidence value for each different text representation of the handwritten character.

50. A system according to claim 47, wherein said second computing device is capable of converting the handwriting input for character recognition into a plurality of additional text representations of the handwriting input according to different respective conversion methods.

51. A system according to claim 46, wherein said second computing device is capable of verifying a selection associated with at least one of a checkbox and a radio button by applying at least one business rule to the selection based upon at least one form definition associated with the at least one form identifier.

52. A system according to claim 46, wherein the packaged data further includes compressed free-form handwriting input, wherein said second computing device is further capable of at least one of uncompressing the compressed free-form handwriting input, rendering and storing the compressed free-form handwriting input.

53. A system according to claim 46, wherein said second computing device includes a database capable of storing at least one of the packaged data and the at least one form identifier and the processed electronic handwriting input parsed from the packaged data.

54. A system according to claim 46, wherein said second computing device is further capable of transmitting at least one of the packaged data and the processed electronic handwriting input.

55. A system according to claim 46, wherein the at least one form identifier is associated with at least one form definition for at least one electronic form, wherein said second computing device includes a database capable of storing the at least one form definition, and wherein said second computing device is capable of associating the processed electronic handwriting input with at least one form definition associated with the at least one form identifier of the packaged data received from said pen-enabled computing device.

56. A system according to claim 46, wherein said pen-enabled computing device is capable of capturing handwriting input comprising at least one free-form handwriting input, handwriting input for character recognition, at least one checkbox selection and at least one radio button selection, wherein said pen-enabled computing device is capable of converting the handwriting input for character recognition into a text representation of the handwriting input, wherein the processed electronic handwriting input comprises the text representation of the handwriting input and the handwriting input, wherein capturing and converting occur before transmitting the packaged data, wherein said pen-enabled computing device is capable of transmitting the packaged data to said second computing device located remote from said pen-enabled computing device, and wherein said second computing device comprises a server computing device.

19. A pen-enabled computing device comprising:

a handwriting capture interface capable of receiving and capturing an electronic handwriting input within at least one input field of an electronic form based upon a position of a writing stylus;

a processing element in communication with said handwriting capture interface, said processing unit being capable of detecting a type of electronic handwriting input based upon at least one of the electronic handwriting input received and the position of the writing stylus, wherein said processing element is further capable of processing the electronic handwriting input based upon the type of electronic handwriting input; and

a user interface in communication with said processing element and adapted to provide feedback based upon at least one of the position of the writing stylus, the electronic handwriting input captured, the type of input detected and a form definition associated with the electronic form.

28. A method of communicating and processing packaged data from a pen-enabled computing device, said method comprising:

transmitting the packaged data, wherein the packaged data includes at least one form identifier and processed electronic handwriting input;

receiving the packaged data and thereafter parsing the packaged data into the at least one form identifier and the processed electronic handwriting input; and

verifying the processed electronic handwriting input when the processed electronic handwriting input comprises at least one of a text representation of handwriting input for character recognition and a selection associated with at least one of a checkbox and a radio button.

37. A computer program product for communicating and processing packaged data from a pen-enabled computing device, the computer program product comprising a computer-readable storage medium having computer-readable program code embodied in said medium, the computer-readable program code comprising:

a first executable portion for transmitting the packaged data, wherein the packaged data includes at least one form identifier and processed electronic handwriting input;

a second executable portion for receiving the packaged data and thereafter parsing the packaged data into the at least one form identifier and the processed electronic handwriting input; and

a third executable portion for verifying the processed electronic handwriting input when the processed electronic handwriting input comprises at least one of a text representation of handwriting input for character recognition and a selection associated with at least one of a checkbox and a radio button.

46. A system for communicating packaged data, said system comprising:

a pen-enabled computing device capable of transmitting the packaged data, wherein the packaged data includes at least one form identifier and processed electronic handwriting input; and

a second computing device capable of receiving the packaged data and thereafter parsing the packaged data into the at least one form identifier and the processed electronic handwriting input, wherein said second computing device is further capable of verifying the processed electronic handwriting input when the processed electronic handwriting input comprises at least one of a text representation of handwriting input for character recognition and a selection associated with at least one of a checkbox and a radio button.