Handwritten text capture via interface surface

• US 7,170,499 B1
• Filed: 05/23/2000
• Issued: 01/30/2007
• Est. Priority Date: 05/25/1999
• Status: Expired due to Term

• Current Assignee: Livescribe Incorporated (Anoto Group AB)
• Original Assignee: Silverbrook Research Pty Limited
• Inventors: Lapstun, Paul, Silverbrook, Kia
• Primary Examiner(s): Hjerpe, Richard
• Assistant Examiner(s): Abdulselam, Abbas I.
• Application Number:
  US09/575,170
• Time in Patent Office: 2,443 Days
• Field of Search: 345/173, 345/177, 345/179, 345/180, 345/166, 345/183, 178/18.01, 178/18.03, 178/19.01, 717/106, 717/141, 700/222, 382/312
• US Class Current: 345/173
• CPC Class Codes: B41J 13/103 for the sheet feeding section
• CPC Class Codes: B41J 13/106 for the sheet output section
• CPC Class Codes: B41J 2/17503 Ink cartridges
• CPC Class Codes: B41J 2/17513 Inner structure
• CPC Class Codes: B41J 2/17523 Ink connection
• CPC Class Codes: B41J 2/17546 electronically
• CPC Class Codes: B41J 2/17553 Outer structure
• CPC Class Codes: B41J 2/17556 Means for regulating the pressure in the cartridge
• CPC Class Codes: B41J 2/17563 Ink filters
• CPC Class Codes: B41J 2/2114 Ejecting transparent or white coloured liquids, e.g. processing liquids B41J2/211 takes precedence
• CPC Class Codes: B42C 19/02 starting with single sheets
• CPC Class Codes: B42C 9/0006 by applying adhesive to a stack of sheets
• CPC Class Codes: B42C 9/0081 applying adhesive to individual sheets for binding them together by fusing, welding B42C9/0093
• CPC Class Codes: B42P 2261/04 Producing books by printing sheets in following order, e.g. for ordering via the Internet
• CPC Class Codes: B65H 29/34 from supports slid from under the articles
• CPC Class Codes: B65H 37/04 for securing together articles or webs, e.g. by adhesive, stitching or stapling adhering replacement to expiring web during change of web roll B65H19/18
• CPC Class Codes: G06F 21/608 Secure printing
• CPC Class Codes: G06F 2203/0384 Wireless input, i.e. hardware and software details of wireless interface arrangements for pointing devices
• CPC Class Codes: G06F 2221/2153 Using hardware token as a secondary aspect
• CPC Class Codes: G06F 3/0321 by optically sensing the absolute position with respect to a regularly patterned surface forming a passive digitiser, e.g. pen optically detecting position indicative tags printed on a paper sheet constructional details of pen-shaped pointing devices G06F3/03545, G06F3/03542, G06F3/037
• CPC Class Codes: G06F 3/03545 : Pens or stylus
• CPC Class Codes: G06F 3/03546 : using a rotatable ball at the tip as position detecting member
• CPC Class Codes: G06F 3/038 : Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
• CPC Class Codes: G06F 3/0386 : for light pen
• CPC Class Codes: G06F 3/04883 : for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/1204 : resulting in reduced user or operator actions, e.g. presetting, automatic actions, using hardware token storing data
• CPC Class Codes: G06F 3/1265 : Printing by reference, e.g. retrieving document/image data for a job from a source mentioned in the job
• CPC Class Codes: G06F 3/1284 : Local printer device
• CPC Class Codes: G06K 17/00 : Methods or arrangements for effecting co-operative working between equipments covered by two or more of main groups G06K1/00 - G06K15/00, e.g. automatic card files incorporating conveying and reading operations
• CPC Class Codes: G06V 30/10 : Character recognition
• CPC Class Codes: G06V 30/1423 : the instrument generating sequences of position coordinates corresponding to handwriting preprocessing or recognising digital ink G06V30/32
• CPC Class Codes: G06V 30/1444 : Selective acquisition, locating or processing of specific regions, e.g. highlighted text, fiducial marks or predetermined fields
• CPC Class Codes: H04L 2209/56 : Financial cryptography, e.g. electronic payment or e-cash
• CPC Class Codes: H04L 2209/603 : Digital right managament [DRM]
• CPC Class Codes: H04L 2209/805 : Lightweight hardware, e.g. radio-frequency identification [RFID] or sensor
• CPC Class Codes: H04L 9/3247 : involving digital signatures
• CPC Class Codes: H04L 9/3263 : involving certificates, e.g. public key certificate [PKC] or attribute certificate [AC]; Public key infrastructure [PKI] arrangements network architectures or network communication protocols for supporting authentication of entities using certificates in a packet data network H04L63/0823
• CPC Class Codes: H04N 1/00127 : Connection or combination of a still picture apparatus with another apparatus, e.g. for storage, processing or transmission of still picture signals or of information associated with a still picture
• CPC Class Codes: H04N 1/00204 : with a digital computer or a digital computer system, e.g. an internet server programmed control between transmitter and receiver or between image input and image output device H04N1/32561
• CPC Class Codes: H04N 1/00244 : with a server, e.g. an internet server fax-servers or the like for store and forward H04N1/324
• CPC Class Codes: H04N 1/00326 : with a data reading, recognizing or recording apparatus, e.g. with a bar-code apparatus arrangements for the associated working of recording or reproducing apparatus with related apparatus G11B31/00
• CPC Class Codes: H04N 1/00358 : Type of the scanned marks
• CPC Class Codes: H04N 1/00376 : Means for identifying a mark sheet or area
• CPC Class Codes: H04N 1/00567 : Handling of original or reproduction media, e.g. cutting, separating, stacking
• CPC Class Codes: H04N 1/00968 : by scanning marks on a sheet mark-sheet input means H04N1/00355; sensing record carriers G06K7/00
• CPC Class Codes: H04N 1/32101 : Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title
• CPC Class Codes: H04N 1/32122 : in a separate device, e.g. in a memory or on a display separate from image data
• CPC Class Codes: H04N 1/32128 : attached to the image data, e.g. file header, transmitted message header, information on the same page or in the same computer file as the image for information embedded in the image H04N1/32144
• CPC Class Codes: H04N 1/32771 : in response to a request, e.g. for a particular document
• CPC Class Codes: H04N 1/32778 : using a mark-sheet or machine-readable code request
• CPC Class Codes: H04N 2201/0082 : Image hardcopy reproducer H04N2201/0091 - H04N2201/0094 take precedence
• CPC Class Codes: H04N 2201/3205 : of identification information, e.g. name or ID code H04N2201/3209 takes precedence
• CPC Class Codes: H04N 2201/3207 : of an address
• CPC Class Codes: H04N 2201/3226 : of identification information or the like, e.g. ID code, index, title, part of an image, reduced-size image
• CPC Class Codes: H04N 2201/3242 : of processing required or performed, e.g. for reproduction or before recording H04N2201/3256 and subgroups take precedence
• CPC Class Codes: H04N 2201/3243 : of type information, e.g. handwritten or text document
• CPC Class Codes: H04N 2201/3247 : Data linking a set of images to one another, e.g. sequence, burst or continuous capture mode
• CPC Class Codes: H04N 2201/3249 : data relating to a linked page or object, e.g. hyperlink
• CPC Class Codes: H04N 2201/3269 : of machine readable codes or marks, e.g. bar codes or glyphs
• CPC Class Codes: H04N 2201/327 : which are undetectable to the naked eye, e.g. embedded codes
• CPC Class Codes: H04N 2201/3271 : Printing or stamping
• CPC Class Codes: H04N 2201/3278 : Transmission
• CPC Class Codes: Y10S 707/99942 : Manipulating data structure, e.g. compression, compaction, compilation

Abstract

A method and system for enabling user interaction with computer software running in a computer system via an interface surface and a sensing device. The interface surface contains information relating to the computer software and coded data indicative of a text field. When placed in an operative position relative to the interface surface, the sensing device senses indicating data indicative of the text field and generates movement data indicative of the sensing device'"'"'s movement relative to the interface surface. The indicating data and movement data are received in the computer system and the text field is identified from the indicating data. The computer software is operated at least partly in reliance on the movement data, and in accordance with instructions associated with the text field.

Claims

1. A method of enabling user interaction with computer software running in a computer system via:

an interface surface containing information relating to the computer software and having coded data indicative of a text field disposed thereon; and

a sensing device which, when placed in an operative position relative to the interface surface, senses indicating data indicative of the text field and generates movement data indicative of the sensing device'"'"'s movement relative to the interface surface;

the method including the steps of, in the computer system;

(a) receiving the indicating data from the sensing device;

(b) receiving the movement data from the sensing device;

(c) identifying the text field from the indicating data; and

(d) operating the computer software at least partly in reliance on the movement data, and in accordance with instructions associated with the text field.

2. A method according to claim 1, the method further including the steps of, in the computer system, performing text recognition on the handwritten user input, thereby to generate computer text.

3. A method according to claim 2, further including the step of, in the computer system, recognising whether the movement data is indicative of an text editing command drawn onto the surface by the user.

4. A method according to claim 3, wherein, in the event that an editing command is recognised, operating the computer system in accordance with instructions associated with the editing command.

5. A method according to claim 1, including the step of sending, in the computer system, data to the computer software indicative of at least the text field.

6. A method according to claim 1, wherein the text field is associated with a visible text zone defined on the interface surface.

7. A method according to claim 6, wherein the editing command is selected from the following group:

strikeout;

underlining;

cutting;

pasting; and

relocation.

8. A method according to claim 7, wherein the editing command is applied to computer text associated with the text field.

9. A method according to claim 7, wherein the editing command is applied to one or more letters, words or paragraphs.

10. A method according to any one of claims 1 to 9, wherein the sensing device includes at least one acceleration measuring device for measuring acceleration of the sensing device as it is used to write the handwritten user input onto the surface, the movement data being generated by periodically sampling the acceleration of the sensing device as it is used to write the handwritten user input onto the surface.

11. A method according to claim 10, further including the step of generating movement data in the form of a locus of the sensing device in relation to the surface, the locus being determined by ascertaining relative displacement of the sensing device.

12. A method according to claim 11, wherein the relative displacement is obtained by doubly integrating the acceleration with respect to time.

13. A method according to claim 11 or 12, wherein the acceleration measuring device includes one or more accelerometers configured to measure at least two orthogonal components of acceleration.

14. A method according to any one of claims 1 to 9, wherein position elements are disposed on the interface surface, the sensing device being configured to periodically sense position elements as it is used to write the handwritten user input onto the surface, the method including the step of generating the movement data in the form of a locus of the sensing device in relation to the surface by ascertaining relative displacement of the sensing device over time with respect to at least one of the position elements.

15. A method according to claim 14, wherein the position elements are disposed on the surface as a regular array of dots, lines or other formations.

16. A method according to claim 14, wherein the position elements are disposed on the surface stochastically.

17. A method according to any one of claims 1 to 10, wherein the coded data includes at least one tag, each tag being indicative of the signature field.

18. A method according to claim 17, wherein the tags are also indicative of points within the signature field.

19. A method according to claim 18, wherein each of the tags includes:

first identity data defining a relative position of that tag; and

second identity data identifying the signature field.

20. A method according to claim 19, wherein the relative position is defined in relation to the signature field.

21. A method according to claim 19, wherein the relative position is defined in relation to a plurality of the other tags.

22. A system according to claim 21, wherein components of rotation of the rollerball, due to movement of the sensing device when writing the handwritten user input onto the surface, are periodically measured.

23. A method according to claim 19, wherein the relative position is defined in relation to the interface surface.

24. A method according to claim 19, wherein the first identity data identifies stored information defining the relative position, the stored information not being stored on the interface surface.

25. A method according to claim 24, wherein the first identity data and the second identity data together identify stored information defining the relative position.

26. A system according to any one of claims 19 to 21, wherein the coded data includes at least one tag, each tag being indicative of the signature field.

27. A system according to claim 26, wherein the tags are also indicative of points within the signature field.

28. A system according to claim 27, wherein each of the tags includes:

first identity data defining a relative position of that tag; and

second identity data identifying the signature field.

29. A system according to claim 28, wherein the relative position is defined in relation to the signature field.

30. A system according to claim 28, wherein the relative position is defined in relation to a plurality of the other tags.

31. A system according to claim 28, wherein the relative position is defined in relation to the interface surface.

32. A system according to claim 28, wherein the first identity data identifies stored information defining the relative position, the stored information not being stored on the interface surface.

33. A system according to claim 32, wherein the first identity data and the second identity data together identify stored information defining the relative position.

34. A method according to any one of claims 1 to 9, wherein the movement data is generated by ascertaining relative movement of one or more motion sensing elements rotatably mounted to the sensing device for contact with the surface while the sensing device is used to write the handwritten user input thereon.

35. A method according to claim 34, wherein the motion sensing elements include one or more rollerballs mounted for rotation within a constraining housing disposed substantially within the sensing device.

36. A method according to claim 35, wherein components of rotation of the rollerball, due to movement of the sensing device when writing the handwritten user input onto the surface, are periodically measured.

37. A method according to claim 36, wherein the components of rotation of the rollerball due to movement of the sensing device by the user when writing the handwritten user input onto the surface are measured by means of:

rollers disposed within the constraining housing for rotation, the rollers being configured to be driven by contact with the rotating rollerball;

or

optical sensing of rotation of the rollerball with respect to the constraining housing.

38. A system for enabling user interaction with computer software running in a computer system via:

an interface surface containing information relating to the computer software and having coded data indicative of a text field disposed thereon; and

a sensing device which, when placed in an operative position relative to the interface surface, senses indicating data indicative of the text field and generates movement data indicative of the sensing device'"'"'s movement relative to the interface surface;

the computer system being configured to;

(a) receive the indicating data from the sensing device;

(b) receive the movement data from the sensing device;

(c) identify the text field from the indicating data; and

(d) operate the computer software at least partly in reliance on the movement data, and in accordance with instructions associated with the text field.

39. A system according to claim 38, wherein the computer system is configured to perform text recognition on the handwritten user input, thereby to generate computer text.

40. A system according to claim 39, further including the step of, in the computer system, recognising whether the movement data is indicative of an editing command drawn onto the surface by the user.

41. A system according to claim 40, wherein, in the event that an editing command is recognised, operating the computer software in accordance with instructions associated with the editing command.

42. A system according to claim 40, wherein the editing command is selected from the following group in relation to text:

strikeout;

underlining;

cutting;

pasting; and

relocation.

43. A system according to claim 42, wherein the editing command is applied after the conversion into computer text.

44. A system according to claim 42, wherein the motion sensing elements include one or more rollerballs mounted for rotation within a constraining housing disposed substantially within the sensing device.

45. A system according to claim 39, wherein the position elements are disposed on the surface as a regular array of dots, lines or other formations.

46. A system according to claim 39, wherein the position elements are disposed on the surface stochastically.

47. A system according to claim 38, wherein the computer system is configured to send data to the computer software indicative of at least the text field.

48. A system according to any one of claims 38 to 43, wherein the text field is associated with a visible text zone defined on the interface surface.

49. A system according to claim 48, wherein the components of rotation of the rollerball due to movement of the sensing device by the user when writing the handwritten user input onto the surface are measured by means of:

rollers disposed within the constraining housing for rotation, the rollers being configured to be driven by contact with the rotating rollerball;

or

optical sensing of rotation of the rollerball with respect to the constraining housing.

50. A system according to any one of claims 38 to 43, wherein the sensing device includes at least one acceleration measuring device for measuring acceleration of the sensing device as it is used to write the handwritten user input onto the surface, the movement data being generated by periodically sampling the acceleration of the sensing device as it is used to write the handwritten user input onto the surface.

51. A system according to claim 50, the system being configured to generate movement data in the form of a locus of the sensing device in relation to the surface, the locus being determined by ascertaining relative displacement of the sensing device.

52. A system according to claim 51, wherein the relative displacement is obtained by doubly integrating the acceleration with respect to time.

53. A system according to claim 51 or 52, wherein the acceleration measuring device includes one or more accelerometers configured to measure at least two orthogonal components of acceleration.

54. A system according to any one of claims 38 to 43, wherein position elements are disposed on the interface surface, the sensing device being configured to periodically sense position elements as it is used to write the handwritten user input onto the surface, the system being configured to generate the movement data in the form of a locus of the sensing device in relation to the surface by ascertaining relative displacement of the sensing device over time with respect to at least one of the position elements.

55. A system according to any one of claims 38 to 43, wherein the movement data is generated by ascertaining relative movement of one or more motion sensing elements rotatably mounted to the sensing device for contact with the surface while the sensing device is used to write the handwritten user input thereon.

56. A system according to any one of claims 38 to 43, wherein the computer system is configured to send data to the computer software indicative of at least the text field.

57. A system according to any one of claims 38 to 43, wherein the text field is associated with a visible text zone defined on the interface surface.

58. A system according to any one of claims 38 to 43, wherein the sensing device includes at least one acceleration measuring device for measuring acceleration of the sensing device as it is used to write the handwritten user input onto the surface, the movement data being generated by periodically sampling the acceleration of the sensing device as it is used to write the handwritten user input onto the surface.

59. A system according to claim 58, the system being configured to generate movement data in the form of a locus of the sensing device in relation to the surface, the locus being determined by ascertaining relative displacement of the sensing device.

60. A system according to claim 59, wherein the relative displacement is obtained by doubly integrating the acceleration with respect to time.

61. A system according to claim 59 or 60, wherein the acceleration measuring device includes one or more accelerometers configured to measure at least two orthogonal components of acceleration.

62. A system according to any one of claims 38 to 43, wherein position elements are disposed on the interface surface, the sensing device being configured to periodically sense position elements as it is used to write the handwritten user input onto the surface, the system being configured to generate the movement data in the form of a locus of the sensing device in relation to the surface by ascertaining relative displacement of the sensing device over time with respect to at least one of the position elements.

63. A system according to claim 62, wherein the position elements are disposed on the surface as a regular array of dots, lines or other formations.

64. A system according to any one of claims 38 to 43, wherein the movement data is generated by ascertaining relative movement of one or more motion sensing elements rotatably mounted to the sensing device for contact with the surface while the sensing device is used to write the handwritten user input thereon.

65. A system according to any one of claims 38 to 43, wherein the coded data includes at least one tag, each tag being indicative of the signature field.

66. A system according to claim 65, wherein the tags are also indicative of points within the signature field.

67. A system according to claim 66, wherein each of the tags includes:

first identity data defining a relative position of that tag; and

second identity data identifying signature field.

68. A system according to claim 67, wherein the relative position is defined in relation to the signature field.

69. A system according to claim 67, wherein the relative position is defined in relation to a plurality of the other tags.

70. A system according to claim 67, wherein the relative position is defined in relation to the interface surface.

71. A system for enabling user interaction with computer software running in a computer system, the system including:

an interface surface containing information relating to the computer software and having coded data disposed thereon, the coded data being indicative of a text field relating to the computer software;

the system being configured to, in the computer system;

(a) receive indicating data from a sensing device, the indicating data being indicative of the text field, wherein the sensing device, when placed in an operative position relative to the interface surface, senses the indicating data and generates movement data indicative of the sensing device'"'"'s movement relative to the interface surface;

(b) receive the movement data from the sensing device;

(c) identify the text field on the basis of the indicating data; and

(d) operate the computer software at least partly in reliance on the movement data, and in accordance with instructions associated with the text field.

72. A system according to claim 71, the computer system being configured to perform text recognition on the handwritten user input, thereby to generate computer text.

73. A system according to claim 71, the computer system being configured to send data to the computer software indicative of at least the text field.

74. A system according to claim 71, the computer system being configured to recognise whether the movement data is indicative of an text editing command drawn onto the surface by the user.

75. A system according to claim 74, wherein, in the event that an editing command is recognised, operating the computer system in accordance with instructions associated with the editing command.

76. A method according to claim 74, wherein the editing command is selected from the following group:

strikeout;

underlining;

cutting;

pasting; and

relocation.

77. A method according to claim 76, wherein the editing command is applied to computer text associated with the text field.

78. A method according to claim 77, wherein the editing command is applied to one or more letters, words or paragraphs.

79. A method to enable a user to interact with computer software running in a computer system utilizing a form printed onto a surface, the form including information relating to the computer software, the surface having coded data disposed thereon, the coded data being indicative of a text field relating to the computer software, the method including the steps of:

providing the form to the user;

receiving, in the computer system, indicating data and movement data from a sensing device, the indicating data indicative of the text field, the movement data indicative of movement of the sensing device relative to the form, the sensing device, when placed operatively relative to the text field, generating the indicating data based at least partially on sensing at least some of the coded data and substantially simultaneously generating the movement data; and

identifying, in the computer system and from the indicating data, the text field, and

operating the computer software at least partially in reliance on the movement data and on instructions associated with the text field.

80. The method of claim 79, which includes printing the form in response to receiving, in the computer system, a request for the form.

81. The method of claim 79, which inlcudes causing the form and the coded data to be printed onto the surface substantially simultaneously.

82. The method of claim 79, including the step of performing text recognition on the movement data to generate computer text.

83. The method of claim 79 further including the step of, in the computer system, recognizing whether the movement data is indicative of a text editing command drawn on the surface by the user.

84. The method of claim 83 wherein, in the event that the editing command is recognized, operating the computer system in accordance with instructions associated with the editing command.

85. The method of claim 84 wherein the editing command is applied to computer text associated with the text field.

86. The method of claim 84 wherein the editing command is applied to one or more letters, words or paragraphs.

87. The method of claim 83 wherein the editing command is selected from one of the following group:

strickout, underlining, cutting, pasting; and

relocation.

88. The method of claim 79, inlcuding the step of identifying the user.

89. The method of claim 88, wherein the step of identifying the user includes using the movement data.

90. The method of claim 88, further including the step of receiving, in the computer system, data indicative of an identity of the user.

91. The method of claim 79, further including the step of receiving, in the computer system, data from storage of the sensing device, the data being indicative of an identity of the user.

92. The method of claim 79, including the step of sending, in the computer system, data to the computer software indicative of at least the text field.

93. The method of claim 79, wherein the text field is associated with a visible text zone defined on the surface.

94. The method of claim 79, wherein the sensing device includes at least one acceleration measuring device for measuring acceleration of the sensing device as it is used on the surface, the movement data being generated by periodically sampling the acceleration of the sensing device as it is used on the surface.

95. The method of claim 94, wherein the acceleration measuring device includes one or more accelerometers configured to meansure at least two orthogonal components of acceleration.

96. The method of claim 79, further including the step of generating movement data in the form of a locus of the sensing device in relation to the surface, the locus being determined by ascertaining relative displacement of the sensing device.

97. The method of claim 96, wherein the relative displacement is obtained by doubly integrating the acceleration with respect to time.

98. The method of claim 79, wherein elements are disposed on the surface, the sensing device being configured to periodically sense the elements as it is used on the surface, the method including the step of generating the movement data by ascertaining relative displacement of the sensing means over time with respect to at least one of the elements.

99. The method of claim 98, wherrein the element are disposed on the surface as a regular array of dots, lines or other formations.

100. The method of claim 98, wherein the elements are disposed on the surface stochastically.

101. The method according to claim 98, wherein the coded data includes the elements.

102. The method of claim 79, wherein the movemenbt data is generated by ascertaining relative ration of one or more motion sensing elements rotatably mounted to the sensing device for contact with the surface while the sensing device is used thereon.

103. The method of claim 102 wherein the motion sensing elements include one or more rollerballs mounted for rotation within a constraining housing disposed substantially within the sensing device.

104. The method of claim 103, wherein components of rotation of the rollerball, due to movement of the sensing device on the surface, are periodically measured.

105. The method of claim 104, wherein the components of rotation of the rollerball due to movement of the sensing device on the surface are measured by means of:

rollers disposed within the constraining housing for rotation, the rollers being configured to be driven by contact with the rotating rollerball;

or

optical sensing of rotation of the rollerball with respect to the constraining housing.

106. The method of claim 79, wherein the coded data is indicative of a plurality of positions, in or associated with the text field.

107. The method of claim 79, wherein the coded data includes a plurality of tags, each of which includes tag data.

108. The method of claim 107, including deriving the relative position of at least one tag using at least some of the at least one tag'"'"'s tag data.

109. The method of claim 108, wherein the relative position is defined in relation to one of the group comprising:

a plurality of other tags, the surface, the text field, and a zone associated with the text field.

110. The method of claim 107, including deriving an identity of the text field using at least some of the tag data of at least one tag.

111. The method of claim 110, wherein the data from which the identity of the text field is derived is the same in all tags of the same text field.

112. A system for enabling a user to interact with computer softrware running in a computer system utilizing a form printed onto a surface, the form including information relating to the computer software, the surface having coded data disposed thereon, the coded data being indicative of a text field ralating to the computer software, the system including:

a computer system which;

receives indicating data and movement data from a sensing device, the indicating data indicative of a text field relating to the computer software and the movement data indicative of movement of the sensing device relative to the form, the sensing device, when placed operatively relative to the text field, generating the indicating data based at least partially on sensing at least some of the coded data and substantially simultaneously generating the movement data;

identifies, from the indicating data, the text field, and

operates the computer software at least partially based on reliance on the movement data and instructions associated with the text field.

113. The system of claim 112 including a printer for printing the form in response to receiving, in the computer system, a request for the form.

114. The system of claim 112 including a printer for printing the form, and in which the printer prints the coded data at substantialy the same time as the form.

115. The system of claim 112 including the step of performing text recognition on the movement data to generate computer text.

116. The system of claim 112 further including the step of, in the computer system, recognizing whether the movement data is indicative of a text editing command drawn on the surface by the user.

117. The system of claim 116 wherein, in the event that the editing command is recognized, operating the computer system in accordance with instructions associated with the editing command.

118. The system of claim 116 wherein the editing command is selected from one of the following group:

strikeout, underlining, cutting, pasting; and

relocation.

119. The system of claim 116 wherein the editing command is applied to computer text associated with the text field.

120. The system of claim 116 wherein the editing command is applied to one or more letters, words or paragraphs.

121. The system of claim 112, wherein the computer system is configured to identify the user.

122. The system of claim 121, wherein the computer system is configured to identify the user by using the movement data.

123. The system of claim 121, wherein the computer system is configured to receive data indicative of an identity of the user.

124. The system of claim 112, wherein the computer system is configured to receive identity data from storage of the sensing device, the identity data being indicative of an identity of the user.

125. The system of claim 112, wherein the computer system is configured to send data to the computer software indicative of at least the text field.

126. The system of claim 112, wherein the text field is associated with a visible text zone defined on the surface.

127. The system of claim 112 which includes the sensing device.

128. The system of claim 127 wherein the sensing device includes at least one acceleration measuring device for measuring acceleration of the sensing device as it is used on the surface, the movement data being generated by periodically sampling the acceleration of the sensing device as it is used on the surface.

129. The system of claim 128, wherein the acceleration measuring device includes one or more accelerometers configured to measure at least two orthogonal components of acceleration.

130. The system of claim 128 when dependent on claim 127 wherein the sensing device includes a marking nib.

131. The system of claim 128 when dependent on claim 127 wherein the sensing device contains identity information which imparts a unique identity to the sensing device.

132. The system of claim 131 when dependent on claim 124, wherein the identity data includes the identity of the sensing device.

133. The system of claim 127, wherein the sensing device generates movement data in the form of a lucus of the sensing means in relation to the surface, the locus being determined by ascertaining relative displacement of the sensing device.

134. The system of claim 133, wherein the relative displacement is obtained by doubly integrating acceleration with respect to time.

135. The system of claim 127, wherein elements are disposed on the surface, the sensing device being configured to periodically sense the elements as it is used on the surface, the movement data being generated by ascertaining relative displacement of the sensing means over time with respect to at least one of the elements.

136. The system of claim 135, wherein the coded data is indicative of a plurality of positions in or associated with the text field.

137. The system of claim 136, where the computer system is configured to derive an identity of the text field using at least some of the tag data of at least one tag.

138. The system of claim 137, wherein the data from which the identity of the text field is derived is the same in all the tags of the same text field.

139. The system of claim 135, wherein the coded data includes a plurality of tags, each of which includes tag data.

140. The system of claim 139, wherein the computer system is configured to derive the relative position of at least one tag using at least some of the tag data of the at least one tag.

141. The system of claim 140, wherein the relative position is defined in relation to one of the following group:

a plurality of other tags, the surface, the text field, and a zone associated with the text field.

142. The system of claim 135, wherein the elements are disposed on the surface as a regular array of dots, lines or other formations.

143. The system of claim 135, wherein the elements are disposed on the surface stochastically.

144. The system of claim 135 wherein the coded data includes the elements.

145. The system of claim 127, wherein the movement data is generated by ascertaining relative movement of one or more motion sensing elements rotatably mounted to the sensing device for contact with the surface while the sensing device is used thereon.

146. The system of claim 145, wherein the motion sensing elements include one or more rollerballs mounted for rotation within a constraining housing disposed substantially within the sensing device.

147. The system of claim 146, wherein components of rotation of the rollerball, due to movement of the sensing device when used on the surface, are periodically measured.

148. The system of claim 147, wherein the components of rotation of the rollerball due to movement of the sensing device by the user when used on the surface are measured by means of:

rollers disposed within the constraining housing for rotation, the rollers being configured to be driven by contact with the rotating rollerball;

or

optical sensing of rotation of the rollerball with respect to the constraining housing.