Method and system for collaborative document markup using coded marks

• US 7,415,668 B2
• Filed: 11/12/2002
• Issued: 08/19/2008
• Est. Priority Date: 06/30/1999
• Status: Expired due to Fees

• Current Assignee: Silverbrook Research Pty Limited
• Original Assignee: Silverbrook Research Pty Limited
• Inventors: Silverbrook, Kia, Lapstun, Paul, Lapstun, Jacqueline Anne
• Primary Examiner(s): RIES, LAURIE ANNE
• Application Number:
  US10/291,542
• Publication Number:
  US 20030093757A1
• Time in Patent Office: 2,107 Days
• Field of Search: 715/517, 715/530, 715/268, 715/230, 382/187
• US Class Current: 715/268
• CPC Class Codes: B41J 13/103 for the sheet feeding section
• CPC Class Codes: B41J 13/106 for the sheet output section
• CPC Class Codes: B41J 2/17503 Ink cartridges
• CPC Class Codes: B41J 2/17513 Inner structure
• CPC Class Codes: B41J 2/17523 Ink connection
• CPC Class Codes: B41J 2/17546 electronically
• CPC Class Codes: B41J 2/17553 Outer structure
• CPC Class Codes: B41J 2/17556 Means for regulating the pressure in the cartridge
• CPC Class Codes: B41J 2/17563 Ink filters
• CPC Class Codes: B41J 2/2114 Ejecting transparent or white coloured liquids, e.g. processing liquids B41J2/211 takes precedence
• CPC Class Codes: B42C 19/02 starting with single sheets
• CPC Class Codes: B42C 9/0006 by applying adhesive to a stack of sheets
• CPC Class Codes: B42C 9/0081 applying adhesive to individual sheets for binding them together by fusing, welding B42C9/0093
• CPC Class Codes: B42P 2261/04 Producing books by printing sheets in following order, e.g. for ordering via the Internet
• CPC Class Codes: B65H 29/34 from supports slid from under the articles
• CPC Class Codes: B65H 37/04 for securing together articles or webs, e.g. by adhesive, stitching or stapling adhering replacement to expiring web during change of web roll B65H19/18
• CPC Class Codes: G06F 2203/0337 Status LEDs integrated in the mouse to provide visual feedback to the user about the status of the input device, the PC, or the user
• CPC Class Codes: G06F 3/03545 Pens or stylus
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/1204 resulting in reduced user or operator actions, e.g. presetting, automatic actions, using hardware token storing data
• CPC Class Codes: G06F 3/1243 : Variable data printing, e.g. document forms, templates, labels, coupons, advertisements, logos, watermarks, transactional printing, fixed content versioning
• CPC Class Codes: G06F 3/1284 : Local printer device
• CPC Class Codes: G06F 40/117 : Tagging; Marking up details of markup languages G06F40/143; Designating a block; Setting of attributes style sheets, e.g. eXtensible Stylesheet Language Transformation [XSLT], G06F40/154
• CPC Class Codes: G06F 40/171 : by use of digital ink
• CPC Class Codes: G06K 17/00 : Methods or arrangements for effecting co-operative working between equipments covered by two or more of main groups G06K1/00 - G06K15/00, e.g. automatic card files incorporating conveying and reading operations
• CPC Class Codes: G06V 30/1423 : the instrument generating sequences of position coordinates corresponding to handwriting preprocessing or recognising digital ink G06V30/32
• CPC Class Codes: H04L 12/1827 : Network arrangements for conference optimisation or adaptation
• CPC Class Codes: H04N 1/00127 : Connection or combination of a still picture apparatus with another apparatus, e.g. for storage, processing or transmission of still picture signals or of information associated with a still picture
• CPC Class Codes: H04N 1/00204 : with a digital computer or a digital computer system, e.g. an internet server programmed control between transmitter and receiver or between image input and image output device H04N1/32561
• CPC Class Codes: H04N 1/00244 : with a server, e.g. an internet server fax-servers or the like for store and forward H04N1/324
• CPC Class Codes: H04N 1/00326 : with a data reading, recognizing or recording apparatus, e.g. with a bar-code apparatus arrangements for the associated working of recording or reproducing apparatus with related apparatus G11B31/00
• CPC Class Codes: H04N 1/00358 : Type of the scanned marks
• CPC Class Codes: H04N 1/00376 : Means for identifying a mark sheet or area
• CPC Class Codes: H04N 1/00567 : Handling of original or reproduction media, e.g. cutting, separating, stacking
• CPC Class Codes: H04N 1/00968 : by scanning marks on a sheet mark-sheet input means H04N1/00355; sensing record carriers G06K7/00
• CPC Class Codes: H04N 1/32101 : Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title
• CPC Class Codes: H04N 1/32122 : in a separate device, e.g. in a memory or on a display separate from image data
• CPC Class Codes: H04N 1/32128 : attached to the image data, e.g. file header, transmitted message header, information on the same page or in the same computer file as the image for information embedded in the image H04N1/32144
• CPC Class Codes: H04N 1/32771 : in response to a request, e.g. for a particular document
• CPC Class Codes: H04N 1/32778 : using a mark-sheet or machine-readable code request
• CPC Class Codes: H04N 2201/0082 : Image hardcopy reproducer H04N2201/0091 - H04N2201/0094 take precedence
• CPC Class Codes: H04N 2201/3205 : of identification information, e.g. name or ID code H04N2201/3209 takes precedence
• CPC Class Codes: H04N 2201/3207 : of an address
• CPC Class Codes: H04N 2201/3226 : of identification information or the like, e.g. ID code, index, title, part of an image, reduced-size image
• CPC Class Codes: H04N 2201/3242 : of processing required or performed, e.g. for reproduction or before recording H04N2201/3256 and subgroups take precedence
• CPC Class Codes: H04N 2201/3243 : of type information, e.g. handwritten or text document
• CPC Class Codes: H04N 2201/3247 : Data linking a set of images to one another, e.g. sequence, burst or continuous capture mode
• CPC Class Codes: H04N 2201/3249 : data relating to a linked page or object, e.g. hyperlink
• CPC Class Codes: H04N 2201/3269 : of machine readable codes or marks, e.g. bar codes or glyphs
• CPC Class Codes: H04N 2201/327 : which are undetectable to the naked eye, e.g. embedded codes
• CPC Class Codes: H04N 2201/3271 : Printing or stamping
• CPC Class Codes: H04N 2201/3278 : Transmission

Abstract

The invention concerns a method and system for enabling collaborative document markup. Employing the invention involves the use of one or more forms which support interaction with a computer system or network. Each form is printed on sheet material such as paper and includes coded data which allows it to be used to interact with the computer system via a sensing device operated by a user.

Specifically, the method includes the steps of providing a participant with at least one document markup form containing information relating to a collaborative document markup session and including coded data indicative of an identity of the document markup form and of at least one reference point of the document markup form, receiving, in a computer system, indicating data from a sensing device operated by said participant involved in the document markup session, said indicating data regarding the identity of the document markup form and a position of the sensing device relative to the document markup form, the sensing device, when placed in an operative position relative to the document markup form, sensing the indicating data using at least some of the coded data, identifying in the computer system and from the indicating data, at least one parameter relating to the document markup session, and providing at least one other participant remote from said participant with at least one document markup form containing information representative of the at least one parameter.

The invention can be employed by geographically distributed participants to mark up a shared document using interactive surface media, while engaged in a telephone conference or similar. Every time a participant adds a markup to the document the other participants can be provided with a printed copy of the updated page.

Claims

1. A method enabling a plurality of participants to collaboratively markup a form, the method comprising the steps of:

providing each of the participants with a document markup form showing the form, each of the document markup forms having coded data indicative of an identity of the document markup form and at least one reference point on the document markup form;

providing each of the participants with a sensing device for transmitting indicating data to a computer system, the indicating data being generated by the sensing device to identify the document markup form and a least one of the position and the movement of the sensing device relative to the document markup form such that the computer system captures markups that any of the participants make to the document markup form;

wherein,

the computer system is configured to create a description of a further document markup form having coded data indicative of the identity of the further document markup form and at least one reference point on the further document markup form, and visual content of the document markup form, the visual content having at least some of the markups, the description created by the computer system defining a relationship between the visual content and the coded data using the at least one reference point, the computer system further configured to provide any of the participants with the further document markup form upon request, the further document markup form showing at least some of the markups, the further document markup form also having coded data indicative of an identity of the further document markup form and at least one reference point on the further document markup form such that further markups on the further document markup form are also captured in the computer system using the indicating data and the relationship between the visual content and the associated coded data.

2. A method according to claim 1, wherein the coded data comprises a plurality of substantially undifferentiated marks positioned relative to a set of predetermined nominal mark positions, each mark representing one of a plurality of coded values.

3. A method according to claim 2, wherein the coded value represented by a mark is at least partially determined by the position of the mark relative to the set of predetermined nominal mark positions.

4. A method according to claim 1, wherein the predetermined nominal mark positions are arranged relative to a plurality of nominal lines.

5. A method according to claim 4, wherein at least one pair of the lines are spaced apart from one another by a distance of less than 100 millimeters.

6. A method according to claim 1, wherein the marks have centers and wherein the relative spacing of the centers of at least one pair of adjacent marks is less than 12 millimeters.

7. A method according to claim 1, wherein each mark has a minimum radius and a maximum radius and wherein the length of a mark'"'"'s minimum radius is greater than 40% of the length of that mark'"'"'s maximum radius.

8. A method according to claim 1, wherein any 10 millimeter diameter area of the coded data indicative of the identity of the document markup form includes sufficient information to identify the document markup form.

9. A method according to claim 1, wherein any 10 millimeter diameter area of the coded data indicative of the at least one reference point of the document markup form includes sufficient information to identify the at least one reference point.

10. A method according to claim 1, wherein the document markup form has at least one zone encompassing some of the coded data such that one of the participants can transmit an instruction to the computer system by positioning or moving the sensing device in a predetermined manner relative to the at least one zone.

11. A method according to claim 10, in which the instruction is selected from the group comprising:

send an invitation to a document markup session;

start a document markup session;

end a document markup session;

send a message to a participant during a document markup session;

request to view messages sent during a document markup session;

request to view the page history of a document markup session;

order the printing of a document markup page;

update a document markup page; and

order the reprinting of a new document markup page.

12. A method according to claim 10, wherein the instruction is informing the computer system that a user has selected an option parameter applicable to collaboratively marking up the document markup form.

13. A method according to claim 12, in which the option parameter is associated with at least one of:

an access level;

a message recipient; and

a line color.

14. A method according to claim 10, in which the instruction is a text parameter that informs the computer system, that the participant has entered handwritten text data by means of the sensing device.

15. A method according to claim 14, which includes converting, in the computer system, the handwritten text data to computer text.

16. A method according to claim 15, which includes converting, in the computer system, the handwritten text data to computer text using an online handwriting recognition program.

17. A method according to claim 14, in which the text parameter is associated with at least one of:

a document markup session description;

a document markup session purpose;

a document markup session start date;

a start time;

an end time;

an attachment document identification;

a participant identification;

a message subject description; and

a message text.

18. A method according to claim 10, in which the instruction is an authorization parameter informing the computer system that the participant has entered a handwritten signature by means of the sensing device.

19. A method according to claim 18, which includes verifying, in the computer system, that the signature is that of the participant.

20. A method according to claim 19, in which the authorization parameter is associated with updating a document markup page.

21. A method according to claim 10, in which the instruction is a graphical parameter informing the computer system that the participant has entered hand-drawn graphical information by means of the sensing device.

22. A method according to claim 21, in which the graphical parameter is associated with a markup to a document markup page.

23. A method according to claim 1,in which the document markup form contains information relating to at least one of:

booking a document markup session;

controlling a document markup session;

selecting invitees to a document markup session;

inviting participants to a document markup session;

composing messages in a document markup session;

sending messages in a document markup session;

viewing messages in a document markup session;

selecting a line color in a document markup session;

viewing the history of a document markup session;

printing document markup pages;

updating document markup pages;

reprinting document markup pages; and

ending a document markup session.

24. A method according to claim 1, in which the participants are provided with a telephonic communicator for use while marking up the document mark up form.

25. A method according to claim 24, in which the telephonic communicator includes a video communication link between the participants.

26. A method according to claim 24, wherein the telephonic communicator is controlled by said computer system.

27. A system enabling at least two participants to collaboratively mark up a form, the system comprising;

a plurality of document markup forms, each showing the form to be marked up, and having coded data indicative of the identity of the document markup form and at least one reference point on the document markup form;

plurality of sensing devices, each sensing device configured for generating indicating data from the coded data when placed in an operative position relative to the document markup form; and

,

a computer system for receiving the indicating data transmitted from the sensing devices, the computer system using the indicating data to identify the document markup form to which the sensing device has been placed in an operative position and record at least one of the position and movement of the sensing device relative to the document markup form to capture markups that any of the participants make to the document markup form;

wherein,

the computer system is configured to create a description of a further document markup form having coded data indicative of the identity of the further document markup form and at least one reference point on the further document markup form, and visual content of the document markup form, the visual content having at least some of the markups, the description created by the computer system defining a relationship between the visual content and the coded data using the at least one reference point, the computer system further configured to provide any of the participants with the further document markup form upon request, the further document markup form showing at least some of the markups, the further document markup form also having coded data indicative of an identity of the further document markup form and at least one reference point on the further document markup form such that further markups on the further document markup form are also captured in the computer system using the indicating data and the relationship between the visual content and the associated coded data.

28. A system according to claim 27, wherein the document markup form has at least one zone encompassing some of the coded data such that one of the participants can transmit an instruction to the computer system by positioning or moving the sensing device in a predetermined manner relative to the at least one zone.

29. A system according to claim 28, wherein the instruction is selected from the group comprising:

send an invitation to a document markup session;

start a document markup session;

end a document markup session;

send a message to a participant during a document markup session;

request to view messages sent during a document markup session;

request to view the page history of a document markup session;

order the printing of a document markup page;

update a document markup page; and

order the reprinting of a document markup page.

30. A system according to claim 28, wherein the instruction is informing the computer system that a user has selected an option parameter applicable to collaboratively marking up the document markup form, the option parameter being at least one of:

an access level;

a message recipient; and

a line color.

31. A system according to claim 28, wherein the instruction is a text parameter that informs the computer system, that the participant has entered handwritten text data by means of the sensing device, the text parameter being associated with at least one of:

a document markup session description;

a document markup session purpose;

a document markup start date;

a start time;

an end time;

an attachment document identification;

a participant identification;

a document markup session purpose;

a message subject description; and

a message text.

32. A system according to 28, wherein the instruction is an authorization parameter informing the computer system that the participant has entered a handwritten signature by means of the sensing device.

33. A system according to claim 28, wherein the instruction is a graphical parameter informing the computer system that the participant has entered hand-drawn graphical information by means of the sensing device.

34. A system according to claim 27, wherein the coded data comprises a plurality of substantially undifferentiated marks positioned relative to a set of predetermined nominal mark positions, each mark represents one of a plurality of coded values.

35. A system according to claim 34, wherein the coded value represented by a mark is at least partially determined by the position of the mark relative to the set of predetermined nominal mark positions.

36. A system according to claim 35 wherein the predetermined nominal mark positions are arranged relative to a plurality of nominal lines.

37. A system according to claim 36 wherein at least one pair of the lines are spaced apart from one another by a distance of less than 100 millimeters.

38. A system according to claim 34 wherein the marks have centers and wherein the relative spacing of the centers of at least one pair of adjacent marks is less than 12 millimeters.

39. A system according to claim 34 wherein each mark has a minimum radius and a maximum radius and wherein the length of a mark'"'"'s minimum radius is greater than 40% of the length of that mark'"'"'s maximum radius.

40. A system according to claim 27 wherein any 10 millimeter diameter area of the coded data indicative of the identity of the document markup form includes sufficient information to identify the document markup form.

41. A system according to claim 27, wherein any 10 millimeter diameter area of the coded data indicative of the at least one reference point of the document markup form includes sufficient information to identify the at least one reference point.

42. A system according to claim 27, further comprising a telephone communicator for use by the participants while marking up the document markup form.

43. A system according to claim 42, further comprising a video communicator for use by the participants while marking up the document markup form.

44. A system according to claim 27, wherein the document markup form has at least one zone encompassing some of the coded data such that one of the participants can transmit an instruction to the computer system by positioning or moving the sensing device in a predetermined manner relative to the at least one zone