Electronically capturing information from a printed document

• US 7,760,386 B2
• Filed: 12/06/2007
• Issued: 07/20/2010
• Est. Priority Date: 09/17/1999
• Status: Expired due to Fees

• Current Assignee: Silverbrook Research Pty Limited
• Original Assignee: Silverbrook Research Pty Limited
• Inventors: Silverbrook, Kia, Lapstun, Paul
• Primary Examiner(s): Tran; Douglas Q
• Application Number:
  US11/951,874
• Publication Number:
  US 20080088874A1
• Time in Patent Office: 957 Days
• Field of Search: 358/1.15, 358/1.1, 358/1.14, 358/1.13, 358/1.18, 358/3.27, 358/3.28, 358/3.29, 358/3.31
• US Class Current: 358/1.15
• CPC Class Codes: G06F 2203/0337 Status LEDs integrated in the mouse to provide visual feedback to the user about the status of the input device, the PC, or the user
• CPC Class Codes: G06F 3/0321 by optically sensing the absolute position with respect to a regularly patterned surface forming a passive digitiser, e.g. pen optically detecting position indicative tags printed on a paper sheet constructional details of pen-shaped pointing devices G06F3/03545, G06F3/03542, G06F3/037
• CPC Class Codes: G06F 3/03545 Pens or stylus
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 40/171 by use of digital ink
• CPC Class Codes: G06F 40/174 Form filling; Merging
• CPC Class Codes: G06Q 10/10 Office automation; Time management
• CPC Class Codes: H04N 1/00127 Connection or combination of a still picture apparatus with another apparatus, e.g. for storage, processing or transmission of still picture signals or of information associated with a still picture

Abstract

A system for electronically capturing information from a printed document, comprising: an interface surface provided on said document for conveying visual information to said user, and coded data disposed thereon indicative of an identity of the document and of coordinates of a plurality of locations of the interface surface; a user input device movable in response to a desired action and having at least one sensor element for sensing at least some of the coded data and generating data in response to said movement; and a computer system arranged to receive said data from said user input device and to process said data in accordance with said user'"'"'s desired action, wherein in response to the user'"'"'s desired action, the computer system generates and transfer print data to a printer, wherein the printer prints a second document provided with a second interface surface.

Claims

1. A system for electronically capturing information from a printed document, comprising:

an interface surface provided on said document for conveying visual information to said user, said surface having coded data disposed thereon indicative of an identity of the document and of coordinates of a plurality of locations of the interface surface;

a user input device movable by said user relative to said interface surface in response to a desired action and having at least one sensor element provided thereon, said at least one sensor element sensing at least some of the coded data and generating data in response to said movement of the user input device; and

a computer system arranged to receive said data from said user input device and to process said data in accordance with said user'"'"'s desired action, wherein in response to the user'"'"'s desired action, the computer system generates and transfers print data to a printer, wherein the printer prints a second document provided with a second interface surface, wherein the printer prints visual information relating to the processed user'"'"'s action and second coded data on the second interface surface, the second coded data being indicative of an identity of the second document and of coordinates of a plurality of locations of the second interface surface.

2. A system of claim 1, wherein the document is a printed page and the information is provided in the form of text and/or graphics and or images printed on said interface surface of the printed page.

3. A system of claim 2, wherein the coded data is in the form of a plurality of small and densely arranged tags printed upon the interface surface of the page.

4. A system of claim 3, wherein each tag is arranged on the interface surface of the page in a manner which identifies the page and which identifies its own position on the page.

5. A system of claim 4, wherein each tag is printed in infrared absorptive ink.

6. A system of claim 1, wherein the user input device is a pen-like instrument which is arranged to be gripped by a hand of the user for movement across the interface surface.

7. A system of claim 6, wherein movement of said instrument across said interface surface enables reading of said information from the interface surface and/or depositing written information onto said interface surface in accordance with said desired action.

8. A system of claim 7, wherein the at least one sensor element is a force sensor which detects when a nib of the instrument is in contact with the interface surface, said contact being indicative of said desired action.

9. A system according to claim 8, wherein said instrument further comprises an image sensor which reads said coded data disposed upon said interface surface when said instrument is moved in contact across said surface.

10. A system according to claim 9, wherein said instrument further comprises a controller unit in communication with said image sensor which captures and decodes said coded data read by the image sensor.

11. A system according to claim 10, wherein coded data is decoded to generate data relating to the position and orientation of the instrument relative to the surface as the instrument is in motion.

12. A system according to claim 11, wherein said data relating to the position and orientation of the instrument relative to said surface is captured as a series of one or more strokes.

13. A system according to claim 12, wherein a stroke is a sequence of time-stamped positions of said instrument initiated by initial contact of said nib of the instrument with said interface surface and completed by removal of said contact between the nib of the instrument and the interface surface.

14. A system according to claim 12, wherein said data is encrypted by the controller unit for transmission to the computer system.

15. A system according to claim 5, wherein the printer is configured to print the coded data at the same time as the visual information of the second interface surface.

16. A system according to claim 14, wherein the computer system receives said encrypted data relating to the position and orientation of the instrument relative to the interface surface of the document together with data which identifies the document.

17. A system according to claim 16, wherein the computer system comprises a document server which stores data relating to a variety of documents, said data including the information conveyed on each document together with the location of said information relative to the interface surface.

18. A system according to claim 17, wherein upon receiving said encrypted data from said instrument, the computer system retrieves the document data from the document server and determines which element of the document the data relates to.

19. A system according to claim 18, wherein upon determining which element of the document the received data relates to, said computer system interprets said data in the context of the element to perform said desired action.

20. A system according to claim 1, wherein the data is indicative of a plurality of time stamped coordinates sensed as the user input device is moved relative to the interface surface.