Digital bookclip

• US 9,058,067 B2
• Filed: 03/31/2009
• Issued: 06/16/2015
• Est. Priority Date: 04/03/2008
• Status: Expired due to Fees

• Current Assignee: Livescribe Incorporated (Anoto Group AB)
• Original Assignee: Livescribe Incorporated (Anoto Group AB)
• Inventors: Van Schaack, Andy, Marggraff, Jim
• Primary Examiner(s): Wang-Hurst, Kathy
• Assistant Examiner(s): SOTO LOPEZ, JOSE R
• Application Number:
  US12/415,306
• Publication Number:
  US 20090267923A1
• Time in Patent Office: 2,268 Days
• Field of Search: 345/179, 345/156, 345/179.173, 382/229
• US Class Current: 1/1
• CPC Class Codes: G06F 3/0317 in co-operation with a patterned surface, e.g. absolute position or relative movement detection for an optical mouse or pen positioned with respect to a coded surface
• CPC Class Codes: G06F 3/0321 by optically sensing the absolute position with respect to a regularly patterned surface forming a passive digitiser, e.g. pen optically detecting position indicative tags printed on a paper sheet constructional details of pen-shaped pointing devices G06F3/03545, G06F3/03542, G06F3/037
• CPC Class Codes: G06F 3/03545 Pens or stylus
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text

Abstract

The described embodiments present a system and method for obtaining a portion of a digital document from a printed version of the document. Locations where a smart pen device interacts with a digital bookclip aligned relative the printed document are identified via coordinate sets. A digital document associated with the printed document and the coordinate sets from the smart pen device and digital bookclip are used to identify locations in the digital documents corresponding to locations in the printed document. Data from the identified locations in the digital documents is retrieved and presented to a user and can then be copied, saved, mailed electronically, and/or printed to a new paper document.

Claims

1. A pen-based computing system for digitally capturing content from a printed document comprising one or more pages of printed data, the printed document associated with a document identifier, the system comprising:

a digital bookclip comprising a physical material encoded with a pattern, the physical material distinct from the printed document;

a smart pen device comprising;

an imaging system configured to capture an interaction of the smart pen device with the digital bookclip by reading the encoded pattern of the digital bookclip, the smart pen device capturing a beginning location on the digital bookclip corresponding to a beginning of the interaction and an end location on the digital bookclip corresponding to an end of the interaction;

a database storing a digital representation of the printed document; and

a memory storing computer program code configured to be executed by a processor coupled to the smart pen device, the computer program code including instructions for;

accessing the digital representation of the printed document from the database using the document identifier,

determining a vertical or horizontal orientation of the digital bookclip with respect to the printed document;

receiving the captured beginning and end locations corresponding to the interaction of the smart pen with the digital bookclip;

identifying a selected first portion of the digital representation of the printed document based on the determined orientation of the digital bookclip with respect to the printed document and the beginning location and the end location of the digital bookclip captured when the digital bookclip is aligned with the printed document; and

retrieving the portion of the digital representation of the printed document.

2. The pen-based computing system of claim 1, wherein retrieving the portion of the digital representation of the printed document corresponding to the selection by the smart pen device comprises:

transmitting the portion of the digital representation to a device, printing the portion of the digital representation, or emailing the portion of the digital representation to an email address.

3. The pen-based computing system of claim 1, wherein the digital bookclip further comprises a control region, wherein the smart pen communicates its location on the digital bookclip to the processor responsive to the smart pen device interacting with the control region.

4. The pen-based computing system of claim 1, wherein the digital bookclip further comprises a numeric keypad, wherein the document identifier is identified responsive to an interaction of the smart pen with the numeric keypad.

5. The pen-based computing system of claim 1, wherein the digital bookclip is aligned to a page of the printed document.

6. The pen-based computing system of claim 1, wherein the digital bookclip being aligned to the printed document comprises:

manually aligning a vertical dimension of the digital bookclip with a vertical dimension of the page and manually aligning a horizontal position of the digital bookclip aligned with a specified position on the page.

7. The pen-based computing system of claim 6, wherein the specified position on the page comprises a corner of the page.

8. The pen-based computing system of claim 1, wherein the digital bookclip is a physically separate object from the printed document.

9. The system of claim 1, wherein the physical material is opaque.

10. The system of claim 1, wherein:

the smart pen device comprises a display system configured to display a first notice response to the smart pen device capturing the beginning location on the digital bookclip and a second notice responsive to the smart pen device capturing the end location on the digital bookclip; and

the computer program code additionally includes instructions for displaying at least a sub-portion of the digital representation of the printed document using the display system.

11. The system of claim 1, wherein identifying a selected portion of the digital representation of the printed document based comprises:

identifying a beginning of a sentence corresponding to the beginning location captured on the digital bookclip and identifying an ending of a sentence corresponding to the end location captured on the digital bookclip; and

selecting the portion of the digital representation between the identified beginning of the sentence and the identified end of the sentence.

12. The system of claim 1, comprising:

selecting an append button;

capturing a second beginning location on the digital bookclip corresponding to a beginning of a second interaction with the digital bookclip and a second end location on the digital bookclip corresponding to an end of the second interaction with the digital bookclip;

identifying a second portion of the digital document based on the second beginning location and the second end location of the second interaction; and

appending the second portion of the digital document to the selected first portion of the digital document.

13. A method for digitally capturing content from a printed document comprising one or more pages of printed data, the printed document associated with a document identifier, and a page of the printed document aligned with a digital bookclip in a predetermined manner, the method comprising:

receiving the document identifier associated with the printed document;

determining a vertical or horizontal orientation of the digital bookclip with respect to the printed document, wherein the digital bookclip comprises a physical material encoded with a pattern, the physical material distinct from the printed document;

using an imaging system of a data clipping device, capturing a beginning location on the digital bookclip corresponding to a beginning of an interaction with the data clipping device and an end location on the digital bookclip corresponding to an end of the interaction with the data clipping device;

identifying a selected portion of the page of the printed document based on the determined orientation of the digital bookclip with respect to the printed document and the beginning location and the end location of the interaction captured when the digital bookclip is aligned with the page of the printed document;

communicating the selected portion of the page of the printed document and the document identifier to a digital document retrieval system, that is configured to located a digital document associated with the document identifier and retrieve a portion of the digital document associated with the portion of the page of the printed document; and

receiving from the digital document retrieval system the portion of the digital document associated with the portion of the page of the printed document.

14. The method of claim 13, wherein a vertical dimension of the digital bookclip is aligned with a vertical dimension of the page;

and

wherein a horizontal position of the digital bookclip is aligned with a specified position on the page.

15. The method of claim 14, wherein the horizontal position on the page comprises a corner of the page.

16. The method of claim 13, wherein the digital bookclips a physically separate object from the printed document.

17. The method of claim 13, wherein the data clipping device comprises a smart pen device.

18. A method for obtaining a digital representation of a region of a printed document including one or more pages, the method comprising:

receiving a document identifier associated with the printed document;

capturing, by an image sensor of a smart pen, a sequence of characters during a single vertical gesture of the smart pen, the single vertical gesture of the smart pen intersecting a plurality of horizontally oriented text on the printed document, the sequence of characters below and within view of the smart pen device during the single vertical gesture;

using optical character recognition to identify the sequence of characters captured during the single vertical gesture;

retrieving a digital document associated with the document identifier;

comparing the sequence of characters captured during the single vertical gesture with data included in the digital document; and

responsive to finding a sequence of characters in the data of the digital document matching the sequence of characters captured during the single vertical gesture, retrieving a portion of the digital document corresponding to the plurality of lines of horizontally oriented text data on the printed document.

19. The method of claim 18 wherein the single vertical gesture of the smart pen device comprises a vertical drag.

20. The method of claim 18 wherein comparing the sequence of characters captured during the single vertical gesture comprises:

generating one or more sequences of characters from data included in the digital document; and

comparing the sequence of characters captured during the single vertical gesture with the one or more sequences of characters from data included in the digital document.

21. A non-transitory computer-readable storage medium storing instructions configured to be executed by a processor coupled to a smart pen device, the instructions for digitally capturing content from a printed document comprising one or more pages of printed data, the printed document associated with a document identifier, the instructions including instructions for:

receiving the document identifier associated with the printed document;

determining a vertical or horizontal orientation of a digital bookclip with respect to the printed document, wherein the digital bookclip comprises a physical material encoded with a pattern, the physical material distinct from the printed document;

identifying a selected portion of a page of the printed document based on the determined orientation of the digital bookclip and a beginning location and an end location of an interaction of a data clipping device with the digital bookclip captured when the digital bookclip is aligned with the page of the printed document;

transmitting the selected portion of the page and the document identifier to a digital document store for locating a digital document associated with the document identifier.

22. The non-transitory computer readable storage medium of claim 21, wherein identifying the portion of the page of the printed document associated with the selection received from the data clipping device comprises:

determining a paper coordinate system associated with the digital bookclip;

determining a coordinate set associated with a location on the digital bookclip accessed by the data clipping device; and

identifying the coordinate set associated with the location on the digital bookclip accessed by the data clipping device in the digital coordinate system.

23. The non-transitory computer readable storage medium of claim 21, wherein retrieving the portion of the digital document associated with the portion of the page of the printed document comprises:

identifying a coordinate set associated with the selection of the one or more locations, the coordinate set specifying a relative position of the selection of the one or more locations on the digital bookclip;

identifying a line number included in the digital document associated with the document identifier associated with the coordinate set associated with the selection of the one or more locations, the line number identifying a line of text in the digital document; and

retrieving the line of text in the digital document.