Associating electronic documents, and apparatus, methods and software relating to such activities

• US 7,659,891 B2
• Filed: 01/31/2005
• Issued: 02/09/2010
• Est. Priority Date: 01/30/2004
• Status: Expired due to Fees

• Current Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Original Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Inventors: Mackenzie, Andrew
• Primary Examiner(s): Nguyen, Kevin M
• Application Number:
  US11/045,440
• Publication Number:
  US 20050188306A1
• Time in Patent Office: 1,835 Days
• Field of Search: 345179-183, 178/18.01, 178/18.03, 178/19, 715/512, 715/263, 715/200, 382/306, 382/179, 382/184, 382/187
• US Class Current: 345/179
• CPC Class Codes: G06F 16/93 Document management systems

Abstract

A method of associating a first electronic document with a second electronic document comprising having a first physical paper identifier (130) having pen-readable coding (12) which codes for an identifier for the first electronic document, and reading the coding of the first electronic document with a pen (20) to acquire information enabling the identity of the first electronic document to be established, and communicating that identity to a computer processor (107), and using the processor (107) to associate the identified first electronic document with the second electronic document.

Claims

1. A method of associating a first electronic document with a second electronic document comprising:

having a first physical paper identifier having a device readable coding, which codes for an identifier for said first electronic document, and;

reading said coding of said first electronic document with a device, to acquire information enabling said identity of said first electronic document to be established, and;

communicating that identity to a computer processor, and;

detecting a user gesture associating the identified first electronic document with the second electronic document, wherein the user gesture includes a user linking marker gesture performed with the device on at least a portion of a hardcopy of the identified first electronic document and on at least a portion of a hardcopy of the second electronic document; and

using said processor to associate said identified first electronic document with said second electronic document in response to the detected user gesture, wherein the associating includes the processor interpreting the user gesture on the hardcopies as instructions to link the first and second electronic documents.

2. A method according to claim 1, wherein said device is a digital pen.

3. A method according to claim 1 wherein said device is used to read a second physical paper identifier coding for said second electronic document and to communicate to said processor information enabling said identity of said second electronic document to be established.

4. A method according to claim 3 wherein said first physical paper identifier comprises a first sheet of digital paper having a device readable position-determining pattern and having human readable content;

said second physical paper identifier comprises one or more sheets of digital paper having a device readable position-determining pattern.

5. A method according to claim 1 wherein said device is used to create at least some human discernable content of at least one of said first and second electronic documents.

6. A method according to claim 1 wherein at least one of said first and said second physical identifier comprises a printed and/or digital pen-written paper document having human discernable content equivalent to at least part of the respective one of said first and second electronic documents, the printed document being one or more of the hardcopies.

7. A method according to claim 6 wherein at least one of said first and second documents and said equivalent one of said first and second electronic documents whose identity is coded for by their device-readable coding have substantially the same human readable content as each other.

8. A method according to claim 7 wherein at least one of said first and second physical paper document and their equivalent electronic documents present substantially identical representatives of their human readable content to a user, at least one of said electronic documents faithfully replicating a paper document created at least in part by a user making markings with said device, on digital paper, comprising at least one of said paper documents.

9. A method according claim 1 in which said physical paper identifier has a device position determining pattern on it to enable said device, to acquire data to enable said position of said pen, or device, on said paper to be determined, and to enable device movements on said paper to be represented in an equivalent digital document.

10. A method according to claim 9 wherein a link is caused to be established between said first electronic document and said second electronic document by one of:

(i) making one of a specific predetermined action, gesture and mark with said device on at least one of said first physical paper identifier and a second physical paper identifier which has a device-readable code coding for said second electronic document;

(ii) making one of a non-specific undefined action, gesture and mark with said device on at least one of said first physical paper identifier and a second physical paper identifier which has a pen-readable, device-readable code coding for said first or second electronic document; and

(iii) making a non-specified mark with said device by one of (a) placing device in contact with said first physical paper identifier and moving said device from said first physical paper identifier to a second physical paper identifier which has a device-readable code coding for said second electronic document, and (b) placing said pen or device in contact with said second physical paper identifier and moving said device from said second physical paper identifier to said first physical paper identifier, wherein device exerts downwards pressure, throughout said pen stroke or device movement producing said mark.

11. A method according to claim 1 wherein said physical paper identifiers include a physical paper print-out of at least one of said electronic documents identified by said paper identifier.

12. A method according to claim 1 comprising a user:

(i) writing at least one of notes and sketches on notelets comprising a plurality of first sheets of paper, comprising first physical paper identifiers, using a device to create content on said first sheets, and to create a plurality of first electronic documents equivalent to said notelet content;

(ii) positioning said plurality of notelets on second sheets of paper, comprising second physical paper identifiers, at places where it is desired for said content of said first sheets of paper to be reproduced in a representation of an electronic combined document formed from an electronic document equivalent to and identified by said second sheets and from said first electronic documents created by said device upon said notelets;

(iii) using said device to make one of link actions, marks and gestures on each notelet and said adjacent area on said second document so as to link said plurality of first electronic documents with said second electronic document to create a combined electronic document such that said notelet contents appear to a user viewing said combined electronic document at said positions where said one of link actions, marks and gestures are made.

13. A method according to claim 1 wherein said user gesture comprises writing a line, and or making a device gesture of writing the line, that extends from one the hardcopies to the other hardcopy.

14. A method according to claim 1 wherein said coding comprises at least one of:

(i) a pattern of markings from which a page identity can be established;

(ii) a pattern of markings from which a position in a marking pattern can be established;

(iii) a radio frequency marker;

(iv) an ultraviolet marker;

(v) a marker detectable at an electromagnetic wave spectrum that penetrates paper well.

15. A method according to claim 1 wherein said second electronic document is associated with said electronic document in a manner such that when a combined, associated, electronic document, comprising said first and second electronic documents, is displayed said first and second electronic documents are presented to a user as separate identifiable documents each retaining their integrity unadulterated by said other.

16. A method according to claim 15 wherein said combined electronic document when displayed to a user presents said first and second documents in a manner from said group:

(i) one after the other, as equivalent paper pages containing said content of said electronic documents had as if said paper pages been stacked on top of each other;

(ii) as options in a user-selectable menu, with options relating to at least one of said first, said second and said combined electronic documents being visible to said user at the time they select.

17. A method according to claim 1 wherein said processor has locally available memory and access to a communications link to a remote memory resource, and wherein pursuant to identification of said first electronic document said processor establishes whether or not said first electronic document exists in said locally available memory and if it does not said processor communicates via said communications link with said remote memory resource to cause one of said first electronic document, and a copy of said first electronic document, to be transferred to said locally available memory.

18. A method according to claim 17 wherein said communications link comprises at least one of:

a LAN;

a WAN;

a MAN;

the internet.

19. A method according to claim 1 wherein said first physical identifier comprises a sheet of paper having a position determining pattern readable by said device to enable data relating to device movements made upon said sheet to be captured, and wherein an association between said second electronic document and said first electronic document is established using data acquired by said device to establish said identity of said sheet of paper, and wherein said association is made by one of:

(i) after a user has finished moving said device over said paper, or finished writing upon or marking said sheet of paper with said pen; and

(ii) when said device recognises said identity of said sheet of paper.

20. A method according to claim 19 wherein there is a first electronic document file in a first computer memory file, and a second electronic document in a second computer memory file, and wherein there is an association made associating said first and second files by a computer processor, said association being one of:

(a) before, a user moves said device over said sheet of paper, or writes or marks said sheet of paper with said device to populate said first file with data;

(b) during a user moving said device over said sheet of paper, or writes or marks said sheet of paper with said device to populate said first file with data; and

(c) after a user moves said device over said sheet of paper, or writes or marks said sheet of paper with said device to populate said first file with data.

21. A method according to claim 1, further comprising:

generating a single identifier identifying the linked first and second electronic documents;

receiving a user selection of the single identifier; and

presenting the linked first and second electronic documents in response to receiving the user selection of the single identifier.

22. A system for presenting to a user a visual representation of a combined document including at least some user readable content from a first paper document and at least some user readable content from a second paper document, said system comprising:

a digital document linking device, said device having a position determining device adapted to acquire information to enable said position of said device to be determined, said position determining device being one of a position determining sensor and a camera;

a first paper sheet having a first device-readable pattern to enable said device to acquire information from said first paper sheet to enable said position of said device in said first pattern to be determined;

a second paper sheet comprising a paper document having a second device readable pattern to enable said device to acquire information from said second paper sheet to enable said position of said device in said second pattern to be determined, and there being an electronic equivalent document equivalent to said content of said second paper sheet;

a computer processor adapted to process signals from said device;

a communications link adapted to communicate said pen or device with said processor to enable said signals to be communicated to said processor, said signals including device acquired data capable of enabling said position of said device in said patterns to be identified;

and wherein;

said processor has software which when run is adapted to;

identify said second electronic document equivalent to said content of said second document using second pattern-related data acquired by said device;

to create a first electronic document representative of user-applied device movements, made on said first paper sheet when said user creates a first, written paper document on said first paper sheet;

to interpret data derived from device movements performed by said user on said first and second paper sheets as linking instructions to create a link between said second electronic document and said first electronic document so as to enable a visual representation to be produced of said second paper document with said device created first paper document associated with it; and

to act on said linking instructions so as to cause said first and second electronic documents to be so linked.

23. A system according to claim 22 wherein said document linking device is a pen.

24. A system according to claim 22 wherein said software is adapted to interpret a linking action made with said device by said user that is made on a selected part of said second document and a selected part of said first sheet as instructions to create a visual representation derived from said first and second electronic documents with said selected parts aligned in said visual representation.

25. A system according to claim 22 wherein said software is adapted to cause a third electronic document to be produced and stored in processor-accessible memory, said third electronic document comprising data obtained from said first and second electronic documents.

26. A system according to claim 22 wherein said software is adapted to cause a set of instructions to be produced which, when a user requests said production of said visual representation of said combined electronic document, references data from said first and second electronic documents to create said visual representation of said combined document.

27. A system for presenting to a user a visual representation of a combined document including at least some user readable content from a first paper document and at least some user readable content from a second paper document, said system comprising:

reading means for reading a first and second device-readable position-determining patterns on said first and second paper documents respectively to identify said position of said reading means on said paper documents, said reading means having a lighting means adapted to shine light onto said paper documents, a light receiving means adapted to receive light from said lighting means that has been reflected off said paper documents so as to acquire information to enable said position of said writing means on said paper documents to be determined, and a pressure sensing means, said reading means being adapted to acquire said information and determine when said pressure sensing means senses a reading pressure applied to said documents by reading means;

a processing means adapted to process signals from said reading means;

a communication means adapted to communicate said reading means with said processor to enable said signals to be communicated to said processing means, said signals including device-acquired data capable of enabling said position of said device in said patterns to be identified;

an electronic equivalent to said user readable content of said second paper document, said electronic equivalent document being stored in memory accessible by said processor;

and wherein;

said processing means has software means which when run is adapted to;

identify said second electronic document equivalent to said content of said second document using second pattern-related data acquired by said device;

create a first electronic document representative of user-applied device movements made by said reading means on said first paper sheet when said user creates a first, written, paper document on said first paper sheet;

to interpret data derived from movements made by said user on said first and second paper documents using said reading means as linking instructions to create a link between said second electronic document and said first electronic document so as to enable a visual representation to be produced of said second paper document with said device-created first paper document associated with it; and

to act on said linking instructions so as to cause said first and second electronic documents to be so linked.

28. A software for associating a first electronic document with a second electronic document, wherein a first physical paper identifier having device-readable coding codes for an identifier for said first electronic document, said software when run on a computer system performing a method comprising:

reading said coding of said first electronic document with a device, to acquire information enabling said identity of said first electronic document to be established, and;

communicating that identity to a computer processor, and;

detecting a user gesture associating the identified first electronic document with the second electronic document, wherein the user gesture includes a user linking marker gesture performed with the device on at least a portion of a hardcopy of the identified first electronic document and on at least a portion of a hardcopy of the second electronic document; and

using said processor to associate said identified first electronic document with said second electronic document in response to the detected user gesture, wherein the associating includes the processor interpreting the user gesture on the hardcopies as instructions to link the first and second electronic documents.