Associating electronic documents, and apparatus, methods and software relating to such activities

• US 20050188306A1
• Filed: 01/31/2005
• Published: 08/25/2005
• Est. Priority Date: 01/30/2004
• Status: Active Grant

• Current Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Original Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Inventors: Mackenzie, Andrew
• Granted Patent: US 7,659,891 B2
• Time in Patent Office: Days
• US Class Current: 715/268
• CPC Class Codes: G06F 16/93 Document management systems

Abstract

A method of associating a first electronic document with a second electronic document comprising having a first physical paper identifier (130) having pen-readable coding (12) which codes for an identifier for the first electronic document, and reading the coding of the first electronic document with a pen (20) to acquire information enabling the identity of the first electronic document to be established, and communicating that identity to a computer processor (107), and using the processor (107) to associate the identified first electronic document with the second electronic document.

Claims

1. A method of associating a first electronic document with a second electronic document comprising having a first physical paper identifier having a device readable coding, which codes for an identifier for said first electronic document, and reading said coding of said first electronic document with a device, to acquire information enabling said identity of said first electronic document to be established, and communicating that identity to a computer processor, and using said processor to associate said identified first electronic document with said second electronic document.

2. A method according to claim 1, wherein said device is a digital pen.

3. A method according to claim 1 wherein said device is used to read a second physical paper identifier coding for said second electronic document and to communicate to said processor information enabling said identity of said second electronic document to be established.

4. A method according to claim 1 wherein said device is used to create at least some human discernable content of at least one of said first and second electronic documents.

5. A method according to claim 1 wherein at least one of said first and said second physical identifier comprises a printed and/or digital pen-written paper document having human discernable content equivalent to at least part of the respective one of said first and second electronic documents.

6. A method according to claim 5 wherein at least one of said first and second documents and said equivalent one of said first and second electronic documents whose identity is coded for by their device-readable coding have substantially the same human readable content as each other.

7. A method according to claim 6 wherein at least one of said first and second physical paper document and their equivalent electronic documents present substantially identical representatives of their human readable content to a user in a What You See is What You Get manner, at least one of said electronic documents faithfully replicating a paper document created at least in part by a user making markings with said device, on digital paper, comprising at least one of said paper documents.

8. A method according claim 1 in which said physical paper identifier has a device position determining pattern on it to enable said device, to acquire data to enable said position of said pen, or device, on said paper to be determined, and to enable device movements on said paper to be represented in an equivalent digital document.

9. A method according to claim 3 wherein said first physical paper identifier comprises a first sheet of digital paper having a device readable position-determining pattern and having human readable content;

said second physical paper identifier comprises one or more sheets of digital paper having a device readable position-determining pattern; and

wherein said user associates an electronic document identified by said first sheet of paper with a specific region a human discernable representation of said second electronic document by using said device to link said first electronic document to said specific region by making one of a linking marker gesture and action, with said device on the or a said second sheet of paper at a position on the or a said second sheet of paper equivalent to said specific region.

10. A method according to claim 1 wherein a user makes one of a linking action, mark, and gesture on at least one, or more than one, physical paper identifier of said document, said one of action, mark and gesture being interpreted by said processor as instructions to link electronic documents identified by said pen, or device.

11. A method according to claim 1 wherein said physical paper identifiers include a physical paper print-out of at least one of said electronic documents identified by said paper identifier.

12. A method according to claim 1 comprising a user:

(i) writing at least one of notes and sketches on notelets comprising a plurality of first sheets of paper, comprising first physical paper identifiers, using a device to create content on said first sheets, and to create a plurality of first electronic documents equivalent to said notelet content;

(ii) positioning said plurality of notelets on second sheets of paper, comprising second physical paper identifiers, at places where it is desired for said content of said first sheets of paper to be reproduced in a representation of an electronic combined document formed from an electronic document equivalent to and identified by said second sheets and from said first electronic documents created by said device upon said notelets;

(iii) using said device to make one of link actions, marks and gestures on each notelet and said adjacent area on said second document so as to link said plurality of first electronic documents with said second electronic document to create a combined electronic document such that said notelet contents appear to a user viewing said combined electronic document at said positions where said one of link actions, marks and gestures are made.

13. A method according to claim 1 wherein said first physical paper identifier has content equivalent to said content of said first electronic document, and wherein a first sheet of paper comprises said first physical paper identifier and a second sheet of paper comprises a second physical paper identifier having content equivalent to said content of a second electronic document, and wherein said first and second electronic documents are linked by one of writing a line, and making a device gesture, that extends from one sheet of paper to said other.

14. A method according to claim 8 wherein a link is caused to be established between said first electronic document and said second electronic document by one of:

(i) making one of a specific predetermined action, gesture and mark with said device on at least one of said first physical paper identifier and a second physical paper identifier which has a device-readable code coding for said second electronic document;

(ii) making one of a non-specific undefined action, gesture and mark with said device on at least one of said first physical paper identifier and a second physical paper identifier which has a pen-readable, device-readable code coding for said first or second electronic document; and

(iii) making a non-specified mark with said device by one of (a) placing device in contact with said first physical paper identifier and moving said device from said first physical paper identifier to a second physical paper identifier which has a device-readable code coding for said second electronic document, and (b) placing said pen or device in contact with said second physical paper identifier and moving said device from said second physical paper identifier to said first physical paper identifier, wherein device exerts downwards pressure, throughout said pen stroke or device movement producing said mark.

15. A method according to claim 1 wherein said coding comprises at least one of:

—

(i) a pattern of markings from which a page identity can be established;

(ii) a pattern of markings from which a position in a marking pattern can be established;

(iii) a radio frequency marker;

(iv) an ultraviolet marker;

(v) a marker detectable at an electromagnetic wave spectrum that penetrates paper well.

16. A method according to claim 1 wherein said second electronic document is associated with said electronic document in a manner such that when a combined, associated, electronic document, comprising said first and second electronic documents, is displayed said first and second electronic documents are presented to a user as separate identifiable documents each retaining their integrity unadulterated by said other.

17. A method according to claim 16 wherein said combined electronic document when displayed to a user presents said first and second documents in a manner from said group:

—

(i) one after the other, as equivalent paper pages containing said content of said electronic documents had as if said paper pages been stacked on top of each other;

(ii) as options in a user-selectable menu, with options relating to at least one of said first, said second and said combined electronic documents being visible to said user at the time they select.

18. A method according to claim 1 wherein said processor has locally available memory and access to a communications link to a remote memory resource, and wherein pursuant to identification of said first electronic document said processor establishes whether or not said first electronic document exists in said locally available memory and if it does not said processor communicates via said communications link with said remote memory resource to cause one of said first electronic document, and a copy of said first electronic document, to be transferred to said locally available memory.

19. A method according to claim 18 wherein said communications link comprises at least one of:

(i) a LAN;

(ii) a WAN;

(iii) a MAN;

(iv) the internet

20. A method according to claim 1 wherein said first physical identifier comprises a sheet of paper having a position determining pattern readable by said device to enable data relating to device movements made upon said sheet to be captured, and wherein an association between said second electronic document and said first electronic document is established using data acquired by said device to establish said identity of said sheet of paper, and wherein said association is made by one of:

(i) after a user has finished moving said device over said paper, or finished writing upon or marking said sheet of paper with said pen; and

(ii) when said device recognises said identity of said sheet of paper.

21. A method according to claim 20 wherein there is a first electronic document file in a first computer memory file, and a second electronic document in a second computer memory file, and wherein there is an association made associating said first and second files by a computer processor, said association being one of:

(a) before, a user moves said device over said sheet of paper, or writes or marks said sheet of paper with said device to populate said first file with data;

(b) during a user moving said device over said sheet of paper, or writes or marks said sheet of paper with said device to populate said first file with data; and

(c) after a user moves said device over said sheet of paper, or writes or marks said sheet of paper with said device to populate said first file with data;

22. A system for presenting to a user a visual representation of a combined document including at least some user readable content from a first paper document and at least some user readable content from a second paper document, said system comprising:

a digital document linking device, said device having a position determining device adapted to acquire information to enable said position of said device to be determined, said position determining device being one of a position determining sensor and a camera;

a first paper sheet having a first device-readable pattern to enable said device to acquire information from said first paper sheet to enable said position of said device in said first pattern to be determined;

a second paper sheet comprising a paper document having a second device readable pattern to enable said device to acquire information from said second paper sheet to enable said position of said device in said second pattern to be determined, and there being an electronic equivalent document equivalent to said content of said second paper sheet;

a computer processor adapted to process signals from said device;

a communications link adapted to communicate said pen or device with said processor to enable said signals to be communicated to said processor, said signals including device acquired data capable of enabling said position of said device in said patterns to be identified;

and wherein;

said processor has software which when run is adapted to;

—

identify said second electronic document equivalent to said content of said second document using second pattern-related data acquired by said device;

—

to create a first electronic document representative of user-applied device movements, made on said first paper sheet when said user creates a first, written paper document on said first paper sheet;

to interpret data derived from device movements performed by said user on said first and second paper sheets as linking instructions to create a link between said second electronic document and said first electronic document so as to enable a visual representation to be produced of said second paper document with said device created first paper document associated with it; and

to act on said linking instructions so as to cause said first and second electronic documents to be so linked.

23. A system according to claim 22 wherein said document linking device is a pen.

24. A system according to claim 22 wherein said software is adapted to interpret a linking action made with said device by said user that is made on a selected part of said second document and a selected part of said first sheet as instructions to create a visual representation derived from said first and second electronic documents with said selected parts aligned in said visual representation.

25. A system according to claim 22 wherein said software is adapted to cause a third electronic document to be produced and stored in processor-accessible memory, said third electronic document comprising data obtained from said first and second electronic documents.

26. A system according to claim 22 wherein said software is adapted to cause a set of instructions to be produced which, when a user requests said production of said visual representation of said combined electronic document, references data from said first and second electronic documents to create said visual representation of said combined document.

27. A system for presenting to a user a visual representation of a combined document including at least some user readable content from a first paper document and at least some user readable content from a second paper document, said system comprising:

reading means for reading a first and second device-readable position-determining patterns on said first and second paper documents respectively to identify said position of said reading means on said paper documents, said reading means having a lighting means adapted to shine light onto said paper documents, a light receiving means adapted to receive light from said lighting means that has been reflected off said paper documents so as to acquire information to enable said position of said writing means on said paper documents to be determined, and a pressure sensing means, said reading means being adapted to acquire said information and determine when said pressure sensing means senses a reading pressure applied to said documents by reading means;

a processing means adapted to process signals from said reading means;

a communication means adapted to communicate said reading means with said processor to enable said signals to be communicated to said processing means, said signals including device-acquired data capable of enabling said position of said device in said patterns to be identified;

an electronic equivalent to said user readable content of said second paper document, said electronic equivalent document being stored in memory accessible by said processor;

and wherein;

said processing means has software means which when run is adapted to;

—

identify said second electronic document equivalent to said content of said second document using second pattern-related data acquired by said device;

—

create a first electronic document representative of user-applied device movements made by said reading means on said first paper sheet when said user creates a first, written, paper document on said first paper sheet;

to interpret data derived from said movements made by said user in which said reading means first reads one of said first digital device-readable pattern and said second digital device-readable pattern, and then reads said other one of said first digital pen-readable pattern and said second digital pen-readable pattern, whilst maintaining said reading pressure on said pressure sensing means, as linking instructions to create a link between said second electronic document and said first electronic document so as to enable a visual representation to be produced of said second paper document with said device-created first paper document associated with it; and

to act on said linking instructions so as to cause said first and second electronic documents to be so linked.

28. A software for associating a first electronic document with a second electronic document, wherein a first physical paper identifier having device-readable coding codes for an identifier for said first electronic document, said software when run being adapted to:

—

identify said first electronic document from coding acquired by a device; and

associate said identified first electronic document with said second electronic document.