Method and apparatus for electronic memo processing for integrally managing document including paper document and electronic memo added to the document

• US 6,396,598 B1
• Filed: 08/26/1998
• Issued: 05/28/2002
• Est. Priority Date: 08/26/1997
• Status: Expired due to Term

• Current Assignee: DataQuill Limited (Dataquill BVI Limited)
• Original Assignee: Sharp Kabushiki Kaisha (Hon Hai Precision Industry Co., Ltd.)
• Inventors: Akasaka, Kouji, Kashiwagi, Kouichi, Urano, Naoki
• Primary Examiner(s): Grant, II, Jerome
• Assistant Examiner(s): Worku, Negussie
• Application Number:
  US09/140,772
• Time in Patent Office: 1,371 Days
• Field of Search: 358/474,478,479,462,450,448,400,424 382/312,313,314,315,187,188,189,305,306
• US Class Current: 358/474
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: H04N 1/00127 Connection or combination of a still picture apparatus with another apparatus, e.g. for storage, processing or transmission of still picture signals or of information associated with a still picture
• CPC Class Codes: H04N 1/00129 with a display device, e.g. CRT or LCD monitor with a television apparatus H04N1/00283; arrangements for control of display devices G09G
• CPC Class Codes: H04N 1/32112 in a separate computer file, document page or paper sheet, e.g. a fax cover sheet H04N1/32122 takes precedence
• CPC Class Codes: H04N 1/32122 in a separate device, e.g. in a memory or on a display separate from image data
• CPC Class Codes: H04N 2201/0063 Constructional details
• CPC Class Codes: H04N 2201/0096 Portable devices
• CPC Class Codes: H04N 2201/3245 of image modifying data, e.g. handwritten addenda, highlights or augmented reality information
• CPC Class Codes: H04N 2201/3277 The additional information being stored in the same storage device as the image data
• CPC Class Codes: Y10S 707/99936 Pattern matching access

Abstract

An electronic memo adding and displaying apparatus 50 includes a tablet with integrated display for electronically acquiring an electronic memo to a document input by a user through a virtual transparent input sheet registered to be overlapped with an arbitrary object document 52, and for displaying the electronic memo on the virtual transparent input sheet, and a control unit 58 performing an electronic memo storing process, for storing the electronic memo acquired through the tablet with integrated display in a storage while associating the electronic memo with the object document.

Claims

1. An electronic memo processing apparatus, comprising:

a document identifier for identifying an arbitrary object document;

an electronic memo retriever for retrieving, from a storage, an electronic memo associated with the document identified by said document identifier; and

a display device for displaying the electronic memo retrieved by said electronic memo retriever on a virtual transparent input sheet positioned such that the electronic memo is overlapped with said object document,

wherein said object document and said electronic memo are distinct from one another and said electronic memo is stored separately from said object document; and

further including;

an electronic memo acquirer for electronically acquiring an electronic memo to said document, input by a user on said virtual transparent input sheet; and

electronic memo storage for storing in said storage the electronic memo acquired by said electronic memo acquirer, wherein said processing apparatus associates the electronic memo with said object document;

wherein said display device includes a display in a form of a pair of eyeglasses having a transparent display portion defined by lenses of said eyeglasses for displaying said object document and said electronic memo overlapped with each other when the eyeglasses are worn by a user.

2. An electronic memo processing apparatus, comprising:

a document identifier for identifying an arbitrary object document;

an electronic memo retriever for retrieving, from a storage, an electronic memo associated with the document identified by said document identifier; and

a display device for displaying the electronic memo retrieved by said electronic memo retriever on a virtual transparent input sheet positioned such that the electronic memo is overlapped with said object document,

wherein said object document and said electronic memo are distinct from one another and said electronic memo is stored separately from said object document; and

further including

an electronic memo acquirer for electronically acquiring an electronic memo to said document, input by a user on said virtual transparent input sheet; and

electronic memo storage for storing in said storage the electronic memo acquired by said electronic memo acquirer, wherein said processing apparatus associates the electronic memo with said object document;

a modification detector for detecting how layout of said object document is modified after last addition of an electronic memo to said object document; and

a layout adjuster for adjusting position of display of an electronic memo to said object document, in accordance with layout modification of said object document detected by said modification detector.

3. An electronic memo processing apparatus, comprising:

a document identifier for identifying an arbitrary object document;

an electronic memo retriever for retrieving, from a storage, an electronic memo associated with the document identified by said document identifier; and

a display device for displaying the electronic memo retrieved by said electronic memo retriever on a virtual transparent input sheet positioned such that the electronic memo is overlapped with said object document,

wherein said object document and said electronic memo are distinct from one another and said electronic memo is stored separately from said object document; and

further including;

an electronic memo acquirer for electronically acquiring an electronic memo to said document, input by a user on said virtual transparent input sheet; and

electronic memo storage for storing in said storage the electronic memo acquired by said electronic memo acquirer, wherein said processing apparatus associates the electronic memo with said object document;

a determiner for determining whether said object document is stored in document storage storing a document; and

a document registerer which, when it is determined by said determiner that said object document is not stored in said document storage, for converting said object document to a data format allowing electronic processing, and registering the converted document to a data document in said document storage.

4. An electronic memo processing apparatus, comprising:

a document identifier for identifying an arbitrary object document;

an electronic memo retriever for retrieving, from a storage, an electronic memo associated with the document identified by said document identifier; and

a display device for displaying the electronic memo retrieved by said electronic memo retriever on a virtual transparent input sheet positioned such that the electronic memo is overlapped with said object document,

wherein said object document and said electronic memo are distinct from one another and said electronic memo is stored separately from said object document; and

further including;

an electronic memo acquirer for electronically acquiring an electronic memo to said document, input by a user on said virtual transparent input sheet; and

electronic memo storage for storing in said storage the electronic memo acquired by said electronic memo acquirer, wherein said processing apparatus associates the electronic memo with said object document;

said object document is an electronic document; and

said apparatus further comprising;

an operator recognizer for electronically acquiring and recognizing an operator to said document input by handwriting by a user on said virtual transparent input sheet; and

a document modifier for modifying said electronic document in accordance with the operator acquired by said operator recognizer.

5. The electronic memo processing apparatus according to claim 4, further comprising:

a modification detector for detecting how layout of said object document is modified by said document modifier; and

a layout adjuster for adjusting position of display of an electronic memo to said object document, in accordance with layout modification of said object detected by said modification detector.

6. An electronic memo processing apparatus, comprising:

a display device for displaying an electronic object document;

an operator recognizer for electronically acquiring handwriting from an operator and recognizing the operator by the operator'"'"'s handwriting, wherein the handwriting is performed on a virtual transparent input sheet registered to be overlapped with the object document; and

a document modifier for modifying said object document in accordance with the operator recognized by said operator recognizer.

7. A method of processing an electronic memo, comprising the steps of:

storing a plurality of electronic memos, wherein each electronic memo is associated with an object document and is stored separately therefrom;

identifying an arbitrary object document;

retrieving from storage an electronic memo that is associated with the document identified by said document identifying step; and

displaying the electronic memo retrieved in said step of retrieving on a virtual transparent input sheet such that the electronic memo is overlapped with said object document;

electronically acquiring an electronic memo to said document input by a user on the virtual transparent input sheet registered to be overlapped with an arbitrary object document; and

storing the electronic memo while associating the electronic memo with said object document, in said storage;

wherein said step of display includes the step of displaying said electronic memo on a binocular type display device having a transparent display portion displaying said object document and track of said handwritten data overlapped with each other, when worn by a user.

8. A method of processing an electronic memo, comprising the steps of:

displaying an electronic object document;

electronically acquiring handwriting from an operator and recognizing the operator by the operator'"'"'s handwriting, wherein the handwriting is performed on a virtual transparent input sheet such that the handwriting is overlapped with the object document; and

modifying said object document in accordance with the operator recognized in said step of recognizing the operator.

9. The recording medium according to claim 8, wherein

format of said electronic memo includes a plurality of said electronic memos associated with said object document;

each of said plurality of said electronic memos includes attribute data; and

said step of display displays said plurality of said electronic memos in different manner of display in accordance with the attribute.

10. The recording medium according to claim 8, wherein

said object document is an electronic document;

and

said method of processing an electronic memo further includes the steps of

electronically obtaining and recognizing an operator to said document input by handwriting by a user on said virtual transparent input sheet, and

modifying said electronic document in accordance with the operator acquired in the step of recognizing the operator.

11. The recording medium according to claim 8, wherein

said method of processing an electronic memo further includes the steps of

detecting how layout of said object document is modified by said step of modifying document, and

adjusting position of display of an electronic memo to said object document, in accordance with layout modification of said object document detected by said step of detecting modification.

12. A computer readable recording medium storing an electronic memo processing program for implementing a method of processing an electronic memo including the steps of

displaying an electronic object document,

electronically acquiring handwriting from an operator and recognizing the operator by the operator'"'"'s handwriting, wherein the handwriting is performed on a virtual transparent input sheet such that the electronic memo is overlapped with the object document, and

modifying said electronic document in accordance with the operator recognized in the step of recognizing the operator.