Manual entry interactive paper and electronic document handling and processing system

• US 6,081,261 A
• Filed: 11/01/1995
• Issued: 06/27/2000
• Est. Priority Date: 11/01/1995
• Status: Expired due to Term

• Current Assignee: Ricoh Corporation (Ricoh Company Limited)
• Original Assignee: Ricoh Corporation (Ricoh Company Limited)
• Inventors: Wolff, Gregory J., Stork, David G.
• Primary Examiner(s): Liang, Regina
• Application Number:
  US08/551,535
• Time in Patent Office: 1,700 Days
• Field of Search: 345/179, 345/180, 345/181, 345/182, 345/183, 345/173, 345/174, 345/175, 345/158, 345/169, 345/901, 345/146, 178/18, 178/19, 382/119-122, 382/181-184, 382/187, 382/188
• US Class Current: 345/179
• CPC Class Codes: G06F 3/03545 Pens or stylus
• CPC Class Codes: G06K 7/10881 constructional details of hand-held scanners
• CPC Class Codes: G06V 30/228 of three-dimensional handwriting, e.g. writing in the air
• CPC Class Codes: G06V 30/333 Preprocessing; Feature extraction

Abstract

A manual entry interactive paper and electronic document handling and process system uses a pen-like instrument (PI) with a writing point for making written entries upon a physical document and sensing the three-dimensional forces exerted on the writing tip as well as the motion associated with the act of writing. The PI is also equipped with a CCD array for reading pre-printed bar codes used for identifying document pages and other application defined areas on the page, as well as for providing optical character recognition data. A communication link between the PI and an associated base unit transfers the transducer data from the PI. The base unit includes a programmable processor, a display, and a communication link receiver. The processor includes programs for written character and word recognition, memory for storage of an electronic version of the physical document and any hand-written additions to the document. The display unit displays the corresponding electronic version of the physical document on a CRT or LCD as a means of feedback to the user and for use by authorized electronic agents.

Claims

1. A document handling system comprising:

a pen instrument to track writing motions made with the pen instrument so that an electronic document is modified by incorporating reproductions of strokes made with the pen instrument, wherein the pen instrument tracks its own motion and generates signals that represent the writing motions made with the pen instrument; and

a processing unit having an interface to receive the signals from the pen instrument, wherein the processing unit stores the electronic document and modifies the electronic document in response to the strokes made with the pen instrument such that representations of the writing motions made with the pen instrument are displayed when the electronic document is displayed.

2. The system of claim 1 wherein the pen instrument comprises at least one transducer to sense self motion in a multi-dimensional space and generate electrical signals representative of the self motion.

3. The system of claim 1 wherein the pen instrument has at least one rate gyroscope to generate at least some of the electrical signals.

5. The system of claim 1 wherein the pen instrument has at least one accelerometer and at least one gyroscope to generate at least some of the electrical signals.

6. The system of claim 1 further comprising at least two infrared receiving scanning stations located at prescribed positions external to the pen instrument, the scanning stations to scan the area in which the pen instrument is used, wherein the scanning stations receive an infrared signal from the pen instrument.

7. The system of claim 1 further comprising at least two infrared radiating scanning sources located at prescribed positions external to the pen instrument, the scanning sources to illuminate the pen instrument, wherein the pen instrument determines movements based, at least in part, on the scanning sources.

4. The system of claim wherein the pen instrument has at least one accelerometer to generate at least some of the electrical signals.

8. A method comprising:

tracking a location of a pen instrument when the pen instrument is used to modify a physical document, wherein sensors within the pen instrument track the location of the pen instrument;

generating signals describing movement of the pen instrument based on the location of the pen instrument;

transmitting the signals to a receiving device, wherein the signals are used to modify an electronic document corresponding to the physical document, and further wherein strokes made with the pen instrument are displayed when the electronic document is displayed.

9. The method of claim 8 wherein generating electrical signals describing the series of strokes comprises generating the electrical signals with at least one transducer to sense self motion in a multi-dimensional space.

10. The method of claim 8 wherein generating electrical signals describing the series of strokes comprises generating the electrical signals with at least one rate gyroscope.

11. The method of claim 8 wherein generating electrical signals describing the series of strokes comprises generating the electrical signals with at least one accelerometer.

12. The method of claim 8 wherein generating electrical signals describing the series of strokes comprises generating the electrical signals with at least one accelerometer and at least one gyroscope.

13. The method of claim 8 wherein tracking a location of a pen instrument comprises generating an infrared signal with the pen instrument that is received by at least two infrared receiving scanning stations located at prescribed positions external to the pen instrument, the scanning stations to scan the area in which the pen instrument is used.

14. The method of claim 8 wherein tracking a location of a pen instrument comprises receiving an infrared signal from at least two infrared radiating scanning sources located at prescribed positions external to the pen instrument, the scanning sources to illuminate the pen instrument, wherein the pen instrument determines movements based, at least in part, on the infrared signals.

15. An apparatus comprising:

means for tracking a location of a pen instrument when the pen instrument is used to modify a physical document, wherein sensors within the pen instrument track the location of the pen instrument;

means for generating signals describing movement of the pen instrument based on the location of the pen instrument;

means for transmitting the signals to a receiving device, wherein the signals are used to modify an electronic document corresponding to the physical document, and further wherein strokes made with the pen instrument are displayed when the electronic document is displayed.

16. The apparatus of claim 15 wherein the means for generating electrical signals describing the series of strokes comprises at least one transducer to sense self motion in a multi-dimensional space.

18. The apparatus of claim 15 wherein the means for generating electrical signals describing the series of strokes comprises at least one accelerometer.

20. The apparatus of claim 15 wherein the means for tracking a location of a pen instrument comprises means for generating an infrared signal with the pen instrument that is received by at least two infrared receiving scanning stations located at prescribed positions external to the pen instrument, the scanning stations to scan the area in which the pen instrument is used.

21. The apparatus of claim 15 wherein the means for tracking a location of a pen instrument comprises means for receiving an infrared signal from at least two infrared radiating scanning sources located at prescribed positions external to the pen instrument, the scanning sources to illuminate the pen instrument, wherein the pen instrument determines movements based, at least in part, on the infrared signals.

17. The apparatus of claim wherein the means for generating electrical signals describing the series of strokes comprises at least one rate gyroscope.

19. The apparatus of claim wherein the means for generating electrical signals describing the series of strokes comprises at least one accelerometer and at least one gyroscope.