Electro-optic slate for direct entry and display and/or storage of hand-entered textual and graphic information

• US 5,194,852 A
• Filed: 06/16/1989
• Issued: 03/16/1993
• Est. Priority Date: 12/01/1986
• Status: Expired due to Fees

• Current Assignee: Summagraphics Corp.
• Original Assignee: Summagraphics Corp.
• Inventors: More, Edward S., Aiken, John C.
• Primary Examiner(s): Brier, Jeffery A.
• Assistant Examiner(s): Chin, Jick
• Application Number:
  US07/368,241
• Time in Patent Office: 1,369 Days
• Field of Search: 340/706, 340/707, 340/712, 178/18, 178/19, 341/5, 341/33
• US Class Current: 345/182
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
• CPC Class Codes: G06V 10/12 Details of acquisition arrangements; Constructional details thereof
• CPC Class Codes: Y10S 345/902 Menu display

Abstract

A portable interactive electro-optic data input/output, processing, storage, and display device responsive to hand printed text and hand drawn graphics. The device preferably comprises a combined flat panel display and input pen sensing surface constructed from non-mechanical, non-emissive display elements, such as liquid crystal display elements. The device also comprises an input pen for manual entry of hand printed text and hand drawn graphics, as well as commands, directly onto the display surface for providing an electronic writing and drawing slate. The display elements themselves are preferably utilized as input pen sense locations. The flat panel display and input pen sensing surface is constructed so that there is no display distortion when the input pen is in contact with the surface. Rapid input pen sensing is provided for accommodating natural pen movement on a high resolution, large area display. A character recognition method is also associated with the device for automatic and computationally efficient on-line recognition of hand printed text characters, while accommodating a natural printing style. Hand printed text characters are recognized and preferably stored in a compact and standardized format, such as ASCII, for later display, processing, or output to external equipment, such as a printer, plotter, or computer. Graphics can also be entered and stored for later display, processing, or output to an external device, and graphics can be interspersed with text, if desired. Also, text and graphics can preferably be input to the device from external information processing equipment for display and/or processing.

Claims

1. A portable interactive electronic device for performing at least one of the functions of writing and graphics, comprising:

input pen means configured to be held in the hand of a user;

non-mechanical, non-emissive display means comprising a plurality of display elements including display electrode means for operating electro-optic material located between the display electrode means, the display means being operable in two modes, including a first mode in which the display electrode means is activated to excite the electro-optic material therebetween for displaying textual and/or graphical information and a second mode in which the display electrode means is electrically coupled with the input pen means manipulated by the user proximate the display means along a path to form information in one of the forms of text characters and graphics;

means for applying a display drive signal to the display electrode means in the first mode and for applying a relatively high-frequency signal to the display electrode means in the second mode;

pen sense control means associated with the display means and responsive to electrical coupling of the display electrode means with the input pen means in the second mode for producing position signals corresponding to positions of the input pen means with respect to the display means as the user manipulates the input pen means along the path; and

display control means connected to the pen sense control means and display means and responsive to the position signals for energizing selected display electrode means of the display elements to display at least one of the text characters and graphics corresponding to the path followed by the input pen means;

whereby information in one of the forms of text characters and graphics is hand-entered by the user directly onto the display means.

2. The device of claim 1, further comprising data memory connected to the control means for storing data representative of the position signals produced by the pen sense control means, the stored data being accessible in connection with energizing the selected display elements to display information in one of the forms of text characters and graphics.

3. The device of claim 2, further comprising data compression and decompression means incorporated into the control means and respectively responsive to the position signals for encoding the graphics as compressed data for storage in the data memory and responsive to the compressed data stored in the data memory for decoding the compressed data to display the graphics.

5. The device of claim 2, further comprising:

a plurality of function select regions incorporated into the display means, the regions being selectively activated by the user touching a given region with the input pen means, the pen sense control means being responsive to the given region being touched for producing a position signal indicative of a selected function; and

graphics processing means connected to the control means and responsive to the position signal indicative of the selected function for executing a predetermined routine.

6. The device of claim 2, further comprising:

a function select region incorporated into the display means, the region being selectively activated by the user touching the region with the input pen means, the pen sense control means being responsive to the region being touched for producing a position signal; and

data input/output means connected to the control means and responsive to the position signal produced when the region is touched for initiating exchange of data with external information processing means.

7. The device of claim 2, further comprising:

a document viewing and processing area incorporated into the display means for displaying text characters in typefont form;

a text conversion area incorporated into the display means, the input pen means being manipulated by the user proximate the text conversion area along a path comprising at least one stroke to form a discrete hand printed text character; and

character recognition means connected to the control means and responsive to the position signals for encoding the hand printed text character in a standardized format representative of a corresponding typefont text character;

the hand printed text character being displayed as the corresponding typefont text character in the document viewing and processing area.

8. The device of claim 7, further comprising data memory connected to the control means for storing data representative of the corresponding typefont text character.

9. The device of claim 8 wherein the data memory comprises at least one volatile electronic memory device.

10. The device of claim 2, further comprising:

a plurality of function select regions incorporated into the display means, the regions being selectively activated by the user touching a given region with the input pen means, the pen sense control means being responsive to the given region being touched for producing a position signal indicative of a selected function; and

text processing means connected to the control means and responsive to the position signal indicative of the selected function for executing a predetermined routine.

11. The device of claim 1, further comprising:

control means connected to the pen sense control means and display control means, the control means comprising microprocessor means and resident software, including text and graphics editing and filing software; and

data memory connected to the control system for storing data representative of text characters and graphics.

12. The device of claim 1, further comprising a portable power supply incorporated into the device.

13. The device of claim 12, further comprising data input/output means connected to the control means, the data input/output means comprising a modem for enabling exchange of data between the device and external information processing means.

20. The device of claim 1 wherein the display electrode means includes an segmented backplane.

4. A portable interactive electronic device for performing at least one of the functions of writing and graphics, comprising:

input pen means configured to be held in the hand of a user;

non-mechanical, non-emissive display means comprising a plurality of display elements including display electrode means for operating electro-optic material located between the display electrode means, the display means being operable in two modes, including a first mode in which the display electrode means is activated to excite the electro-optic material therebetween for displaying textual and/or graphical information and a second mode in which the display electrode means is electrically coupled with the input pen means manipulated by the user proximate the display means along a path to form information in one of the forms of text characters and graphics;

means for applying a display drive signal to the display means in the first mode and for applying a relatively high-frequency signal to the display means in the second mode;

pen sense control means associated with the display means and responsive to electrical coupling of the display electrode means with the input pen means in the second mode for producing position signals corresponding to positions of the input pen means with respect to the display means as the user manipulates the input pen means along the path; and

display control means connected to the pen sense control means and display means and responsive to the position signals for energizing selected display electrode means of the display elements to display at least one of the text characters and graphics corresponding to the path followed by the input pen means;

whereby information in one of the forms of text characters and graphics is hand-entered by the user directly onto the display means;

wherein the display means comprises;

an upper substrate consisting of a translucent material, the upper substrate having an exterior surface and an interior surface, the input pen means being configured to the manipulated by the user proximate the upper substrate;

a lower substrate spaced from the upper substrate, the lower substrate having an exterior surface and an interior surface;

a plurality of first electrodes and a plurality of second electrodes disposed on one of the upper and lower substrates;

display electronics comprising gating transistors and capacitors associated with the transistors, the gating transistors and capacitors being connected to the first and second electrodes; and

a backplane disposed on the other of the upper and lower substrates, so as to provide an active matrix addressed display; and

electro-optic material within an interstitial region between the upper and lower substrates; and

wherein

the pen sense control means is connected to the backplane and the input pen means and responsive to electrical coupling of the backplane with the input pen means in the second mode for producing position signals correlated to positions of the input pen means with respect to the display means as the user manipulates the input pen means; and

wherein

the display control means is connected to the first and second electrodes and responsive to the position signals in the first mode for energizing the electro-optic material to display at least one of the text characters and graphics corresponding to the path followed by the input pen means.

14. A portable interactive electronic device for performing at least one of the functions of writing and graphics, comprising:

input pen means configured to be held in the hand of a user;

non-mechanical, non-emissive display means comprising a plurality of display elements including display electrode means for operating electro-optic material located between the display electrode means, the display means being operable in two modes, including a first mode in which the display electrode means is activated to excite the electro-optic material therebetween for displaying textual and/or graphical information and a second mode in which the display electrode means is electrically coupled with the input pen means manipulated by the user proximate the display means along a path to form information in one of the forms of text characters and graphics;

pen sense control means associated with the display means and responsive to electrical coupling of the display electrode means with the input pen means for producing position signals corresponding to positions of the input pen means with respect to the display means as the user manipulates the input pen means along the path; and

display control means connected to the pen sense control means and display means and responsive to the position signals for energizing selected display electrode means of the display elements to display at least one of the text characters and graphics corresponding to the path followed by the input pen means;

whereby information in one of the forms of text characters and graphics is hand-entered by the user directly onto the display means;

wherein the display means comprises;

an upper substrate consisting of a translucent material, the upper substrate having an exterior surface and an interior surface, the input pen means being configured to be manipulated by the user proximate the upper substrate;

a lower substrate spaced from the upper substrate, the lower substrate having an exterior surface and an interior surface;

a plurality of first electrodes, each of the first electrodes having a plurality of notches;

a plurality of second electrodes, the second electrodes intersecting the first electrodes; and

electro-optic material within an interstitial region between the upper and lower electrodes; and

wherein

the pen sense control means is connected to the second electrodes and the input pen means and responsive to electrical coupling of the second electrodes with the input pen means through the notches for producing position signals correlated to positions of the input pen means with respect to crosspoints corresponding to intersections of the first and second electrodes as the user manipulates the input pen means; and

wherein

the display control means is connected to the first and second electrodes and responsive to the position signals for energizing the electro-optic material in the vicinity of corresponding crosspoints.

15. The device of claim 14 wherein the pen signal is connected to the input pen means to be transmitted by the input pen means and received by the second electrodes for producing the position signals.

16. The device of claim 14 wherein the pen signal is connected to the second electrodes to be transmitted from the vicinity of corresponding crosspoints and received by the input pen means for producing the position signals.

17. The device of claim 14 wherein the electro-optic material is liquid crystal material.

18. The device of claim 14 wherein the first electrodes are disposed on the interior surface of the upper substrate and the second electrodes are disposed on the interior surface of the lower substrate, so as to provide a passive matrix addressed display.

19. The device of claim 14 wherein the first and second electrodes are disposed on one of the upper and lower substrates, further comprising display electronics comprising gating transistors and capacitors, associated with the transistors connected to the first and second electrodes, and a backplane disposed on the other of the upper and lower substrates, so as to provide an active matrix addressed display.