System for optically entering, displaying and decoding handwritten symbols

• US 4,112,415 A
• Filed: 11/22/1976
• Issued: 09/05/1978
• Est. Priority Date: 11/28/1975
• Status: Expired due to Term

• Current Assignee: Johan O. Hilbrink
• Original Assignee: Johan O. Hilbrink
• Inventors: Hilbrink, Johan O.
• Primary Examiner(s): Thesz, Joseph M.
• Application Number:
  US05/744,124
• Time in Patent Office: 652 Days
• Field of Search: 340/146.3 SY, 340/146.3 H, 340/146.3 AE, 340/146.3 MA, 340/146.3 Q, 364/200 MS File
• US Class Current: 382/189
• CPC Class Codes: G06F 3/033 Pointing devices displaced or positioned by the user , e.g. mice, trackballs, pens or joysticks; Accessories therefor digitisers characterised by the transducing means G06F3/041
• CPC Class Codes: G06V 10/12 Details of acquisition arrangements; Constructional details thereof
• CPC Class Codes: G06V 10/75 Organisation of the matching processes, e.g. simultaneous or sequential comparisons of image or video features; Coarse-fine approaches, e.g. multi-scale approaches; using context analysis; Selection of dictionaries

Abstract

An optical data entry and display system for decoding handwritten symbols into a data processing code is disclosed. The system comprises a television monitor for displaying decoded and otherwise derived symbols as well as for displaying a sequence of light spots on which a symbol may be traced by means of a light pen. The positions of the light spots comprising the trace are used in a comparison with a set of stored values defining the predetermined symbols to decode the trace.

Claims

1. An interactive optical data entry and display system for decoding a handwritten trace into a data processing code defined by a set of predetermined symbols, said system comprising:

(a) a control means for generating a signal sequence;

(b) a display responsive to said signal seequence for displaying a corresponding pattern of display elements;

(c) tracing means for making said handwritten trace on said display;

(d) sensing means in association with said control means and said tracing means for identifying, in terms of a first coordinate and a second coordinate, the positions of those display elements passed over by said tracing means while making said handwritten trace; and

(e) computing means responsive to said sensing means and said control means comprising;

i. for each of said predetermined symbols, a stored trace uniquely corresponding thereto;

ii. means for comparing said handwritten trace with each of said stored traces such that the best comparison identifies said written trace as the symbol corresponding to the stored trace which caused said best comparison;

iii. means for tabulating a first ordered list of values corresponding to those of said first coordinates identified by said handwritten trace and a second ordered list of values corresponding to those of said second coordinates identified by said hand-written trace;

iv. a plurality of matrices; and

v. calculating means for multiplying one of said matrices with said first ordered list to derive a first vector and for multiplying one of said matrices with said second ordered list to derive a second vector.

2. A system according to claim 1, wherein said control means comprises a timing circuit and a plurality of registers and wherein said display is responsive to said timing circuit such that each of said display elements is uniquely defined by a particular state of said timing circuit.

3. A system according to claim 2 wherein said display is responsive to said plurality of registers such that the display image produced by said display is defined by the contents of said plurality of registers and wherein said tracing means comprises a lightpen responsive to said display elements and said sensing means comprises a sensing circuit adapted to generate an output in response to inputs from said lightpen.

4. A system according to claim 3, wherein said computing means includes means responsive to said timing circuit and to said output of said sensing circuit wherein the states of said timing circuit corresponding to the generation of said output of said sensing circuit define a first series of values descriptive of said handwritten trace on said display .

5. A system according to claim 4, wherein each of said stored traces comprises a series of stored characteristic values uniquely identifying a corresponding one of said predetermined symbols and wherein said computing means includes means for comparing said first series of values with each of said series of stored characteristic values such that the best value comparison identifies said handwritten trace as that symbol corresponding to the series of stored characteristic values causing said best value comparison.

6. A system according to claim 1, wherein said computing means includes interpolation means for interpolating said first and second ordered lists such that their lengths are equal and wherein said plurality of matrices comprisees a simple matrix having a dimension compatible with said length of said first and second ordered lists.

7. A system according to claim 6, wherein said single matric comprises numbers such that when said single matrix is multiplied with the sampled values of a periodic function the coefficients of the Fourier Series expansion of said periodic function results.

8. A system according to claim 7, wherein said interpolation means includes means for interpolating said first and second lists such that their length is eight and wherein said single matrix is

9. A system according to claim 1, wherein said computing means includes, for each of said stored traces, a third vector with a dimension equal to the sum of the dimensions of said first and second vectors and wherein each of said third vectors uniquely identifies one of said stored traces, said computing means including means for comparing the component terms of said first and second vectors with respective terms of each of said third vectors such that the best vector comparison identifies said handwritten trace as the symbol corresponding to the third vector which caused said best vector comparison.

10. A system according to claim 9, wherein each of said third vectors comprises the coefficients of a Fourier series expansion derived from the trace of the predetermined symbol corresponding thereto.

11. A method for identifying a handwritten trace entered on a display comprising the steps of:

(a) displaying a pattern of display elements on a display;

(b) entering a handwritten trace on said display so as to identify the positions of some at least of said display elements in terms of a first coordinate and a second coordinate;

(c) tabulating a first ordered list comprising said first coordinates and a second ordered list comprising said second coordinates;

(d) interpolating said first and second ordered lists such that their lengths are equal;

(e) multiplying a matrix with said interpolated first and second ordered lists to derive respectively a first vector and a second vector;

(f) comparing said vectors with each of a series of stored vectors uniquely corresponding to one of said predetermined symbols; and

(g) identifying said handwritten trace as the symbol corresponding to the stored vector which caused the best of said comparisons.

12. A method according to claim 11, wherein said comparison step comprises the step of comparing the component terms of said first and second vectors with the respective terms of each of a series of third vectors, each of said third vectors comprising the coefficients of a Fourier Series expansion derived from said first and second coordinates of one of said predetermined symbols.

13. A method according to claim 12, wherein said identification step comprises the step of identifying the best comparision of said first and second vectors with each of said third vectors as the symbol corresponding to the third vector which caused said best comparison.

14. An interactive optical data entry and display system for decoding a handwritten trace into a data processing code defined by a set of predetermined symbols, said system comprising:

(a) a display having an effectively continuous display screen comprised of a plurality of selectively visually sensible display elements and operative to visually display any one or more of said set of predetermined symbols anywhere on said screen by patterns of said display elements;

(b) control means connected to said display for generating on said screen a pattern of visually sensible display elements forming a letterarea, said letterarea having a first pattern of visually sensible display elements forming a letterspace and a second pattern of visually sensible display elements forming a letterend;

(c) tracing means for making a handwritten trace on said display screen within said letterarea;

(d)sensing means in association with said control means and said tracing means for identifying each of said display elements of said letterspace and at least one of said display elements of said letterend passed over by said tracing means while making said handwritten trace; and

(e) computing means responsive to said sensing means and said control means and having, for each of said predetermined symbols, a stored trace uniquely corresponding thereto, said computing means including means for comparing said identified display elements of said letterspace with each of said stored traces such that the best comparison identifies a handwritten trace as the symbol corresponding to the stored trace which caused said best comparison.

15. A system according to claim 14, wherein said computing means includes additional means for selecting signal sequences for generation by said control means such that the display is caused to exhibit the symbol corresponding to said stored trace causing said best comparison.

16. A system according to claim 15, wherein said additional means includes means for selecting said signal sequence such that the corresponding pattern of display elements is caused to exhibit the symbol corresponding to said stored trace causing said best comparison only after said tracing means has passed over at least one display element of said the letterend.

17. A system according to claim 14, wherein said control means comprises means responsive to said sensing means and said sensing means includes means for selecting signal sequences for generation by said control means such that the letterspace continuously reflects said handwritten trace in progress.

18. The interactive optical data entry and display system according to claim 14 wherein said control means is operative in response to said best comparison to generate on said screen a pattern of visually sensible display elements forming the symbol corresponding to the stored trace which caused said best comparison.

19. The interactive optical data entry and display system according to claim 18 wherein said control means are operative in response to said tracing means to generate on said screen in said letterspace a pattern of visually sensible display elements corresponding to said handwritten trace.

20. A method for entering, displaying, comparing and identifying handwritten traces defined by a set of predetermined symbols comprising the steps of:

(a) causing a display screen to visually display on said screen a pattern of selectively visually sensible elements forming a letterarea, said letterarea including a first pattern of visually sensible display elements forming a letterspace and a second pattern of visually sensible display elements forming a letterend;

(c) entering on said screen and within said letterspace a desired handwritten trace;

(c) causing said letterspace to continuously reflect the in-progress condition of said desired handwritten trace;

(d) entering on said screen and within at least one of said elements of said letterend a handwritten trace completing said desired handwritten trace within said letterspace;

(e) comparing said desired completed entered handwritten trace within said letterspace with each of a series of stored traces uniquely corresponding to one of said predetermined symbols;

(f) identifying said desired completed entered handwritten trace within said letterspace as the symbol corresponding to the stored trace which caused the best of said comparisons; and

(g) causing display in the letterspace of said screen of the predetermined symbol corresponding to said stored trace causing said best comparison.