Method and system for producing from document image a form display with blank fields and a program to input data to the blank fields

• US 5,228,100 A
• Filed: 07/10/1990
• Issued: 07/13/1993
• Est. Priority Date: 07/10/1989
• Status: Expired due to Term

• Current Assignee: Hitachi, Ltd., Hitachi Software Engineering Co., Ltd. (Hitachi, Ltd.)
• Original Assignee: Hitachi, Ltd., Hitachi Software Engineering Co., Ltd. (Hitachi, Ltd.)
• Inventors: Kuno, Yoshiaki, Yamada, Syozi, Suzuki, Hitoshi, Tsuchiya, Masayuki, Matsuda, Toshihiko, Fujise, Hiroshi, Takeda, Haruo, Koai, Ichitaro
• Primary Examiner(s): Couso, Jose L.
• Application Number:
  US07/550,521
• Time in Patent Office: 1,099 Days
• Field of Search: 382/14, 382/15, 382/22, 382/25, 382/48, 382/57, 382/61, 364/513, 364/514, 364/518, 364/523
• US Class Current: 382/175
• CPC Class Codes: G06F 40/174 Form filling; Merging
• CPC Class Codes: G06V 30/10 Character recognition
• CPC Class Codes: G06V 30/1444 Selective acquisition, locating or processing of specific regions, e.g. highlighted text, fiducial marks or predetermined fields
• CPC Class Codes: G06V 30/412 Layout analysis of documents structured with printed lines or input boxes, e.g. business forms or tables

Abstract

A data processing system for inputting data to a form display includes a scanner for inputting an image of a form document to the system, a processor for recognizing character and line patterns from the form document image supplied from the scanner to produce physical structure data of the document and logical structure data related to data input/output fields in the form document depending on the physical structure data so as to automatically produce based on the logical structure data a program to input data to the form display, a display screen for presenting thereon a form display defined by the physical structure data or normalized data obtained by correcting the physical structure data to be adaptive to a cursor pitch, a data input key apparatus, and a printer for producing a printout document based on the form display filled with the data.

Claims

1. A method of producing on a screen a form display including at least one blank field in which characters are to be written, the method comprising the steps of:

recognizing from an original form image a physical layout of a plurality of character patterns and a plurality of line patterns constituting a form;

converting the layout of the form recognized in said recognizing step into a second layout of the form including a blank field modified to correspond to an integral multiple of a basic pitch of a cursor movement responsive to input operations of characters on a display screen; and

presenting on the display screen a form display having the second layout obtained in said converting step;

wherein a character string is displayed in said blank field of the form display, said character string inputted from an input device, with a predetermined character size at a position associated with the cursor pitch.

2. A method according to claim 1, further including the steps of:

presenting on the display screen a form display comprising the character and line patterns in the physical layout recognized in said recognizing step; and

correcting in response to a user'"'"'s input operation a portion of the character or line pattern included in the form display presented on the display screen;

said converting step conducting the layout conversion on the character and line patterns corrected in said correcting step.

3. A method according to claim 1, further comprising a step of converting a form document into image data by use of an image input means,

said recognizing step being executed on the image data as said original form image.

4. A method according to claim 3, further including the steps of:

detecting an inclination of the form document based on the image data supplied from the image input means; and

correcting the inclination, said recognizing step being executed on the image data undergone the inclination correction as said original form image.

5. A method according to claim 1, wherein said recognizing step comprises:

extracting, from a plurality of character patterns included in said original form image, at least one character string constituted by a plurality of adjacent characters; and

comparing a group of standard words or terms stored beforehand in a memory with the extracted character string to automatically correct a part of the extracted character string so as to match the character string with one of said standard words or terms,

said converting step executing the layout conversion on the character and line patterns thus corrected.

6. A method or producing a form document, the method comprising the steps of:

recognizing from an original document image, a layout of character and line patterns constituting a document, and storing a recognition result as physical structure data of the document;

converting the layout of the character and line patterns recognized in said recognizing step into a second layout of a form including at least one blank field modified to correspond to an integral multiple of a basic pitch of a cursor movement responsive to an input operation of character or numeric data on a display screen and storing a conversion result as normalized document data;

presenting on the display screen a form display having the second layout created from the normalized document data;

displaying characters or numerals inputted by the user in said modified blank field in the form display; and

combining the data of characters or numerals inputted by the user in said displaying step with the physical structure data of the document and outputting a combined result to a printer, to thereby produce a form document filled with data.

7. A method according to claim 6, further including the steps of:

presenting on the display screen a form display comprising the character and line patterns corresponding to said physical structure data obtained in said recognizing step;

correcting in response to a user'"'"'s key operation a portion of the physical structure data and the character or line pattern included in the form display presented on the display screen; and

said converting step conducting the layout conversion on the character and line patterns represented by said physical structure data thus corrected.

8. A method according to claim 6, further comprising a step of converting a form document into image data by use of an image input means,

said recognizing step being executed on the image data as the original document image.

9. A method according to claim 8, further including a step of detecting an inclination of the form document based on the image data supplied from the image input means and correcting the inclination,

said recognizing step being executed on the image data which was subject to the inclination correction as the original document data.

10. A method according to claim 6, further including the steps of:

extracting, from a plurality of character patterns included in said original document image, at least one character string comprising a plurality of adjacent characters;

comparing a group of standard words or terms stored beforehand in a memory with the extracted character string to automatically correct a character pattern constituting part of the character string so as to match the character string with one of said standard words or terms;

said converting step executing the layout conversion on the layout of character and line patterns thus corrected.

11. A method of inputting data by use of a form display having a plurality of blank input/output fields in which data items are to be set, the method comprising the steps of:

recognizing a layout of character and line patterns constituting a form from an original form image to store in a memory a recognition result as physical structure data of the form;

analyzing the physical structure data to detect data input/output fields included in the form and item names associated with the respective data input/output fields;

referencing, based on the detected item names, a knowledge base to determine for each said input/output field a field attribution indicating an output source or a generation rule of data to be set thereto;

presenting on a display screen a form display created based on the physical structure data; and

achieving, for each said data input/output field included in the form display presented on the display screen, data processing associated with the field attribution thereof to set in the data input/output field a data manually supplied from the user or a data automatically generated.

12. A method according to claim 11, wherein said referencing sep determines whether the field attribution of an input/output field indicates that input data from a keyboard is set to the field, that data read from a data file is set to the field, or that data obtained through a calculation using data set at least to one of said input/output fields is set to the field.

13. A method of automatically generating a program for setting data in a form display having a plurality of blank input/output fields to be loaded with data, the method comprising the steps of:

recognizing from an image of a form document having a plurality of input/output fields, physical structure data denoting a layout of character and line patterns constituting a form document;

analyzing the physical structure data to detect a plurality of input/output fields for use in data input/output operations and at least one fixed field including therein a character string indicating an item name;

examining a positional relation between the fixed field and the input/output fields to determine for each said input/output field an item name of data to be set thereto;

determining for each input/output field, based on the item name of data and a knowledge base, a field attribution indicating an input source or a generation rule of data to be set in the input/output field; and

automatically generating a program for the user to input data to blank input/output fields of the form display presented on the display screen based on the field attributions and the physical structure data.

14. A method according to claim 13, further including the steps of:

producing from the physical structure data normalized form data having a layout of the character and line patterns converted to be adaptive to an integral multiple of a basic pitch of a cursor movement responsive to an input operation of characters on the display screen,

said analyzing step being conducted such that, in place of the physical structure data, the normalized form data is analyzed for the field recognition.

15. A method according to claim 13, wherein said analyzing step further includes the steps of:

extracting a plurality of cell regions each including a rectangular area defined by at least three side liens formed with line patterns;

determining a rectangular area in each of said cell regions as an input/output field or as a fixed field by detecting the presence or absence of any character string in each said cell region and/or by analyzing a content of the detected character string; and

detecting a particular word outside the cell region to identify a blank area adjacent to the word as an input/output field.

16. A method according to claim 14, wherein said analyzing step further includes the steps of:

extracting a plurality of cell regions each including a rectangular area defined by at least three side lines formed with line patterns;

determining a rectangular area in each of said cell regions as an input/output field or as a fixed field by detecting the presence or absence of any character string in each of said cell regions and/or by analyzing a content of the detected character string; and

detecting a particular word outside the cell regions to identify a blank area adjacent to the word as an input/output field.

17. A data processing system for inputting data to a form display presented in a display screen comprising:

first memory means for storing therein image data of a form having a plurality of blank fields in which character or numeric data are to be placed;

display means provided with a display screen for presenting the form display;

input means for inputting character and/or numeric data; and

control means for achieving a control operation such that data supplied from said input means is inputted to a blank field indicated by a cursor in the form display presented in the display screen;

said control means including;

means for recognizing based on the form image stored in said first memory means a layout of a plurality of character and line patterns constituting a form and for producing physical structure data of the form; and

means for producing normalized form data from the physical structure data of the form by modifying the layout of the character and line patterns to correspond to an integral multiple of the basic pitch of the cursor movement responsive to an input operation of character or numeric data on the display screen,

the normalized form data defining a form display to be presented on the display screen for a data input operation.

18. A system according to claim 17, further including a printer apparatus wherein:

said control means combines data inputted to the blank fields of the form display with a format defined by the physical structure data to supply the combined data to the printer apparatus.

19. A system according to claim 17, further including image input means for converting an image of a form to image data, wherein

the image data supplied from said image input means is stored in said first memory means.

20. A data processing system for inputting data to a form display presented in a display screen comprising:

first memory means for storing therein image data of a form document having a plurality of blank fields for setting therein character or numeric data;

display means provided with a display screen for presenting a form display;

input means for inputting character and/or numeric data;

second memory means for storing therein a plurality of data records;

knowledge base means loaded, for each word or term, with knowledge information of a plurality of items;

control means for achieving a control operation of data inputs to blank fields in the form display presented in the display screen;

said control means including;

first means for recognizing based on the form document image stored in said first memory means a layout of a plurality of the character and line patterns constituting a form document and for producing physical structure data of the form document;

second means for analyzing the physical structure data to detect data input fields included in the form document and item names associated with said data input fields;

third means for referencing based on the item names the knowledge base and for respectively detecting for said input field attributions indicating input sources or generation rules of data to be set to the input fields; and

fourth means for automatically producing based on the field attributions a program for inputting data to blank data input fields of the form display defined by the physical structure data and presented on the display screen, wherein

when the program is executed, data inputted from said input means by the operator, data of either one of the items included in a data record read out from said second memory means, and data obtained through a calculation are selectively set to the blank input fields of the form display.

21. A system according to claim 20, wherein:

said control means further includes fifth means for generating normalized data from the physical structure data of the form document by automatically correcting the layout of the character and line patterns so as to be adaptive to an integral multiple of the basic pitch of the cursor movement responsive to an input operation of character or numeric data on the display screen;

said second means analyzes the normalized data in place of the physical structure data; and

said fourth means automatically generates a program for inputting data to blank data input fields of the form display defined by the physical structure data and presented on the display screen.

22. A system according to claim 21, further including image input means for receiving as an input thereto an image of a form document, wherein

the form document image supplied from said image input means is stored in said first memory means.

23. A system according to claim 21, further including a printer means for producing a form document, wherein:

said control means for editing data inputted to the blank fields of the form display with a document format defined by the physical structure data, thereby supplying the edited data to the printer means.

24. A method of automatically generating a program for setting data in a form display having a plurality of blank fields to be filled with data, the method comprising the steps of:

recognizing from an image of a form document having a plurality of fields, physical structure data denoting a layout of the form document;

analyzing the physical structure data by referring to a knowledge base to obtain logical structure data denoting attributions of respective fields in said document and relations between said fields; and

automatically generating based on said logical structure data and said physical structure data a program for presenting a form display on a display screen and for setting data in blank fields of said form display in response to an user'"'"'s data input operations.

25. A method according to claim 24, the method further comprising the steps of:

presenting on the display screen the recognized data input fields with a style visually distinctive from the other portions of the form display, thereby to amend the form display by user operations if an error exists in a result of automatic recognition for the logical structure data.

26. A method according to claim 24, the method further comprising the steps of:

normalizing the layout of the form document such that each of blank fields has a size adaptive to an integral multiple of a basic pitch of a cursor movement responsive to input operations of characters or numerals on the display screen, wherein said program is generated so that data input operations by the user are carried out on the display screen presenting a form display having the normalized layout.

27. A method according to claim 24, the method further comprising the steps of:

producing a hard copy of a document including a layout of document generated from the physical structure data and having a plurality of fields filled with data inputted by the user operation on the display screen.

28. A method according to claim 24, the method further comprising the steps of:

presenting on the display screen a layout of the form display generated from said physical structure data obtained in said recognizing step; and

correcting the physical structure data in response to user operations to change a part of the form display presented in the display screen,

wherein said analyzing step and generating step are executed on the physical structure data thus corrected.

29. A method according to claim 24, the method further comprising the steps of:

normalizing the layout of the form document such that each of blank fields has a size adaptive to an integral multiple of a basic pitch of a cursor movement responsive to input operations of characters on the display screen, wherein said program is generated such that data input operations by the user are carried out on the display screen presenting a form display having the normalized layout.

30. A method according to claim 24, the method further comprising the steps of:

producing a hard copy of a document including a layout of document generated from the physical structure data and having a plurality of fields filled with data inputted by the user operation on the display screen.