Character recognizing device, image reading device, character recognizing method, and program product

• US 20010043740A1
• Filed: 05/17/2001
• Published: 11/22/2001
• Est. Priority Date: 05/17/2000
• Status: Abandoned Application

• Current Assignee: Minolta Corporation Limited (Konica Minolta Inc.)
• Original Assignee: Minolta Corporation Limited (Konica Minolta Inc.)
• Inventors: Tanaka, Yoshinori, Ichikawa, Yukihiko
• Application Number:
  US09/858,946
• Publication Number:
  US 20010043740A1
• Time in Patent Office: Days
• US Class Current: 382/176
• CPC Class Codes: G06V 30/10 Character recognition
• CPC Class Codes: G06V 30/274 Syntactic or semantic context, e.g. balancing
• CPC Class Codes: G06V 30/412 Layout analysis of documents structured with printed lines or input boxes, e.g. business forms or tables

Abstract

The digital copying machine 14 includes the character recognizing unit 31 that recognizes character strings included in table areas extracted from the image, the table operational unit 34 that calculates based on the numerical data obtained by converting character strings consisting of numbers and the operational expressions defined according to the specific character strings, and the verification unit 35 that compares the calculated values calculated by the table operational unit 34 with the numerical data to be verified. If a calculated value and a corresponding numerical data do not match, the control unit 26 notifies the user about the mismatch. The user can easily check recognition errors of numbers or errors in preparing the original document.

Claims

1. A character recognition device comprising:

an extracting unit that extracts table areas from an image;

a character recognizing unit that recognizes character strings included in said table areas;

a converting unit that converts character strings consisting of numbers from the recognized character strings into numerical data;

a defining unit that defines operational expressions based on specific character strings from the recognized character strings;

an operational unit that calculates based on said numerical data and said operational expressions;

a comparing unit that compares calculated value provided by said operational unit with said numerical data; and

a reporting unit that reports mismatches when there are mismatches between said calculated value and said numerical data.

2. The character recognition device of the

claim 1

wherein,

said reporting unit changes color attributes of character strings of which said calculated value do not match with said numerical data.

3. The character recognition device of the

claim 1

further comprising:

a first memory unit that stores multiple table formats;

a second memory unit that stores operational expressions corresponding to each table format; and

a selecting unit that selects one of the table formats based on positional relations between rectangular frames in said table area and the recognized character strings.

4. The character recognition device of the

claim 3

wherein,

said defining unit retrieve operational expressions that correspond to the table format selected by said selecting unit from said second memory unit.

5. The character recognition device of the

claim 4

further comprising:

a first setup unit that sets up multiple table formats containing character strings that specify table structures and operation types; and

a second setup unit that sets up operational expressions for each table format.

6. The character recognition device of the

claim 1

further comprising:

a first memory unit that stores character strings that specify types of operations;

a second memory unit that stores operational expressions corresponding to character strings that specify types of operations; and

a selecting unit that selects operational expressions with matching character strings that specify types of operations based on the recognized character strings.

7. The character recognition device of the

claim 6

wherein,

said defining unit retrieve operational expressions selected by said selecting unit from said second memory unit.

8. The character recognition device of the

claim 7

further comprising:

a first setup unit that sets up character strings that specify types of operations; and

a second setup unit that sets up operational expressions corresponding to character strings that specify types of operations.

9. The character recognition device of the

claim 6

further comprising:

an identifying unit that identifies positions where character strings that specify types of operations.

10. The character recognition device of the

claim 9

wherein,

said operational unit calculates according to the defined operational expressions in the column direction if said character strings exist in row labels that represent row headings in the table.

11. The character recognition device of the

claim 9

wherein,

said operational unit calculates according to the defined operational expression in the row direction if said character strings exist in column labels that represents column headings in the table.

12. The character recognition device of the

claim 1

wherein,

said character strings that specify types of operations contain “

average,”

“

total,”

“

sum,”

or “

subtotal.”

13. An image reading device comprising:

a reading unit that reads a document and outputs its image data;

an extracting unit that extracts table areas from the outputted image data;

a character recognizing unit that recognizes character strings included in said table areas;

a converting unit that converts character strings consisting of numbers from the recognized character strings into numerical data;

a defining unit that defines operational expressions based on specific character strings from the recognized character strings;

an operational unit that calculates based on said numerical data and said operational expressions;

a comparing unit that compares calculated value provided by said operational unit with said numerical data;

a forming unit that forms an image that reports mismatches when there are mismatches between said calculated value and said numerical data; and

an output unit that outputs the image formed by the forming unit.

14. The image reading device of the

claim 13

further comprising:

a printing unit that prints the image outputted from said output unit.

15. The image reading device of the

claim 13

wherein,

said forming unit changes color attributes of a character string of which said calculated value do not match with said numerical data.

16. The image reading device of the

claim 13

further comprising:

a first memory unit that stores multiple table formats;

a second memory unit that stores operational expressions corresponding to each table format; and

a selecting unit that selects one of the table formats based on positional relations between rectangular frames in said table area and the recognized character strings.

17. The image reading device of the

claim 16

wherein,

said defining unit retrieve operational expressions that correspond to the table format selected by said selecting unit from said second memory unit.

18. The image reading device of the

claim 17

further comprising:

a first setup unit that sets up multiple table formats containing character strings that specify table structures and operation types; and

a second setup unit that sets up operational expressions for each table format.

19. The image reading device of the

claim 13

further comprising:

a first memory unit that stores character strings that specify types of operations;

a second memory unit that stores operational expressions corresponding to character strings that specify types of operations; and

a selecting unit that selects operational expressions with matching character strings that specify types of operations based on the recognized character strings.

20. The image reading device of the

claim 19

wherein,

said defining unit retrieve operational expressions selected by said selecting unit from said second memory unit.

21. The image reading device of the

claim 20

further comprising:

a first setup unit that sets up character strings that specify types of operations; and

a second setup unit that sets up operational expressions corresponding to character strings that specify types of operations.

22. The image reading device of the

claim 19

further comprising:

an identifying unit that identifies positions where character strings that specify types of operations.

23. The image reading device of the

claim 22

wherein,

said operational unit calculates according to the defined operational expressions in the column direction if said character strings exist in row labels that represent row headings in the table.

24. The image reading device of the

claim 22

wherein,

said operational unit calculates according to the defined operational expression in the row direction if said character strings exist in column labels that represents column headings in the table.

25. The image reading device of the

claim 13

wherein,

said character strings that specify types of operations contain “

average,”

“

total,”

“

sum,”

or “

subtotal.”

26. A character recognition device comprising:

an extracting unit that extracts table areas from an image;

a character recognizing unit that recognizes character strings included in said table areas; and

an identifying means that identifies recognition errors committed by said character recognizing unit;

wherein,

said identifying means including;

a converting unit that converts character strings consisting of numbers from the recognized character strings into numerical data;

a defining unit that defines operational expressions based on specific character strings from the recognized character strings;

an operational unit that calculates based on said numerical data and said operational expressions; and

a comparing unit that compares calculated value provided by said operational unit with said numerical data.

27. An image reading device comprising:

a reading unit that reads a document and outputs its image data;

an extracting unit that extracts table areas from the outputted image data;

a character recognizing unit that recognizes character strings included in said table areas; and

an identifying means that identifies recognition errors committed by said character recognizing unit;

wherein,

said identifying means including;

a converting unit that converts character strings consisting of numbers from the recognized character strings into numerical data;

a defining unit that defines operational expressions based on specific character strings from the recognized character strings;

an operational unit that calculates based on said numerical data and said operational expressions; and

a comparing unit that compares calculated value provided by said operational unit with said numerical data.

28. A character recognition method comprising the steps of:

1) extracting table areas from an image;

2) recognizing character strings included in said table areas;

3) converting character strings consisting of numbers from the recognized character strings into numerical data;

4) defining operational expressions based on specific character strings from the recognized character strings;

5) calculating based on said numerical data and said operational expressions;

6) comparing calculated value with said numerical data; and

7) reporting mismatches when there are mismatches between said calculated value and said numerical data.

29. A storage medium readable by a computer for storing a program operable to recognize characters, the program comprising:

an extracting means that extracts table areas from an image;

a character recognizing means that recognizes character strings included in said table areas;

a converting means that converts character strings consisting of numbers from the recognized character strings into numerical data;

a defining means that defines operational expressions based on specific character strings from the recognized character strings;

an operational means that calculates based on said numerical data and said operational expressions;

a comparing means that compares calculated value provided by said operational means with said numerical data; and

a reporting means that reports mismatches when there are mismatches between said calculated value and said numerical data.

30. A computer program product for recognizing characters, the computer program products comprising:

a computer usable medium having computer readable program means embodied in said medium, said computer readable program means comprising;

an extracting means that extracts table areas from an image;

a character recognizing means that recognizes character strings included in said table areas;

a converting means that converts character strings consisting of numbers from the recognized character strings into numerical data;

a defining means that defines operational expressions based on specific character strings from the recognized character strings;

an operational means that calculates based on said numerical data and said operational expressions;

a comparing means that compares calculated value provided by said operational means with said numerical data; and

a reporting means that reports mismatches when there are mismatches between said calculated value and said numerical data.