Systems and methods of processing scanned data

• US 9,769,354 B2
• Filed: 07/30/2015
• Issued: 09/19/2017
• Est. Priority Date: 03/24/2005
• Status: Active Grant

• Current Assignee: Kofax Incorporated
• Original Assignee: Kofax Incorporated
• Inventors: Thrasher, Christopher W., Shustorovich, Alexander, Thompson, Stephen Michael, Amtrup, Jan W., Macciola, Anthony, Borrey, Roland G., Schmidtler, Mauritius A. R., Taylor, Robert A., Fechter, Joel S., Asuri, Hari S.
• Primary Examiner(s): WASHINGTON, JAMARES
• Application Number:
  US14/814,455
• Publication Number:
  US 20160028921A1
• Time in Patent Office: 782 Days
• Field of Search: 358 19, 358 21, 358 324, 358 327, 358 111, 358518, 358519
• CPC Class Codes: G06K 15/407 Managing marking material, e.g. checking available colours
• CPC Class Codes: G06V 10/242 by image rotation, e.g. by 90 degrees
• CPC Class Codes: G06V 10/993 Evaluation of the quality of the acquired pattern
• CPC Class Codes: G06V 30/40 Document-oriented image-based pattern recognition
• CPC Class Codes: H04N 1/2338 according to user specified instructions, e.g. user selection of reproduction mode
• CPC Class Codes: H04N 1/40 Picture signal circuits H04N1/387 takes precedence
• CPC Class Codes: H04N 1/40012 Conversion of colour to monochrome
• CPC Class Codes: H04N 1/4092 Edge or detail enhancement
• CPC Class Codes: H04N 1/58 Edge or detail enhancement; Noise or error suppression, e.g. colour misregistration correction H04N1/62 takes precedence
• CPC Class Codes: H04N 1/60 Colour correction or control H04N1/54 takes precedence
• CPC Class Codes: H04N 1/6016 Conversion to subtractive colour signals
• CPC Class Codes: H04N 1/6027 Correction or control of colour gradation or colour contrast H04N1/6058 takes precedence
• CPC Class Codes: H04N 2201/0093 Facsimile machine H04N2201/0094 takes precedence

Abstract

An efficient method and system to enhance digital acquisition devices for analog data is presented. The enhancements offered by the method and system are available to the user in local as well as in remote deployments yielding efficiency gains for a large variety of business processes. The quality enhancements of the acquired digital data are achieved efficiently by employing virtual reacquisition. The method of virtual reacquisition renders unnecessary the physical reacquisition of the analog data in case the digital data obtained by the acquisition device are of insufficient quality. The method and system allows multiple users to access the same acquisition device for analog data. In some embodiments, one or more users can virtually reacquire data provided by multiple analog or digital sources. The acquired raw data can be processed by each user according to his personal preferences and/or requirements. The preferred processing settings and attributes are determined interactively in real time as well as non real time, automatically and a combination thereof.

Claims

1. A computer-implemented data processing method comprising:

receiving image data from a data acquisition device;

automatically analyzing, using a first analytic engine, at least portions of the image data to determine whether the image data is within a first set of parameters;

generating a first set of processor settings when the image data is not within the first set of parameters;

processing the image data with the first set of processor settings to generate processed data;

automatically analyzing, using a second analytic engine, at least portions of the processed data to determine whether the processed data is within a second set of parameters and if not, generating a second set of processor settings using the second analytic engine, wherein generating the second set of processor settings comprises independently identifying a binarization threshold range for each image feature depicted in the at least portions of the processed data;

reprocessing the image data using the second set of processor settings to generate reprocessed data; and

outputting at least one of the processed data and the reprocessed data;

wherein the second set of parameters is different than the first set of parameters; and

wherein the first set of processor settings and the second set of processor settings each relate to one or more image characteristics selected from;

brightness, contrast and gamma.

2. The method as recited in claim 1, further comprising performing a plurality of thresholding iterations, each thresholding iteration comprising:

the analyzing at least portions of the processed data to determine whether the processed data is within the second set of parameters, and if not, generating the second set of processor settings to reprocess the image data; and

the reprocessing the image data with the second set of processor settings to generate the reprocessed data, and

wherein for each of the plurality of thresholding iterations, the second set of processor settings comprises a different binarization threshold than a binarization threshold employed in an immediately previous thresholding iteration.

3. The method as recited in claim 2, each thresholding iteration further comprising:

extracting image features from one or more of the processed data and the reprocessed data.

4. The method as recited in claim 2, each thresholding iteration further comprising:

extracting textual information from one or more of the processed data and the reprocessed data, and the method further comprising assembling the extracted textual information from two or more of the thresholding iterations.

5. The method as recited in claim 1, further comprising performing a plurality of thresholding iterations on a per-feature basis.

6. The method as recited in claim 4, wherein the extracted textual information comprises a plurality of characters, and the method further comprising:

determining a threshold level of each of the plurality of characters from each of the two or more thresholding iterations; and

selecting a set of optimal characters based on the threshold level of each of the plurality of characters; and

wherein the assembling further comprises assembling the set of optimal characters into a composite image.

7. The method as recited in claim 1, wherein the at least portions of the image comprise one or more trouble regions identified based on a learn-by-example (LBE) training process.

8. The method as recited in claim 4, further comprising validating the extracted textual information.

9. The method as recited in claim 1, wherein the processing includes applying a color conversion algorithm, and

wherein applying the color conversion algorithm comprises normalizing intensity values across one or more color channels of the image data, the one or more color channels being selected from R, G and B.

10. The method as recited in claim 1, wherein at least one of the first set of parameters and the second set of parameters comprise a classification confidence value threshold.

11. The method as recited in claim 1, wherein each of the first set of processor settings and the second set of processor settings comprise one or more binarization thresholds.

12. The method as recited in claim 1, wherein analyzing at least portions of the image data to determine whether the image data is within the first set of parameters comprises optical character recognition (OCR).

13. The method as recited in claim 1, wherein analyzing at least portions of the image data to determine whether the image data is within the first set of parameters comprises a connected components analysis.

14. The method as recited in claim 1, wherein the at least portions of the image data comprise a plurality of regions of interest each depicting one or more image features, and the method further comprising locating the plurality of regions of interest within the image data based at least in part on a learn-by-example (LBE) training operation;

and

wherein analyzing at least portions of the image data to determine whether the image data is within the first set of parameters comprises an image classification operation based at least in part on the learn-by-example (LBE) training operation.

15. The method as recited in claim 1, further comprising inverting the image data.

16. A computer program product configured to perform data processing, the computer program product comprising a non-transitory computer readable storage medium having stored thereon computer readable program instructions configured to cause one or more processors, upon execution of the instructions, to:

receive image data from a data acquisition device;

analyze at least portions of the image data to determine whether the image data is within a first set of parameters;

generate a first set of processor settings when the image data is not within the first set of parameters;

process the image data with the first set of processor settings to generate processed data;

perform a plurality of thresholding iterations, each thresholding iteration comprising;

analyzing at least portions of the processed data to determine whether the processed data is within a second set of parameters, and if not, generating a second set of processor settings to reprocess the image data;

reprocessing the image data with the second set of processor settings to generate the reprocessed data;

extracting textual information from one or more of the processed data and the reprocessed data; and

wherein for each of the plurality of thresholding iterations, the second set of processor settings comprises a different binarization threshold than a binarization threshold employed in an immediately previous thresholding iteration; and

assemble the extracted textual information from two or more of the thresholding iterations; and

output at least one of the processed data and the reprocessed data,

wherein the second set of parameters is different than the first set of parameters, and

wherein the first set of processor settings and the second set of processor settings each relate to one or more image characteristics selected from;

brightness, contrast and gamma.

17. The computer program product as recited in claim 16, the computer readable program instructions being further configured to cause one or more processors, upon execution of the instructions, to:

perform a plurality of thresholding iterations, each thresholding iteration comprising;

analyzing at least portions of the processed data to determine whether the processed data is within the second set of parameters;

generating the second set of processor settings to reprocess the image data;

reprocessing the image data with the second set of processor settings to generate the reprocessed data; and

extracting textual information from one or more of the processed data and the reprocessed data, and

wherein for each of the plurality of thresholding iterations, the second set of processor settings comprises a different binarization threshold than a binarization threshold employed in an immediately previous thresholding iteration.

18. A computer-implemented data processing device comprising one or more processors configured to execute logic;

and

logic configured to cause at least one of the processors, upon execution of the logic, to;

receive image data from a data acquisition device;

analyze at least portions of the image data to determine whether the image data is within a first set of parameters;

generate a first set of processor settings when the image data is not within the first set of parameters;

process the image data with the first set of processor settings to generate processed data;

perform a plurality of thresholding iterations, each thresholding iteration comprising;

analyzing at least portions of the processed data to determine whether the processed data is within a second set of parameters, and if not, generating a second set of processor settings to reprocess the image data;

reprocessing the image data with the second set of processor settings to generate the reprocessed data;

extracting textual information from one or more of the processed data and the reprocessed data; and

wherein for each of the plurality of thresholding iterations, the second set of processor settings comprises a different binarization threshold than a binarization threshold employed in an immediately previous thresholding iteration; and

validate the extracted textual information; and

output at least one of the processed data and the reprocessed data,

wherein the second set of parameters is different than the first set of parameters, and

wherein the first set of processor settings and the second set of processor settings each relate to one or more image characteristics selected from;

brightness, contrast and gamma.

19. The device as recited in claim 18, further comprising logic configured to cause one or more of the processors to:

analyze at least portions of the processed data to determine whether the processed data is within the second set of parameters;

generate the second set of processor settings to reprocess the image data;

reprocess the image data with the second set of processor settings to generate the reprocessed data; and

extract textual information from one or more of the processed data and the reprocessed data, and

wherein for each of the plurality of thresholding iterations, the second set of processor settings comprises a different binarization threshold than a binarization threshold employed in an immediately previous thresholding iteration.