ITERATIVE RECOGNITION-GUIDED THRESHOLDING AND DATA EXTRACTION

• US 20170024629A1
• Filed: 07/19/2016
• Published: 01/26/2017
• Est. Priority Date: 07/20/2015
• Status: Active Grant

• Current Assignee: Kofax Incorporated
• Original Assignee: Kofax Incorporated
• Inventors: Thrasher, Christopher W., Shustorovich, Alexander, Thompson, Stephen Michael, Amtrup, Jan W., Macciola, Anthony
• Granted Patent: US 10,242,285 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06T 2207/20104 Interactive definition of region of interest [ROI]
• CPC Class Codes: G06T 7/11 Region-based segmentation
• CPC Class Codes: G06T 7/136 involving thresholding
• CPC Class Codes: G06T 7/187 involving region growing; involving region merging; involving connected component labelling
• CPC Class Codes: G06V 10/25 Determination of region of interest [ROI] or a volume of interest [VOI]
• CPC Class Codes: G06V 10/28 Quantising the image, e.g. histogram thresholding for discrimination between background and foreground patterns
• CPC Class Codes: G06V 10/457 by analysing connectivity, e.g. edge linking, connected component analysis or slices

Abstract

Techniques for improved binarization and extraction of information from digital image data are disclosed in accordance with various embodiments. The inventive concepts include independently binarizing portions of the image data on the basis of individual features, e.g. per connected component, and using multiple different binarization thresholds to obtain the best possible binarization result for each portion of the image data independently binarized. Determining the quality of each binarization result may be based on attempted recognition and/or extraction of information therefrom. Independently binarized portions may be assembled into a contiguous result. In one embodiment, a method includes: identifying a region of interest within a digital image; generating a plurality of binarized images based on the region of interest using different binarization thresholds; and extracting data from some or all of the plurality of binarized images. Corresponding systems and computer program products are also disclosed.

Claims

1. A computer-implemented method, comprising:

identifying a region of interest within a digital image;

generating a plurality of binarized images based on the region of interest, wherein some or all of the binarized images are generated using a different one of a plurality of binarization thresholds; and

extracting data from some or all of the plurality of binarized images.

2. The computer-implemented method as recited in claim 1, wherein the region of interest comprises a plurality of connected components;

and

wherein each of the plurality of binarized images corresponds to a different combination of;

one of the plurality of connected components; and

one of the plurality of binarization thresholds.

3. The computer-implemented method as recited in claim 1, wherein the region of interest comprises a plurality of connected components;

and

wherein extracting the data is performed on a per-component basis for at least some of the plurality of connected components.

4. The computer-implemented method as recited in claim 1, wherein the region of interest comprises a plurality of connected components;

and

wherein extracting the data comprises estimating an identity of some or all of the plurality of connected components within one or more of the plurality of binarized images.

5. The computer-implemented method as recited in claim 4, comprising determining a confidence of the estimated identity of some or all of the plurality of connected components.

6. The computer-implemented method as recited in claim 5, wherein determining the confidence of the estimated identity of some or all of the plurality of connected components comprises comparing the estimated identity of each respective one of the plurality of connected components for which the identity was estimated with an expected identity of the respective one of the plurality of connected components.

7. The computer-implemented method as recited in claim 5, wherein determining the confidence of the estimated identity of some or all of the plurality of connected components comprises comparing an estimated location of each respective one of the plurality of connected components for which the identity was estimated with an expected location of the respective one of the plurality of connected components.

8. The computer-implemented method as recited in claim 5, wherein some or all of the plurality of connected components comprise non-textual information;

and

wherein determining the confidence of the estimated identity of some or all of the plurality of connected components comprises classifying some or all of the connected components for which the identity was estimated based on image features.

9. The computer-implemented method as recited in claim 5, comprising determining whether the confidence of the estimated identity of one of the plurality of connected components is less than a predetermined confidence threshold.

10. The computer-implemented method as recited in claim 9, comprising, in response to determining the confidence of the estimated identity of the one of the plurality of connected components is less than the predetermined confidence threshold, estimating the identity of the one of the plurality of connected components based on a different one of the plurality of binarized images than the one of the plurality of binarized images for which the confidence of the estimated identity of one of the plurality of connected components was determined to be less than the predetermined confidence threshold.

11. The computer-implemented method as recited in claim 1, wherein extracting the data from some or all of the plurality of binarized images comprises:

generating at least one sequence of candidate extraction results for each grouping of one or more connected components depicted within the region of interest;

determining an optimal extraction result within each sequence of candidate extraction results; and

assembling all of the optimal extraction results into a single string of the one or more connected components.

12. The computer-implemented method as recited in claim 11, wherein each sequence of candidate extraction results comprises a plurality of candidate extraction results each corresponding to the same grouping of one or more of the connected components depicted within the region of interest;

and

wherein each of the plurality of candidate extraction results in each respective sequence of candidate extraction results corresponds to a different one of the plurality of binarization thresholds.

13. The computer-implemented method as recited in claim 12, wherein at least one of the plurality of candidate results from each of at least two of the sequences of candidate extraction results correspond to a same one of the plurality of binarization thresholds.

14. The computer-implemented method as recited in claim 11, wherein determining the optimal extraction result within each sequence of candidate extraction results comprises selecting one extraction result within each sequence of candidate extraction results so as to minimize intensity differences between the optimal extraction results assembled into the single string.

15. The computer-implemented method as recited in claim 1, wherein the region of interest comprises a plurality of connected components;

and

wherein at least two of the plurality of connected components are extracted from different ones of the plurality of binarized images.

16. The computer-implemented method as recited in claim 1, comprising normalizing color within the digital image or the region of interest.

17. The computer-implemented method as recited in claim 1, comprising validating the extracted data.

18. The computer-implemented method as recited in claim 17, comprising inferring a classification of an object depicted in the digital image based on validating the extracted data.

19. A system, comprising:

a processor; and

logic integrated with and/or executable by the processor to cause the processor to;

identify a region of interest within a digital image;

generate a plurality of binarized images based on the region of interest, wherein some or all of the binarized images are generated using a different one of a plurality of binarization thresholds; and

extract data from some or all of the plurality of binarized images.

20. A computer program product, comprising a computer readable medium having embodied therewith computer readable program instructions configured to cause a processor, upon execution thereof, to:

identify, using the processor, a region of interest within a digital image;

generate, using the processor, a plurality of binarized images based on the region of interest, wherein some or all of the binarized images are generated using a different one of a plurality of binarization thresholds; and

extract, using the processor, data from some or all of the plurality of binarized images.