System and method for processing and identifying content in form documents

• US 10,528,807 B2
• Filed: 04/12/2019
• Issued: 01/07/2020
• Est. Priority Date: 05/01/2018
• Status: Active Grant

• Current Assignee: NLP Logix LLC
• Original Assignee: Scribe Fusion LLC
• Inventors: Berseth, Matthew Thomas, Marsh, Robert Jackson
• Primary Examiner(s): Garcia, Santiago
• Application Number:
  US16/383,496
• Publication Number:
  US 20190340429A1
• Time in Patent Office: 270 Days
• CPC Class Codes: G06F 16/22 Indexing; Data structures therefor; Storage structures
• CPC Class Codes: G06F 16/285 Clustering or classification
• CPC Class Codes: G06T 2207/30176 Document
• CPC Class Codes: G06T 5/77 Retouching; Inpainting; Scratch removal
• CPC Class Codes: G06T 7/11 Region-based segmentation
• CPC Class Codes: G06T 7/194 involving foreground-background segmentation
• CPC Class Codes: G06V 30/412 Layout analysis of documents structured with printed lines or input boxes, e.g. business forms or tables
• CPC Class Codes: G06V 30/414 Extracting the geometrical structure, e.g. layout tree; Block segmentation, e.g. bounding boxes for graphics or text

Abstract

The present disclosure generally provides a system and method for processing and identifying data in form. The system and method may distinguish between content data and background data in a form. In some aspects, the content data or background data may be removed, wherein the remaining data may be processed separately. Removal of the background data or the content data may allow for more effective or efficient character recognition of the data. In some embodiments, data may be processed on an element basis, wherein each element of the form may be labeled as background data, content data, noise, or combinations thereof. This system and method may significantly increase the ability to capture and extract relevant information from a form.

Claims

1. A process for processing and identifying content in a form, the process comprising the steps of:

receiving a form set comprising a plurality of data sets, wherein each of the plurality of data sets populate at least a first form in the form set, and wherein each form in the form set and each data set in the plurality of data sets comprises a plurality of elements;

processing at least a portion of the form set and a portion of the plurality of data sets that populate the portion of the form set through a first artificial entity; and

identifying any combination of one or more noise, background data, and content data without character recognition for each form in the portion of the form set and the portion of the plurality of data sets, wherein the identifying labels each element of the portion of the form set and the portion of the plurality of data sets as at least one of noise, background data, or content data.

2. The process of claim 1, wherein processing comprises the steps of:

segmenting each form in the portion of the form set, wherein the identifying occurs for each segment; and

reassembling each form in the portion of the form set.

3. The process of claim 1, wherein the plurality of data sets comprises one or both synthetic data and authentic data.

4. The process of claim 1, wherein the form set comprises one or both synthetic forms and authentic forms.

5. The process of claim 1, wherein the form set comprises a plurality of form types, and the process further comprises identifying a plurality of form types for at least the portion of the form set.

6. The process of claim 1, further comprising the process step of inpainting missing elements, wherein the inpainting increases a legibility of one or both background data or content data.

7. The process of claim 1, further comprising the step of removing the content data for each form in the portion of the form set and the portion of the plurality of data sets.

8. The process of claim 7, wherein removing the content data prepares each form in the portion of the form set and the portion of the plurality of data sets for recognition of the background data.

9. The process of claim 7, wherein the removing occurs through a second artificial entity.

10. The process of claim 1, further comprising the step of removing the background data for each form in the portion of the form set and the portion of the plurality of data sets.

11. The process of claim 10, wherein removing the background data prepares each form in the portion of the form set and the portion of the plurality of data sets for recognition of the content data.

12. The process of claim 10, wherein the removing occurs through a second artificial entity.

13. The process of claim 1, further comprising the process step of categorizing at least a portion of the content data.

14. The process of claim 13, wherein the categorizing occurs through a second artificial entity.

15. The process of claim 13, wherein categorizing creates separable layers that, when separate, allows for increased recognition of at least a portion of the content data.

16. The process of claim 1, wherein at least some of one or both the background data and the form set are indexed, wherein indexing associates at least one form type with the portion of one or both the background data and the form set.

17. The process of claim 16, further comprising the process step of indexing a first portion of one or both the background data and the form set.

18. The process of claim 17, wherein the indexing occurs through a second artificial entity.

19. The process of claim 17, wherein the indexing occurs through the first artificial entity.