Smart optical input/output (I/O) extension for context-dependent workflows

• US 10,380,237 B2
• Filed: 08/08/2017
• Issued: 08/13/2019
• Est. Priority Date: 02/10/2009
• Status: Active Grant

• Current Assignee: Tungsten Automation Corp.
• Original Assignee: Kofax Incorporated
• Inventors: Macciola, Anthony, Amtrup, Jan W.
• Primary Examiner(s): Cunningham, Gregory F
• Application Number:
  US15/672,215
• Publication Number:
  US 20170337173A1
• Time in Patent Office: 735 Days
• Field of Search: 382229
• CPC Class Codes: G06F 40/103 Formatting, i.e. changing of presentation of documents automatic justification G06F40/189; automatic line break hyphenation G06F40/191
• CPC Class Codes: G06F 40/174 Form filling; Merging
• CPC Class Codes: G06F 40/274 Converting codes to words; Guess-ahead of partial word inputs
• CPC Class Codes: G06Q 10/10 Office automation; Time management
• CPC Class Codes: G06V 10/143 Sensing or illuminating at different wavelengths
• CPC Class Codes: G06V 2201/07 Target detection
• CPC Class Codes: G06V 30/224 of printed characters having additional code marks or containing code marks
• CPC Class Codes: G06V 30/40 Document-oriented image-based pattern recognition
• CPC Class Codes: G06V 30/416 Extracting the logical structure, e.g. chapters, sections or page numbers; Identifying elements of the document, e.g. authors
• CPC Class Codes: H04N 1/40 Picture signal circuits H04N1/387 takes precedence

Abstract

Systems, methods, and computer program products for smart, automated capture of textual information using optical sensors of a mobile device, and selective provision of such textual information to a user interface for facilitating performance of downstream workflows are disclosed. The capture and provision is context-aware, and determines context of the optical input, and optionally invokes a contextually-appropriate workflow based thereon. The techniques also provide capability to normalize, correct, and/or validate the captured optical input and provide the corrected, normalized, validated, etc. information to the contextually-appropriate workflow. As a result, the overall process of capturing information from optical input using a mobile device, invoking an appropriate workflow, and providing captured information to the workflow is significantly simplified and improved in terms of accuracy of data transfer/entry, speed and efficiency of workflows, and user experience.

Claims

1. A computer-implemented method, comprising:

receiving optical input via one or more optical sensors of a mobile device;

analyzing the optical input using a processor of the mobile device to determine a context of the optical input;

determining textual information from the optical input; and

selectively providing the textual information to a user interface based on the context of the optical input.

2. The method as recited in claim 1, further comprising:

automatically invoking a contextually-appropriate workflow based on the context of the optical input.

3. The method as recited in claim 2, wherein the workflow comprises:

a telecommunications application or function;

an insurance quote;

a health care admission process;

a signing ceremony; and

/or

a financial services application configured to facilitate;

displaying at least one of an account statement, an account balance, and a payment due date;

processing a deposit;

preparing a tax return; and

/or

processing a loan application.

4. The method as recited in claim 1, further comprising either or both of:

correcting OCR errors in the textual information prior to selectively providing the textual information to the user interface; and

normalizing a format of the textual information prior to selectively providing the textual information to the user interface.

5. The method as recited in claim 1, wherein the context comprises either or both of:

a type of document represented in the optical input; and

a content of the document represented in the optical input.

6. The method as recited in claim 5, wherein the type of document is selected from the group consisting of:

a contract, a tender document, an identity document, an insurance document, a title, a quote, and a vehicle registration.

7. The method as recited in claim 5, wherein the content is selected from the group consisting of:

a driver license number, a vehicle identification number, a phone number, a social security number, a signature, a line item of an invoice, a partial or complete address, a universal resource locator, an insurance group number, a credit card number, a tracking number, a photograph, and a distribution of fields depicted on the document.

8. A computer program product comprising:

a non-transitory computer readable storage medium having program code embodied therewith, the program code readable/executable by a mobile device to;

receive optical input via one or more optical sensors of a mobile device;

analyze the optical input using a processor of the mobile device to determine a context of the optical input;

determine textual information from the optical input; and

selectively provide the textual information to a user interface based on the context of the optical input.

9. The computer program product as recited in claim 8, further comprising program code readable/executable by the mobile device to:

automatically invoke a contextually-appropriate workflow based on the context of the optical input.

10. The computer program product as recited in claim 9, wherein the workflow comprises:

a telecommunications application or function;

an insurance quote;

a health care admission process;

a signing ceremony; and

/or

a financial services application configured to facilitate one or more of;

displaying at least one of an account statement, an account balance, and a payment due date;

processing a deposit;

preparing a tax return; and

/or

processing a loan application.

11. The computer program product as recited in claim 8, further program code readable/executable by the mobile device to perform either or both of:

correcting OCR errors in the textual information prior to selectively providing the textual information to the user interface; and

normalizing a format of the textual information prior to selectively providing the textual information to the user interface.

12. The computer program product as recited in claim 8, wherein the context comprises either or both of:

a type of document represented in the optical input; and

a content of the document represented in the optical input.

13. The computer program product as recited in claim 12, wherein the type of document is selected from the group consisting of:

a contract, a tender document, an identity document, an insurance document, a title, a quote, and a vehicle registration.

14. The computer program product as recited in claim 12, wherein the content is selected from the group consisting of:

a driver license number, a vehicle identification number, a phone number, a social security number, a signature, a line item of an invoice, a partial or complete address, a universal resource locator, an insurance group number, a credit card number, a tracking number, a photograph, and a distribution of fields depicted on the document.

15. A computer program product comprising:

a non-transitory computer readable storage medium having program code embodied therewith, the program code readable/executable by a mobile device to;

receive optical input via one or more optical sensors of the mobile device;

analyze the optical input using a processor of the mobile device to determine a context of the optical input; and

automatically invoke a contextually-appropriate workflow based on the context of the optical input.

16. The computer program product as recited in claim 15, further comprising program code readable/executable by the mobile device to perform one or more either or both of:

correcting OCR errors in the optical input and providing the corrected optical input to the contextually-appropriate workflow; and

normalizing a format of the optical input and providing the normalized optical input to the contextually-appropriate workflow.

17. The computer program product as recited in claim 15, wherein the context comprises either or both of:

a type of document represented in the optical input; and

a content of the document represented in the optical input.

18. The computer program product as recited in claim 17, wherein the type of document is selected from a group consisting of:

a contract, a tender document, an identity document, an insurance document, a title, a quote, and a vehicle registration.

19. The computer program product as recited in claim 17, wherein the content is selected from the group consisting of:

a driver license number, a vehicle identification number, a phone number, a social security number, a signature, a line item of an invoice, a partial or complete address, a universal resource locator, an insurance group number, a credit card number, a tracking number, a photograph, and a distribution of fields depicted on the document.

20. The computer program product as recited in claim 15, wherein the workflow comprises:

a telecommunications application or function;

an insurance quote;

a health care admission process;

a signing ceremony; and

/or

a financial services application configured to facilitate;

displaying at least one of an account statement, an account balance, and a payment due date;

processing a deposit;

preparing a tax return; and

/or

processing a loan application.