Smart optical input/output (I/O) extension for context-dependent workflows

• US 9,747,269 B2
• Filed: 04/20/2016
• Issued: 08/29/2017
• Est. Priority Date: 02/10/2009
• Status: Active Grant

• Current Assignee: Kofax Incorporated
• Original Assignee: Kofax Incorporated
• Inventors: Macciola, Anthony, Amtrup, Jan W.
• Primary Examiner(s): Cunningham, Gregory F
• Application Number:
  US15/134,318
• Publication Number:
  US 20160232149A1
• Time in Patent Office: 496 Days
• Field of Search: 382229
• CPC Class Codes: G06F 40/103 Formatting, i.e. changing of presentation of documents automatic justification G06F40/189; automatic line break hyphenation G06F40/191
• CPC Class Codes: G06F 40/174 Form filling; Merging
• CPC Class Codes: G06F 40/274 Converting codes to words; Guess-ahead of partial word inputs
• CPC Class Codes: G06Q 10/10 Office automation; Time management
• CPC Class Codes: G06V 10/143 Sensing or illuminating at different wavelengths
• CPC Class Codes: G06V 2201/07 Target detection
• CPC Class Codes: G06V 30/224 of printed characters having additional code marks or containing code marks
• CPC Class Codes: G06V 30/40 Document-oriented image-based pattern recognition
• CPC Class Codes: G06V 30/416 Extracting the logical structure, e.g. chapters, sections or page numbers; Identifying elements of the document, e.g. authors
• CPC Class Codes: H04N 1/40 Picture signal circuits H04N1/387 takes precedence

Abstract

Systems, methods, and computer program products for smart, automated capture of textual information using optical sensors of a mobile device are disclosed. The capture and provision is context-aware, and determines context of the optical input, and invokes a contextually-appropriate workflow based thereon. The techniques also provide capability to normalize, correct, and/or validate the captured optical input and provide the corrected, normalized, validated, etc. information to the contextually-appropriate workflow. Other information necessary by the workflow and available to the mobile device optical sensors may also be captured and provided, in a single automatic process. As a result, the overall process of capturing information from optical input using a mobile device, invoking an appropriate workflow, and providing captured information to the workflow is significantly simplified and improved in terms of accuracy of data transfer/entry, speed and efficiency of workflows, and user experience.

Claims

1. A method, comprising:

receiving optical input via one or more optical sensors of a mobile device;

analyzing the optical input using a processor of the mobile device to determine a context of the optical input; and

automatically invoking a contextually-appropriate workflow based on the context of the optical input.

2. The method as recited in claim 1, comprising one or more of:

correcting OCR errors in the optical input and providing the corrected optical input to the contextually-appropriate workflow; and

normalizing a format of the optical input and providing the normalized optical input to the contextually-appropriate workflow.

3. The method as recited in claim 1, wherein the context comprises one or more of:

a type of document represented in the optical input; and

a content of the document represented in the optical input.

4. The method as recited in claim 3, wherein the type of document is selected from a group consisting of:

a contract, a tender document, an identity document, an insurance document, a title, a quote, and a vehicle registration.

5. The method as recited in claim 3, wherein the content is selected from:

a driver license number, a vehicle identification number, a phone number, a social security number, a signature, a line item of an invoice, a partial or complete address, a universal resource locator, an insurance group number, a credit card number, a tracking number, a photograph, and a distribution of fields depicted on the document.

6. The method as recited in claim 1, wherein the workflow comprises one or more of a telecommunications application or function;

an insurance quote;

a health care admission process;

a signing ceremony; and

a financial services application configured to facilitate one or more of;

displaying at least one of an account statement, an account balance, and a payment due date;

processing a deposit;

preparing a tax return; and

processing a loan application.

7. The method as recited in claim 6, wherein the context of the optical input is determined to be automobile-related based at least in part on detecting the optical input comprises a driver license number and a vehicle identification number;

and

wherein the contextually-appropriate workflow comprises the insurance quote, wherein the quote is for automobile insurance.

8. The method as recited in claim 6, wherein the context of the optical input is determined to be automobile-related based at least in part on detecting the optical input comprises a driver license number, a signature, and a photograph;

and

wherein the contextually-appropriate workflow comprises the insurance quote, wherein the quote is for automobile insurance.

9. The method as recited in claim 6, wherein the context of the optical input is determined to be financial services based at least in part on detecting the optical input comprises a document depicting a signature and one or more of an account number and a deposit amount;

and

wherein the contextually-appropriate workflow comprises the deposit.

10. The method as recited in claim 6, wherein the context of the optical input is determined to be financial services based at least in part on detecting the optical input comprises a document depicting a signature and a particular font;

and

wherein the contextually-appropriate workflow comprises the deposit.

11. The method as recited in claim 6, wherein the context of the optical input is determined to be financial services based at least in part on detecting the optical input comprises a credit card number;

and

wherein the contextually-appropriate workflow comprises the financial services application configured to display at least one of the account statement, the account balance, and the payment due date.

12. The method as recited in claim 6, wherein the context of the optical input is determined to be financial services based at least in part on detecting the optical input comprises a social security number;

and

wherein the contextually-appropriate workflow comprises the financial services application configured to facilitate preparing a tax return.

13. The method as recited in claim 6, wherein the context of the optical input is determined to be financial services based at least in part on detecting the optical input comprises a signature and a distribution of fields corresponding to a loan agreement;

and

wherein the contextually-appropriate workflow comprises the signing ceremony.

14. The method as recited in claim 6, wherein the context of the optical input is determined to be financial services based at least in part on detecting the optical input comprises a signature and a distribution of fields corresponding to a loan agreement;

and

wherein the contextually-appropriate workflow comprises the financial services application configured to facilitate processing the loan application.

15. The method as recited in claim 6, wherein the context of the optical input is determined to be health care-related based at least in part on detecting the optical input comprises one or more of:

a health insurance provider name, a policyholder name, and an insurance group number; and

wherein the contextually-appropriate workflow comprises one or more of the health care admission process and the insurance quote, wherein the insurance quote is a quote for health insurance.

16. The method as recited in claim 6, wherein the context of the optical input is determined to be Internet browsing based at least in part on detecting the optical input comprises a universal resource locator (URL);

and

wherein the contextually-appropriate workflow comprises a browser application.

17. The method as recited in claim 6, wherein the context of the optical input is determined to be an enterprise service based at least in part on detecting the optical input comprises an invoice;

and

wherein the contextually-appropriate workflow comprises an enterprise application configured to display a status of the invoice.

18. The method as recited in claim 6, wherein the context of the optical input is determined to be telecommunications based at least in part on detecting the optical input comprises a phone number;

and

wherein the contextually-appropriate workflow comprises the telecommunications application or function.

19. A mobile device comprising a processor and logic configured to cause the processor to:

receive optical input via one or more optical sensors of a mobile device;

analyze the optical input using the processor to determine a context of the optical input; and

automatically invoke a contextually-appropriate workflow based on the context of the optical input.

20. A computer program product comprising:

a non-transitory computer readable storage medium having program code embodied therewith, the program code readable/executable by a processor of a mobile device to;

receive optical input via one or more optical sensors of a mobile device;

analyze the optical input using the processor to determine a context of the optical input; and

automatically invoke a contextually-appropriate workflow based on the context of the optical input.