System and method to augment electronic documents with externally produced metadata to improve processing

• US 10,210,580 B1
• Filed: 07/22/2015
• Issued: 02/19/2019
• Est. Priority Date: 07/22/2015
• Status: Active Grant

• Current Assignee: Intuit, Inc.
• Original Assignee: Intuit, Inc.
• Inventors: Paulus, Wolfgang, Cabrera, Luis Felipe, Graves, Mike
• Primary Examiner(s): Chein, Allen C
• Application Number:
  US14/805,612
• Time in Patent Office: 1,308 Days
• Field of Search: None
• CPC Class Codes: G06Q 10/06 Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
• CPC Class Codes: G06Q 40/12 Accounting
• CPC Class Codes: G06Q 40/123 Tax preparation or submission
• CPC Class Codes: G10L 15/00 Speech recognition G10L17/00 takes precedence

Abstract

A method and system facilitates importation and categorization of financial documents in a financial system. The method and system include receiving source data and externally generated metadata associated with a financial document, such as a receipt of purchase. The method and system further include analyzing the metadata and categorizing the financial document based on the metadata.

Claims

1. A computing system implemented method for facilitating import of financial records of a user of a financial system, the method comprising:

receiving, with a user interface of a computing system, image data of a financial document of a user of a financial system;

receiving externally generated metadata associated with the financial document, the externally generated metadata includes audio data provided by the user indicating the nature of the financial document, the audio data including indication of one or more financial categories, the externally generated metadata further including am image of a business establishment associated with the financial document;

analyzing, by an analytics module of the computing system, the metadata, including analyzing the audio data and the image of the business establishment to determine one of more signals within the analyzed data indicating one or more characteristics or attributes of the financial document, the analysis including analyzing the image of the business establishment to determine a name of the business establishment and making a determination that the name of the business establishment corresponds to a particular category;

sorting, by the analytics module, the financial document into one or more categories based on the results of the analysis; and

providing an indication to the user of the one or more categories.

2. The method of claim 1 wherein the financial document is a receipt for a purchase of goods or services.

3. The method of claim 2 wherein sorting the financial document into a category includes sorting the financial document into a tax category.

4. The method of claim 2 wherein sorting the financial document includes sorting the financial document into one or more expense management categories.

5. The method of claim 2 wherein the source data includes an image of the receipt.

6. The method of claim 5 wherein the metadata includes an audio recording describing the receipt.

7. The method of claim 6 wherein analyzing the metadata includes analyzing the audio recording with a speech recognition module of the computing system.

8. The method of claim 1 including prompting, with a user interface of the computing system, the user to provide the metadata.

9. The method of claim 1 wherein the financial system includes a financial software application installed on a mobile computing device operated by the user.

10. The method of claim 9 wherein the mobile computing device is one of a smart phone, a tablet, a laptop computer, or an MP3 player.

11. The method of claim 9 including:

receiving, with the financial software application, the source data; and

prompting the user to provide the metadata.

12. The method of claim 11 wherein prompting the user to provide the metadata includes prompting the user to provide a voice recording describing the financial document.

13. The method of claim 12 wherein the voice recording describing the financial document is converted to digital text.

14. The method of claim 1 wherein the financial system includes a tax return preparation service.

15. The method of claim 14 wherein the financial system adjusts a tax return preparation interview based on the metadata.

16. The method of claim 1 wherein the financial system is a personal financial management system.

17. A non-transitory computer-readable medium having a plurality of computer-executable instructions which, when executed by a processor, perform a method for facilitating import of financial records of a user of a financial system, the instructions comprising:

a user interface module configured to receive source data representing a financial document of a user and externally generated metadata associated with the financial document, the externally generated metadata includes image and audio data provided by the user indicating the nature of the financial document, the audio data including indication of one or more financial categories, the externally generated metadata further including am image of a business establishment associated with the financial document; and

an analytics module configured to analyze the metadata including analyzing the image data to determine one of more signals within the analyzed data indicating one or more characteristics or attributes of the financial document, the analysis including analyzing the audio data and the image of the business establishment to determine a name of the business establishment and making a determination that the name of the business establishment corresponds to a particular category, and to sort the financial document into one or more categories based on the metadata, the user interface module being configured to provide an indication of the one or more categories to the user.

18. The computer-readable medium of claim 17, wherein the instructions further comprise a financial system which includes the user interface module and the analytics module.

19. The computer-readable medium of claim 18, wherein the financial system includes a tax return preparation system.

20. The computer-readable medium of claim 17, wherein the financial system includes a financial planning system.

21. The computer-readable medium of claim 18 including an information acquisition module configured to gather additional data from one or more of a third party database, a public database, or a financial service provider associated with the financial system and to provide the additional data to the analytics module.

22. The computer readable medium of claim 21 wherein the analytics module is configured to analyze the additional data and to sort the financial document into the one or more categories based in part on the additional data.

23. A system for facilitating import of financial records of a user of a financial system, the system comprising:

at least one processor; and

at least one memory coupled to the at least one processor, the at least one memory having stored therein instructions which, when executed by any set of the one or more processors, perform a process including;

receiving, with a user interface of a computing system, image data of a financial document of a user of a financial system;

receiving externally generated metadata associated with the financial document, the externally generated metadata includes audio data provided by the user indicating the nature of the financial document, the audio data including indication of one or more financial categories, the externally generated metadata further including am image of a business establishment associated with the financial document;

analyzing, by an analytics module of the computing system, the metadata, including analyzing the audio data and the image data to determine one of more signals within the analyzed data indicating one or more characteristics or attributes of the financial document, the analysis including analyzing the image of the business establishment to determine a name of the business establishment and making a determination that the name of the business establishment corresponds to a particular category;

sorting, by the analytics module, the financial document into one or more categories based on the results of the analysis; and

providing an indication to the user of the one or more categories.

24. The system of claim 23 wherein the financial document is a receipt for a purchase of goods or services.

25. The system of claim 24 wherein sorting the financial document into a category includes sorting the financial document into a tax category.

26. The system of claim 24 wherein sorting the financial document includes sorting the financial document into one or more spending categories.

27. The system of claim 24 wherein the source data includes an image of the receipt.

28. The system of claim 24 wherein the metadata includes a voice recording related to the receipt.

29. The system of claim 28 wherein sorting the financial document includes analyzing the voice recording with a speech recognition module of the computing system.

30. The method of claim 29 wherein the voice recording describing the financial document is converted to digital text.

31. The system of claim 23 wherein the process includes prompting the user to provide the metadata.