System and method for processing receipts and other records of users

• US 9,196,006 B2
• Filed: 09/17/2014
• Issued: 11/24/2015
• Est. Priority Date: 05/10/2011
• Status: Active Grant

• Current Assignee: Expensify Incorporated
• Original Assignee: Expensify Incorporated
• Inventors: Barrett, David M., Kuchta, Kevin Michael
• Primary Examiner(s): Park, Chan
• Assistant Examiner(s): RICE, ELISA M
• Application Number:
  US14/489,357
• Publication Number:
  US 20150003734A1
• Time in Patent Office: 433 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: G06Q 20/045 using payment protocols involving tickets
• CPC Class Codes: G06Q 40/02 Banking, e.g. interest calculation or account maintenance credit or loans G06Q40/03
• CPC Class Codes: G06Q 40/12 Accounting
• CPC Class Codes: G06V 10/98 Detection or correction of errors, e.g. by rescanning the pattern or by human intervention; Evaluation of the quality of the acquired patterns
• CPC Class Codes: G06V 30/224 of printed characters having additional code marks or containing code marks
• CPC Class Codes: G06V 30/413 Classification of content, e.g. text, photographs or tables

Abstract

A service can perform optical character recognition (OCR) on an image of a record to determine a first set of information items about the record. A second set of information items can be identified that are likely part of the record but not determinable from performing OCR on the image. Another resource can be utilized to determine the second set of information items. A classification for the record can be determined based on first and second sets of information items. The record can be associated with a financial resource of the user based at least in part on the classification.

Claims

1. A method for determining record information, the method being implemented by one or more processors and comprising the steps of:

receiving a low quality image of a record from a user;

communicating the low quality image to one or more resources for recognizing characters from images, in order to determine a first set of information items provided on the image;

identifying a second set of information items that are likely part of the record but not determinable from characters provided on the image;

utilizing another resource to determine the second set of information items;

determining a classification for the record based on the first and second sets of information items; and

associating the record with a financial resource of the user based at least in part on the classification;

wherein utilizing another resource includes;

(i) scanning a plurality of transactions recorded with one or more financial accounts of the user;

(ii) identifying at least a first transaction that is relevant to the record, based on the first set of information items; and

(iii) identifying the second set of information items from information provided with the at least first transaction.

2. The method of claim 1, wherein the second set of information items includes one or more of a merchant, a transaction value, or a date of a transaction from scanning the plurality of transactions.

3. The method of claim 1, wherein utilizing another resource includes querying a merchant or entity database using information that is determined from the first set of information items.

4. The method of claim 1, wherein the determining the classification includes determining that the image is a particular type of financial receipt.

5. The method of claim 1, wherein associating the record with the financial resource includes associating the record with a financial account of the user.

6. The method of claim 1, wherein associating the record with the financial resource includes identifying the record as being a cash transaction.

7. A non-transitory computer-readable medium that stores instructions, which when executed by one or more processors of a computer system, cause the computer system to perform operations that include:

receiving a low quality image of a record from a user;

communicating the low quality image to one or more resources for recognizing characters from images, in order to determine a first set of information items provided on the image;

identifying a second set of information items that are likely part of the record but not determinable from characters provided on the image;

utilizing another resource to determine the second set of information items;

determining a classification for the record based on the first and second sets of information items; and

associating the record with a financial resource of the user based at least in part on the classification;

wherein utilizing another resource includes;

(i) scanning a plurality of transactions recorded with one or more financial accounts of the user;

(ii) identifying at least a first transaction that is relevant to the record, based on the first set of information items; and

(iii) identifying the second set of information items from information provided with the at least first transaction.

8. The non-transitory computer-readable medium of claim 7, wherein the second set of information items includes one or more of a merchant, a transaction value, or a date of a transaction from scanning the plurality of transactions.

9. The non-transitory computer-readable medium of claim 7, wherein utilizing another resource includes querying a merchant or entity database using information that is determined from the first set of information items.

10. The non-transitory computer-readable medium of claim 7, wherein the determining the classification includes determining that the image is a particular type of financial receipt.

11. The non-transitory computer-readable medium of claim 7, wherein associating the record with the financial resource includes associating the record with a financial account of the user.

12. The non-transitory computer-readable medium of claim 7, wherein associating the record with the financial resource includes identifying the record as being a cash transaction.