Financial management system categorization utilizing image or video acquired with mobile communication device

• US 9,633,385 B1
• Filed: 01/30/2012
• Issued: 04/25/2017
• Est. Priority Date: 01/30/2012
• Status: Active Grant

• Current Assignee: Intuit, Inc.
• Original Assignee: Intuit, Inc.
• Inventors: Ganjoo, Afshin
• Primary Examiner(s): Misiaszek, Michael
• Application Number:
  US13/361,130
• Time in Patent Office: 1,912 Days
• Field of Search: 705 261- 272
• CPC Class Codes: G06Q 30/0601 Electronic shopping [e-shopping]
• CPC Class Codes: G06Q 30/0623 Item investigation
• CPC Class Codes: G06Q 40/02 Banking, e.g. interest calculation or account maintenance credit or loans G06Q40/03

Abstract

Systems, methods and computer program products for item categorization. A mobile communication device such as a smartphone is utilized by a consumer to acquire an image or video of a barcode or other machine readable indicia associated with an item. The image or video is processed to identify read or scan the barcode to determine corresponding numerical data or a code, which is used to identify the specific item selected by the consumer for purchase from a merchant. The identified specific item (or image or video or associated data) is transmitted from the mobile communication device to a computer hosting a financial management system, which categorizes the item and update or generates financial reports or summaries reflecting the recent categorization data. Reports or summaries such as category or item-based budget reports can be transmitted to and displayed on a screen of the mobile communication device.

Claims

1. A computer-implemented method, comprising:

a processor or computing element of a mobile communication device

executing a financial management system application,

acquiring a digital image or video of a machine-readable representation of data associated with a specific item offered by a merchant and selected by the consumer before purchase of the specific item by the consumer from the merchant,

decoding or scanning the machine-readable representation within the digital image or video to determine data comprising a number or code identifying the specific item, and

determining the specific item selected by the consumer based at least in part upon the determined number or code;

before purchase of the specific item by the consumer from the merchant, the mobile communication device, by the financial management system application, transmitting identification of the specific item through a network to a computer hosting a financial management system that is linked to an account the consumer has with a financial institution and that is utilized by the consumer to manage the consumer'"'"'s finances;

the computer, by the financial management system,

determining a category of the specific item, determining budget data for the determined category, and

transmitting the budget data to the mobile communication device; and

the mobile communication device, by the financial management system application, displaying the budget data to the user.

2. The method of claim 1, wherein the specific item is determined by the processor or computing element of the mobile communication device looking up the determined number or code within a table.

3. The method of claim 1, wherein the computer, by the financial management system, looks up the number or code within a table hosted or accessed by the computer hosting the financial management system to categorize the specific item.

4. The method of claim 1, wherein the processor or computing element of the mobile communication device acquires the digital image or video before the consumer leaves the merchant store.

5. The method of claim 4, wherein the processor or computing element of the mobile communication device transmits the machine-readable representation data before the consumer leaves the merchant store.

6. The method of claim 1, further comprising

the mobile communication device acquiring additional digital images or videos of respective machine-readable representations of respective data associated with respective specific items offered by a merchant and selected by the consumer for purchase from the same merchant, the respective digital images or videos being acquired with the mobile communication device before respective specific items are purchased by the consumer;

the mobile communication device, by the financial management system application, transmitting respective machine-readable representation data to the computer hosting the financial management system; and

the computer, by the financial management system, categorizing respective specific items.

7. The method of claim 6, wherein a first specific item is assigned a first category, and a second specific item is assigned a second category different than the first category.

8. The method of claim 6, wherein a first specific item and a second specific item are assigned a first category, and a third specific item is assigned a second category different than the first category.

9. The method of claim 1, further comprising the mobile communication device, by the financial management system application, determining a location of the consumer, wherein the mobile communication device, by the financial management system, transmits the machine readable representation data to the computer based at least in part upon the location of the consumer.

10. The method of claim 9, wherein the mobile communication device, by the financial management system application, transmits the machine-readable representation data to the computer automatically in response to detecting that the consumer has left the merchant store.

11. The method of claim 9, wherein the processor or computing element of the mobile communication device the location of the consumer utilizing global positioning system data of the mobile communication device.

12. The method of claim 1, further comprising the mobile communication device, by the financial management system, determining a location of the consumer, wherein an acquisition session is initiated based at least in part upon the location of the consumer being the merchant store, wherein the image or video is acquired during the acquisition session and associated with the merchant at the merchant store location.

13. The method of claim 1, wherein the specific item is automatically categorized by the financial management system.

14. The method of claim 1, wherein the specific item is categorized based at least in part upon a categorization assigned to the specific item by a plurality of other users of the financial management system.

15. The method of claim 13, wherein the mobile communication device receives and displays the budget data before the specific item is purchased by the consumer.

16. The method of claim 1, wherein the machine-readable representation of data is a one-dimensional barcode, a two-dimensional barcode or a three-dimensional barcode.

17. The method of claim 1, wherein the machine-readable representation of data is a barcode, a matrix or a Quick Response (QR) code.

18. The method of claim 1, wherein the budget data determined by the financial management system and transmitted to the mobile communication device comprises:

current budget data for the determined category, and

hypothetical budget data for the determined category assuming the specific item is purchased by the consumer,

wherein both of the current budget data and the hypothetical budget data are displayed to the user through an interface generated by the financial management system application.

19. The method of claim 1, determining the category of the specific item and budget data and transmitting the budget data to the mobile communication device by the computer are performed before purchase of the specific item by the consumer from the merchant, and wherein displaying the budget data to the user by the mobile communication device is performed before purchase of the specific item by the consumer from the merchant.

20. The method of claim 1, wherein the consumer has purchased the specific item from the merchant, further comprising the computer, by the financial management system, receiving data of a completed transaction for purchase of the specific item from the linked account.

21. A computer-implemented method, comprising:

a mobile communication device

executing a financial management system application,

acquiring a digital image or video of a machine-readable representation of data associated with a specific item offered by a merchant and selected by the consumer before purchase of the specific item by the consumer from the merchant, and

decoding or scanning the machine-readable representation within the digital image or video to determine data comprising a number or code identifying the specific item;

before purchase of the specific item by the consumer from the merchant, the mobile communication device, by the financial management system application,

transmitting machine-readable representation data through a network to a computer hosting a financial management system that is linked to an account the consumer has with a financial institution and that is utilized by the consumer to manage the consumer'"'"'s finances; and

the computer, by the financial management system,

determining the specific item selected by the consumer based at least in part upon the determined number or code,

determining a category of the specific item,

determining budget data for the determined category, and

transmitting the budget data to the mobile communication device; and

the mobile communication device, by the financial management system application, displaying the budget data to the user.

22. The method of claim 21, wherein the computer, by the financial management system, looks up the number or code within a table hosted or accessed by the computer hosting the financial management system to determine the category of the specific item.

23. A computer-implemented method, comprising:

a processor or computing element of a mobile communication device

executing a financial management system application, and

acquiring a digital image or video of a machine-readable representation of data associated with a specific item offered by a merchant and selected by the consumer before purchase of the specific item by the consumer from the merchant;

before purchase of the specific item by the consumer from the merchant, the mobile communication device, by the financial management system application, transmitting the digital image or video to a computer hosting a financial management system that is linked to an account the consumer has with a financial institution and that is utilized by the consumer to manage the consumer'"'"'s finances;

the computer, by the financial management system,

decoding or scanning the machine-readable representation within the digital image or video to determine data comprising a number or code,

determining the specific item selected by the consumer based at least in part upon the determined number or code,

determining a category of the specific item,

determining budget data for the determined category, and

transmitting the budget data to the mobile communication device; and

the mobile communication device, by the financial management system application, displaying the budget data to the user.

24. The method of claim 23, the computer, by the financial management system, determining the specific item by looking up the number or code within a table hosted or accessed by the computer.

25. A computer-implemented method, comprising:

a mobile communication device

executing a financial management system application, and

acquiring a digital image or video of a machine-readable representation of data associated with a specific item offered by a merchant and selected by the consumer before purchase of the specific item by the consumer from the merchant; and

before purchase of the specific item by the consumer from the merchant, the mobile communication device, by the financial management system application,

transmitting machine-readable representation data through a network to a computer hosting a financial management system that is linked to an account the consumer has with a financial institution and that is utilized by the consumer to manage the consumer'"'"'s finances;

the computer, by the financial management system,

decoding or scanning the machine-readable representation within the digital image or video to determine data comprising a number or code,

determining the specific item selected by the consumer based at least in part upon the determined number or code,

determining a category of the specific item,

determining budget data for the determined category, and

transmitting the budget data to the mobile communication device;

the mobile communication device, by the financial management system application,

displaying the budget data to the user the mobile communication device

acquiring additional digital images or videos of respective machine-readable representations of respective data associated with respective specific items offered by a merchant and selected by the consumer for purchase from the same merchant, the respective digital images or videos being acquired with the mobile communication device before respective specific items are purchased by the consumer, and

transmitting respective machine-readable representation data to the computer hosting the financial management system; and

the computer, by the financial management system, determining respective categories of respective additional specific items.

26. The method of claim 25, wherein a first specific item is assigned a first category, and a second specific item is assigned a second category different than the first category.

27. The method of claim 25, wherein a first specific item and a second specific item are assigned a first category, and a third specific item is assigned a second category different than the first category.