POPULATING BUDGETS AND/OR WISH LISTS USING REAL-TIME VIDEO IMAGE ANALYSIS

• US 20120233015A1
• Filed: 02/03/2012
• Published: 09/13/2012
• Est. Priority Date: 03/08/2011
• Status: Active Grant

• Current Assignee: Bank of America Corp.
• Original Assignee: Bank of America Corp.
• Inventors: Calman, Matthew A., Ross, Erik Stephen
• Granted Patent: US 9,317,835 B2
• Time in Patent Office: Days
• US Class Current: 705/26.8
• CPC Class Codes: G06Q 10/10 Office automation; Time management
• CPC Class Codes: G06Q 30/02 Marketing; Price estimation or determination; Fundraising
• CPC Class Codes: G06Q 30/06 Buying, selling or leasing transactions
• CPC Class Codes: G06Q 30/0613 Third-party assisted
• CPC Class Codes: G06Q 30/0633 Lists, e.g. purchase orders, compilation or processing
• CPC Class Codes: G06Q 30/0641 Shopping interfaces
• CPC Class Codes: G06Q 30/0643 Graphical representation of items or shoppers
• CPC Class Codes: G06Q 40/02 Banking, e.g. interest calculation or account maintenance credit or loans G06Q40/03
• CPC Class Codes: G06Q 40/12 Accounting
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06V 20/20 in augmented reality scenes
• CPC Class Codes: G06V 20/46 Extracting features or characteristics from the video content, e.g. video fingerprints, representative shots or key frames

Abstract

System, method, and computer program product are provided for using real-time video analysis, such as augmented reality to provide the user of a mobile device with real-time budgeting and wish lists. Through the use of real-time vision object recognition objects, logos, artwork, products, locations, and other features that can be recognized in the real-time video stream can be matched to data associated with such to provide the user with real-time budget impact and wish list updates based on the products and budget data determined as being the object. In this way, the objects, which may be products and/or budget data in the real-time video stream, may be included into a user'"'"'s budget and/or wish list, such that the user receives real-time budget and/or wish list updates incorporating product and/or budget data located in a real-time video stream.

Claims

1. A method for populating a user directory, the method comprising:

receiving financial information for a user, wherein the financial information provides an indication of financial history of the user;

identifying, by a computer device processor, one or more products proximate in location to a mobile device;

determining a location in the user directory to populate with the one or more products, wherein the user directory comprise at least one of a user budget or a user wish list;

receiving information about one or more products in the user directory, wherein the information about one or more products comprises a price associated with the one or more products;

presenting, via the mobile device, a selectable indicator associated with the product, wherein the indicators provides real-time impact on the user directory based at least in part on the information about the one or more products identified proximate in location to the mobile device; and

providing access to the user directory by selection of the indicator associated with the product, such that the at least one of the user budget or the user wish list is accessible.

2. The method of claim 1 further comprises providing the user with real-time loan procurement for purchasing the one or more products proximate in location to the mobile device, wherein the real-time loan procurement is based at least in part on the receiving of financial information for a user.

3. The method of claim 1, wherein the real-time impact on the user directory further comprises the real-time impact that purchasing the one or more products proximate in location to the mobile device would have on the at least one of the user budget or the user wish list.

4. The method of claim 3, further comprising providing a communicable link between the user and a financial advisor, via the mobile device, such that the financial advisor can advise the user based on the real-time impact that purchasing one or more products proximate in location to the mobile device would have on the user budget and the user wish list.

5. The method of claim 1, wherein identifying one or more products further comprises capturing, via the mobile device, images of the one or more products.

6. The method of claim 5, wherein capturing images further comprises implementing, via a computer device processor, object recognition processing to identify one or more images that correspond to one or more products.

7. The method of claim 1, wherein identifying one or more products further comprises capturing a tag located on or proximate to one or more of the products and reading the tag to identify the product.

8. The method of claim 1, wherein identifying one or more products further comprises capturing real-time video of the one or more products.

9. The method of claim 1, wherein the user directory further comprises the user budget and the user wish list.

10. The method of claim 1, further comprising developing a budget strategy, wherein the budget strategy is based at least in part on said receiving financial information for the user, wherein the receiving financial information comprises at least one of user transaction history, user income, user financial plans, or user personal plans.

11. The method of claim 1, wherein presenting an indicator associated with the one or more products further comprises superimposing the indicator over real-time video that is captured by the mobile device, wherein the indicator is selectable by the user.

12. The method of claim 1, wherein one or more products further comprise budget data, wherein budget data includes financial documents that influence the user budget or user wish list.

13. A system for populating a user directory, the system comprising:

a memory device with computer-readable program code stored thereon;

a communication device;

a processing device operatively coupled to the memory device and the communication device, wherein the processing device is configured to execute the computer-readable program code to;

receive financial information for a user, wherein the financial information provides an indication of financial history of the user;

identify one or more products proximate in location to a mobile device;

determine a location in the user directory to populate with the one or more products, wherein the user directory comprise at least one of a user budget or a user wish list;

receive information about one or more products in the user directory, wherein the information about one or more products comprises a price associated with the one or more products;

present, via the mobile device, a selectable indicator associated with the product, wherein the indicators provides real-time impact on the user directory based at least in part on the information about the one or more products identified proximate in location to the mobile device; and

provide access to the user directory by selection of the indicator associated with the product, such that the at least one of the user budget or the user wish list is accessible.

14. The system of claim 13 further comprises providing the user with real-time loan procurement for purchasing the one or more products proximate in location to the mobile device, wherein the real-time loan procurement is based at least in part on the receiving of financial information for a user.

15. The system of claim 13, wherein the real-time impact on the user directory further comprises the real-time impact that purchasing the one or more products proximate in location to the mobile device would have on the at least one of the user budget or the user wish list.

16. The system of claim 15, further comprising providing a communicable link between the user and a financial advisor, via the mobile device, such that the financial advisor can advise the user based on the real-time impact that purchasing one or more products proximate in location to the mobile device would have on the user budget and the user wish list.

17. The system of claim 13, wherein identifying one or more products further comprises capturing, via the mobile device, images of the one or more products.

18. The system of claim 17, wherein capturing images further comprises implementing, via a computer device processor, object recognition processing to identify one or more images that correspond to one or more products.

19. The system of claim 13, wherein identifying one or more products further comprises capturing a tag located on or proximate to one or more of the products and reading the tag to identify the product.

20. The system of claim 13, wherein identifying one or more products further comprises capturing real-time video of the one or more products.

21. The system of claim 13, wherein the user directory further comprises the user budget and the user wish list.

22. The system of claim 13, further comprising developing a budget strategy, wherein the budget strategy is based at least in part on said receiving financial information for the user, wherein the receiving financial information comprises at least one of user transaction history, user income, user financial plans, or user personal plans.

23. The system of claim 13, wherein presenting an indicator associated with the one or more products further comprises superimposing the indicator over real-time video that is captured by the mobile device, wherein the indicator is selectable by the user.

24. The system of claim 13, wherein one or more products further comprise budget data, wherein budget data includes financial documents that influence the user budget or user wish list.

25. A computer program product for populating a user directory, the computer program product comprising at least one non-transitory computer-readable medium having computer-readable program code portions embodied therein, the computer-readable program code portions comprising:

an executable portion configured for receiving financial information for a user, wherein the financial information provides an indication of financial history of the user;

an executable portion configured for identifying one or more products proximate in location to a mobile device;

an executable portion configured for determining a location in the user directory to populate with the one or more products, wherein the user directory comprise at least one of a user budget or a user wish list;

an executable portion configured for receiving information about one or more products in the user directory, wherein the information about one or more products comprises a price associated with the one or more products;

an executable portion configured for presenting, via the mobile device, a selectable indicator associated with the product, wherein the indicators provides real-time impact on the user directory based at least in part on the information about the one or more products identified proximate in location to the mobile device; and

an executable portion configured for providing access to the user directory by selection of the indicator associated with the product, such that the at least one of the user budget or the user wish list is accessible.

26. The computer program product of claim 25 further comprises an executable portion configured for providing the user with real-time loan procurement for purchasing the one or more products proximate in location to the mobile device, wherein the real-time loan procurement is based at least in part on the receiving of financial information for a user.

27. The computer program product of claim 25, wherein the real-time impact on the user directory further comprises the real-time impact that purchasing the one or more products proximate in location to the mobile device would have on the at least one of the user budget or the user wish list.

28. The computer program product of claim 25, further comprising an executable portion configured for providing a communicable link between the user and a financial advisor, via the mobile device, such that the financial advisor can advise the user based on the real-time impact that purchasing one or more products proximate in location to the mobile device would have on the user budget and the user wish list.

29. The computer program product of claim 25, wherein identifying one or more products further comprises capturing, via the mobile device, images of the one or more products.

30. The computer program product of claim 29, wherein capturing images further comprises implementing, via a computer device processor, object recognition processing to identify one or more images that correspond to one or more products.

31. The computer program product of claim 25, wherein identifying one or more products further comprises capturing a tag located on or proximate to one or more of the products and reading the tag to identify the product.

32. The computer program product of claim 25, wherein identifying one or more products further comprises capturing real-time video of the one or more products.

33. The computer program product of claim 25, wherein the user directory further comprises the user budget and the user wish list.

34. The computer program product of claim 25, further comprising an executable portion configured for developing a budget strategy, wherein the budget strategy is based at least in part on said receiving financial information for the user, wherein the receiving financial information comprises at least one of user transaction history, user income, user financial plans, or user personal plans.

35. The computer program product of claim 25, wherein presenting an indicator associated with the one or more products further comprises superimposing the indicator over real-time video that is captured by the mobile device, wherein the indicator is selectable by the user.

36. The computer program product of claim 25, wherein one or more products further comprise budget data, wherein budget data includes financial documents that influence the user budget or user wish list.