Populating budgets and/or wish lists using real-time video image analysis

• US 9,317,835 B2
• Filed: 02/03/2012
• Issued: 04/19/2016
• Est. Priority Date: 03/08/2011
• Status: Active Grant

• Current Assignee: Bank of America Corp.
• Original Assignee: Bank of America Corp.
• Inventors: Calman, Matthew A., Ross, Erik Stephen
• Primary Examiner(s): Smith, Jeffrey A
• Assistant Examiner(s): Lee, Jennifer
• Application Number:
  US13/365,996
• Publication Number:
  US 20120233015A1
• Time in Patent Office: 1,537 Days
• Field of Search: 705 261- 272
• US Class Current: 1/1
• CPC Class Codes: G06Q 10/10 Office automation; Time management
• CPC Class Codes: G06Q 30/02 Marketing; Price estimation or determination; Fundraising
• CPC Class Codes: G06Q 30/06 Buying, selling or leasing transactions
• CPC Class Codes: G06Q 30/0613 Third-party assisted
• CPC Class Codes: G06Q 30/0633 Lists, e.g. purchase orders, compilation or processing
• CPC Class Codes: G06Q 30/0641 Shopping interfaces
• CPC Class Codes: G06Q 30/0643 Graphical representation of items or shoppers
• CPC Class Codes: G06Q 40/02 Banking, e.g. interest calculation or account maintenance credit or loans G06Q40/03
• CPC Class Codes: G06Q 40/12 Accounting
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06V 20/20 in augmented reality scenes
• CPC Class Codes: G06V 20/46 Extracting features or characteristics from the video content, e.g. video fingerprints, representative shots or key frames

Abstract

System, method, and computer program product are provided for using real-time video analysis, such as augmented reality to provide the user of a mobile device with real-time budgeting and wish lists. Through the use of real-time vision object recognition objects, logos, artwork, products, locations, and other features that can be recognized in the real-time video stream can be matched to data associated with such to provide the user with real-time budget impact and wish list updates based on the products and budget data determined as being the object. In this way, the objects, which may be products and/or budget data in the real-time video stream, may be included into a user'"'"'s budget and/or wish list, such that the user receives real-time budget and/or wish list updates incorporating product and/or budget data located in a real-time video stream.

Claims

1. A method for populating a user directory, the method comprising:

receiving financial information for a user, wherein the financial information provides an indication of financial history of the user;

analyzing, via a processing device, a real-time video stream representing a surrounding environment captured on a mobile device;

identifying one or more products within the real-time video stream;

determining a location in the user directory to populate with the one or more products identified within the real-time video stream, wherein the user directory comprises a user budget and a user wish list;

determining information about the one or more products within the real-time video stream, wherein the information about the one or more products comprises a price associated with the one or more products within the real-time video stream;

presenting, via superimposing over the real-time video stream on the mobile device, a selectable indicator associated with the one or more products within the real-time video stream, wherein the selectable indicator provides real-time impact on the user budget and the user wish list for the one or more products identified within the real-time video stream if the one or more products in the real-time video stream were purchased by the user associated with the user mobile device displaying the real-time video stream, wherein presenting the selectable indicator comprises superimposing the selectable indicator with the real-time impact of the one or more products on the user budget and the user wish list over the real-time video stream of the one or more products; and

providing, via selection of the selectable indicator, a communicable link between the user and a financial advisor, via the mobile device, and transmitting the real-time video stream with the selectable indicator superimposed over the real-time video stream to the financial advisor via the communicable link, such that the financial advisor can advise the user based on the real-time impact that purchasing one or more products would have on the user budget and the user wish list.

2. The method of claim 1 further comprises providing the user with real-time loan procurement for purchasing the one or more products, wherein the real-time loan procurement is based at least in part on the received financial information for the user.

3. The method of claim 1, wherein identifying one or more products comprises implementing, via a computer device processor, object recognition processing to identify one or more images within the real-time video stream that correspond to one or more products.

4. The method of claim 1, wherein identifying one or more products further comprises capturing a tag located on one of the one or more products and reading the tag to identify the one of the one or more products.

5. The method of claim 1, further comprising developing a budget strategy, wherein the budget strategy is based at least in part on the received financial information for the user, wherein the received financial information comprises at least one of user transaction history, user income, user financial plans, or user personal plans.

6. A system for populating a user directory, the system comprising:

a memory device with computer-readable program code stored thereon;

a communication device;

a processing device operatively coupled to the memory device and the communication device, wherein the processing device is configured to execute the computer-readable program code to;

receive financial information for a user, wherein the financial information provides an indication of financial history of the user;

analyze a real-time video stream representing a surrounding environment captured on a mobile device;

identify one or more products within the real-time video stream;

determine a location in the user directory to populate with the one or more products identified within the real-time video stream, wherein the user directory comprises a user budget and a user wish list;

determine information about the one or more products within the real-time video stream, wherein the information about the one or more products comprises a price associated with the one or more products within the real-time video stream;

present, via superimposing over the real-time video stream on the mobile device, a selectable indicator associated with the one or more products within the real-time video stream, wherein the selectable indicator provides real-time impact on the user budget and the user wish list for the one or more products identified within the real-time video stream if the one or more products in the real-time video stream were purchased by the user associated with the user mobile device displaying the real-time video stream, wherein presenting the selectable indicator comprises superimposing the selectable indicator with the real-time impact of the one or more products on the user budget and the user wish list over the real-time video stream of the one or more products; and

provide, via selection of the selectable indicator, a communicable link between the user and a financial advisor, via the mobile device, and transmitting the real-time video stream with the selectable indicator superimposed over the real-time video stream to the financial advisor via the communicable link, such that the financial advisor can advise the user based on the real-time impact that purchasing one or more products would have on the user budget and the user wish list.

7. The system of claim 6 further comprises providing the user with real-time loan procurement for purchasing the one or more products, wherein the real-time loan procurement is based at least in part on the received financial information for the user.

8. The system of claim 6, wherein identifying one or more products comprises implementing, via a computer device processor, object recognition processing to identify one or more images within the real-time video stream that correspond to one or more products.

9. The system of claim 6, wherein identifying one or more products further comprises capturing a tag located on one of the one or more products and reading the tag to identify the one of the one or more products.

10. The system of claim 6, further comprising developing a budget strategy, wherein the budget strategy is based at least in part on the received financial information for the user, wherein the received financial information comprises at least one of user transaction history, user income, user financial plans, or user personal plans.

11. A computer program product for populating a user directory, the computer program product comprising at least one non-transitory computer-readable medium having computer-readable program code portions embodied therein, the computer-readable program code portions comprising:

an executable portion configured for receiving financial information for a user, wherein the financial information provides an indication of financial history of the user;

an executable portion configured for analyzing a real-time video stream representing a surrounding environment captured on a mobile device;

an executable portion configured for identifying one or more products within the real-time video stream;

an executable portion configured for determining a location in the user directory to populate with the one or more products identified within the real-time video stream, wherein the user directory comprises a user budget and a user wish list;

an executable portion configured for determining information about the one or more products within the real-time video stream, wherein the information about the one or more products comprises a price associated with the one or more products within the real-time video stream;

an executable portion configured for presenting, via superimposing over the real-time video stream on the mobile device, a selectable indicator associated with the one or more products within the real-time video stream, wherein the selectable indicator provides real-time impact on the user budget and the user wish list for the one or more products identified within the real-time video stream if the one or more products in the real-time video stream were purchased by the user associated with the user mobile device displaying the real-time video stream, wherein presenting the selectable indicator comprises superimposing the selectable indicator with the real-time impact of the one or more products on the user budget and the user wish list over the real-time video stream of the one or more products; and

an executable portion configured for providing, via selection of the selectable indicator, a communicable link between the user and a financial advisor, via the mobile device, and transmitting the real-time video stream with the selectable indicator superimposed over the real-time video stream to the financial advisor via the communicable link, such that the financial advisor can advise the user based on the real-time impact that purchasing one or more products would have on the user budget and the user wish list.

12. The computer program product of claim 11 further comprises an executable portion configured for providing the user with real-time loan procurement for purchasing the one or more products, wherein the real-time loan procurement is based at least in part on the received financial information for the user.

13. The computer program product of claim 11, wherein identifying one or more products comprises implementing, via a computer device processor, object recognition processing to identify one or more images within the real-time video stream that correspond to one or more products.

14. The computer program product of claim 11, wherein identifying one or more products further comprises capturing a tag located on one of the one or more products and reading the tag to identify the one of the one or more products.

15. The computer program product of claim 11, further comprising an executable portion configured for developing a budget strategy, wherein the budget strategy is based at least in part on the received financial information for the user, wherein the received financial information comprises at least one of user transaction history, user income, user financial plans, or user personal plans.