System for populating budgets and/or wish lists using real-time video image analysis

• US 9,519,932 B2
• Filed: 02/16/2016
• Issued: 12/13/2016
• Est. Priority Date: 03/08/2011
• Status: Active Grant

• Current Assignee: Bank of America Corp.
• Original Assignee: Bank of America Corp.
• Inventors: Calman, Matthew A., Ross, Erik Stephen
• Primary Examiner(s): Desai, Resha
• Assistant Examiner(s): Lee, Jennifer
• Application Number:
  US15/045,188
• Publication Number:
  US 20160162982A1
• Time in Patent Office: 301 Days
• Field of Search: 705 261- 272
• US Class Current: 1/1
• CPC Class Codes: G06Q 10/10 Office automation; Time management
• CPC Class Codes: G06Q 30/02 Marketing; Price estimation or determination; Fundraising
• CPC Class Codes: G06Q 30/06 Buying, selling or leasing transactions
• CPC Class Codes: G06Q 30/0613 Third-party assisted
• CPC Class Codes: G06Q 30/0633 Lists, e.g. purchase orders, compilation or processing
• CPC Class Codes: G06Q 30/0641 Shopping interfaces
• CPC Class Codes: G06Q 30/0643 Graphical representation of items or shoppers
• CPC Class Codes: G06Q 40/02 Banking, e.g. interest calculation or account maintenance credit or loans G06Q40/03
• CPC Class Codes: G06Q 40/12 Accounting
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06V 20/20 in augmented reality scenes
• CPC Class Codes: G06V 20/46 Extracting features or characteristics from the video content, e.g. video fingerprints, representative shots or key frames

Abstract

System, method, and computer program product are provided for using real-time video analysis, such as augmented reality to provide the user of a mobile device with real-time budgeting and wish lists. Through the use of real-time vision object recognition objects, logos, artwork, products, locations, and other features that can be recognized in the real-time video stream can be matched to data associated with such to provide the user with real-time budget impact and wish list updates based on the products and budget data determined as being the object. In this way, the objects, which may be products and/or budget data in the real-time video stream, may be included into a user'"'"'s budget and/or wish list, such that the user receives real-time budget and/or wish list updates incorporating product and/or budget data located in a real-time video stream.

Claims

1. A system for populating a user directory with product information, the system comprising:

a memory device with computer-readable program code stored thereon;

a communication device;

a processing device operatively coupled to the memory device and the communication device, wherein the processing device is configured to execute the computer-readable program code and wherein the computer-readable program code is configured to cause said processing device to;

receive financial information for a user, wherein the financial information provides an indication of financial history of the user;

analyze a real-time video stream representing a surrounding environment captured on a mobile device;

identify one or more products within the real-time video stream;

determine a location in the user directory to populate with the one or more products identified within the real-time video stream, wherein the user directory comprises a user budget and a user wish list;

determine information about the one or more products within the real-time video stream, wherein the information about the one or more products comprises a price associated with the one or more products within the real-time video stream;

present, via superimposing over the real-time video stream on the mobile device, a selectable indicator associated with the one or more products within the real-time video stream, wherein the selectable indicator provides real-time impact on the user budget and the user wish list for the one or more products identified within the real-time video stream if the one or more products in the real-time video stream were purchased by the user associated with the user mobile device displaying the real-time video stream, wherein presenting the selectable indicator comprises superimposing the selectable indicator with the real-time impact of the one or more products on the user budget and the user wish list over the real-time video stream depicting the one or more products; and

provide, via selection of the selectable indicator, a communicable link between the user and a third party, via the mobile device, and transmit the real-time video stream with the selectable indicator superimposed over the real-time video stream to the third party via the communicable link, such that the third party can advise the user based on the real-time impact that purchasing one or more products would have on the user budget and the user wish list.

2. The system of claim 1, wherein the computer-readable program code is further configured to cause said processing device to provide the user with real-time loan procurement for purchasing the one or more products, wherein the real-time loan procurement is based at least in part on the received financial information for the user.

3. The system of claim 1, wherein identifying one or more products comprises implementing, via a computer device processor, object recognition processing to identify one or more images within the real-time video stream that correspond to one or more products.

4. The system of claim 1, wherein identifying one or more products further comprises capturing real-time video of the one or more products.

5. The system of claim 1, wherein the computer-readable program code is further configured to cause said processing device to develop a budget strategy, wherein the budget strategy is based at least in part on the received financial information for the user, wherein the received financial information comprises at least one of user transaction history, user income, user financial plans, or user personal plans.

6. The system of claim 1, wherein the computer-readable program code is further configured to cause said processing device to provide access to the user directory by selection of the selectable indicator on the display of the real-time video stream, such that the user budget and the user wish list is accessible.

7. The system of claim 1, wherein the computer-readable program code is further configured to cause said processing device to provide the user with an ability to purchase at least one of the one or more products located within the real-time video stream.