Augmented reality virtual banker

• US 10,078,867 B1
• Filed: 01/10/2014
• Issued: 09/18/2018
• Est. Priority Date: 01/10/2014
• Status: Active Grant

• Current Assignee: Wells Fargo Bank NA (Wells Fargo & Company)
• Original Assignee: Wells Fargo Bank NA (Wells Fargo & Company)
• Inventors: Chan, Christin, Tengelitsch, II, Erick Von
• Primary Examiner(s): Kalinowski, Alexander G
• Assistant Examiner(s): Lickteig, Blane A
• Application Number:
  US14/151,960
• Time in Patent Office: 1,712 Days
• Field of Search: 705 30, 705 14, 705 26, 382117
• CPC Class Codes: G06Q 40/02 Banking, e.g. interest calculation or account maintenance credit or loans G06Q40/03
• CPC Class Codes: G06V 40/165 using facial parts and geometric relationships

Abstract

A method implemented on an augmented reality electronic device includes viewing at least a portion of a financial document with the augmented reality electronic device. One or more words or phrases in a section of the financial document are identified using the augmented reality electronic device. A customer associated with the financial document is identified. An indication of the one or more words or phrases and an identification of the customer are sent to a server computer. Customized content is received from the server computer based on the one or more words or phrases and the identification of the customer. The customized content is displayed on the augmented reality electronic device.

Claims

1. A method implemented on an augmented reality electronic device, the method comprising:

viewing at least a portion of a financial document with the augmented reality electronic device;

identifying one or more words or phrases in a section of the financial document using the augmented reality electronic device;

identifying an account identification number associated with the financial document using the augmented reality electronic device;

authenticating a user of the augmented reality device;

after authenticating the user, logging on to a financial account of the user identified by the account identification number;

sending the one or more words or phrases and the account identification number to a server computer;

as a result of sending the one or more words or phrases and the account identification number to the server computer, receiving a textual message from a virtual agent of a financial institution, the textual message identifying customized financial content related to the one or more words and phrases and related to the financial account of the user, the textual message inquiring as to whether the user wishes to the view the customized financial content;

projecting an overlay of an image of the virtual agent on the augmented reality electronic device, the image including the textual message and one or more virtual buttons that permit a selection of the customized financial content;

receiving a selection of one of the virtual buttons;

as a result of receiving the selection of the one of the virtual buttons, displaying an information area on a display screen of the augmented reality electronic device, the information area including;

(i) a first area with a control that, when activated, displays on the display screen details regarding a bank credit card rewards program;

(ii) a second area with a control that, when activated, provides details for making an appointment with a personal banker; and

(iii) a third area with a control that, when activated, initiates a telephone call to the personal banker, the information area being displayed below the image of the virtual agent on the display screen;

receiving a selection of one control from one of the first area, the second area or the third area of the information area;

receiving the customized financial content corresponding to the selection;

projecting the customized financial content on the augmented reality electronic device;

detecting that the user has looked away from the financial document for greater than a predetermined period of time; and

as a result of detecting that the user has looked away from the financial document for greater than the predetermined period of time, logging off from the financial account for the user.

2. The method of claim 1, wherein the augmented reality electronic device is a headset.

3. The method of claim 2, wherein the headset comprises a wearable computer with a camera and an optical head-mounted display.

4. The method of claim 1, wherein the augmented reality electronic device is a mobile electronic computing device, the mobile electronic computing device including an augmented reality software application.

5. The method of claim 1, wherein the financial document is a portfolio management account statement for the customer.

6. The method of claim 1, wherein the financial document is a banking statement.

7. The method of claim 1, wherein projecting the customized content comprises displaying an account balance trend for the customer.

8. The method of claim 1, wherein displaying the customized content comprises displaying marketing information related to the financial document.

9. The method of claim 1, wherein the display of the customized content overlays a display of the financial document on the augmented reality electronic device.

10. The method of claim 1, further comprising enabling the customer to take an action on the augmented reality electronic device based on the displayed customized content.

11. The method of claim 10, wherein the action comprises paying a bill.

12. The method of claim 10, wherein the action comprises enrolling for a financial service.

13. A method implemented on an augmented reality electronic device, the method comprising:

viewing at least a portion of a financial document with the augmented reality electronic device;

identifying one or more words or phrases in a section of the financial document using the augmented reality electronic device;

obtaining an identification for a customer from a section of the financial document;

sending the one or more words or phrases and the identification of the customer to a server computer;

as a result of sending the one or more words or phrases and the identification of the customer to the server computer, receiving a textual message from a virtual banker of a financial institution, the textual message identifying a balance trend of a financial account of the customer, the balance trend being identified based on an analysis of the one or more words and phrases, the textual message inquiring as to whether the user wishes to the view the balance trend;

projecting an overlay of an image of the virtual banker on the augmented reality electronic device, the image including the textual message and one or more virtual buttons that permit a display of the balance trend;

receiving a selection of one of the virtual buttons;

as a result of receiving the selection of the one of the virtual buttons, receiving data relating to the balance trend;

projecting a graph showing the balance trend on the augmented reality electronic device, the graph showing a trend of assets and liabilities for the customer, the graph including a plurality of additional virtual buttons, a first additional virtual button permitting a display of the balance trend over one time period, a second additional virtual button permitting a display of the balance trend over a different time period, and a third additional virtual button permitting initiation of a telephone call with a personal banker;

detecting that the user has looked away from the financial document for greater than a predetermined period of time; and

as a result of detecting that the user has looked away from the financial document for greater than the predetermined period of time, logging off from a financial account for the user.

14. The method of claim 13, wherein the augmented reality electronic device is a headset comprising a wearable computer with a camera and an optical head-mounted display.

15. The method of claim 13, wherein the augmented reality electronic device is a mobile electronic computing device, the mobile electronic computing device including an augmented reality software application.

16. An augmented reality electronic computing device comprising:

a processing unit; and

system memory, the system memory including instructions which, when executed by the processing unit, cause the augmented reality electronic computing device to;

view at least a portion of a financial document;

identify one or more words or phrases in a section of the financial document

identify an account identification number associated with the financial document;

authenticate a user of the augmented reality device;

after authenticating the user, log on to a financial account of the user identified by the account identification number;

send the one or more words or phrases and the account identification number to a server computer;

as a result of sending the one or more words or phrases and the identification of the customer to the server computer, receive a textual message from a virtual banker of a financial institution, the textual message identifying information regarding a financial account of the customer that the virtual banker would like to discuss with the customer, the information related to the financial account of the customer being identified based on an analysis of the one or more words and phrases, the textual message inquiring as to whether the user would like to view a balance trend of the financial account;

project an overlay of an image of the virtual banker on the augmented reality electronic device, the image including the textual message and one a virtual button that permits the display of the balance trend of the financial account;

receive a selection of the virtual button;

as a result of receiving a selection of the virtual button, receiving data relating to the balance trend of the financial account;

projecting a graph showing the balance trend of the financial account on the augmented reality electronic device, the graph showing a trend of assets and liabilities for the customer, the graph including a plurality of additional virtual buttons, a first additional virtual button permitting a display of the balance trend over a 12-month period, a second additional virtual button permitting a display of the balance trend over a 6-month period, and a third additional virtual button permitting initiation of a telephone call with a personal banker;

display the customized content;

detect that the user has looked away from the financial document for greater than a predetermined period of time; and

as a result of detecting that the user has looked away from the financial document for greater than the predetermined period of time, log off from the financial account for the user.

17. The augmented reality electronic computing device of claim 16, wherein the augmented reality electronic computing device is a headset comprising a wearable computer with a camera and an optical head-mounted display.

18. The augmented reality electronic computing device of claim 16, wherein the augmented reality electronic computing device is a mobile electronic computing device, the mobile electronic computing device including an augmented reality software application.