System for prediction of future circumstances and generation of real-time interactive virtual reality user experience

• US 10,055,891 B2
• Filed: 10/07/2016
• Issued: 08/21/2018
• Est. Priority Date: 10/07/2016
• Status: Active Grant

• Current Assignee: Bank of America Corp.
• Original Assignee: Bank of America Corp.
• Inventors: Jones-McFadden, Alicia C., Hsieh, Matthew, Enscoe, Scott R., Anand, Raghav, Anderson, Michael, Miller, Elizabeth Ann, Shilov, Daniel, Salvino, Alicia Anli
• Primary Examiner(s): Merouan, Abderrahim
• Application Number:
  US15/288,081
• Publication Number:
  US 20180101985A1
• Time in Patent Office: 683 Days
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0141 characterised by the informative content of the display
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06T 19/00 Manipulating 3D models or images for computer graphics
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06V 20/20 in augmented reality scenes

Abstract

Systems provide for a virtual reality experience of a predicted future state based on the occurrence or contemplation of an event. Other systems herein described provide for an augmented reality experience that replaces an object within view with an augmented display of the object based on the predicted future state of the object.

Claims

1. A system for providing an augmented reality display of a predicted future state of an object, the system comprising:

a wearable computing device including a memory, at least one processor in communication with the memory, an image-capturing device in communication with the processor, and an Optical Head-Mounted Display (OHMD) in communication with the processor;

a database configured to store attributes associated with a user of the wearable computing device; and

a predicted future state module stored in the memory, executable by the processor and configured to;

capture, via the image-capturing device, an image of an actual object,

identify the actual object,

retrieve, from the database, one or more attributes associated with the user,

predict a future state of the actual object based on the identification of the actual object and the one or more attributes associated with the user, and

display, in the OHMD, an augmented reality view that replaces the actual object with the predicted future state of the actual object, wherein the predicted future state is one of (i) a virtual future condition of the actual object, or (ii) a virtual replacement object that replaces the actual object.

2. The system of claim 1, wherein the predicted future state module is further configured to identify the actual object by implementing one or more object recognition techniques.

3. The system of claim 1, wherein the predicted future state module is further configured to identify a current state of the actual object.

4. The system of claim 3, wherein the predicted future state module is further configured to predict the future state of the actual object based on the identification of the actual object, the current state of the actual object and the one or more attributes associated with the user.

5. The system of claim 3, wherein the predicted future state module is further configured to identify the current state of the actual object, wherein the current state includes a current value of the actual object.

6. The system of claim 5, wherein the predicted future state module is further configured to predict the future state of the actual object based on the identification of the actual object t, the current value of the actual object and the one or more attributes associated with the user.

7. The system of claim 1, wherein the predicted future state module is further configured to predict a future state of the actual object based on the identification of the actual object and the one or more attributes associated with the user, wherein the future state is for a predetermined future period in time.

8. The system of claim 7, wherein the predicted future state module provides for the user to configure the predetermined future period in time either prior to capturing the image of the actual object or after capturing the image of the actual object.

9. The system of claim 1, wherein the database configured to store the attributes, further defines the attributes as financial performance attributes associated with the user and wherein the predicted future state module is further configured to predict the future state of the actual object based on the identification of the object and the one or more financial performance attributes.

10. The system of claim 9, wherein the database configured to store the financial performance attributes, further defines the financial performance attributes as at least one of current savings amount, historical savings performance, current loan amounts, historical loan repayment performance, and current financial inflow and outflow.

11. A system for providing a user a virtual reality experience of a future state of the user, the system comprising:

a mobile computing device including a memory and at least one processor in communication with the memory;

a database configured to store attributes associated with a user of the mobile computing device; and

a virtual reality experience module stored in the memory, executable by the processor and configured to;

receive an input that indicates an occurrence or contemplation of an event associated with the user,

retrieve, from the database, one or more, attributes associated with the user,

generate at least two virtual reality experiences of a future state of the user, wherein a first virtual reality experience is based on the event being contemplated occurring and the one or more attributes associated with the user and a second virtual reality experience is based on the event being contemplated not occurring and the one or more attributes associated with the user, and

provide for the at least two virtual reality experiences to be displayable to the user, on the mobile computing device, in response to the occurrence of the event or the contemplation of the event.

12. The system of claim 11, wherein the mobile computing device is further defined as a wearable computing device including an Optical Head-Mounted Display (OHMD) that is configured to display the virtual reality experience to the user.

13. The system of claim 11, wherein the virtual reality experience module is further configured to generate the at least two virtual reality experiences of the future state of the user, wherein the first virtual reality experience is based on the event being contemplated occurring and the one or more attributes associated with the user and the second virtual reality experience is based on the event being contemplated not occurring and the one or more attributes associated with the user, wherein the future state is defined by a predetermined future time period.

14. The system of claim 11, wherein the virtual reality experience module provides for the user to configure the predetermined future time period.

15. The system of claim 11, wherein the database configured to store attributes associated with a user further defines the attributes as profile attributes associated with the user and financial attributes associated with the user.

16. The system of claim 15, wherein the financial attributes include one or more of historical transaction records, current savings amount, current rate of savings, current inflow and outflow of finances, and financial goals.

17. The system of claim 15, wherein the virtual reality experience module is further configured to receive an input that indicates an occurrence of the event or contemplation of the event associated with the user, wherein the event is further defined as a financial transaction.

18. The system of claim 17, wherein the virtual reality experience module is further configured to generate the at least two virtual reality experiences of a financial trajectory of the user based on the occurrence of the financial transaction or contemplation of the financial transaction and the one or more financial attributes associated with the financial transaction.