Facilitating dynamic across-network location determination using augmented reality display devices

• US 10,109,095 B2
• Filed: 12/08/2016
• Issued: 10/23/2018
• Est. Priority Date: 12/08/2016
• Status: Active Grant

• Current Assignee: Bank of America Corp.
• Original Assignee: Bank of America Corp.
• Inventors: Johansen, Joseph N.
• Primary Examiner(s): McDowell, Jr., Maurice L.
• Application Number:
  US15/372,909
• Publication Number:
  US 20180165848A1
• Time in Patent Office: 684 Days
• CPC Class Codes: G05B 2219/32014 Augmented reality assists operator in maintenance, repair, programming, assembly, use of head mounted display with 2-D 3-D display and voice feedback, voice and gesture command
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06Q 10/10 Office automation; Time management
• CPC Class Codes: G06T 11/00 2D [Two Dimensional] image generation
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text
• CPC Class Codes: G06V 40/172 Classification, e.g. identification
• CPC Class Codes: H04L 67/52 specially adapted for the location of the user terminal

Abstract

An augmented reality system includes a central server, a local server an augmented reality user device. The central server includes account information for a customer and institution information. The institution information includes employee specialty data and employee office data. The local server includes location information for the customer and a plurality of employees. The augmented reality user device displays account information and displays a location of one of the employees.

Claims

1. An augmented reality system comprising:

a central server comprising institution information comprising;

employee specialty data indicating one or more specialties of each of a plurality of employees of an institution; and

employee office data indicating an office of a plurality of offices of each of the plurality of employees, wherein each of the plurality of offices is an office of the institution and each office is geographically distinct;

a local server located at a first office of the plurality of offices comprising location information, the location information indicating the location of the first customer and a location of the plurality of employees of the first office;

an augmented reality user device for the first customer comprising;

a location engine implemented in hardware that receives at least part of the location information from the local server and determines the geographical location of the first customer using the location information;

a request engine implemented in hardware that;

receives a request from the first customer comprising a requested specialty, wherein the request is a request to communicate with a one of the plurality of employees having the requested specialty; and

receives an identification of a first employee from the central server in response to the request, the first employee identified based on the geographic location of the first customer and the requested specialty;

a display configured to;

overlay virtual objects onto tangible objects in real-time; and

display a contact card, wherein the contact card comprises and name of the first employee; and

create a virtual overlay of the location of the first employee in a real scene.

2. The augmented reality system of claim 1, further comprising:

a biometric engine implemented in hardware that;

receives biometric data for the first customer;

confirms the first customer'"'"'s identity by comparing the received biometric data for the first customer to predetermined biometric data for the first customer; and

generates an identity confirmation token indicating the confirmation of the first customer'"'"'s identity; and

the request engine includes the identity confirmation token in the request from the first customer.

3. The augmented reality system of claim 1, wherein the augmented reality user device is further configured to communicate location information to the local server based on information received from one of a global positioning system (“

GPS”

) sensor and a beacon.

4. The augmented reality system of claim 1, wherein the augmented reality user device further comprises a facial recognition engine implemented in hardware that performs facial recognition to identify a face of the requested employee and confirms the requested employee'"'"'s identity using the facial recognition.

5. The augmented reality system of claim 1, wherein the augmented reality user device is operable to determine an availability of one or more of the plurality of employees and the first employee is further identified based on the availability.

6. The augmented reality system of claim 1, wherein the augmented reality user device is operable to:

receive a request to locate each of the plurality of employees associated with a predetermined specialty; and

display a virtual overlay of the location of each of the plurality of employees associated with the predetermined specialty.

7. The augmented reality system of claim 1, wherein the display is further configured to display account information for the first customer indicating a type of account that the first customer has with the institution and a balance of the account.

8. An augmented reality digital transfer method comprising:

storing, at a central server, employee specialty data indicating one or more specialties of each of a plurality of employees of an institution;

storing, at the central server, employee office data indicating an office of a plurality of offices of each of the plurality of employees, wherein each of the plurality of offices is an office of the institution and each office is geographically distinct;

storing, at a local server located at a first office of the plurality of offices, location information, the location information indicating the location of the first customer and a location of the plurality of employees of the first office;

receiving at least part of the location information from the local server and determine the geographical location of the first customer using the location information;

receiving a request from the first customer comprising a requested specialty, wherein the request is a request to communicate with a one of the plurality of employees having the requested specialty;

receiving an identification of a first employee from the central server in response to the request, the first employee identified based on the geographic location of the first customer and the requested specialty;

overlaying virtual objects onto tangible objects in real-time;

displaying a contact card, wherein the contact card comprises and name of the first employee; and

creating a virtual overlay of the location of the first employee in a real scene.

9. The method of claim 8, further comprising:

receiving biometric data for the first customer;

confirming the first customer'"'"'s identity by comparing the received biometric data for the first customer to predetermined biometric data for the first customer;

generating an identity confirmation token indicating the confirmation of the first customer'"'"'s identity; and

including the identity confirmation token in the request from the first customer.

10. The method of claim 8, further comprising communicating location information based on information received from one of a global positioning system (“

GPS”

) sensor and a beacon.

11. The method of claim 8, further comprising performing facial recognition to identify a face of the requested employee and confirming the requested employee'"'"'s identity using the facial recognition.

12. The method of claim 8, further comprising determining the availability of the requested employee and displaying the location of the requested employee based on a determination that the requested employee is available.

13. The method of claim 8, further comprising:

receiving a request to locate each of the plurality of employees associated with a predetermined specialty; and

displaying a virtual overlay of the location of each of the plurality of employees associated with the predetermined specialty.

14. The method of claim 8, further comprising displaying account information for the first customer, wherein the account information for the first customer indicates a type of account that the first customer has with the institution and a balance of the account.

15. An augmented reality user device comprising:

a location engine implemented in hardware that receives location information from a local server and determines the geographical location of a first customer using the location information, wherein the location information indicates the location of the first customer and a location of a plurality of employees of a first office of a plurality of offices, wherein each of the plurality of offices is an office of the institution and each office is geographically distinct;

a request engine implemented in hardware that;

receives a request from the first customer comprising a requested specialty, wherein the request is a request to communicate with a one of the plurality of employees having the requested specialty; and

receives an identification of a first employee from a central server in response to the request, the first employee identified based on the geographic location of the first customer and the requested specialty;

a display configured to;

overlay virtual objects onto tangible objects in real-time; and

display a contact card, wherein the contact card comprises and name of the first employee; and

create a virtual overlay of the location of the first employee in a real scene.

16. The augmented reality user device of claim 15, further comprising:

a biometric engine implemented in hardware that;

receives biometric data for the first customer;

confirms the first customer'"'"'s identity by comparing the received biometric data for the first customer to predetermined biometric data for the first customer; and

generates an identity confirmation token indicating the confirmation of the first customer'"'"'s identity; and

the request engine includes the identity confirmation token in the request from the first customer.

17. The augmented reality user device of claim 15, further configured to communicate location information to the local server based on information received from one of a global positioning system (“

GPS”

) sensor and a beacon.

18. The augmented reality user device of claim 15, further comprising a facial recognition engine implemented in hardware that performs facial recognition to identify a face of the requested employee and confirms the requested employee'"'"'s identity using the facial recognition.

19. The augmented reality user device of claim 15, further configured to determine the availability of the requested employee and display the location of the requested employee based on a determination that the requested employee is available.

20. The augmented reality user device of claim 15, further configured to:

receive a request to locate each of the plurality of employees associated with a predetermined specialty; and

display a virtual overlay of the location of each of the plurality of employees associated with the predetermined specialty.