Facilitating dynamic across-network location determination using augmented reality display devices

• US 10,109,096 B2
• Filed: 12/08/2016
• Issued: 10/23/2018
• Est. Priority Date: 12/08/2016
• Status: Active Grant

• Current Assignee: Bank of America Corp.
• Original Assignee: Bank of America Corp.
• Inventors: Johansen, Joseph N.
• Primary Examiner(s): McDowell, Jr., Maurice L.
• Application Number:
  US15/372,964
• Publication Number:
  US 20180165849A1
• Time in Patent Office: 684 Days
• CPC Class Codes: G05B 2219/32014 Augmented reality assists operator in maintenance, repair, programming, assembly, use of head mounted display with 2-D 3-D display and voice feedback, voice and gesture command
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06Q 10/10 Office automation; Time management
• CPC Class Codes: G06T 11/00 2D [Two Dimensional] image generation
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text
• CPC Class Codes: G06V 10/17 using hand-held instruments
• CPC Class Codes: G06V 20/20 in augmented reality scenes
• CPC Class Codes: G06V 40/12 Fingerprints or palmprints
• CPC Class Codes: G06V 40/172 Classification, e.g. identification
• CPC Class Codes: H04L 67/52 specially adapted for the location of the user terminal

Abstract

An augmented reality system includes a central server, a local server an augmented reality user device. The central server includes account information for a customer and institution information. The institution information includes employee specialty data and employee office data. The local server includes location information for the customer and a plurality of employees. The augmented reality user device displays account information and displays a location of one of the employees.

Claims

1. An augmented reality system comprising:

a central server comprising;

account information for a first customer; and

institution information, the institution information comprising;

employee specialty data indicating one or more specialties of each of a plurality of employees of an institution; and

employee office data indicating an office of each of the plurality of employees, wherein each of the plurality of offices is are office of the institution and each office is geographically distinct;

a local server located at a first office of the plurality of offices comprising location information, the location information indicating a location of the first customer and a location of the plurality of employees of the first office;

an augmented reality user device for a first employee comprising;

a request engine implemented in hardware that;

receives a request from the first customer to communicate with the first employee, the request based on the specialty associated with the first employee and the location of the first employee;

a location engine implemented in hardware that;

receives at least part of the location information from the local server and determines the geographical location of the first customer using the location information; and

a display configured to;

overlay virtual objects onto tangible objects in real-time;

display at least part of the account information; and

generate a virtual overlay of the location of the first customer.

2. The augmented reality system of claim 1, wherein the request engine determines an availability of the first employee and retrieves the request from the first customer upon a determination that the first employee is available.

3. The augmented reality system of claim 1, wherein the display is further configured to display an image of the first customer.

4. The augmented reality system of claim 1, wherein the augmented reality user device is further configured to communicate location information to the local server based on information received from one of a global positioning system (“

GPS”

) sensor and a beacon.

5. The augmented reality system of claim 1, farther comprising:

a biometric engine implemented in hardware that;

receives biometric data for the first customer; and

confirms the first customer'"'"'s identity by comparing the received biometric data for the first customer to predetermined biometric data for the first customer.

6. The augmented reality system of claim 1, wherein the augmented reality user device further comprises a facial recognition engine implemented in hardware that performs facial recognition to identify a face of the requested employee and confirms the requested employee'"'"'s identity using the facial recognition.

7. The augmented reality system of claim 1, wherein the account information for the first customer indicates a type of account that the first customer has with the institution and a balance of the account.

8. An augmented reality digital data transfer method comprising:

storing, at a central server, account information for a first customer;

storing, at the central server, institution information, the institution information comprising;

employee specialty data indicating one or more specialties of each of a plurality of employees of an institution; and

employee office data indicating an office of each of the plurality of employees, wherein each of the plurality of offices is an office of the institution and each office is geographically distinct;

storing, at a local server located at a first office of the plurality of offices, location information, the location information indicating a location of the first customer and a location of the plurality of employees of the first office;

receiving a request from the first customer to communicate with the first employee, the request based on the specialty associated with the first employee and the location of the first employee;

receiving at least part of the location information from the local server and determining the geographical location of the first customer using the location information;

overlaying virtual objects onto tangible objects in real-time;

displaying at least part of the account information; and

generating a virtual overlay of the location of the first customer.

9. The method of claim 8, further comprising determining an availability of the first employee and generating the request to retrieve specialties associated with the first employee upon a determination that the first employee is available.

10. The method of claim 8, further comprising displaying an image of the first customer.

11. The method of claim 8, further comprising communicating location information based on information received from one of a global positioning system (“

GPS”

) sensor and a beacon.

12. The method of claim 8, further comprising:

receiving biometric data for the first customer; and

confirming the first customer'"'"'s identity by comparing the received biometric data for the first customer to predetermined biometric data for the first customer.

13. The method of claim 8, further comprising performing facial recognition to identify a face of the requested employee and confirming the requested employee'"'"'s identity using the facial recognition.

14. The method of claim 8, wherein the account information for the first customer indicates a type of account that the first customer has with the institution and a balance of the account.

15. An augmented reality user device comprising:

a request engine implemented in hardware that;

receives a request from a first customer to communicate with a first employee, the request based on a specialty associated with the first employee and a location of the first employee;

a location engine in implemented in hardware that;

receives location information from a local server and determines the geographical location of the first employee using the location information, wherein the location information indicates the location of the first customer and a location of a plurality of employees of a first office of a plurality of offices, wherein each of the plurality of offices is an office of the institution and each office is geographically distinct; and

a display configured to;

overlay virtual objects onto tangible objects in real-time;

display account information for the first customer; and

generate a virtual overlay of the location of the first customer.

16. The augmented reality user device of claim 15, wherein the request engine determines an availability of the first employee and generates the request to retrieve specialties associated with the first employee upon a determination that the first employee is available.

17. The augmented reality user device of claim 15, wherein the display is further configured to display an image of the first customer.

18. The augmented reality user device of claim 15, further comprising:

a biometric engine implemented in hardware that;

receives biometric data for a first employee of a plurality of employees; and

confirms the first employee'"'"'s identity by comparing the received biometric data for the first employee to predetermined biometric data for the first employee.

19. The augmented reality user device of claim 15, further configured to communicate location information to the local server based on information received from one of a global positioning system (“

GPS”

) sensor and a beacon.

20. The augmented reality user device of claim 15, wherein the augmented reality user device further comprises a facial recognition engine implemented in hardware that performs facial recognition to identify a face of the requested employee and confirms the requested employee'"'"'s identity using the facial recognition.