Network Error Detection Using Virtual Reality Display Devices

• US 20190278621A1
• Filed: 03/09/2018
• Published: 09/12/2019
• Est. Priority Date: 03/09/2018
• Status: Active Grant

• Current Assignee: Bank of America Corp.
• Original Assignee: Bank of America Corp.
• Inventors: Thomas, James M., Shields, Alan W.
• Granted Patent: US 10,620,981 B2
• Time in Patent Office: Days
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G06F 9/45533 Hypervisors; Virtual machine monitors
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06V 40/20 Movements or behaviour, e.g. gesture recognition recognition of facial expressions G06V40/16
• CPC Class Codes: H04L 43/06 Generation of reports
• CPC Class Codes: H04L 43/0823 Errors, e.g. transmission errors

Abstract

The device that includes a normalization engine configured to populate data fields in a normalized data structure with network information in accordance with normalization rules. The device further includes a virtualization engine configured to generate virtual data defining one or more virtual objects in accordance with virtualization rules that map data fields from the normalized data structure to physical attributes of virtual objects and to transmit the virtual data defining the one or more virtual objects for display on a user device. The virtualization engine is further configured to receive user feedback that identifies a selected virtual object, to identify data field values in the normalized data structure for the physical attributes of the selected virtual object, and to generate an error report comprising at least a portion of the identified data fields values. The virtualization engine is further configured to send the error report to the user device.

Claims

1. A network error detection device, comprising:

a network interface configured to receive network information from a plurality of data sources;

a memory configured to store;

a normalized data structure comprising a plurality of data fields;

normalization rules configured to map received network information to data fields in the normalized data structure; and

virtualization rules configured to map data fields from the normalized data structure to physical attributes of virtual objects, wherein virtual objects are computer generated renderings of physical objects;

a normalization engine implemented by one or more processors, configured to populate data fields in the normalized data structure with received network information in accordance with the normalization rules;

a virtualization engine implemented by the one or more processors, configured to generate virtual data defining one or more virtual objects for a virtual reality environment, wherein generating each virtual object comprises;

selecting an entry linked with a plurality of data fields in the normalized data structure; and

setting physical attributes for the virtual object based on the data field values for the entry in the normalized data structure in accordance with the virtualization rules;

the network interface further configured to;

transmit the virtual data defining the one or more virtual objects for display on a user device in response to generating the one or more virtual objects;

receive user feedback from the user device, wherein the user feedback identifies a selected virtual object;

the virtualization engine further configured to;

identify physical attributes of the selected virtual object;

identify data fields and corresponding data field values in the normalized data structure for the identified physical attributes of the selected virtual object based on the virtualization rules;

generate an error report comprising at least a portion of the identified data fields values; and

the network interface further configured to send the error report to the user device.

2. The device of claim 1, further comprising the user device, wherein the user device comprises:

a display configured to present virtual objects in the virtual reality environment;

a virtual overlay engine implemented by the one or more processors, configured to;

receive the virtual data defining the one or more virtual objects;

render the one or more virtual objects in the virtual reality environment on the display;

a camera configured to capture gestures performed by a user; and

a gesture recognition engine configured to;

detect a gesture performed by the user interacting with a virtual object from among the one or more virtual objects in the virtual reality environment using the camera; and

send the user feedback to the virtualization engine identifying the virtual object as the selected virtual object.

3. The device of claim 2, wherein detecting the gesture performed by the user interacting with the virtual object from among the one or more virtual objects in the virtual environment comprises detecting the user repositioning the virtual object within the virtual reality environment.

4. The device of claim 1, further comprising the user device, wherein the user device comprises:

a display configured to present virtual objects in the virtual reality environment;

a virtual overlay engine implemented by the one or more processors, configured to;

receive the virtual data defining the one or more virtual objects;

render the one or more virtual objects in the virtual reality environment on the display;

a microphone configured to capture audio signals; and

a voice recognition engine configured to;

detect an audio signal identifying a virtual object from among the one or more virtual objects in the virtual reality environment using the microphone; and

send the user feedback to the virtualization engine identifying the virtual object as the selected virtual object.

5. The device of claim 1, wherein:

setting physical attributes for a virtual object comprises;

setting a starting location within the virtual reality environment; and

setting a target location within the virtual reality environment; and

the virtual object is configured to move from the starting location to the target location when displayed on the user device.

6. The device of claim 1, wherein:

the virtual reality environment is a geographical map; and

at least one of the one or more virtual objects is configured to traverse the geographical map.

7. The device of claim 1, wherein receiving network information from the plurality of data sources comprises:

receiving a first portion of network information from a first data source in a first format; and

receiving a second portion of the network information from a second data source in a second format, wherein the second format is different than the first format.

8. The device of claim 1, wherein the user device is configured to display at least a portion of the error report in the virtual reality environment.

9. A network error detection method, comprising:

receiving, by a network interface, network information from a plurality of data sources;

populating, by a normalization engine, data fields in a normalized data structure with received network information in accordance with normalization rules, wherein;

the normalized data structure comprising a plurality of data fields; and

the normalization rules are configured to map received network information to data fields in the normalized data structure;

generating, by a virtualization engine, virtual data defining one or more virtual objects for a virtual reality environment using virtualization rules, wherein;

the virtualization rules are configured to map data fields from the normalized data structure to physical attributes of virtual objects;

virtual objects are computer generated renderings of physical objects; and

generating each virtual object comprises;

selecting an entry linked with a plurality of data fields in the normalized data structure; and

setting physical attributes for the virtual object based on the data field values for the entry in the normalized data structure in accordance with the virtualization rules;

transmitting, by the network interface, the virtual data defining the one or more virtual objects for display on a user device in response to generating the one or more virtual objects;

receiving, by the network interface, user feedback from the user device, wherein the user feedback identifies a selected virtual object;

identifying, by the virtualization engine, physical attributes of the selected virtual object;

identifying, by the virtualization engine, data fields and corresponding data field values in the normalized data structure for the identified physical attributes of the selected virtual object based on the virtualization rules;

generating, by the virtualization engine, an error report comprising at least a portion of the identified data fields values; and

sending, by the network interface, the error report to the user device.

10. The method of claim 9, further comprising:

receiving, by a virtual overlay engine, the virtual data defining the one or more virtual objects;

rendering, by the virtual overlay engine, the one or more virtual objects in the virtual reality environment on a display;

detecting, by a gesture recognition engine, a gesture performed by the user interacting with a virtual object from among the one or more virtual objects in the virtual reality environment; and

sending, by the virtual overlay engine, the user feedback to the virtualization engine identifying the virtual object as the selected virtual object.

11. The method of claim 10, wherein detecting the gesture performed by the user interacting with the virtual object from among the one or more virtual objects in the virtual environment comprises detecting the user repositioning the virtual object within the virtual reality environment.

12. The method of claim 9, further comprising:

receiving, by a virtual overlay engine, the virtual data defining the one or more virtual objects;

rendering, by the virtual overlay engine, the one or more virtual objects in the virtual reality environment on the display;

detecting, by a voice recognition engine, an audio signal identifying a virtual object from among the one or more virtual objects in the virtual reality environment; and

sending, by the virtual overlay engine, the user feedback to the virtualization engine identifying the virtual object as the selected virtual object.

13. The method of claim 9, wherein:

setting physical attributes for a virtual object comprises;

setting a starting location within the virtual reality environment; and

setting a target location within the virtual reality environment; and

the virtual object is configured to move from the starting location to the target location when displayed on the user device.

14. The method of claim 9, wherein:

the virtual reality environment is a geographical map; and

at least one of the one or more virtual objects is configured to traverse the geographical map.

15. The method of claim 9, wherein receiving network information from the plurality of data sources comprises:

receiving a first portion of network information from a first data source in a first format; and

receiving a second portion of the network information from a second data source in a second format, wherein the second format is different than the first format.

16. The method of claim 9, further comprising displaying, by the virtual overlay engine, at least a portion of the error report in the virtual reality environment.

17. A network error detection device, comprising:

a network interface configured to receive network information from a plurality of data sources;

a memory configured to store;

a normalized data structure comprising a plurality of data fields;

normalization rules configured to map received network information to data fields in the normalized data structure; and

virtualization rules configured to map data fields from the normalized data structure to physical attributes of virtual objects, wherein virtual objects are computer generated renderings of physical objects;

a normalization engine implemented by one or more processors, configured to populate data fields in the normalized data structure with received network information in accordance with the normalization rules;

a virtualization engine implemented by the one or more processors, configured to;

generate virtual data defining one or more virtual objects for a virtual reality environment, wherein generating each virtual object comprises;

selecting an entry linked with a plurality of data fields in the normalized data structure; and

setting physical attributes for the virtual object based on the data field values for the entry in the normalized data structure in accordance with the virtualization rules;

a virtual overlay engine implemented by the one or more processors, configured to;

receive the virtual data defining the one or more virtual objects;

render the one or more virtual objects in the virtual reality environment on a display; and

receive user feedback, wherein the user feedback identifies a selected virtual object from among the one or more virtual objects;

the virtualization engine further configured to;

identify physical attributes of the selected virtual object;

identify data fields and corresponding data field values in the normalized data structure for the identified physical attributes of the selected virtual object based on the virtualization rules;

generate an error report comprising at least a portion of the identified data fields values; and

the virtual overlay engine further configured to display the error report.

18. The device of claim 17, further comprising:

a camera configured to capture gestures performed by a user; and

a gesture recognition engine configured to;

detect a gesture performed by the user interacting with a virtual object from among the one or more virtual objects in the virtual reality environment using the camera; and

send the user feedback to the virtualization engine identifying the virtual object as the selected virtual object.

19. The device of claim 18, wherein detecting the gesture performed by the user interacting with the virtual object from among the one or more virtual objects in the virtual environment comprises detecting the user repositioning the virtual object within the virtual reality environment.

20. The device of claim 17, wherein:

setting physical attributes for a virtual object comprises;

setting a starting location within the virtual reality environment; and

setting a target location within the virtual reality environment; and

the virtual object is configured to move from the starting location to the target location when displayed on the display.