Multi-device virtual reality, augmented reality and mixed reality analytics

• US 10,712,814 B2
• Filed: 04/19/2018
• Issued: 07/14/2020
• Est. Priority Date: 04/21/2017
• Status: Active Grant

• Current Assignee: Accenture Global Solutions Limited (Accenture PLC)
• Original Assignee: Accenture Global Solutions Limited (Accenture PLC)
• Inventors: Webb, Sunny, Short, Matthew Thomas, Mehta, Manish, Dooley, Robert, Cheng, Grace T., Dubey, Alpana
• Primary Examiner(s): Chang, Kent W
• Assistant Examiner(s): Bibbee, Chayce R
• Application Number:
  US15/956,816
• Publication Number:
  US 20180307311A1
• Time in Patent Office: 817 Days
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 3/40 Scaling of whole images or parts thereof, e.g. expanding or contracting

Abstract

Methods, systems, and apparatus for performing virtual reality simulations using virtual reality systems. In some aspects a method includes the actions of logging user actions in a virtual reality system, wherein the user actions include one or more of (i) a path traveled by user in the virtual reality system, or (ii) user interactions with objects in the virtual reality system; aggregating logged action over a first user and a second user; and deriving modifications to the virtual reality system based at least in part on the aggregated logged actions. The modifications to the VR system can include modifying at least one of (i) appearance of objects shown in the VR system, (ii) floor plan of the VR system, and (iii) location of objects shown in the VR system.

Claims

1. A computer implemented method comprising:

logging user actions in a virtual reality (VR) system, wherein the user actions comprise (i) a path traveled by a user in the VR system, and (ii) user interactions with objects in the VR system and wherein the VR system is an immersive VR system that relies on polygonal models and utilizes a headset that immerses the user in a VR environment, the headset having sensors configured to determine which direction the user'"'"'s head is facing, and wherein logging user interactions comprises monitoring whether a user looks at an object at least in part based on a direction the user'"'"'s head is facing;

aggregating logged user actions over a first user and a second user;

deriving modifications to the VR system based at least in part on the aggregated logged user actions, the modifications to the VR system comprising modifying an appearance of objects shown in the VR system, wherein modifying an appearance of objects shown in the VR system comprises rendering objects with a low number of user interactions at a lower visual fidelity than objects with a high number of user interactions, and wherein deriving modifications to the VR system based at least in part on the aggregated logged actions comprises applying crowd-guided assistance provided by a crowd assistance platform configured to allow a worker to share a request to a plurality of distributed experts and to allow an expert from the plurality of distributed experts to respond;

receiving data representing a request from the user to view an object of interest;

providing, via the virtual reality system, a 3D image of the object of interest;

receiving input from the user representing a specified area of interest associated with the object of interest; and

providing an enhanced interactive 3D image of at least a portion of the object of interest based on the received input.

2. The method of claim 1, wherein logging user actions in the VR system comprises logging user actions using one or more sensors.

3. The method of claim 2, wherein the sensors include one or more of internet of things (IOT) sensors, VR sensors, and mixed reality (MR) sensors.

4. The method of claim 1, wherein logging user interactions comprises monitoring how a user looks at an object.

5. The method of claim 4, wherein monitoring how a user looks at an object comprises monitoring a user'"'"'s gaze direction.

6. The method of claim 1, wherein user interactions comprise touching an object in the VR system.

7. The method of claim 1, wherein rendering objects with a low number of user interactions at a lower visual fidelity comprises rendering objects at a lower resolution.

8. The method of claim 1, wherein rendering objects with a low number of user interactions at a lower visual fidelity comprises rendering objects in two dimensions.

9. The method of claim 1, wherein modifying an appearance of objects shown in the VR system comprises similarly rendering objects with a low number of user interactions.

10. A system comprising:

one or more computers and one or more storage devices on which are stored instructions that are operable, when executed by the one or more computers, to cause the one or more computers to perform operations comprising;

logging user actions in a virtual reality (VR) system, wherein the user actions comprise (i) a path traveled by user in the VR system, and (ii) user interactions with objects in the VR system and wherein the VR system is an immersive VR system that relies on polygonal models and utilizes a headset that immerses the user in a VR environment, the headset having sensors configured to determine which direction the user'"'"'s head is facing, and wherein logging user interactions comprises monitoring whether a user looks at an object at least in part based on a direction the user'"'"'s head is facing;

aggregating logged action over a first user and a second user; and

deriving modifications to the VR system based at least in part on the aggregated logged actions, the modifications to the VR system comprising modifying an appearance of objects shown in the VR system, wherein modifying an appearance of objects shown in the VR system comprises rendering objects with a low number of user interactions at a lower visual fidelity than objects with a high number of user interactions, and wherein deriving modifications to the VR system based at least in part on the aggregated logged actions comprises applying crowd-guided assistance provided by a crowd assistance platform configured to allow a worker to share a request to a plurality of distributed experts and to allow an expert from the plurality of distributed experts to respond;

receiving data representing a request from the user to view an object of interest;

providing, via the virtual reality system, a 3D image of the object of interest;

receiving input from the user representing a specified area of interest associated with the object of interest; and

providing an enhanced interactive 3D image of at least a portion of the object of interest based on the received input.

11. The system of claim 10, wherein rendering objects with a low number of user interactions at a lower visual fidelity comprises rendering objects at a lower resolution.

12. The system of claim 10, wherein rendering objects with a low number of user interactions at a lower visual fidelity comprises rendering objects in two dimensions.

13. The system of claim 10, wherein modifying an appearance of objects shown in the VR system comprises similarly rendering objects with a low number of user interactions.

14. The system of claim 10, wherein logging user interactions comprises monitoring how a user looking at an object, determined by an angle and direction a user'"'"'s head is facing.

15. The system of claim 14, wherein monitoring how a user looks at an object comprises monitoring a user'"'"'s gaze direction.

16. The system of claim 10, wherein user interactions comprise touching an object in the VR system.

17. The system of claim 10, wherein logging user actions in the VR system comprises logging user actions using one or more sensors.

19. The system of claim 10, wherein user interactions comprise touching an object in the VR system.

18. The system of system 17, wherein the sensors comprises internet of things (TOT) sensors.