VIRTUAL REALITY EXPERIENCE FOR A VEHICLE
First Claim
1. An autonomous vehicle (AV) comprising:
- a sensor system to generate sensor data corresponding to a situational environment of the AV;
a data processing system to determine that values for the sensor data exceed one or more programmed thresholds for a virtual reality experience;
a control system to utilize the sensor data to autonomously control the AV along a current route;
one or more computing resources shared between a virtual reality system and other systems of the AV, including at least one of the sensor system, the data processing system, and the control system; and
the virtual reality system to;
provide the sensor data to a virtual reality application, executed on a second computing device, based on the values for the sensor data; and
manage utilization of the one or more computing resources between the second computing device and the other systems of the AV, wherein managing utilization includes (i) monitoring usage of the one or more computing resources by the other systems of the AV, (ii) determining that excess resources are available, and (iii) making the excess resources available to the virtual reality application to render the virtual reality experience in a higher fidelity or resolution and display the virtual reality experience to a rider in the AV.
7 Assignments
0 Petitions
Accused Products
Abstract
A virtual reality system is disclosed that provides autonomous vehicle (AV) sensor data to applications such as games and augmented reality overlays to enhance experiences for riders in the autonomous vehicle. Virtual reality headsets offer users unique and interesting experiences, but when used in a changing environment such as a moving vehicle, external stimuli can impair the virtual reality experience. AV sensors can predict these stimuli so that applications can take measures to reduce their impacts on virtual reality experiences. In addition, sensors can include cameras that send live video feeds to virtual reality devices to render improved views of the environment around the AV and of landmarks in a city. Furthermore, virtual reality devices can take advantage of the AV'"'"'s computing resources in order to offer better performance and more features to applications.
-
Citations
20 Claims
-
1. An autonomous vehicle (AV) comprising:
-
a sensor system to generate sensor data corresponding to a situational environment of the AV; a data processing system to determine that values for the sensor data exceed one or more programmed thresholds for a virtual reality experience; a control system to utilize the sensor data to autonomously control the AV along a current route; one or more computing resources shared between a virtual reality system and other systems of the AV, including at least one of the sensor system, the data processing system, and the control system; and the virtual reality system to; provide the sensor data to a virtual reality application, executed on a second computing device, based on the values for the sensor data; and manage utilization of the one or more computing resources between the second computing device and the other systems of the AV, wherein managing utilization includes (i) monitoring usage of the one or more computing resources by the other systems of the AV, (ii) determining that excess resources are available, and (iii) making the excess resources available to the virtual reality application to render the virtual reality experience in a higher fidelity or resolution and display the virtual reality experience to a rider in the AV. - View Dependent Claims (3, 4, 5, 6, 7, 8, 9, 10, 11)
-
-
2. (canceled)
-
12. A virtual reality system for an autonomous vehicle (AV) comprising:
-
one or more computing resources, including one or more processors, shared between the virtual reality system and other systems of the AV, including at least one of a sensor system, a data processing system, and a control system for the AV that utilizes the sensor data to autonomously control the AV along a current route; and one or more memory resources storing instructions that, when executed by the one or more processors, cause the virtual reality system to; retrieve, from the data processing system of the AV, sensor data corresponding to a situational environment of the AV, wherein the data processing system determines that values for the sensor data exceed one or more programmed thresholds for a virtual reality experience; provide the sensor data to a virtual reality application, executed on a second computing device, based on the values for the sensor data; and manage utilization of the one or more computing resources between the second computing device and the other systems of the AV, wherein managing utilization includes (i) monitoring usage of the one or more computing resources by the other systems of the AV, (ii) determining that excess resources are available, and (iii) making the excess resources available to the virtual reality application to render the virtual reality experience in a higher fidelity or resolution and display the virtual reality experience to a rider in the AV. - View Dependent Claims (14, 15, 16, 17, 18)
-
-
13. (canceled)
-
19. A non-transitory computer-readable medium storing instructions for a virtual reality system of an autonomous vehicle (AV), wherein the instructions when executed by one or more processors, cause the one or more processors to:
-
retrieve, from a data processing system of the AV, sensor data corresponding to a situational environment of the AV, wherein the data processing system determines that values for the sensor data exceed one or more programmed thresholds for a virtual reality experience; provide the sensor data to a virtual reality application, executed on a second computing device, based on the values for the sensor data; and manage utilization of one or more computing resources, shared between the virtual reality system and other systems of the AV, including at least one of a sensor system, the data processing system, and a control system for the AV that utilizes the sensor data to autonomously control the AV along a current route, between the second computing device and the other systems of the AV, wherein managing utilization includes (i) monitoring usage of the one or more computing resources by the other systems of the AV, (ii) determining that excess resources are available, and (iii) making the excess resources available to the virtual reality application to render the virtual reality experience in a higher fidelity or resolution and display the virtual reality experience to a rider in the AV.
-
-
20. (canceled)
Specification