Virtual Reality Environment Responsive to Predictive Route Navigation

• US 20170103571A1
• Filed: 10/13/2015
• Published: 04/13/2017
• Est. Priority Date: 10/13/2015
• Status: Active Grant

• Current Assignee: HERE Global B.V. (Nokia Corporation)
• Original Assignee: HERE Global B.V. (Nokia Corporation)
• Inventors: Beaurepaire, Jerome
• Granted Patent: US 10,724,874 B2
• Time in Patent Office: Days
• CPC Class Codes: G01C 21/3638 including 3D objects and buildings three dimensional [3D] modelling, e.g. data description of 3D objects G06T17/00; geographic models G06T17/05
• CPC Class Codes: G01C 21/3667 Display of a road map G01C21/3614 takes precedence; guidance using 3D or perspective road maps G01C21/3635
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G09B 9/02 for teaching control of vehicles or other craft

Abstract

A vehicle state sensor data record associated with a current state of a vehicle is received. A predictive vehicle navigation data record based on map data is also received. The map data is associated with a current location of the vehicle. A first element of a virtual reality environment is adapted based on the received vehicle state sensor data record, and second element of the virtual reality environment is generated based on the received predictive vehicle navigation data record.

Claims

1. A method comprising:

receiving a vehicle state sensor data record associated with a current state of a vehicle;

receiving a predictive vehicle navigation data record based on map data, the map data associated with a current location of the vehicle;

adapting a first element of a virtual reality environment based on the received vehicle state sensor data record; and

generating a second element of the virtual reality environment based on the received predictive vehicle navigation data record.

2. The method of claim 1, the method further comprising:

receiving a vehicle environment sensor data record associated with current surroundings of the vehicle; and

generating a third element of the virtual reality environment based on the received vehicle environment sensor data record associated with the current surroundings of the vehicle.

3. The method of claim 1, the method further comprising:

sending an instruction to adjust an instrument of the vehicle based on the virtual reality environment.

4. The method of claim 1, the method further comprising:

receiving an externally generated vehicle state sensor data record from at least one other vehicle; and

adapting a fourth element of the virtual reality environment based on the received externally generated vehicle sensor data record.

5. The method of claim 1, the method further comprising:

receiving an infrastructure data record from roadway infrastructure; and

adapting a fifth element of the virtual reality environment based on the received infrastructure data record.

6. The method of claim 1, wherein the received vehicle state sensor data record includes a current state of acceleration or deceleration of the vehicle.

7. The method of claim 1, wherein the virtual reality environment includes a path corresponding to a predicted route of the vehicle.

8. An apparatus comprising:

at least one processor; and

at least one memory including computer program code for one or more programs;

the at least one memory and the computer program code configured to, with the at least one processor, cause the system to at least perform;

receive a vehicle state sensor data record associated with a current state of a vehicle;

receive a predictive vehicle navigation data record based on map data, the map data associated with a current location of the vehicle;

receive a vehicle environment sensor data record associated with current surroundings of the vehicle;

adapt a first element of a virtual reality environment based on the received vehicle state sensor data records;

generate a second element of the virtual reality environment based on the received predictive vehicle navigation data record; and

generate a third element of the virtual reality environment based on the received vehicle environment sensor data record associated with the current surroundings of the vehicle.

9. The system of claim 8, the at least one memory and the computer program code configured to, with the at least one processor, cause the system to at least perform:

send an instruction to adjust an instrument of the vehicle based on the virtual reality environment.

10. The system of claim 8, the at least one memory and the computer program code configured to, with the at least one processor, cause the system to at least perform:

receive an externally generated vehicle state sensor data record from at least one other vehicle; and

adapt a fourth element of the virtual reality environment based on the received externally generated vehicle sensor data record.

11. The system of claim 8, the at least one memory and the computer program code configured to, with the at least one processor, cause the system to at least perform:

receive an infrastructure data record from roadway infrastructure; and

adapt a fifth element of the virtual reality environment based on the received infrastructure data record.

12. The system of claim 8, wherein the received vehicle state sensor data record includes a current state of acceleration or deceleration of the vehicle.

13. The system of claim 8, wherein the virtual reality environment includes a path corresponding to a predicted route of the vehicle.

14. A non-transitory computer readable medium including instructions that when executed are operable to:

receive a vehicle state sensor data record associated with a current state of a vehicle;

receive a predictive vehicle navigation data record based on map data, the map data associated with a current location of the vehicle;

receive a vehicle environment sensor data record associated with current surroundings of the vehicle;

adapt a first element of a virtual reality environment based on the received vehicle state sensor data records;

generate a second element of the virtual reality environment based on the received predictive vehicle navigation data record; and

generate a third element of the virtual reality environment based on the received vehicle environment sensor data record associated with the current surroundings of the vehicle.

15. The non-transitory computer readable medium of claim 14, including instructions that when executed are operable to:

send an instruction to adjust an instrument of the vehicle based on the virtual reality environment.

16. The non-transitory computer readable medium of claim 14, including instructions that when executed are operable to:

receive an externally generated vehicle sensor data record from at least one other vehicle; and

adapt a fourth element of the virtual reality environment based on the received externally generated vehicle sensor data record.

17. The non-transitory computer readable medium of claim 14, including instructions that when executed are operable to:

receive an infrastructure data record from roadway infrastructure; and

adapt a fifth element of the virtual reality environment based on the received infrastructure data record.

18. The non-transitory computer readable medium of claim 14, wherein the received vehicle state sensor data record includes a current state of acceleration or deceleration of the vehicle.

19. The non-transitory computer readable medium of claim 14, wherein the generated the virtual reality environment includes a path corresponding to a predicted route of the vehicle.

20. The non-transitory computer readable medium of claim 14, including instructions that when executed are operable to:

receive an autonomous driving vehicle data record associated with driver control; and

generate a sixth element of the virtual reality environment based on the received autonomous driving vehicle data record.