Technologies for motion-compensated virtual reality

• US 10,186,065 B2
• Filed: 10/01/2016
• Issued: 01/22/2019
• Est. Priority Date: 10/01/2016
• Status: Active Grant

• Current Assignee: Intel Corporation
• Original Assignee: Intel Corporation
• Inventors: Anderson, Glen J., Beckwith, Richard T., Agrawal, Ankur, Shi, Meng
• Primary Examiner(s): Amin, Jwalant
• Application Number:
  US15/283,333
• Publication Number:
  US 20180096501A1
• Time in Patent Office: 843 Days
• CPC Class Codes: B60K 2360/165 Videos and animations
• CPC Class Codes: B60K 2360/166 Navigation
• CPC Class Codes: B60K 2360/177 Augmented reality
• CPC Class Codes: B60K 2360/5915 Inter vehicle communication
• CPC Class Codes: B60K 35/00 Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
• CPC Class Codes: B60K 35/10 Input arrangements, i.e. from user to vehicle, associated with vehicle functions or specially adapted therefor
• CPC Class Codes: B60K 35/23 Head-up displays [HUD] optical aspects of head-up displays G02B27/01
• CPC Class Codes: B60K 35/28 characterised by the type of the output information, e.g. video entertainment or vehicle dynamics information; characterised by the purpose of the output information, e.g. for attracting the attention of the driver
• CPC Class Codes: B60K 35/85 Arrangements for transferring vehicle- or driver-related data
• CPC Class Codes: G02B 2027/0183 Adaptation to parameters characterising the motion of the vehicle
• CPC Class Codes: G02B 27/0179 Display position adjusting means not related to the information to be displayed
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 2200/16 involving adaptation to the client's capabilities
• CPC Class Codes: G06V 20/20 in augmented reality scenes
• CPC Class Codes: G06V 20/56 exterior to a vehicle by using sensors mounted on the vehicle
• CPC Class Codes: G06V 20/59 inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions
• CPC Class Codes: G06V 40/174 Facial expression recognition

Abstract

Technologies for motion-compensated virtual reality include a virtual reality compute device of a vehicle. The virtual reality compute device is configured to render a virtual reality content to an occupant of the vehicle and determine a motion of the vehicle based at least on sensor data generated by one or more vehicle motion sensors of the vehicle. Based on the determined motion of the vehicle, the virtual reality compute device modifies the rendered virtual reality media. In some embodiments, the virtual reality compute device may utilize other sensors associated with the vehicle and/or a user-worn virtual reality device to predict the motion of the vehicle in order to determine an expected motion of the vehicle that is expected to be sensed in the future.

Claims

1. A virtual reality compute device of a vehicle, the virtual reality compute device comprising:

a motion-to-virtual reality content mapping database having stored therein a motion-to-virtual reality content mapping that maps vehicle motion to motion compensation virtual reality content

a virtual reality renderer to render virtual reality content to an occupant of the vehicle; and

a virtual reality motion compensator to (i) determine a motion of the vehicle based at least on sensor data generated by one or more vehicle motion sensors of the vehicle;

(ii) compare the determined motion of the vehicle to the motion-to-virtual reality content mapping to determine corresponding motion compensation virtual reality content; and

(iii) modify the rendered virtual reality media based on the determined motion compensation virtual reality content.

2. The virtual reality compute device of claim 1, wherein to determine the motion of the vehicle comprises to determine the motion of the vehicle based on sensor data produced by one or more vehicle motion sensors of the vehicle.

3. The virtual reality compute device of claim 1, wherein to determine the motion of the vehicle further comprises to determine the motion of the vehicle based on a predicted motion of the vehicle.

4. The virtual reality compute device of claim 3, wherein to determine the motion of the vehicle based on the predicted motion of the vehicle comprises:

to access navigation data provided by a vehicle navigation system of the vehicle, and

to predict a motion of the vehicle based on the accessed navigation data.

5. The virtual reality compute device of claim 3, wherein to determine the motion of the vehicle based on the predicted vehicle motion comprises to predict a motion of the vehicle based on historical motion data indicative of a historical motion of the vehicle.

6. The virtual reality compute device of claim 1, wherein:

to determine the motion of the vehicle comprises (i) to determine a present motion of the vehicle and (ii) to determine a vehicle motion sensor data signature indicative of the initiation of a predicted vehicle motion; and

to modify the rendered virtual reality media comprises to modify the rendered virtual reality media in response to a determination that the determined present motion of the vehicle matches the vehicle motion sensor data signature.

7. The virtual reality compute device of claim 1, wherein to modify the rendered virtual reality media content comprises to:

compare the determined motion of the vehicle to a reference threshold; and

modify the rendered virtual reality media content in response to a determination that the determined motion of the vehicle satisfies is greater than the reference threshold.

8. A method for rendering virtual reality media, the method comprising:

rendering, by a virtual reality compute device of a vehicle, a virtual reality content to an occupant of the vehicle;

determining, by the virtual reality compute device, a motion of the vehicle based at least on sensor data generated by one or more vehicle motion sensors of the vehicle;

comparing, by the virtual reality compute device, the determined motion of the vehicle to a motion-to-virtual reality content mapping stored in motion-to-virtual reality content mapping database to determine a motion compensation virtual reality content, wherein the motion-to-virtual reality content mapping maps vehicle motion to motion compensation virtual reality content; and

modifying, by the virtual reality compute device, the rendered virtual reality media content based on the determined motion compensation virtual reality content.

9. The method of claim 8, wherein determining the motion of the vehicle comprises determining the motion of the vehicle based on sensor data produced by one or more vehicle motion sensors of the vehicle.

10. The method of claim 8, wherein determining the motion of the vehicle further comprises determining the motion of the vehicle based on a predicted motion of the vehicle.

11. The method of claim 10, wherein determining the motion of the vehicle based on the predicted motion of the vehicle comprises:

accessing navigation data provided by a vehicle navigation system of the vehicle, and

predicting a motion of the vehicle based on the accessed navigation data.

12. The method of claim 10, wherein determining the motion of the vehicle based on the predicted vehicle motion comprises predicting a motion of the vehicle based on historical motion data indicative of a historical motion of the vehicle.

13. The method of claim 8, wherein:

determining the motion of the vehicle comprises (i) determining a present motion of the vehicle and (ii) determining a vehicle motion sensor data signature indicative of the initiation of a predicted vehicle motion; and

modifying the rendered virtual reality media comprises modifying the rendered virtual reality media in response to a determination that the determined present motion of the vehicle matches the vehicle motion sensor data signature.

14. The method of claim 8, wherein modifying the rendered virtual reality media content comprises:

comparing the determination motion of the vehicle to a reference threshold; and

modifying the rendered virtual reality media content in response to a determination that the determined motion of the vehicle satisfies is greater than the reference threshold.

15. One or more non-transitory, machine-readable storage media comprising a plurality of instructions stored thereon that, when executed, causes a virtual reality compute device to:

render a virtual reality content to an occupant of the vehicle;

determine a motion of the vehicle based at least on sensor data generated by one or more vehicle motion sensors of the vehicle;

compare the determined motion of the vehicle to a motion-to-virtual reality content mapping stored in motion-to-virtual reality content mapping database to determine a motion compensation virtual reality content, wherein the motion-to-virtual reality content mapping maps vehicle motion to motion compensation virtual reality content; and

modify the rendered virtual reality media content based on the determined motion compensation virtual reality content.

16. The one or more non-transitory, machine-readable storage media of claim 15, wherein to determine the motion of the vehicle comprises to determine the motion of the vehicle based on sensor data produced by one or more vehicle motion sensors of the vehicle.

17. The one or more non-transitory, machine-readable storage media of claim 15, wherein to determine the motion of the vehicle further comprises to determine the motion of the vehicle based on a predicted motion of the vehicle.

18. The one or more non-transitory, machine-readable storage media of claim 17, wherein to determine the motion of the vehicle based on the predicted motion of the vehicle comprises to:

access navigation data provided by a vehicle navigation system of the vehicle, and

predict a motion of the vehicle based on the accessed navigation data.

19. The one or more non-transitory machine-readable storage media of claim 17, wherein to determine the motion of the vehicle based on the predicted vehicle motion comprises to predict a motion of the vehicle based on historical motion data indicative of a historical motion of the vehicle.

20. The one or more non-transitory, machine-readable storage media of claim 15, wherein to:

determine the motion of the vehicle comprises to (i) determine a present motion of the vehicle and (ii) determine a vehicle motion sensor data signature indicative of the initiation of a predicted vehicle motion; and

modify the rendered virtual reality media comprises to modify the rendered virtual reality media in response to a determination that the determined present motion of the vehicle matches the vehicle motion sensor data signature.

21. The one or more non-transitory, machine-readable storage media of claim 15, wherein to modify the rendered virtual reality media content comprises to:

compare the determination motion of the vehicle to a reference threshold; and

modify the rendered virtual reality media content in response to a determination that the determined motion of the vehicle satisfies is greater than the reference threshold.