System and method for dynamic in-vehicle virtual reality

• US 10,764,554 B2
• Filed: 01/30/2019
• Issued: 09/01/2020
• Est. Priority Date: 10/03/2013
• Status: Active Grant

• Current Assignee: Honda Motor Co., Ltd. (Honda Motor Company)
• Original Assignee: Honda Motor Co., Ltd. (Honda Motor Company)
• Inventors: Alaniz, Arthur, Whinnery, Joseph, Murrish, Robert Wesley, Gleeson-May, Michael Eamonn
• Primary Examiner(s): Robinson, Terrell M
• Application Number:
  US16/262,826
• Publication Number:
  US 20190166353A1
• Time in Patent Office: 580 Days
• CPC Class Codes: G01C 21/365 Guidance using head up displays or projectors, e.g. virtual vehicles or arrows projected on the windscreen or on the road itself
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06T 19/00 Manipulating 3D models or images for computer graphics
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: H04N 13/117 the virtual viewpoint locations being selected by the viewers or determined by viewer tracking
• CPC Class Codes: H04N 13/344 with head-mounted left-right displays
• CPC Class Codes: H04N 13/366 using viewer tracking
• CPC Class Codes: H04N 13/398 Synchronisation thereof; Control thereof

Abstract

A method for rendering views to an output device, including receiving vehicle data from a portable device. The vehicle data is from a frame of reference of an exterior environment of a vehicle. The method also includes receiving user data from a portable device. The user data includes a health data about a user from a frame of reference of an exterior environment of the vehicle. The method also includes generating a view based on the vehicle data, the user data and a model. The model includes one or more components that define the view. The method further includes determining a difference between the user data and the vehicle data. The method additionally includes rendering the view at a rendering speed to the output device by controlling the output device to update display of the view according to the determined difference. The rendering speed is based on the health data.

Claims

1. A computer-implemented method for rendering views for an immersive virtual reality or augmented reality to an output device, comprising:

receiving vehicle data from a portable device, wherein the vehicle data is from a frame of reference of an exterior environment of a vehicle;

receiving user data from the portable device, wherein the user data includes a health data about a user from the frame of reference of the exterior environment of the vehicle;

generating a view for the immersive virtual reality or augmented reality based on the vehicle data, the user data, and a model, the model including one or more components that define the view;

determining a difference, from the frame of reference of the exterior environment of the vehicle, between the user data and the vehicle data; and

rendering the view at a rendering speed to the output device by controlling the output device to update display of the view for the immersive virtual reality or augmented reality according to the determined difference, wherein the rendering speed is reduced in response to the health data.

2. The computer-implemented method of claim 1, wherein rendering the view to the output device includes modifying the view based on the health data to minimize sensory processing.

3. The computer-implemented method of claim 1, wherein rendering the view includes augmenting the one or more components of the model based on the determined difference.

4. The computer-implemented method of claim 1, wherein the portable device is operatively connected for computer communication to one or more portable medical devices worn by the user or in-vehicle biological health monitoring devices.

5. The computer-implemented method of claim 1, further comprising:

receiving updated health data about the user; and

adjusting the rendering speed based on the updated health data.

6. The computer-implemented method of claim 1, wherein the health data indicates motion or sensory issues including one or more of disorientation, vertigo, and motion sickness.

7. A computing system for rendering views for an immersive virtual reality or augmented reality to an output device, comprising:

a processor operatively connected for computer communication to one or more vehicle systems of a vehicle and the output device, the processor including;

a virtual reality data module receives vehicle data and user data from a portable device, wherein the vehicle data is from a frame of reference of an exterior environment of a vehicle, and wherein the user data includes a health data about a user from the frame of reference of the exterior environment of the vehicle;

a dynamic virtual reality module generates a view for the immersive virtual reality or augmented reality based on the vehicle data, the user data, and a model, the model including one or more components that define the view;

a rendering module determines a difference between the user data and the vehicle data indicative of a perspective based on motion of the vehicle within the frame of reference of the exterior environment of the vehicle from the vehicle data and motion of the user within the frame of reference of the vehicle from the user data and the rendering module renders the view to the output device by controlling the output device to update display of the view for the immersive virtual reality or augmented reality according to the determined difference, wherein rendering speed of the rendering is reduced in response to the health data.

8. The computer system of claim 7, wherein the dynamic virtual reality module modifies the view based on the health data to minimize sensory processing.

9. The computer system of claim 7, wherein the dynamic virtual reality module augments the one or more components of the model based on the determined difference.

10. The computer system of claim 7, wherein the portable device is operatively connected for computer communication to one or more portable medical devices worn by the user or in-vehicle biological health monitoring devices.

11. The computer system of claim 7, further comprising:

receiving updated health data about the user; and

adjusting the rendering speed based on the updated health data.

12. A non-transitory computer-readable medium comprising instructions that when executed by a processor perform a method for rendering views for an immersive virtual reality or augmented reality to an output device in a vehicle, comprising:

receiving vehicle data from a portable device, wherein the vehicle data is from a frame of reference of an exterior environment of a vehicle;

receiving user data from the portable device, wherein the user data includes a health data about a user from the frame of reference of the exterior environment of the vehicle;

generating a view for the immersive virtual reality or augmented reality based on the vehicle data, the user data, and a model, the model including one or more components that define the view;

determining a difference between the user data and the vehicle data; and

rendering the view at a rendering speed to the output device by controlling the output device to update display of the view for the immersive virtual reality or augmented reality according to the determined difference, wherein the rendering speed is reduced in response to the health data.

13. The non-transitory computer-readable medium of claim 12, wherein rendering the view to the output device includes modifying the view based on the health data to minimize sensory processing.

14. The non-transitory computer-readable medium of claim 12, wherein rendering the view includes augmenting the one or more components of the model based on the determined difference.

15. The non-transitory computer-readable medium of claim 12, wherein the portable device is operatively connected for computer communication to one or more portable medical devices worn by the user or in-vehicle biological health monitoring devices.

16. The non-transitory computer-readable medium of claim 12, further comprising:

receiving updated health data about the user; and

adjusting the rendering speed based on the updated health data.

17. The non-transitory computer-readable medium of claim 12, wherein the health data indicates motion or sensory issues including one or more of disorientation, vertigo, and motion sickness.