System and method for dynamic in-vehicle virtual reality

• US 10,437,322 B2
• Filed: 02/01/2019
• Issued: 10/08/2019
• Est. Priority Date: 10/03/2013
• Status: Active Grant

• Current Assignee: Honda Motor Co., Ltd. (Honda Motor Company)
• Original Assignee: Honda Motor Co., Ltd. (Honda Motor Company)
• Inventors: Alaniz, Arthur, Whinnery, Joseph, Murrish, Robert Wesley, Gleeson-May, Michael Eamonn
• Primary Examiner(s): Drennan, Barry
• Assistant Examiner(s): Robinson, Terrell M
• Application Number:
  US16/265,712
• Publication Number:
  US 20190163265A1
• Time in Patent Office: 249 Days
• CPC Class Codes: B60R 2300/20 characterised by the type of display used
• CPC Class Codes: B60R 2300/8006 for monitoring and displaying scenes of vehicle interior, e.g. for monitoring passengers or cargo
• CPC Class Codes: G02B 2027/0187 slaved to motion of at least a part of the body of the user, e.g. head, eye
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text

Abstract

A method for dynamic virtual reality includes receiving vehicle data. The vehicle data includes a velocity, an orientation, and a location of a vehicle within a first frame of reference. The method also includes receiving user data. The user data includes a velocity, an orientation and a location of a user within a second frame of reference different than the first frame of reference. The method includes generating a view based on the vehicle data, the user data, and a model, the model including one or more components that define the view. The method includes determining a difference between the user data and the vehicle data. The method includes rendering the view to the output device by controlling the output device to update display of the view according to the determined difference relative to the second frame of reference.

Claims

1. A computer-implemented method for virtual reality rendering views to an output device, comprising:

receiving vehicle data from a portable device, the vehicle data including a velocity, an orientation, and a location of a vehicle;

receiving user data from the portable device, the user data including a velocity, an orientation and a location of a user;

generating a view based on the vehicle data, the user data and a model, the model including one or more components that define the view;

determining a difference between the user data and the vehicle data indicative of a perspective based on motion of the vehicle from the vehicle data and motion of the user from the user data; and

rendering the view to the output device by controlling the output device to update display of the view according to the determined difference.

2. The computer-implemented method of claim 1, wherein the user data includes health data about the user, and wherein the health data is received from one or more health monitoring devices associated with the user.

3. The computer-implemented method of claim 2, wherein the one or more health monitoring devices are integrated with the output device.

4. The computer-implemented method of claim 2, wherein rendering the view to the output device includes modifying the view based on the health data to minimize sensory processing.

5. The computer-implemented method of claim 2, wherein rendering the view is performed at a predetermined rendering speed, and wherein the computer-implemented method includes adjusting the predetermined rendering speed based on the health data.

6. The computer-implemented method of claim 1, wherein the output device is located remotely from the vehicle.

7. The computer-implemented method of claim 1, wherein the vehicle data includes vehicle environment data, and the computer-implemented method further comprises modifying the view based on the vehicle environment data.

8. The computer-implemented method of claim 1, wherein generating the view is further based on a model, the model including one or more components that define the view, and wherein the one or more components includes a virtual vehicle.

9. A computing system for rendering views to an output device, comprising:

a processor operatively connected for computer communication to one or more vehicle systems of a vehicle and the output device, the processor including;

a virtual reality data module receiving vehicle data associated with one or more of the vehicle systems of the vehicle from a portable device, wherein the vehicle data includes a velocity, an orientation, and a location of the vehicle, the virtual reality data module receiving predictive vehicle data including a velocity, an orientation, and a location of the vehicle;

and the virtual reality data module receiving user data the from the portable device, the user data including a velocity, an orientation and a location of a user, wherein the user is in possession of the output device;

a dynamic virtual reality module generates a view based on the vehicle data, the predictive vehicle data, the user data, and a model, the model including one or more components that define the view; and

a rendering module determines a difference between the user data and the vehicle data indicative of a perspective based on motion of the vehicle and motion of the user from the user data, and wherein the rendering module renders the view to the output device by controlling the output device to update display of the view according to the determined difference and the predictive vehicle data.

10. The computing system of claim 9, wherein the user data includes health data about the user, and wherein the health data is received from one or more health monitoring devices associated with the user.

11. The computing system of claim 10, wherein the one or more health monitoring devices are integrated with the portable device.

12. The computing system of claim 10, wherein the rendering module modifies the view based on the health data to minimize sensory processing.

13. The computing system of claim 10, wherein the rendering module renders the view at a predetermined rendering speed, and wherein the rendering module adjusts the predetermined rendering speed based on the health data.

14. The computing system of claim 9, wherein the output device is located remotely from the vehicle.

15. The computing system of claim 9, wherein the vehicle data includes vehicle environment data, and wherein the rendering module modifies the view based on the vehicle environment data.

16. The computing system of claim 9, wherein generating the view is further based on a model, the model including one or more components that define the view, and wherein the one or more components includes a virtual vehicle.

17. A non-transitory computer-readable medium comprising instructions that when executed by a processor perform a method for rendering views to an output device, comprising:

receiving vehicle data from a portable device, the vehicle data including a velocity, an orientation, and a location of a vehicle;

receiving user data from the portable device, the user data including a velocity, an orientation and a location of a user;

generating a view based on the vehicle data, the user data and a model, the model including one or more components that define the view;

determining a difference between the user data and the vehicle data indicative of a perspective based on motion of the vehicle from the vehicle data and motion of the user from the user data; and

rendering the view to the output device by controlling the output device to update display of the view according to the determined difference.

18. The non-transitory computer-readable medium of claim 17, wherein the user data includes health data about the user.

19. The non-transitory computer-readable medium of claim 17, wherein the output device is located remotely from the vehicle.

20. The non-transitory computer-readable medium of claim 17, wherein the vehicle data includes vehicle environment data.