SYSTEM AND METHOD FOR DYNAMIC IN-VEHICLE VIRTUAL REALITY

• US 20150097860A1
• Filed: 02/11/2014
• Published: 04/09/2015
• Est. Priority Date: 10/03/2013
• Status: Active Grant

• Current Assignee: Honda Motor Co., Ltd. (Honda Motor Company)
• Original Assignee: Honda Motor Co., Ltd. (Honda Motor Company)
• Inventors: Alaniz, Arthur, Whinnery, Joseph, Gleeson-May, Michael Eamonn, Murrish, Robert
• Granted Patent: US 9,547,173 B2
• Time in Patent Office: Days
• US Class Current: 345/633
• CPC Class Codes: B60R 2300/20 characterised by the type of display used
• CPC Class Codes: B60R 2300/8006 for monitoring and displaying scenes of vehicle interior, e.g. for monitoring passengers or cargo
• CPC Class Codes: G02B 2027/0187 slaved to motion of at least a part of the body of the user, e.g. head, eye
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text

Abstract

A method for in-vehicle dynamic virtual reality includes receiving vehicle data from one or more vehicle systems of a vehicle, wherein the vehicle data includes vehicle dynamics data and receiving user data from a virtual reality device. The method includes generating a virtual view based on the vehicle data, the user data and a virtual world model, the virtual world model including one or more components that define the virtual view, wherein generating the virtual view includes augmenting one or more components of the virtual world model according to at least one of the vehicle data and the user data and rendering the virtual view to an output device by controlling the output device to update display of the virtual view according to the vehicle dynamics data.

Claims

1. A computer-implemented method for in-vehicle dynamic virtual reality, comprising:

receiving vehicle data from one or more vehicle systems of a vehicle, wherein the vehicle data includes vehicle dynamics data;

receiving user data from a virtual reality device;

generating a virtual view based on the vehicle data, the user data and a virtual world model, the virtual world model including one or more components that define the virtual view, wherein generating the virtual view includes augmenting one or more components of the virtual world model according to at least one of the vehicle data and the user data; and

rendering the virtual view to an output device by controlling the output device to update display of the virtual view according to the vehicle dynamics data.

2. The method of claim 1, comprising determining an orientation and a location of the vehicle based on the vehicle data.

3. The method of claim 2, comprising determining an orientation and a location of the user relative to the vehicle based on the user data and the vehicle data.

4. The method of claim 3, wherein augmenting one or more components of the virtual world model is based on at least one of the orientation and the location of the vehicle and the orientation and the location of the user.

5. The method of claim 1, comprising determining vehicle motion data based on the vehicle dynamics data.

6. The method of claim 5, wherein determining the vehicle motion data includes determining predictive vehicle motion data.

7. The method of claim 5, comprising determining user motion data representing motion of the user relative to the vehicle based on the user data and the vehicle data.

8. The method of claim 7, comprising determining a temporal-motion rendering speed based on the vehicle motion data and the user motion data.

9. The method of claim 8, wherein rendering the virtual view to an output device comprises controlling the output device to update display of the virtual view based on the temporal-motion rendering speed.

10. A vehicle computing system for in-vehicle dynamic virtual reality, comprising:

a data store storing a virtual world model, the virtual world model including one or more components that define a virtual view;

a processor operatively connected for computer communication to the data store, one or more vehicle systems of a vehicle and a virtual reality device, the processor including;

a virtual reality data module receiving vehicle data from the one or more vehicle systems of a vehicle, wherein the vehicle data includes vehicle dynamics data, and receiving user data from the virtual reality device;

a dynamic virtual reality module generating the virtual view based on the vehicle data, the user data and the virtual world model from the data store, wherein generating the virtual view includes augmenting one or more components of the virtual world model according to at least one of the vehicle data and the user data; and

a rendering module rendering the virtual view from the dynamic reality module to an output device by controlling the output device to update display of the virtual view according to the vehicle dynamics data.

11. The system of claim 10, wherein the dynamic virtual reality module augments one or more properties of one or more of the components of the virtual world model based on the vehicle data and the user data.

12. The system of claim 11, wherein the one or more properties includes a motion property defining a motion of the component.

13. The system of claim 10, wherein the rendering module determines vehicle motion data based on the vehicle dynamics data.

14. The system of claim 13, wherein the rendering module determines user motion data representing motion of the user relative to the vehicle based on the user data and the vehicle data.

15. The system of claim 14, wherein the rendering module determines a temporal-motion rendering speed based on the vehicle motion data and the user motion data.

16. The system of claim 15, wherein the rendering module renders the virtual view to the output device by controlling the output device to update display of the virtual view based on the temporal-motion rendering speed.

17. The system of claim 15, wherein the dynamic virtual reality module augments one or more properties of one or more of the components of the virtual world model based on the temporal-motion rendering speed.

18. A non-transitory computer-readable storage medium storing instructions that, when executed by a vehicle computer, causes the computer to perform the steps of:

receiving vehicle data from one or more vehicle systems of a vehicle, wherein the vehicle data includes vehicle dynamics data;

receiving user data from a virtual reality device;

generating a virtual view based on the vehicle data, the user data and a virtual world model, the virtual world model including one or more components that define the virtual view, wherein generating the virtual view includes augmenting one or more components of the virtual world model according to at least one of the vehicle data and the user data; and

rendering the virtual view to an output device by controlling the output device to update display of the virtual view according to the vehicle dynamics data.

19. The non-transitory computer-readable storage medium of claim of claim 18, comprising determining a temporal-motion rendering speed based on the vehicle dynamics data and the user data.

20. The non-transitory computer-readable storage medium of claim of claim 19, wherein rendering the virtual view to an output device comprises controlling the output device to update display of the virtual view based on the temporal-motion rendering speed.