SYSTEM AND METHOD FOR DYNAMIC IN-VEHICLE VIRTUAL REALITY

• US 20170078638A1
• Filed: 11/22/2016
• Published: 03/16/2017
• Est. Priority Date: 10/03/2013
• Status: Active Grant

• Current Assignee: Honda Motor Co., Ltd. (Honda Motor Company)
• Original Assignee: Honda Motor Co., Ltd. (Honda Motor Company)
• Inventors: Alaniz, Arthur, Whinnery, Joseph, Murrish, Robert Wesley, Gleeson-May, Michael Eamonn
• Granted Patent: US 10,237,529 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G01C 21/365 Guidance using head up displays or projectors, e.g. virtual vehicles or arrows projected on the windscreen or on the road itself
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06T 19/00 Manipulating 3D models or images for computer graphics
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: H04N 13/117 the virtual viewpoint locations being selected by the viewers or determined by viewer tracking
• CPC Class Codes: H04N 13/344 with head-mounted left-right displays
• CPC Class Codes: H04N 13/366 using viewer tracking
• CPC Class Codes: H04N 13/398 Synchronisation thereof; Control thereof

Abstract

A method for in-vehicle dynamic virtual reality, including receiving vehicle data from a portable device, the portable device operably connected for computer communication to an output device, the vehicle data including vehicle dynamics data, and receiving user data from at least one of the portable device or the output device. The method including generating a virtual view based on the vehicle data, the user data and a virtual world model, the virtual world model including one or more components that define the virtual view, wherein generating the virtual view includes augmenting one or more components of the virtual world model according to at least one of the vehicle data or the user data. The method including rendering the virtual view to the output device by controlling the output device to update display of the virtual view according to at least one of the vehicle data or the user data.

Claims

1. A computer-implemented method for in-vehicle dynamic virtual reality, comprising:

receiving vehicle data from a portable device, the portable device operably connected for computer communication to an output device, the vehicle data including vehicle dynamics data of the vehicle;

receiving user data from at least one of the portable device or the output device;

generating a virtual view based on the vehicle data, the user data and a virtual world model, the virtual world model including one or more components that define the virtual view, wherein generating the virtual view includes augmenting one or more components of the virtual world model according to at least one of the vehicle data or the user data; and

rendering the virtual view to the output device by controlling the output device to update display of the virtual view according to at least one of the vehicle data or the user data.

2. The computer-implemented method of claim 1, wherein the portable device obtains the vehicle data independently from the vehicle.

3. The computer-implemented method of claim 1, wherein the portable device is located within a motion frame of reference of the vehicle.

4. The computer-implemented method of claim 1, wherein the portable device includes position and motion sensors, and gathers the vehicle data from the sensors.

5. The computer-implemented method of claim 1, comprising determining vehicle motion data based on the vehicle dynamics data.

6. The computer-implemented method of claim 5, wherein the vehicle motion data comprises at least velocity and acceleration data.

7. The computer-implemented method of claim 5, comprising determining user motion data representing motion of the user relative to the vehicle based on the user data and the vehicle data.

8. The computer-implemented method of claim 7, wherein augmenting one or more components of the virtual world model is based on at least one of the user motion data and the vehicle motion data.

9. The computer-implemented method of claim 7, comprising determining a temporal-motion rendering speed based on the vehicle motion data and the user motion data.

10. The computer-implemented method of claim 9, wherein rendering the virtual view to the output device comprises controlling the output device to update display of the virtual view based on the temporal-motion rendering speed.

11. A system for in-vehicle dynamic virtual reality, comprising:

a portable device including one or more sensors for gathering vehicle data, the portable device operably connected to an output device and a processor, the processor includes;

a virtual reality data module receives vehicle data from the portable device, wherein the vehicle data includes vehicle dynamics data of the vehicle, and receives user data from at least one of the portable device or the output device;

a dynamic virtual reality module generates the virtual view based on the vehicle data, the user data and a virtual world model, wherein generating the virtual view includes augmenting one or more components of the virtual world model according to at least one of the vehicle data or the user data; and

a rendering module renders the virtual view from the dynamic reality module to the output device by controlling the output device to update display of the virtual view according to at least one of the vehicle data and the user data.

12. The system of claim 11, wherein the portable device provides a proxy for vehicle sensors of the vehicle.

13. The system of claim 11, wherein the portable device is attached to the vehicle in a location within a motion reference frame of the vehicle.

14. The system of claim 11, wherein the rendering module determines vehicle motion data based on the vehicle dynamics data.

15. The system of claim 14, wherein the rendering module determines user motion data representing motion of the user relative to the vehicle based on the user data and the vehicle data.

16. The system of claim 15, wherein the rendering module determines a temporal-motion rendering speed based on the vehicle motion data and the user motion data.

17. The system of claim 16, wherein the rendering module renders the virtual view to the output device by controlling the output device to update display of the virtual view based on the temporal-motion rendering speed.

18. The system of claim 16, wherein the dynamic virtual reality module augments one or more properties of one or more of the components of the virtual world model based on the temporal-motion rendering speed.

19. A non-transitory computer-readable storage medium storing instructions that, when executed by a vehicle computer, causes the computer to perform the steps of:

receiving vehicle data from sensors of a portable device, the portable device operably connected for computer communication to an output device, the vehicle data including vehicle dynamics data of the vehicle;

receiving user data from at least one of the portable device or the output device;

generating a virtual view based on the vehicle data, the user data and a virtual world model, the virtual world model including one or more components that define the virtual view, wherein generating the virtual view includes augmenting one or more components of the virtual world model according to at least one of the vehicle data or the user data; and

rendering the virtual view to the output device by controlling the output device to update display of the virtual view according to at least one of the vehicle data or the user data.

20. The non-transitory computer-readable storage medium of claim of claim 19, comprising determining a temporal-motion rendering speed based on the vehicle dynamics data and the user data, and wherein rendering the virtual view to an output device comprises controlling the output device to update display of the virtual view based on the temporal-motion rendering speed.