SYSTEM AND METHOD FOR DYNAMIC IN-VEHICLE VIRTUAL REALITY

• US 20150097864A1
• Filed: 08/08/2014
• Published: 04/09/2015
• Est. Priority Date: 10/03/2013
• Status: Active Grant

• Current Assignee: Honda Motor Co., Ltd. (Honda Motor Company)
• Original Assignee: Honda Motor Co., Ltd. (Honda Motor Company)
• Inventors: Alaniz, Arthur, Whinnery, Joseph, Murrish, Robert Wesley, Gleeson-May, Michael Eamonn
• Granted Patent: US 9,715,764 B2
• Time in Patent Office: Days
• US Class Current: 345/633
• CPC Class Codes: A63F 13/211 using inertial sensors, e.g. accelerometers or gyroscopes
• CPC Class Codes: A63F 13/216 using geographical information, e.g. location of the game device or player using GPS
• CPC Class Codes: A63F 13/332 using wireless networks, e.g. cellular phone networks
• CPC Class Codes: A63F 13/5255 according to dedicated instructions from a player, e.g. using a secondary joystick to rotate the camera around a player's character
• CPC Class Codes: A63F 13/65 automatically by game devices or servers from real world data, e.g. measurement in live racing competition
• CPC Class Codes: B60K 2360/55 Remote control arrangements
• CPC Class Codes: B60K 2360/589 Wireless data transfers
• CPC Class Codes: B60K 2360/77 Instrument locations other than the dashboard
• CPC Class Codes: B60K 2370/152 Displays
• CPC Class Codes: B60K 2370/155 Virtual instruments
• CPC Class Codes: B60K 2370/55 Remote controls
• CPC Class Codes: B60K 2370/589 Wireless
• CPC Class Codes: B60K 2370/77 characterised by locations other than the dashboard
• CPC Class Codes: B60K 35/00 Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
• CPC Class Codes: B60K 35/213 Virtual instruments
• CPC Class Codes: B60K 35/22 Display screens
• CPC Class Codes: B60K 35/60 Instruments characterised by their location or relative disposition in or on vehicles arrangements of lighting devices on dashboards B60Q3/10
• CPC Class Codes: B60K 35/80 Arrangements for controlling instruments
• CPC Class Codes: B60K 35/85 Arrangements for transferring vehicle- or driver-related data
• CPC Class Codes: G01C 21/365 Guidance using head up displays or projectors, e.g. virtual vehicles or arrows projected on the windscreen or on the road itself
• CPC Class Codes: G06F 3/011 : Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/04815 : Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06T 19/006 : Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 7/20 : Analysis of motion motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51
• CPC Class Codes: G06T 7/70 : Determining position or orientation of objects or cameras camera calibration G06T7/80

Abstract

A method for in-vehicle dynamic virtual reality includes receiving vehicle data and user data from one or more portable devices, wherein the vehicle data comprises vehicle dynamics data of the vehicle. The method includes generating a virtual view based on the vehicle data, the user data and a virtual world model. The virtual world model including one or more components that define the virtual view and wherein generating the virtual view includes augmenting one or more components of the virtual world model according to at least one of the vehicle data and the user data. The method includes rendering the virtual view to an output device by controlling the output device to update display of the virtual view according to at least one of the vehicle data or the user data

Claims

1. A computer-implemented method for in-vehicle dynamic virtual reality, comprising:

receiving vehicle data and user data from one or more portable devices, wherein the vehicle data comprises vehicle dynamics data of the vehicle;

generating a virtual view based on the vehicle data, the user data and a virtual world model, the virtual world model including one or more components that define the virtual view, wherein generating the virtual view includes augmenting one or more components of the virtual world model according to at least one of the vehicle data and the user data; and

rendering the virtual view to an output device by controlling the output device to update display of the virtual view according to at least one of the vehicle data or the user data.

2. The method of claim 1, wherein the portable device is an off-vehicle device that obtains the vehicle data externally from the vehicle.

3. The method of claim 2, wherein the vehicle data comprises data about the external environment of the vehicle.

4. The method of claim 2, wherein the off-vehicle device is an imaging unit mounted to a stationary structure external to the vehicle.

5. The method of claim 2, comprising determining vehicle motion data based on the vehicle data.

6. The method of claim 1, wherein the vehicle data comprises a predetermined path of the vehicle.

7. The method of claim 6, wherein determining the vehicle motion data comprises determining at least a velocity and an acceleration of the vehicle based on the predetermined path of the vehicle.

8. The method of claim 5, comprising determining user motion data representing motion of the user relative to the vehicle based on the user data and the vehicle data.

9. The method of claim 8, comprising determining a temporal-motion rendering speed based on the vehicle motion data and the user motion data.

10. The method of claim 9, wherein rendering the virtual view to an output device comprises controlling the output device to update display of the virtual view based on the temporal-motion rendering speed.

11. A vehicle computing system for in-vehicle dynamic virtual reality, comprising:

one or more portable devices that receive and transmit vehicle data and user data;

a processor operably connected to the one or more portable devices, the processor comprising;

a virtual reality data module that receives vehicle data and user data from the one or more portable devices, wherein the vehicle data comprises vehicle dynamics data;

a dynamic virtual reality module that generates a virtual view based on the vehicle data, the user data and the virtual world model from the virtual reality data module, wherein generating the virtual view comprises augmenting one or more components of the virtual world model according to at least one of the vehicle data and the user data; and

a rendering module that renders the virtual view generated by the dynamic reality module to an output device by controlling the output device to update display of the virtual view according to at least one of the vehicle data or the user data.

12. The system of claim 11, wherein the one or more portable devices comprises one or more off-vehicle devices that obtain vehicle data externally from the vehicle.

13. The system of claim 11, wherein the vehicle data comprises predetermined navigation information about a current route of the vehicle.

14. The system of claim 11, wherein the rendering module determines vehicle motion data based on the vehicle dynamics data.

15. The system of claim 14, wherein the rendering module determines user motion data representing motion of the user relative to the vehicle based on the user data and the vehicle data.

16. The system of claim 15, wherein the rendering module determines a temporal-motion rendering speed based on the vehicle motion data and the user motion data, and renders the virtual view to the output device by controlling the output device to update display of the virtual view based on the temporal-motion rendering speed.

17. A non-transitory computer-readable storage medium storing instructions that, when executed by a vehicle computer, causes the computer to perform the steps of:

receiving vehicle data and user data from one or more portable devices, the vehicle data comprising vehicle dynamics data of the vehicle;

generating a virtual view based on the vehicle data, the user data and a virtual world model, the virtual world model comprising one or more components that define the virtual view, wherein generating the virtual view comprises augmenting one or more components of the virtual world model according to at least one of the vehicle data and the user data; and

rendering the virtual view to an output device by controlling the output device to update display of the virtual view according to at least one of the vehicle data or the user data.

18. The non-transitory computer-readable storage medium of claim of claim 17, wherein the portable device receives the vehicle data transmitted from a sensor external to the vehicle.

19. The non-transitory computer-readable storage medium of claim of claim 17, comprising determining a temporal-motion rendering speed based on the vehicle dynamics data and the user data.

20. The non-transitory computer-readable storage medium of claim of claim 19, wherein rendering the virtual view to an output device comprises controlling the output device to update display of the virtual view based on the temporal-motion rendering speed.