PERFORMANCE DRIVING SYSTEM AND METHOD

• US 20160084661A1
• Filed: 09/23/2014
• Published: 03/24/2016
• Est. Priority Date: 09/23/2014
• Status: Abandoned Application

• Current Assignee: GM Global Technology Operations LLC (General Motors Company)
• Original Assignee: GM Global Technology Operations LLC (General Motors Company)
• Inventors: Gautama, Neeraj R., Chau, Jarvis, Macinnes, Roddi L., Mughal, Akkas A., Lo, Joshua
• Application Number:
  US14/493,519
• Publication Number:
  US 20160084661A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G01C 21/26 specially adapted for navigation in a road network
• CPC Class Codes: G01C 21/365 Guidance using head up displays or projectors, e.g. virtual vehicles or arrows projected on the windscreen or on the road itself
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text

Abstract

A system and method that act as a performance driving tool and provide feedback to a driver, such as real-time visual feedback delivered via an augmented reality device. According to one embodiment, the performance driving system gathers pertinent vehicle information and driver information (e.g., the direction of the driver'"'"'s gaze as determined by a wearable head-mounted-display (HMD)) and uses these inputs to generate real-time visual feedback in the form of virtual driving lines and other driving recommendations. These driving recommendations can be presented to the driver via an augmented reality device, such as a heads-up-display (HUD), where the virtual driving lines are projected onto the vehicle windshield so that they are superimposed on top of the actual road surface seen by the driver and can show the driver a suggested line or path to take. Other driving recommendations, like braking, acceleration, steering and shifting suggestions, can also be made.

Claims

1. A performance driving system for a vehicle, comprising:

one or more vehicle sensor(s), the vehicle sensor(s) include a navigation unit that provides navigation signals representative of vehicle location;

one or more output device(s), the output device(s) include an augmented reality device that provides real-time visual feedback to a driver; and

a control module coupled to the vehicle sensor(s) and the output device(s), wherein the control module is configured to provide control signals to the augmented reality device that are at least partially based on the vehicle location and that cause the augmented reality device to provide the driver with real-time visual feedback that includes one or more virtual driving line(s) superimposed on top of an actual road surface seen by the driver.

2. The performance driving system of claim 1, wherein the vehicle sensor(s) further include:

a speed sensor that provides speed signals representative of vehicle speed, a vehicle dynamics sensor unit that provides vehicle dynamics signals representative of vehicle acceleration, an engine control module that provides engine status signals representative of an engine or transmission state, a brake control module that provides brake status signals representative of a braking state, and a steering control module that provides steering status signals representative of a steering angle; and

the control module is further configured to provide control signals to the augmented reality device that are at least partially based on one or more parameters selected from the group consisting of;

the vehicle speed, the vehicle acceleration, the engine or transmission state, the braking state, or the steering angle.

3. The performance driving system of claim 1, further comprising:

one or more exterior sensor(s), the exterior sensor(s) include a target vehicle sensor that provides target vehicle signals representative of one or more nearby object(s); and

the control module is coupled to the exterior sensor(s) and is further configured to provide control signals to the augmented reality device that are at least partially based on the presence of the nearby object(s).

4. The performance driving system of claim 1, further comprising:

one or more exterior sensor(s), the exterior sensor(s) include an environmental sensor that provides environmental signals representative of the outside weather or other conditions exterior to the vehicle; and

the control module is coupled to the exterior sensor(s) and is further configured to provide control signals to the augmented reality device that are at least partially based on the outside weather or other conditions exterior to the vehicle.

5. The performance driving system of claim 1, further comprising:

one or more driver sensor(s), the driver sensor(s) include a camera that is directed towards the face of the driver and provides driver signals representative of facial behavior; and

the control module is coupled to the driver sensor(s) and is further configured to provide control signals to the augmented reality device that are at least partially based on the facial behavior of the driver.

6. The performance driving system of claim 5, wherein the camera is part of a head-mounted-display (HMD) that is worn by the driver and provides driver signals representative of facial behavior that include gaze detection information;

and

the control module is further configured to provide control signals to the augmented reality device that cause the augmented reality device to adjust the virtual driving line(s) at least partially based on the gaze of the driver.

7. The performance driving system of claim 1, wherein the augmented reality device further includes a heads-up-display (HUD);

and

the control module is further configured to provide control signals to the HUD that cause the HUD to project the real-time visual feedback on a windshield of the vehicle so that the virtual driving line(s) are projected images superimposed on top of the actual road surface seen by the driver.

8. The performance driving system of claim 1, wherein the augmented reality device further includes a head-mounted-display (HMD) that is worn by the driver;

and

the control module is further configured to provide control signals to the HMD that cause the HMD to display the real-time visual feedback on a viewing lens of the HMD so that the virtual driving line(s) are displayed images superimposed on top of the actual road surface seen by the driver.

9. The performance driving system of claim 1, wherein the virtual driving line(s) include at least one driving line selected from the group consisting of:

a predicted driving line representative of an anticipated path of the vehicle, a recommended driving line representative of a suggested path of the vehicle based on current conditions, or an ideal driving line representative of an ideal path for the vehicle.

10. The performance driving system of claim 1, wherein the virtual driving line(s) include a predicted driving line representative of an anticipated path of the vehicle and at least one other driving line;

and

the control module is further configured to compare the predicted driving line and the at least one other driving line and to provide control signals to the augmented reality device that cause the augmented reality device to alert the driver when the driving lines deviate by a certain amount.

11. The performance driving system of claim 1, wherein the control module is further configured to provide control signals to the augmented reality device that cause the augmented reality device to make one or more driving recommendation(s) to the driver, and the driving recommendation(s) is selected from the group consisting of:

a braking recommendation, an acceleration recommendation, a steering recommendation, or a shifting recommendation.

12. The performance driving system of claim 1, wherein the output device(s) further include a haptic alert unit integrated within a driver seat;

and

the control module is further configured to provide control signals to the haptic alert unit that cause the haptic alert unit to inform the driver of a driving recommendation by issuing vibrations through the driver seat.

13. The performance driving system of claim 1, wherein the output device(s) further include a data recording unit located in the vehicle, away from the vehicle, or both;

and

the control module is further configured to instruct the data recording unit to record information and data during a driving event on the known course so that information and data can be subsequently evaluated or shared.

14. The performance driving system of claim 13, wherein the data recording unit is located away from the vehicle and is part of a cloud-based data storage system;

and

the control module is further configured to instruct a telematics unit to wirelessly send information and data gathered during a driving event on the known course to the remote data recording unit so that information and data can be subsequently evaluated or shared.

15. A performance driving system for a vehicle, comprising:

one or more driver sensor(s), the driver sensor(s) include a camera that is directed towards the face of the driver and provides driver signals representative of the facial behavior of the driver;

one or more output device(s), the output device(s) provide on-track driving recommendations to a driver; and

a control module coupled to the driver sensor(s) and the output device(s), wherein the control module is configured to provide control signals to the output device(s) that cause the output device(s) to make adjustments to the on-track driving recommendations based at least partially on changes in the facial behavior of the driver.

16. A method for operating a performance driving system for a vehicle, comprising the steps of:

receiving signals from one or more vehicle sensor(s) at a control module while the vehicle is being driven, the vehicle sensor signals relate to the operational state of the vehicle;

receiving signals from one or more driver sensor(s) at the control module while the vehicle is being driven, the driver sensor signals relate to the facial behavior of the driver;

providing the driver with one or more driving recommendation(s) while the vehicle is being driven, wherein the driving recommendation(s) is at least partially based on the vehicle sensor signals; and

adjusting the driving recommendation(s) while the vehicle is being driven, wherein the adjustment to the driving recommendation(s) is at least partially based on the facial behavior of the driver.

17. The method of claim 16, wherein the second receiving step further includes receiving driver sensor signals with gaze detection information from a camera that is part of a head-mounted-display (HMD) unit being worn by the driver;

and

the adjusting step further includes adjusting the driving recommendation(s) based at least partially on the gaze detection information.

18. The method of claim 16, wherein the providing step further includes providing the driver with the driving recommendation(s) by projecting real-time visual feedback onto a windshield of the vehicle with a heads-up-display (HUD), and the real-time visual feedback includes one or more virtual driving line(s) superimposed on top of a road surface seen by the driver.

19. The method of claim 18, wherein the one or more virtual driving line(s) includes at least one driving line selected from the group consisting of:

a predicted driving line representative of an anticipated path of the vehicle, a recommended driving line representative of a suggested path for the vehicle based on current conditions, or an ideal driving line representative of an ideal path for the vehicle.

20. The method of claim 18, wherein the one or more virtual driving line(s) include a predicted driving line representative of an anticipated path of the vehicle and a recommended driving line representative of a suggested path of the vehicle based on current conditions, and the predicted and recommended driving lines are projected onto the windshield at the same time so that the driver is visually presented with an indication as to how much the anticipated and suggested paths of the vehicle deviate.

21. The method of claim 18, wherein the one or more virtual driving line(s) includes a gaze-modified driving line that is at least partially based on an original driving line and the facial behavior of the driver, and the gaze-modified driving line is adjusted from the original driving line in the direction that the driver is gazing.

22. The method of claim 16, wherein the providing step further includes providing the driver with one or more driving recommendation(s) selected from the group consisting of:

a braking recommendation, an acceleration recommendation, a steering recommendation, or a shifting recommendation.