DRIVER AND VEHICLE MONITORING FEEDBACK SYSTEM FOR AN AUTONOMOUS VEHICLE

• US 20180118219A1
• Filed: 10/27/2016
• Published: 05/03/2018
• Est. Priority Date: 10/27/2016
• Status: Active Grant

• Current Assignee: Toyota Jidosha Kabushiki Kaisha (Toyota Motor Corporation)
• Original Assignee: Toyota Motor Engineering & Manufacturing North America Incorporated (Toyota Motor Corporation)
• Inventors: HIEI, Yu, Sherony, Rini, Sayer, Tina Brunetti, Domeyer, Joshua E., Marcoux, John, Johnson, Miles J.
• Granted Patent: US 11,623,647 B2
• Time in Patent Office: Days
• CPC Class Codes: B60W 2540/22 Psychological state; Stress level or workload
• CPC Class Codes: B60W 2540/221 Physiology, e.g. weight, heartbeat, health or special needs
• CPC Class Codes: B60W 2556/10 Historical data
• CPC Class Codes: B60W 40/09 Driving style or behaviour
• CPC Class Codes: B60W 50/14 Means for informing the driver, warning the driver or prompting a driver intervention

Abstract

A feedback server includes a processing circuitry configured to determine an actual driving performance of a driver in a manual driving mode and a projected driving performance if the vehicle had been operated in an autonomous driving mode, compare the driving performance in the manual driving mode and the autonomous driving mode, and transmit a feedback to the driver based on the comparison. The processing circuitry can be further configured to determine a driver state of the driver in the manual driving mode, determine environmental driving condition of the vehicle, and establish a baseline behavior of the driver as a function of the driver state and the environmental driving condition.

Claims

1. A feedback server for an autonomous or highly automated vehicle, comprising:

processing circuitry configured to

determine an actual driving performance of a driver in a manual driving mode and a projected driving performance if the vehicle had been operated in an autonomous driving mode,

compare the driving performance in the manual driving mode and the autonomous driving mode, and

transmit a feedback to the driver based on the comparison.

2. The feedback server according to claim 1, further configured to

determine a driver state of the driver in the manual driving mode,

determine environmental driving condition of the vehicle, and

establish a baseline behavior of the driver as a function of the driver state and the environmental driving condition.

3. The feedback server according to claim 2, wherein:

the driver state is determined using at least one of a heart rate sensor, a blood pressure sensor, a Doppler radar and a camera vision system, and

the environmental driving condition is determined using at least one of a radar sensor, a lidar sensor, and a camera.

4. The feedback server according to claim 2, wherein the driver state is correlated to at least one of the driving performance and the environmental driving conditions.

5. The feedback server according to claim 1, wherein the driving performance is determined as a function of least one of lane keeping, braking, acceleration, and time to collision.

6. The feedback server according to claim 2, wherein the driver state is determined as function of at least one of a physiological state and a psychological state of the driver.

7. The feedback server according to claim 1, wherein the transmission of the feedback to the driver occurs in real-time.

8. The feedback server according to claim 1, wherein the transmission of the feedback to the driver occurs after a driving trip has been completed.

9. The feedback server according to claim 2, wherein the establishment of the baseline behavior of the driver occurs in real-time.

10. The feedback server according to claim 1, wherein the transmission of the feedback includes a real-time prompt to switch to the autonomous driving mode.

11. The feedback server according to claim 2, wherein the feedback includes instructions to improve driving performance by switching to the autonomous driving mode when the driving performance in the autonomous driving mode is determined to be superior than the actual driving performance of the driver in the manual driving mode or when the feedback server determines the driver has deviated from the baseline behavior.

12. The feedback server according to claim 1, further configured to display the feedback in real-time on an external device.

13. A method of providing a driving feedback for an autonomous or highly automated vehicle, the method comprising:

determining, using processing circuitry, an actual driving performance of a driver in a manual driving mode and a projected driving performance if the vehicle had been operated in an autonomous driving mode,

comparing, using the processing circuitry, the driving performance in the manual driving mode and the autonomous driving mode, and

transmitting, via network, feedback to the driver based on the comparison.

14. The method according to claim 13, further comprising:

determining, using the processing circuitry, a driver state of the driver in the manual driving mode,

determining, using the processing circuitry, an environmental driving condition of the vehicle, and

establishing, using the processing circuitry, a baseline behavior of the driver as a function of the driver state and the environmental driving condition.

15. The method according to claim 14, wherein the driver state is correlated to at least one of the driving performance and the environmental driving condition.

16. The method according to claim 13, wherein the driving performance is determined as a function of least one of lane keeping, braking, acceleration, and time to collision.

17. The method according to claim 14, wherein the driver state is determined as a function of at least one of a physiological state and a psychological state of the driver.

18. The method according to claim 13, wherein the transmission of the feedback to the driver occurs in real-time including a real-time prompt to switch to the autonomous driving mode or the transmission of the feedback occurs after a driving trip has been completed.

19. A feedback system comprising:

at least one of a heart rate sensor, a blood pressure sensor, a Doppler radar, and a camera vision system to determine a driver state;

at least one of a radar sensor, a lidar sensor and a camera to determine an environmental driving condition;

processing circuitry configured to

determine an actual driving performance of a driver in a manual driving mode as a function of the determined driver state and the determined environmental driving condition and a projected driving performance if the vehicle had been operated in an autonomous driving mode,

compare the driving performance in the manual driving mode and the autonomous driving mode, and

transmit a feedback to the driver based on the comparison.

20. The feedback system according to claim 19, further configured to:

establish a baseline behavior of the driver as a function of the determined driver state and the determined environmental driving condition.