DETERMINING DRIVER ENGAGEMENT WITH AUTONOMOUS VEHICLE

• US 20180032072A1
• Filed: 07/28/2016
• Published: 02/01/2018
• Est. Priority Date: 07/28/2016
• Status: Active Grant

• Current Assignee: Lytx, Inc.
• Original Assignee: Lytx, Inc.
• Inventors: Hoye, Brett
• Granted Patent: US 10,209,708 B2
• Time in Patent Office: Days
• CPC Class Codes: B60K 28/02 responsive to conditions relating to the driver
• CPC Class Codes: B60W 2040/0818 Inactivity or incapacity of driver
• CPC Class Codes: B60W 2050/0075 Automatic parameter input, automatic initialising or calibrating means
• CPC Class Codes: B60W 2420/403 Image sensing, e.g. optical camera
• CPC Class Codes: B60W 2540/045 Occupant permissions
• CPC Class Codes: B60W 2540/22 Psychological state; Stress level or workload
• CPC Class Codes: B60W 2540/223 Posture, e.g. hand, foot, or seat position, turned or inclined
• CPC Class Codes: B60W 2540/229 Attention level, e.g. attentive to driving, reading or sleeping
• CPC Class Codes: B60W 2540/30 Driving style
• CPC Class Codes: B60W 2555/20 Ambient conditions, e.g. wind or rain
• CPC Class Codes: B60W 2556/10 Historical data
• CPC Class Codes: B60W 30/182 Selecting between different operative modes, e.g. comfort and performance modes
• CPC Class Codes: B60W 40/08 related to drivers or passengers
• CPC Class Codes: B60W 50/082 Selecting or switching between different modes of propelling
• CPC Class Codes: B60W 50/10 Interpretation of driver requests or demands
• CPC Class Codes: B60W 50/14 Means for informing the driver, warning the driver or prompting a driver intervention
• CPC Class Codes: B60W 60/0053 from vehicle to occupant
• CPC Class Codes: B60W 60/0059 Estimation of the risk associated with autonomous or manual driving, e.g. situation too complex, sensor failure or driver incapacity
• CPC Class Codes: G05D 1/0061 for transition from automatic pilot to manual pilot and vice versa

Abstract

A method, system, and computer program product of controlling driver interaction with an autonomous vehicle (AV) system for a vehicle are provided. In an embodiment, a signal indicating a present state of the driver is received. A signal indicating a past state of the driver is received. A present effectiveness of the driver is determined based on the received signals. A target level of engagement of the driver with the AV system is determined based on the present effectiveness of the driver.

Claims

1. A method of controlling driver interaction with an autonomous vehicle (AV) system for a vehicle, the method comprising:

receiving, by a processor, a signal indicating a present state of the driver;

receiving, by the processor, a signal indicating a past state of the driver;

determining, by the processor, a present effectiveness of the driver based on the received signals; and

determining, by the processor, a target level of engagement of the driver with the AV system based on the present effectiveness of the driver.

2. The method of claim 1, wherein the target level of engagement defines whether to recommend that the driver operate the vehicle in a non-autonomous mode.

3. The method of claim 1, further comprising:

receiving, by the processor, a policy, wherein the determination of the target level of engagement is further based on the policy.

4. The method of claim 3, further comprising:

at least one of (i) providing, by the processor, a recommendation to the driver and (ii) changing, by the processor, a mode of operation of the AV system, based on a determination, by the processor, that the policy has been violated.

5. The method of claim 1, wherein the determination of the target level of engagement is further based on an attentiveness level of the driver sufficient to maintain an experience rating.

6. The method of claim 1, wherein the determination of the target level of engagement is further based on an attentiveness level of the driver sufficient to operate the vehicle in an autonomous mode.

7. The method of claim 1, further comprising:

determining, by the processor, whether to recommend coaching for the driver based on the present effectiveness of the driver.

8. The method of claim 1, further comprising:

determining, by the processor, whether to recommend simulation training for the driver based on the present effectiveness of the driver.

9. The method of claim 1, wherein the present state signal is based on a detection, by a sensor, of driver activity.

10. The method of claim 1, wherein the determination of the target level of engagement includes determining a target time for disengaging the AV system.

11. The method of claim 1, wherein the determination of the target level of engagement includes determining a target time for providing a warning to the driver regarding disengagement of the AV system.

12. The method of claim 1, further comprising:

determining a target time for disengaging the AV system.

13. The method of claim 1, further comprising:

determining a target time for providing a warning regarding disengagement of the AV system.

14. The method of claim 1, wherein the past state signal includes when the driver recently napped.

15. The method of claim 1, wherein the past state signal includes at least one of:

vehicle information, environment, and driver behavioral information.

16. The method of claim 1, further comprising:

receiving, by the processor, environment data indicating a driving situation;

determining, by the processor, whether the AV system performs or is expected to perform below a threshold when encountering the driving situation;

if the AV system performs below the threshold, at least one of;

making a recommendation to the driver and disengaging the AV system.

17. The method of claim 1, further comprising:

determining, by the processor, based on at least one of sensor data, map data and environment information, that the vehicle is encountering a driving situation relevant to a skill set of the driver;

at least one of;

providing, by the processor, a recommendation to the driver to operate the vehicle in a non-autonomous mode;

disengaging, by the processor, the AV system.

18. The method of claim 17, further comprising:

responsive to driver operation of the vehicle in a non-autonomous mode in the driving situation, determining, by the processor, whether the skill set of the driver has improved;

if the skill set of the driver has not improved, recommending, by the processor, coaching for the driver.

19. A system for controlling driver interaction with an autonomous vehicle (AV) system for a vehicle, the system comprising:

a processor configured to;

receive a signal indicating a present state of the driver;

receive a signal indicating a past state of the driver;

determine the present effectiveness of the driver based on the received signals; and

determine a preferred level of engagement of the driver with the AV system based on the determined present effectiveness of the driver; and

a non-transitory memory coupled to the processor and configured to provide the processor with instructions.

20. A computer program product for controlling driver interaction with an autonomous vehicle (AV) system for a vehicle, the computer program product being embodied in a non-transitory computer-readable storage medium and comprising computer instructions for:

receiving a signal indicating a present state of the driver;

receiving a signal indicating a past state of the driver;

determining a present effectiveness of the driver based on the received signals; and

determining a target level of engagement of the driver with the AV system based on the present effectiveness of the driver.