Determining driver engagement with autonomous vehicle
First Claim
Patent Images
1. A method of controlling driver interaction with an autonomous vehicle (AV) system for a vehicle, the method comprising:
- receiving, by a processor, a signal indicating a present state of a driver, wherein the signal includes an image collected by a camera;
receiving, by the processor, a signal indicating a past state of the driver;
scoring, by the processor, performance of the driver including by determining an effectiveness of the driver based on the received signals;
determining, by the processor, a target level of engagement of the driver with the AV system based on the driver performance score;
determining, by the processor, that a present driver engagement level meets the target engagement level;
if the present driver engagement level meets the target engagement level, at least one of (i) outputting a recommendation to the driver regarding the AV system and (ii) automatically changing a mode of operation of the AV system;
identifying, by the processor, a skill of the driver to be improved;
determining, by the processor, based on at least one of sensor data, map data and environment information, that the driver is encountering a driving situation relevant to the skill to be improved;
in response to the determination that the vehicle is encountering the driving situation relevant to the skill, prompting the driver to practice the skill by at least one of;
(i) providing, by the processor, a recommendation to the driver to operate the vehicle in a non-autonomous mode and (ii) disengaging, by the processor, the AV system.
2 Assignments
0 Petitions
Accused Products
Abstract
A method, system, and computer program product of controlling driver interaction with an autonomous vehicle (AV) system for a vehicle are provided. In an embodiment, a signal indicating a present state of the driver is received. A signal indicating a past state of the driver is received. A present effectiveness of the driver is determined based on the received signals. A target level of engagement of the driver with the AV system is determined based on the present effectiveness of the driver.
-
Citations
19 Claims
-
1. A method of controlling driver interaction with an autonomous vehicle (AV) system for a vehicle, the method comprising:
-
receiving, by a processor, a signal indicating a present state of a driver, wherein the signal includes an image collected by a camera; receiving, by the processor, a signal indicating a past state of the driver; scoring, by the processor, performance of the driver including by determining an effectiveness of the driver based on the received signals; determining, by the processor, a target level of engagement of the driver with the AV system based on the driver performance score; determining, by the processor, that a present driver engagement level meets the target engagement level; if the present driver engagement level meets the target engagement level, at least one of (i) outputting a recommendation to the driver regarding the AV system and (ii) automatically changing a mode of operation of the AV system; identifying, by the processor, a skill of the driver to be improved; determining, by the processor, based on at least one of sensor data, map data and environment information, that the driver is encountering a driving situation relevant to the skill to be improved; in response to the determination that the vehicle is encountering the driving situation relevant to the skill, prompting the driver to practice the skill by at least one of;
(i) providing, by the processor, a recommendation to the driver to operate the vehicle in a non-autonomous mode and (ii) disengaging, by the processor, the AV system. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17)
-
-
18. A system for controlling driver interaction with an autonomous vehicle (AV) system for a vehicle, the system comprising:
-
a processor configured to; receive a signal indicating a present state of the driver, wherein the signal includes an image collected by a camera; receive a signal indicating a past state of the driver; score performance of the driver including by determining an effectiveness of the driver based on the received signals; determine a target level of engagement of the driver with the AV system based on the determined driver performance score; determine that a present driver engagement level meets the target engagement level; if the present driver engagement level meets the target engagement level, at least one of (i) output a recommendation to the driver regarding the AV system and (ii) automatically change a mode of operation of the AV system; identify a skill of the driver to be improved; determine, based on at least one of sensor data, map data and environment information, that the driver is encountering a driving situation relevant to the skill to be improved; in response to the determination that the vehicle is encountering the driving situation relevant to the skill, prompt the driver to practice the skill by at least one of;
(i) provide a recommendation to the driver to operate the vehicle in a non-autonomous mode and (ii) disengage the AV system; anda non-transitory memory coupled to the processor and configured to provide the processor with instructions.
-
-
19. A computer program product for controlling driver interaction with an autonomous vehicle (AV) system for a vehicle, the computer program product being embodied in a non-transitory computer-readable storage medium and comprising computer instructions for:
-
receiving a signal indicating a present state of the driver, wherein the signal includes an image collected by a camera; receiving a signal indicating a past state of the driver; scoring performance of the driver including by determining an effectiveness of the driver based on the received signals; determining a target level of engagement of the driver with the AV system based on the driver performance score; determining that a present driver engagement level meets the target engagement level; if the present driver engagement level meets the target engagement level, at least one of (i) outputting a recommendation to the driver regarding the AV system and (ii) automatically changing a mode of operation of the AV system; identifying a skill of the driver to be improved; determining, based on at least one of sensor data, map data and environment information, that the driver is encountering a driving situation relevant to the skill to be improved; in response to the determination that the vehicle is encountering the driving situation relevant to the skill, prompting the driver to practice the skill by at least one of;
(i) providing a recommendation to the driver to operate the vehicle in a non-autonomous mode and (ii) disengaging the AV system.
-
Specification