System and method for responding to driver state

• US 10,246,098 B2
• Filed: 07/21/2017
• Issued: 04/02/2019
• Est. Priority Date: 03/15/2013
• Status: Active Grant

• Current Assignee: Honda Motor Co., Ltd. (Honda Motor Company)
• Original Assignee: Honda Motor Co., Ltd. (Honda Motor Company)
• Inventors: Fung, Kin C., Dick, Timothy J.
• Primary Examiner(s): Jeanglaude, Gertrude Arthur
• Application Number:
  US15/656,595
• Publication Number:
  US 20170341658A1
• Time in Patent Office: 620 Days
• Field of Search: 701 36
• CPC Class Codes: B60K 28/02 responsive to conditions relating to the driver
• CPC Class Codes: B60R 25/25 using biometry
• CPC Class Codes: B60W 2540/22 Psychological state; Stress level or workload
• CPC Class Codes: B60W 40/08 related to drivers or passengers
• CPC Class Codes: G06F 2218/12 Classification; Matching
• CPC Class Codes: G06V 10/764 using classification, e.g. of video objects
• CPC Class Codes: G06V 10/82 using neural networks
• CPC Class Codes: G06V 20/597 Recognising the driver's state or behaviour, e.g. attention or drowsiness
• CPC Class Codes: G06V 40/15 Biometric patterns based on physiological signals, e.g. heartbeat, blood flow
• CPC Class Codes: G06V 40/45 Detection of the body part being alive
• CPC Class Codes: G06V 40/70 Multimodal biometrics, e.g. combining information from different biometric modalities
• CPC Class Codes: G07C 5/02 Registering or indicating driving, working, idle, or waiting time only apparatus forming part of taximeters G07B13/00
• CPC Class Codes: G07C 5/08 Registering or indicating performance data other than driving, working, idle, or waiting time, with or without registering driving, working, idle or waiting time
• CPC Class Codes: G07C 9/00309 operated with bidirectional data transmission between data carrier and locks
• CPC Class Codes: G07C 9/00563 using personal physical data of the operator, e.g. finger prints, retinal images, voicepatterns
• CPC Class Codes: G07C 9/37 using biometric data, e.g. fingerprints, iris scans or voice recognition
• CPC Class Codes: G16H 50/20 for computer-aided diagnosis, e.g. based on medical expert systems

Abstract

A method for controlling vehicle systems includes receiving monitoring information from one or more monitoring systems and determining a plurality of driver states based on the monitoring information from the one or more monitoring systems. The method includes determining a combined driver state based on the plurality of driver states and modifying control of one or more vehicle systems based on the combined driver state.

Claims

1. A method of controlling one or more vehicle systems in a motor vehicle, comprising:

receiving monitoring information from one or more monitoring systems;

determining a plurality of driver states of a driver based on the monitoring information from the one or more monitoring systems, wherein the plurality of driver states includes a first driver state comprising hand contact of the driver with a steering wheel of the motor vehicle, and a second driver state comprising engagement of a brake pedal or engagement of an accelerator pedal by the driver;

determining a combined driver state index as a value dependent on evaluating the plurality of driver states together, including evaluating the first driver state and the second driver state together; and

controlling the one or more vehicle systems as a function of the combined driver state index.

2. The method of claim 1, wherein the first driver state comprising hand contact of the driver with the steering wheel of the motor vehicle is a behavioral driver state, and the first driver state is determined based on hand contact information received from the one or more monitoring systems.

3. The method of claim 1, wherein the second driver state comprising engagement of the brake pedal or the accelerator pedal by the driver is a vehicular-sensed driver state, and the second driver state is determined based on braking information from the one or more monitoring systems.

4. The method of claim 1, wherein controlling the one or more vehicle systems includes modifying a control parameter of the one or more vehicle systems as a function of the combined driver state index.

5. The method of claim 4, wherein controlling the one or more vehicle systems includes engaging the one or more vehicle systems or disengaging the one or more vehicle systems according to the control parameter.

6. The method of claim 1, including determining an intent, initiated by the driver, to change autonomous control of the one or more vehicle systems based on the combined driver state index.

7. The method of claim 6, wherein if the first driver state describes at least one hand in contact with the steering wheel or the second driver state describes the brake pedal is engaged or the accelerator pedal is engaged, the combined driver state index is determined to indicate an intent to disengage autonomous control of the one or more vehicles systems.

8. The method of claim 7, wherein modifying the control of the one or more vehicle systems includes disengaging at least one of a brake hold function of a braking system, an electric parking brake system, an idle mode function of an engine, or a lane keep assist system, as a function of the combined driver state index.

9. The method of claim 6, wherein if the first driver state describes no hand contact with the steering wheel or the second driver state describes the brake pedal is disengaged and the accelerator pedal is disengaged, the combined driver state index is determined to indicate an intent to engage autonomous control of the one or more vehicles systems.

10. The method of claim 9, wherein modifying the control of the one or more vehicle systems includes engaging at least one of a brake hold function of a braking system, an electric parking brake system, an idle mode function of an engine, or a lane keep assist system, as a function of the combined driver state index.

11. The method of claim 1, including determining a vehicle state comprising whether the motor vehicle is in a stopped state based on the monitoring information from the one or more monitoring systems.

12. The method of claim 11, wherein controlling the one or more vehicle systems includes controlling the one or more vehicle systems as a function of the combined driver state index and based on the vehicle state.

13. A method of controlling vehicle systems in a motor vehicle, comprising:

receiving monitoring information from one or more monitoring systems;

determining a plurality of driver states of a driver based on the monitoring information from the one or more monitoring systems, wherein the plurality of driver states includes a first driver state comprising hand contact of the driver with a steering wheel of the motor vehicle, and a second driver state comprising braking of the motor vehicle;

determining a combined driver state index resulting from confirming the plurality of driver states together; and

controlling the one or more vehicle systems to engage or disengage a function of the one or more vehicle systems according to the combined driver state index.

14. The method of claim 13, wherein the first driver state comprising hand contact of the driver with the steering wheel of the motor vehicle is a behavioral driver state, and the first driver state is determined based on hand contact information received from the one or more monitoring systems.

15. The method of claim 13, wherein the second driver state comprising braking of the motor vehicle is a vehicular-sensed driver state, and the second driver state is determined based on braking information from the one or more monitoring systems.

16. The method of claim 13, including determining a vehicle state comprising whether the motor vehicle is in a stopped state based on the monitoring information from the one or more monitoring systems.

17. The method of claim 16, wherein determining the combined driver state index includes determining the combined driver state index resulting from confirming the plurality of driver states and the vehicle state together.

18. The method of claim 13, wherein the combined driver state index describes a level of attention of the driver.

19. The method of claim 18, wherein if the first driver state describes at least one hand in contact with the steering wheel or the second driver state describes braking is being applied to the motor vehicle by the driver, the driver is determined to be attentive based on the combined driver state index.

20. The method of claim 18, wherein upon determining the driver is attentive based on the combined driver state index, controlling the one or more vehicle systems includes disengaging at least one of a brake hold function of a braking system, an electric parking brake system, an idle mode function of an engine, or a lane keep assist system, as a function of the combined driver state index.

21. The method of claim 18, wherein if the first driver state describes no hand contact with the steering wheel or the second driver state describes the brake pedal is disengaged and the accelerator pedal is disengaged, the driver is determined to be distracted based on the combined driver state index.

22. The method of claim 18, wherein upon determining the driver is distracted based on the combined driver state index, controlling the one or more vehicle systems includes engaging at least one of a brake hold function of a braking system, an electric parking brake system, an idle mode function of an engine, or a lane keep assist system, as a function of the combined driver state index.

23. A method of controlling one or more vehicle systems in a motor vehicle, comprising:

receiving monitoring information from a plurality of monitoring systems;

determining a plurality of driver states of a driver based on the monitoring information from the one or more monitoring systems, wherein the plurality of driver states includes a behavioral driver state comprising hand contact of the driver with a steering wheel of the motor vehicle, and a vehicular-sensed driver state comprising engagement of a brake pedal or engagement of an accelerator pedal by the driver

determining a combined driver state index as a function of evaluating the plurality of driver states together, including evaluating the behavioral driver state and the vehicular-sensed driver state together; and

modifying a control status of the one or more vehicle systems as a function of the combined driver state index.

24. The method of claim 23, wherein the behavioral driver state is determined based on hand contact information received from the one or more monitoring systems, wherein the hand contact information is measured by the one or more monitoring systems by measuring external characteristics of the driver.

25. The method of claim 23, wherein the vehicular-sensed driver state is determined based on vehicle information received from the one or more monitoring systems.

26. The method of claim 23, wherein the combined driver state index describes a level of autonomous control of the one or more vehicle systems desired by the driver.

27. The method of claim 23, wherein if the behavioral driver state describes at least one hand in contact with the steering wheel or the vehicular-sensed driver state describes the brake pedal is engaged or the accelerator pedal is engaged, modifying the control status of the one or more vehicle systems includes modifying the control status to no control.

28. The method of claim 23, wherein if the behavioral driver state describes no hand contact with the steering wheel or the vehicular-sensed driver state describes the brake pedal is disengaged and the accelerator pedal is disengaged, modifying the control status of the one or more vehicle systems includes modifying the control status to auto control.

29. The method of claim 23, including determining a vehicle state comprising whether the motor vehicle is in a stopped state based on the monitoring information from the one or more monitoring systems.

30. The method of claim 29, wherein modifying the control status of the one or more vehicle systems includes modifying the control status based on the vehicle state and as a function of the combined driver state index.