System and method for responding to driver state

• US 10,759,438 B2
• Filed: 05/22/2019
• Issued: 09/01/2020
• Est. Priority Date: 03/15/2013
• Status: Active Grant

• Current Assignee: Honda Motor Co., Ltd. (Honda Motor Company)
• Original Assignee: Honda Motor Co., Ltd. (Honda Motor Company)
• Inventors: Fung, Kin C., Dick, Timothy J.
• Primary Examiner(s): Jeanglaude, Gertrude Arthur
• Application Number:
  US16/419,145
• Publication Number:
  US 20190276032A1
• Time in Patent Office: 468 Days
• Field of Search: 701 93
• CPC Class Codes: B60K 28/02 responsive to conditions relating to the driver
• CPC Class Codes: B60R 25/25 using biometry
• CPC Class Codes: B60W 2540/22 Psychological state; Stress level or workload
• CPC Class Codes: B60W 40/08 related to drivers or passengers
• CPC Class Codes: G06F 2218/12 Classification; Matching
• CPC Class Codes: G06V 10/764 using classification, e.g. of video objects
• CPC Class Codes: G06V 10/82 using neural networks
• CPC Class Codes: G06V 20/597 Recognising the driver's state or behaviour, e.g. attention or drowsiness
• CPC Class Codes: G06V 40/15 Biometric patterns based on physiological signals, e.g. heartbeat, blood flow
• CPC Class Codes: G06V 40/45 Detection of the body part being alive
• CPC Class Codes: G06V 40/70 Multimodal biometrics, e.g. combining information from different biometric modalities
• CPC Class Codes: G07C 5/02 Registering or indicating driving, working, idle, or waiting time only apparatus forming part of taximeters G07B13/00
• CPC Class Codes: G07C 5/08 Registering or indicating performance data other than driving, working, idle, or waiting time, with or without registering driving, working, idle or waiting time
• CPC Class Codes: G07C 9/00309 operated with bidirectional data transmission between data carrier and locks
• CPC Class Codes: G07C 9/00563 using personal physical data of the operator, e.g. finger prints, retinal images, voicepatterns
• CPC Class Codes: G07C 9/37 using biometric data, e.g. fingerprints, iris scans or voice recognition
• CPC Class Codes: G16H 50/20 for computer-aided diagnosis, e.g. based on medical expert systems

Abstract

A method for controlling vehicle systems includes receiving monitoring information from one or more monitoring systems and determining a plurality of driver states based on the monitoring information from the one or more monitoring systems. The method includes determining a combined driver state based on the plurality of driver states and modifying control of one or more vehicle systems based on the combined driver state.

Claims

1. A method of controlling a vehicle, comprising:

receiving monitoring information about a driver from a monitoring system, wherein the monitoring information includes head movement information about the driver and hand contact information about contact between the driver and a steering wheel of the vehicle;

receiving vehicle information from an automatic cruise control system;

determining a driver state based on the monitoring information and the vehicle information;

modifying one or more control parameters of the automatic cruise control system based on the driver state; and

modifying control of the vehicle based on the control parameter to vary a headway distance between the vehicle and a preceding vehicle.

2. The method of claim 1, wherein the one or more control parameters are at least one of an operational status of the automatic cruise control system, a distance setting of the automatic cruise control system, and a cruising speed of the automatic cruise control system.

3. The method of claim 2, wherein upon determining at least one hand of the driver is in contact with the steering wheel based on the hand contact information and a head look of the driver is forward-looking based on the head movement information, modifying the one or more control parameters includes modifying a distance setting to a medium gap based on the driver state, and modifying control of the vehicle based on the distance setting so that the automatic cruise control system maintains the headway distance between the vehicle and the preceding vehicle.

4. The method of claim 2, wherein upon determining both hands of the driver are in contact with the steering wheel based on the hand contact information and a head look of the driver is forward-looking based on the head movement information, modifying the one or more control parameters includes modifying the distance setting to a minimum gap based on the driver state, and modifying the control of the vehicle based on the distance setting so that the automatic cruise control system decreases the headway distance between the vehicle and the preceding vehicle.

5. The method of claim 2, wherein upon determining a head look of the driver is non-forward-looking based on the head movement information, modifying the one or more control parameters includes modifying the distance setting to a maximum gap based on the driver state, and including modifying the control of the vehicle based on the distance setting so that the automatic cruise control system increases the headway distance between the vehicle and the preceding vehicle.

6. The method of claim 2, wherein modifying the one or more control parameters includes varying the distance setting between a plurality of distances based on the driver state.

7. The method of claim 2, wherein determining the driver state includes determining a first driver state based on the head movement information and a second driver state based on the hand contact information, determining the driver state based on evaluating the first driver state and the second driver state together, and modifying the one or more control parameters based on the combined driver state.

8. The method of claim 2, wherein upon determining the driver is attentive, modifying the distance setting to a minimum gap, and upon determining the driver is less attentive, modifying the distance setting to a medium gap, and upon determining the driver is distracted, modifying the distance setting to a maximum gap.

9. The method of claim 2, wherein upon determining the driver is distracted, modifying the operational status of the automatic cruise control system to manual thereby requiring the driver to input the one or more control parameters.

10. The method of claim 2, including determining a predetermined percentage based on the driver state and modifying the cruising speed by the predetermined percentage.

11. A system for controlling a vehicle, comprising:

a monitoring system;

an automatic cruise control system; and

an electronic control unit including a processor, wherein the processor;

receives monitoring information from the monitoring system, wherein the monitoring information includes head movement information about a driver and hand contact information about contact between the driver and a steering wheel of the vehicle;

receives vehicle information from the automatic cruise control system;

determines a driver state of the driver based on the monitoring information and the vehicle information;

modifies one or more control parameters of the automatic cruise control system based on the driver state; and

modifies control of the vehicle based on the control parameter to vary a headway distance between the vehicle and a preceding vehicle.

12. The system of claim 11, wherein the one or more control parameters are at least one of an operational status of the automatic cruise control system, a distance setting of the automatic cruise control system, and a cruising speed of the automatic cruise control system.

13. The system of claim 12, wherein upon the processor determining at least one hand of the driver is in contact with the steering wheel based on the hand contact information and a head look of the driver is forward-looking based on the head movement information, the processor modifies the distance setting to a medium gap based on the driver state, and modifies control of the vehicle based on the distance setting so that the automatic cruise control system maintains the headway distance between the vehicle and the preceding vehicle.

14. The system of claim 12, wherein upon the processor determining both hands of the driver are in contact with the steering wheel based on the hand contact information and a head look of the driver is forward-looking based on the head movement information, the processor modifies the distance setting to a minimum gap based on the driver state, and modifies the control of the vehicle based on the distance setting so that the automatic cruise control system decreases the headway distance between the vehicle and the preceding vehicle.

15. The system of claim 12, wherein upon the processor determining a head look of the driver is non-forward-looking based on the head movement information, the processor modifies the distance setting to a maximum gap based on the driver state, and including modifies the control of the vehicle based on the distance setting so that the automatic cruise control system increases the headway distance between the vehicle and the preceding vehicle.

16. The system of claim 12, wherein the processor modifies the one or more control parameters by varying the distance setting between a plurality of distances based on the driver state.

17. The system of claim 12, wherein the processor determines the driver state by determining a first driver state based on the head movement information and a second driver state based on the hand contact information, determines a combined driver state based on evaluating the first driver state and the second driver state together, and modifies the one or more control parameters based on the combined driver state.

18. The system of claim 12, wherein when the processor determines the driver is attentive, the processor modifies the distance setting to a minimum gap, and when the processor determines the driver is less attentive, the processor modifies the distance setting to a medium gap, and when the processor determines the driver is distracted, the processor the distance setting to a maximum gap.

19. The system of claim 12, wherein when the processor determines the driver is distracted, the processor modifies the operational status of the automatic cruise control system to manual thereby requiring the driver to input the one or more control parameters.

20. The system of claim 12, wherein the processor determines a predetermined percentage based on the driver state and modifies the cruising speed by the predetermined percentage.