Drowsiness sensing system

• US 10,379,535 B2
• Filed: 10/24/2017
• Issued: 08/13/2019
• Est. Priority Date: 10/24/2017
• Status: Active Grant

• Current Assignee: Lear Corporation
• Original Assignee: Lear Corporation
• Inventors: Migneco, Francesco, Gallagher, David
• Primary Examiner(s): Ismail, Mahmoud S
• Application Number:
  US15/792,085
• Publication Number:
  US 20190121356A1
• Time in Patent Office: 658 Days
• Field of Search: 701 23, 340576
• CPC Class Codes: A61B 2560/0242 adapted to measure environmental factors, e.g. temperature, pollution
• CPC Class Codes: A61B 5/0077 Devices for viewing the surface of the body, e.g. camera, magnifying lens
• CPC Class Codes: A61B 5/0205 Simultaneously evaluating both cardiovascular conditions and different types of body conditions, e.g. heart and respiratory condition
• CPC Class Codes: A61B 5/024 Detecting, measuring or recording pulse rate or heart rate A61B5/0205, A61B5/021 take precedence
• CPC Class Codes: A61B 5/02405 Determining heart rate variability
• CPC Class Codes: A61B 5/0531 Measuring skin impedance
• CPC Class Codes: A61B 5/18 for vehicle drivers or machine operators
• CPC Class Codes: A61B 5/6893 Cars
• CPC Class Codes: A61B 5/7264 Classification of physiological signals or data, e.g. using neural networks, statistical classifiers, expert systems or fuzzy systems neural networks per se G06N3/00; expert systems per se G06N5/00
• CPC Class Codes: A61B 5/7278 Artificial waveform generation or derivation, e.g. synthesising signals from measured signals A61B5/327 takes precedence
• CPC Class Codes: A61B 5/7455 characterised by tactile indication, e.g. vibration or electrical stimulation
• CPC Class Codes: A61B 5/746 Alarms related to a physiological condition, e.g. details of setting alarm thresholds or avoiding false alarms alarms per se G08B
• CPC Class Codes: B60W 2040/0827 due to sleepiness
• CPC Class Codes: B60W 2050/143 Alarm means
• CPC Class Codes: B60W 2420/403 Image sensing, e.g. optical camera
• CPC Class Codes: B60W 2422/00 Indexing codes relating to the special location or mounting of sensors
• CPC Class Codes: B60W 2540/221 Physiology, e.g. weight, heartbeat, health or special needs
• CPC Class Codes: B60W 2540/26 Incapacity
• CPC Class Codes: B60W 2556/50 of positioning data, e.g. GPS [Global Positioning System] data
• CPC Class Codes: B60W 2710/18 Braking system
• CPC Class Codes: B60W 30/09 : Taking automatic action to avoid collision, e.g. braking and steering
• CPC Class Codes: B60W 50/14 : Means for informing the driver, warning the driver or prompting a driver intervention
• CPC Class Codes: G05D 1/0061 : for transition from automatic pilot to manual pilot and vice versa
• CPC Class Codes: G05D 1/0088 : characterized by the autonomous decision making process, e.g. artificial intelligence, predefined behaviours using knowledge based models G06N5/00
• CPC Class Codes: G16H 50/20 : for computer-aided diagnosis, e.g. based on medical expert systems

Abstract

A system includes an electro-dermal potential sensing system to sense electro-dermal potential of a person and configured to output an electro-dermal potential signal, as well as at least one physiological sensor to measure at least one physiological state and output at least one physiological signal. The system also includes a controller to receive the electro-dermal potential signal from the electro-dermal potential sensing system and the at least one physiological signal to determine a drowsiness state of the person.

Claims

1. A system, comprising:

an electro-dermal potential sensing system configured to sense electro-dermal potential of a person and configured to output an electro-dermal potential signal, wherein the electro-dermal potential system includes a plurality of contactless sensors configured to be mounted in a vehicle;

at least one physiological sensor configured to measure at least one physiological state of the person and output at least one physiological signal; and

a controller configured to receive the electro-dermal potential signal from the electro-dermal potential sensing system and the at least one physiological signal and to determine a drowsiness state of the person, wherein the controller is configured to adjust operation of a vehicle system using the determined drowsiness state, and wherein the controller is further configured to receive an external sensor signal from a vehicle environmental sensor system configured to sense external objects around a vehicle and to output a control signal using the electro-dermal potential signal, the at least one physiological signal and the external sensor signal to adjust operation of the vehicle environmental sensor system in the vehicle.

2. A system as recited in claim 1, further comprising:

a vehicle seat;

wherein said person is a driver seated in said seat; and

wherein said electro-dermal potential sensing system is at least partially integrated into the seat.

3. A system as recited in claim 1, wherein said at least one physiological state includes at least one of breathing rate, heart rate variability, and Cardiorespiratory Coupling/Synchrogram (CRS).

4. The system of claim 2, wherein the control signal is to adjust operation of an adaptive braking system in the vehicle based on the determined drowsiness state of the driver exceeding a drowsiness threshold.

5. The system of claim 2, wherein the plurality of contactless sensors are configured to be mounted in the seat;

wherein the seat includes a head rest, and wherein the plurality of contactless sensors includes one or more headrest sensors configured to be mounted in the headrest to measure electro-dermal potential at a head of the driver.

6. The system of claim 2, wherein the seat includes a driver warning device configured to indicate to the driver that the control signal representing drowsiness is output from the controller.

7. The system of claim 2, wherein the controller is configured to measure driver drowsiness based on individual frequency components in the electro-dermal potential signal.

8. The system of claim 2, wherein the controller is configured to quantify a drowsiness state level based on the electro-dermal potential signal and the physiological signal and to output a level signal to adjust a time-to-impact variable in an object avoidance calculation.

9. The system of claim 8, further comprising a camera configured to capture an image of the driver and produce a video output, and wherein the controller is configured to detect drowsiness indicators based on the video output, and wherein the controller is configured to calculate the drowsiness state level of the driver based on the drowsiness indicators.

10. The system of claim 2, wherein the controller is configured to quantify a drowsiness state level based on both the electro-dermal potential signal and the physiological signal and to control a driver alert based on the drowsiness state level, wherein the controller is configured to activate a driver alarm or a vibration in the seat in response to the drowsiness state level exceeding the drowsiness threshold.

11. The system of claim 2, wherein the vehicle environmental sensor system comprises an external sensor configured to detect objects external to the vehicle, the external sensor producing object detection signals using a sensor range, and wherein the controller is configured to increase the sensor range in response to the drowsiness state exceeding a drowsiness threshold.

12. The system of claim 2, wherein the controller is configured to receive at least one of an internal video signal, an external camera signal, a navigational position signal, and a vehicle speed signal, and wherein the controller is configured to determine a false drowsiness state of the driver based on the at least one of the internal video signal, the external camera signal, the navigational position signal, the vehicle speed signal and the electro-dermal potential signal.

13. The system of claim 2, wherein the controller is configured to switch the vehicle operation from a manual mode to an autonomous driving mode.

14. A vehicle system, comprising:

a vehicle environmental sensor system configured to sense external objects around the vehicle and output an external sensor signal;

a seat configured to support an occupant and to be mounted in a vehicle;

a contactless electro-dermal potential system configured to be at least partially integrated into the seat and configured to output an electro-dermal potential signal;

at least one physiological sensor configured to measure at least one of a e respiration rate, heart rate variability, and Cardiorespiratory Coupling/Synchrogram (CRS) of the occupant in the seat and to output at least one physiological signal indicative thereof; and

a controller configured to receive the electro-dermal potential signal from the electro-dermal potential system, the at least one physiological signal and the external sensor signal from the vehicle environmental sensor system and to output a control signal using the electro-dermal potential signal, the at least one physiological signal and the external sensor signal to adjust operation of the vehicle environmental sensor system in the vehicle.

15. The vehicle system of claim 14, wherein the electro-dermal potential system includes a plurality of contactless sensors configured to be mounted in the seat.

16. The vehicle system of claim 14, wherein the vehicle environmental sensor system includes a detection and ranging system with a range setting to sense objects outside the vehicle including a position and a range of an external object, wherein the external sensor signal includes the position and range of the external object, and wherein the controller is configured to adjust the range setting based on the electro-dermal potential signal, the at least one physiological signal and the external sensor signal.

17. The vehicle system of claim 16, wherein the vehicle environmental sensor system includes a light sensor, a LIDAR sensor, a camera, a radio frequency sensor, or a RADAR sensor.

18. The vehicle system of claim 14, further comprising a collision avoidance system having a trigger time based on a control signal from the controller indicative of a drowsiness state of the occupant, wherein the collision avoidance system is configured to trigger an avoidance action based on the trigger time, wherein the collision avoidance system has a first trigger time in response to the control signal indicating a drowsiness state is not detected, a second trigger time in response to the drowsiness state exceeding a first level, and a third trigger time in response to the drowsiness state exceeding a drowsiness threshold, wherein the second trigger time is less than the first trigger time, and wherein the third trigger time is less than the second trigger time and the first trigger time.

19. A system, comprising:

an electro-dermal potential sensing system including a plurality of contactless sensors configured to sense electro-dermal potential of a person seated in a driver seat of a vehicle, the electro-dermal sensing system configured to output an electro-dermal potential signal;

at least one physiological sensor configured to measure at least one physiological state of the person and output at least one physiological signal; and

a controller configured to receive the electro-dermal potential signal from the electro-dermal potential sensing system and the at least one physiological signal and to determine a drowsiness state of the person;

wherein the controller is further configured to adjust operation of an adaptive braking system in a vehicle based on the determined drowsiness state exceeding a drowsiness threshold, and wherein the controller is further configured to receive an external sensor signal from a vehicle environmental sensor system configured to sense external objects around the vehicle and to output a control signal using the electro-dermal potential signal, the at least one physiological signal and the external sensor signal to adjust operation of the vehicle environmental sensor system in the vehicle.

20. The system as recited in claim 19, wherein said at least one physiological state includes Cardiorespiratory Coupling/Synchrogram (CRS).