Occupant monitoring systems and methods

• US 10,046,786 B2
• Filed: 12/28/2016
• Issued: 08/14/2018
• Est. Priority Date: 12/30/2014
• Status: Active Grant

• Current Assignee: Joyson Safety Systems Acquisition, LLC
• Original Assignee: Joyson Safety Systems Acquisition, LLC
• Inventors: Lisseman, Jason Carl, Cech, Len, Gardner, Valerie
• Primary Examiner(s): ARTHUR JEANGLAUDE, GERTRUDE
• Application Number:
  US15/391,887
• Publication Number:
  US 20170106892A1
• Time in Patent Office: 594 Days
• Field of Search: 701 36, 701 49, 3404255, 340438
• CPC Class Codes: B60R 11/04 Mounting of cameras operative during drive; Arrangement of controls thereof relative to the vehicle
• CPC Class Codes: B60R 2011/001 Vehicle control means, e.g. steering-wheel or column
• CPC Class Codes: B60W 10/20 including control of steering systems
• CPC Class Codes: B60W 2040/0818 Inactivity or incapacity of driver
• CPC Class Codes: B60W 2420/403 Image sensing, e.g. optical camera
• CPC Class Codes: B60W 2422/50 on a steering column
• CPC Class Codes: B60W 2510/20 Steering systems
• CPC Class Codes: B60W 2710/20 Steering systems
• CPC Class Codes: B60W 40/09 Driving style or behaviour
• CPC Class Codes: B62D 1/046 Adaptations on rotatable parts of the steering wheel for accommodation of switches
• CPC Class Codes: F21S 45/47 Passive cooling, e.g. using fins, thermal conductive elements or openings
• CPC Class Codes: G06V 20/59 inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions
• CPC Class Codes: G06V 20/593 Recognising seat occupancy
• CPC Class Codes: H04N 23/51 Housings
• CPC Class Codes: H04N 23/90 Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
• CPC Class Codes: H04N 5/33 Transforming infrared radiation cameras or camera modules for generating image signals from infrared radiation H04N23/20; circuitry of SSIS for transforming infrared radiation into image signals H04N25/20

Abstract

Various implementations relate to an operator monitoring system (OMS). Certain implementations include an OMS coupled to a rotatable portion of a steering wheel assembly of a vehicle. For example, the OMS may include an imaging unit, such as a camera, that is coupled to a central hub portion of the steering wheel assembly. The imaging unit has a field of view directed toward one or more occupants in the vehicle and is configured to capture an image signal corresponding to an imaging area in the field of view. The imaging area can be configured to encapsulate an expected position of one or more vehicle occupants. The OMS also includes one or more processing units in electrical communication with the imaging unit that receives and processes the image signal from the imaging unit to determine an occupant state and, in some implementations, provide feedback based on the determined occupant state.

Claims

1. An illumination system for use with an occupant monitoring system (OMS) for monitoring at least one occupant in a vehicle, the vehicle having a steering wheel assembly configure to rotate relative to a steering column, the illumination system comprising:

an infrared light source coupled to a central portion of the steering wheel assembly, the infrared light source directing infrared light within an imaging area of an occupant monitoring system (OMS), wherein the central portion of the steering wheel assembly comprises a hub and spokes, wherein the spokes extend between the hub and a rim of the steering wheel assembly.

2. The illumination system of claim 1, wherein the infrared light source comprises one or more infrared light emitting diodes (LEDs).

3. The illumination system of claim 2, wherein the infrared LEDs are thermally coupled to the steering wheel assembly such that heat generated by the infrared LEDs is transferred toward the steering wheel assembly and away from the infrared LEDs.

4. The illumination system of claim 3, wherein a thermal conductive gap pad is disposed between the infrared LEDs and the hub for transferring heat generated by the infrared LEDs toward the hub and away from the infrared LEDs.

5. The illumination system of claim 1, further comprising a second infrared light source coupled to the rim of the steering wheel assembly, the second infrared light source thermally coupled to the steering wheel assembly such that heat generated by the second infrared LED is transferred toward the steering wheel assembly and away from the second infrared LED.

6. An occupant monitoring system (OMS) for monitoring an occupant in a vehicle comprising:

an imaging unit coupled to a steering wheel assembly of a vehicle, the imaging unit having a field of view for capturing an image of an imaging area within the field of view,

wherein the imaging area encapsulates an expected position of the occupant,

wherein the imaging unit is thermally coupled to the steering wheel assembly of the vehicle such that heat generated by the imaging unit is transferred away from the imaging unit to the steering wheel assembly.

7. The OMS of claim 6, wherein the OMS comprises a housing in which the imaging unit is disposed, the housing comprising a thermally conductive material, and the housing being thermally coupled to the steering wheel assembly.

8. The OMS of claim 7, wherein a thermally conductive gap pad is disposed between the housing and the steering wheel assembly to transfer heat away from the OMS and to the steering wheel assembly.

9. The OMS of claim 6, wherein the housing is directly coupled to a mounting bracket comprising a thermally conductive material, and the mounting bracket is directly coupled to the steering wheel assembly, wherein heat generated by the OMS is transferred to the mounting bracket and from the mounting bracket to the steering wheel assembly.

10. The OMS of claim 9, wherein the steering wheel assembly comprises a hub and spokes that extend between the hub and a rim of the steering wheel assembly, and

wherein the mounting bracket is directly coupled to the hub of the steering wheel assembly such that heat generated by the OMS is transferred from the mounting bracket to the hub of the steering wheel assembly.

11. The OMS of claim 6, wherein the OMS further comprises an infrared light source, the infrared light source being thermally coupled to the steering wheel assembly.

12. The OMS of claim 11, wherein the imaging unit and the infrared light source are coupled to a hub and/or spokes of the steering wheel assembly, the spokes extending between the hub and a rim of the steering wheel assembly.

13. The OMS of claim 6, further comprising a second imaging unit coupled to the vehicle having a corresponding field of view for capturing an image of an imaging area within the field of view, the imaging unit encapsulates an expected position of the occupant.

14. An occupant monitoring system (OMS) for monitoring an occupant in a vehicle, the OMS comprising:

an imaging unit for coupling to a steering wheel assembly, the imaging unit having a field of view inside of the vehicle for capturing an image signal corresponding to an imaging area in the vehicle, the imaging area being within the field of view, and

a processing unit, the processing unit including a processor and a memory operably coupled to the processor, the memory having computer-executable instructions stored thereon that, when executed by the processor, cause the processor to;

monitor an operator interference signal, the operator interference signal associated with an ability of the OMS to monitor the imaging area;

in response to the operator interference signal indicating an interference with an ability of the imaging unit to capture the image signal corresponding to the imaging area, disabling one or more operations of the OMS; and

in response to the operator interference signal indicating that the ability of the imaging unit to capture the image signal is restored, enabling the one or more operations of the OMS.

15. The OMS of claim 14, further comprising a steering angle sensor, wherein:

the imaging area encapsulates an expected position of the occupant in the vehicle;

the imaging unit rotates with a central portion of a steering wheel assembly of the vehicle;

wherein the operator interference signal comprises an electrical signal received from the steering angle sensor and monitoring the operator interference signal comprises;

processing the electrical signal to determine the angle of rotation of the steering wheel assembly and/or the rate of angular rotation of the steering wheel assembly; and

identifying the interference with the ability of the imaging unit to capture the image signal in response to the angle of rotation and/or rate of angular rotation being greater than a threshold angle of rotation and/or threshold rate of angular rotation, respectively.

16. The OMS of claim 15, wherein identifying the interference with the ability of the imaging unit to capture the image signal further comprises the angle of rotation and/or the rate of angular rotation exceeding the threshold angle of rotation and/or the threshold rate of angular rotation, respectively, for a predetermined time period.

17. The OMS of claim 14, further comprising one or more fixed infrared reflective materials disposed within the field of view, wherein the instructions further cause the processor to determine an angle of rotation and/or a rate of rotation based on the image signal of the fixed infrared reflective materials.

18. A method of monitoring an occupant in a vehicle using an occupant monitoring system, the method comprising:

coupling an occupant monitoring system (OMS) to a steering wheel assembly of the vehicle such that the OMS rotates with a rotatable portion of the steering wheel assembly, the OMS including an imaging unit configured to capture an image signal corresponding to an imaging area in the vehicle, the imaging area being within the field of view of the imaging unit;

processing an angle electrical signal to determine the angle of rotation of the steering wheel assembly and/or the rate of angular rotation of the steering wheel assembly;

in response to the angle electrical signal indicating that the angle of rotation and/or the rate of angular rotation has exceeded a threshold angle of rotation or rate of angular rotation, respectively, disabling operation of the OMS; and

in response to the electrical signal indicating that the angle of rotation and/or the rate of angular rotation meets or is below the threshold angle of rotation or rate of angular rotation, respectively, enabling operation of the OMS.

19. The method of claim 18, wherein the angle electrical signal is received from a steering angle sensor.

20. The method of claim 18, wherein the angle electrical signal comprises a plurality of imaging signals from the imaging unit that are processed to determine the angle of rotation of the steering wheel assembly and/or the rate of angular rotation of the steering wheel assembly, the imaging signals from the imaging unit comprising images of a fixed reflective material within the field of view of the imaging unit.