Occupant monitoring systems and methods

• US 10,614,328 B2
• Filed: 12/30/2014
• Issued: 04/07/2020
• Est. Priority Date: 12/30/2014
• Status: Active Grant

• Current Assignee: Joyson Safety Systems Acquisition, LLC
• Original Assignee: Joyson Safety Acquisition LLC
• Inventors: Lisseman, Jason Carl, Cech, Len
• Primary Examiner(s): Nasri, Maryam A
• Application Number:
  US14/586,188
• Publication Number:
  US 20160188987A1
• Time in Patent Office: 1,925 Days
• CPC Class Codes: G06V 20/597 Recognising the driver's state or behaviour, e.g. attention or drowsiness
• CPC Class Codes: H04N 7/18 Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast

Abstract

Various implementations include a vehicle occupant imaging system that is disposed within a vehicle. The system includes an automotive clock spring, at least one imaging unit, and a first processing unit. The automotive clock spring includes a rotor to which a rotatable portion of the steering wheel assembly is coupled, a stator coupled to a stationary portion of the vehicle, and a set of wires extending between the rotor and stator. The imaging unit is coupled to the rotatable portion of the steering wheel assembly. The first processing unit is disposed within the rotor and is configured for electrically receiving image signals captured by the imaging unit and selecting at least a portion of the image signals for communicating to a second processing unit disposed outside of the rotor. The selected image signals are electrically communicated to the second processing unit via the set of electrical wires.

Claims

1. A vehicle occupant imaging system disposed within a vehicle, the system comprising an automotive clock spring disposed within a steering wheel assembly, the automotive clock spring comprising a rotor to which a rotatable portion of the steering wheel assembly is coupled, a stator disposed radially adjacent the rotor and statically coupled within a steering column of the steering assembly, and at least one set of electrical wires coupled between the rotor and the stator, the system comprising:

at least one imaging unit coupled to the rotatable portion of the steering wheel assembly, the imaging unit having a field of view extending toward one or more vehicle occupants;

a first processing unit disposed within the rotor of the automotive clock spring, the first processing unit electrically receiving image signals captured by the imaging unit, selecting at least a portion of the image signals, and communicating the selected image signals to a second processing unit, where selecting a portion of the image signals comprises identifying and selecting one or more portions of an image related to one or more occupant information parameters; and

the second processing unit disposed within the stator of the automotive clock spring within the steering column of the steering assembly, the second processing unit electrically coupled to the first processing unit via the set of electrical wires, wherein the selected image signals are electrically communicated through the set of electrical wires,

wherein the second processing unit comprises a plurality of input connections, a plurality of output connections, and a network interface controller connecting the second processing unit to a vehicle electronic control unit (ECU);

wherein the second processing unit is configured to analyze the selected image signals to determine an occupant information parameter.

2. The vehicle occupant imaging system of claim 1, wherein the second processing unit is further configured for electrically receiving at least one of an angle of rotation or rate of angular rotation of the steering wheel assembly and adjusting an orientation of the image signals based on the received angle of rotation or rate of angular rotation,

wherein the second processing unit is in electrical communication with the imaging unit and configured for adjusting the imaging unit based on the received rotation or rate of angular rotation.

3. The vehicle occupant imaging system of claim 2, wherein a steering angle sensor is disposed in the rotor of the automotive clock spring, the steering angle sensor configured for acquiring the angle of rotation or rate of angular rotation of the steering wheel assembly and electrically communicating the acquired angle of rotation or rate of angular rotation to the second processing unit.

4. The vehicle occupant imaging system of claim 2, wherein a steering angle sensor is disposed in the stator of the automotive clock spring, the steering angle sensor configured for acquiring the angle of rotation or rate of angular rotation of the steering wheel assembly and electrically communicating the acquired angle of rotation or rate of angular rotation to the second processing unit via the set of electrical wires.

5. The vehicle occupant imaging system of claim 2, wherein the first processing unit is further configured for compressing the selected image signals to communicate to the second processing unit, and the second processing unit is further configured for decompressing the compressed image signals.

6. The vehicle occupant imaging system of claim 1, further comprising at least one electrical connector, the electrical connector configured for coupling electrical wires from the imaging unit to the second processing unit.

7. The vehicle occupant imaging system of claim 6, further comprising a length of wire that is configured for extending outwardly from the rotor of the automotive clock spring toward the rotatable portion of the steering wheel assembly and coupling the electrical connector to the first processing unit.

8. The vehicle occupant imaging system of claim 1, further comprising at least one light source disposed adjacent the imaging unit, the light source configured for providing lighting in the field of view of the imaging unit, the light source configured for being in electrical communication with the input connections and output connections of the second processing unit, wherein the second processing unit is configured for controlling an amount of light emitted from the light source.

9. The vehicle occupant imaging system of claim 8, the first processing unit further comprising first and second electrical connectors, the first and second electrical connectors configured for receiving electrical wires from the imaging unit, wherein the first electrical connector and the second electrical connector are coupled to the first processing unit.

10. The vehicle occupant imaging system of claim 9, further comprising a first length of wire that is configured for extending outwardly from the rotor of the automotive clock spring toward the rotatable portion of the steering wheel assembly and coupling the first electrical connector to the first processing unit and a second length of wire that is configured for extending outwardly from the rotor of the automotive clock spring toward the rotatable portion of the steering wheel assembly and coupling the second electrical connector to the first processing unit.

11. The vehicle occupant imaging system of claim 1, further comprising at least one light source configured for being disposed adjacent the imaging unit, the light source configured for providing lighting in the field of view of the imaging unit, the light source configured for being in electrical communication with the second processing unit via at least one pair of an input connection and an output connection wherein the second processing unit is configured for controlling an amount of light emitted from the light source.

12. The vehicle occupant imaging system of claim 11, wherein the first and second electrical connectors are each coupled to a length of wire extending outwardly from the rotor toward the rotatable portion of the steering wheel assembly, the length of wire of the first electrical connector and the second electrical connector coupling the first electrical connector to the first processing unit, and the length of wire of the second electrical connector configured for coupling the second electrical connector to the first processing unit.

13. The vehicle occupant imaging system of claim 1, wherein the second processing unit is configured for being electrically coupled to a power source disposed within the vehicle, wherein power from the power source is available from the second processing unit to the first processing unit and the imaging unit via the input connections and the output connections.

14. The vehicle occupant imaging system of claim 1, wherein the first processing unit is disposed on at least one arcuate-shaped printed circuit board.

15. The vehicle occupant imaging system of claim 14, wherein the at least one arcuate-shaped printed circuit board comprises a plurality of arcuate-shaped printed circuit boards, the arcuate-shaped printed circuit boards being stacked relative to each other so as to fit within the rotor of the automotive clock spring.

16. The vehicle occupant imaging system of claim 14, wherein the first processing unit is configured for saving at least a portion of the selected image signals to a memory, the memory being disposed on the arcuate-shaped printed circuit board.

17. The vehicle occupant imaging system of claim 1, wherein the first processing unit is configured for saving at least a portion of the selected image signals to a memory, the memory configured for being disposed in the rotor.

18. The vehicle occupant system of claim 1, wherein an occupant information parameter includes at least one of information corresponding to the occupant'"'"'s alertness, a state of the occupant the would prevent the imaging unit from capturing relevant image signals, a state of the vehicle that would prevent the imaging from capturing relevant image signals.

19. The vehicle occupant system of claim 1, wherein at least one of the first processing unit and the second processing unit is configured to analyze at least one of the selected image signals and the occupant information parameter to determine an occupant state,

wherein determining the occupant state includes determining at least one of deviation of a position and/or orientation of the occupant'"'"'s head and/or eyes from a predetermined position, and deviation of a position and/or orientation of the occupant'"'"'s head and/or eyes from the predetermined for a predetermined amount of time, determining if the occupant is speaking, determining a physiological state of the occupant.

20. The vehicle occupant system of claim 1, wherein selecting a portion of the image signals related to one or more occupant information parameters includes processing the image signal to identify an analysis region, the analysis region corresponding to a region of the imaging area associated with at least one of the driver, a non-driving vehicle occupant, and a region of interest within or external to the vehicle,

wherein identifying the analysis region includes determining a position and/or orientation of the occupant'"'"'s head and/or eyes.

21. A vehicle occupant imaging system disposed within a vehicle, the vehicle comprising system comprising an automotive clock spring disposed within a steering wheel assembly, the automotive clock spring comprising a rotor to which a rotatable portion of the steering wheel assembly is coupled, a stator disposed radially adjacent the rotor and statically coupled within a non-rotating portion of the steering assembly, and at least one set of electrical wires coupled between the rotor and the stator, the system comprising:

at least one imaging unit coupled to the rotatable portion of the steering wheel assembly, the imaging unit having a field of view extending toward one or more vehicle occupants; and

a first processing unit disposed within the rotor of the automotive clock spring and for electrically receiving image signals captured by the imaging unit, selecting at least a portion of the image signals related to occupant information parameters, and communicating at least one of the selected image signals to a second processing unit,

the second processing unit disposed within the stator of the automotive clock spring of the vehicle, the second processing unit analyzing the at least one of the selected image signals to determine an occupant information parameter, and analyzing the occupant information parameter to determine an occupant state;

the second processing unit comprising a plurality of input connections, a plurality of output connections, and a network interface controller connecting the second processing unit to a vehicle electronic control unit (ECU);

wherein the second processing unit is connected to a plurality of vehicle components via the input connections and the output connections; and

wherein the second processing unit is connected to a power source and provides power to the first processing unit via the set of electrical wires coupled between the rotor and stator and provides power to at least one of the vehicle components via the input connections and the output connections.

22. A vehicle occupant imaging system disposed within a vehicle, the system comprising:

at least one imaging unit coupled to a rotatable portion of a steering wheel assembly, the imaging unit having a field of view extending toward one or more vehicle occupants, the rotatable portion of the steering wheel assembly being rotatable about a steering column;

an automotive clock spring disposed within the steering wheel assembly, the automotive clock spring comprising a rotor to which the rotatable portion of the steering wheel assembly is coupled, a stator disposed radially adjacent the rotor, and at least one set of electrical wires coupled between the rotor and the stator;

a first processing unit disposed adjacent the imaging unit and configured for electrically receiving image signals captured by the imaging unit and selecting at least a portion of the image signals for communicating to a second processing unit;

the second processing unit being disposed in the rotor of the automotive clock spring, the second processing unit being electrically coupled to the first processing unit and a third processing unit disposed outside of the rotor in the vehicle, the second processing unit configured to analyze the selected image signals to determine an occupant information parameter and communicate at least one of the occupant information parameter and the selected image signals to the third processing unit; and

the third processing unit disposed within the stator of the automotive clock spring, the third processing unit configured to analyze at least one of the selected image signals and the occupant information parameter to determine an occupant state, the third processing unit comprising a plurality of input connections, a plurality of output connections, and a network interface controller connecting the third processing unit to a vehicle electronic control unit (ECU);

a light source, the light source configured for being in electrical communication with the third processing unit via at least one pair of the input connections and the output connections, wherein the third processing unit is configured for controlling an amount of light emitted from the light source; and

wherein the third processing unit is configured for being electrically coupled to a power source disposed within the vehicle, wherein power from the power source is available to the first processing unit and the light source via the set of electrical wires coupled between the rotor and stator.