Method and apparatus for monitoring a rear passenger seating area of a vehicle

• US 9,446,770 B2
• Filed: 01/29/2015
• Issued: 09/20/2016
• Est. Priority Date: 01/29/2015
• Status: Active Grant

• Current Assignee: GM Global Technology Operations LLC (General Motors Company)
• Original Assignee: GM Global Technology Operations LLC (General Motors Company)
• Inventors: Valeri, Frank C., Reilly, Scott M., Tzirkel-Hancock, Eli, Talwar, Gaurav, Holdren, John L., Zhao, Xufang
• Primary Examiner(s): NGUYEN, TAN QUANG
• Application Number:
  US14/608,776
• Publication Number:
  US 20160221583A1
• Time in Patent Office: 600 Days
• Field of Search: 701/48, 701/36, 340/457, 381/71.11
• US Class Current: 1/1
• CPC Class Codes: B60W 2040/0881 Seat occupation; Driver or passenger presence
• CPC Class Codes: B60W 2420/54 Audio sensitive means, e.g. ultrasound
• CPC Class Codes: B60W 50/0098 Details of control systems ensuring comfort, safety or stability not otherwise provided for
• CPC Class Codes: G01H 3/00 Measuring characteristics of vibrations by using a detector in a fluid G01H7/00, G01H9/00, G01H11/00 take precedence
• CPC Class Codes: G10K 11/17821 characterised by the analysis of the input signals only
• CPC Class Codes: G10K 11/17825 Error signals
• CPC Class Codes: G10K 11/17875 using an error signal without a reference signal, e.g. pure feedback
• CPC Class Codes: G10K 11/17885 additionally using a desired external signal, e.g. pass-through audio such as music or speech
• CPC Class Codes: G10K 2210/1282 Automobiles
• CPC Class Codes: G10L 17/00 Speaker identification or verification techniques
• CPC Class Codes: G10L 17/26 Recognition of special voice characteristics, e.g. for use in lie detectors; Recognition of animal voices
• CPC Class Codes: G10L 25/15 the extracted parameters being formant information
• CPC Class Codes: G10L 25/63 for estimating an emotional state

Abstract

A vehicle including a passenger compartment having a rear seating area is described. A method for monitoring the rear seating area of the passenger compartment includes monitoring a vehicle operating state comprising one of a key-on state and a key-off state and monitoring the rear seating area. A presence or absence of a passenger in the rear seating area is detected based upon the monitoring, and a control routine is executed based upon the vehicle operating state and the presence or absence of a passenger in the rear seating area.

Claims

1. A method for monitoring a rear seating area of a passenger compartment of a vehicle, the method comprising:

monitoring, by an on-vehicle controller, a vehicle operating state comprising one of a key-on state and a key-off state;

monitoring the rear seating area to detect presence or absence of a passenger in the rear seating area, including monitoring input signals associated with a plurality of sensing devices and monitoring actuator commands from control elements associated with the rear seating area, and executing a sensor fusion routine to evaluate the input signals and the actuator commands; and

executing a control routine based upon the vehicle operating state and the presence or absence of a passenger in the rear seating area, including executing an audio signal processing routine to detect the presence or absence of a passenger in the rear seating area, including;

dynamically capturing audio signals employing the front and rear microphones;

determining differences in times of arrival of the audio signals between the front and rear microphones;

determining differences in magnitudes of power of the audio signals between the front and rear microphones; and

evaluating the differences in times of arrival of the audio signals and the differences in magnitudes of power of the audio signals to determine the presence of a passenger in the rear seating area.

2. The method of claim 1, wherein monitoring input signals associated with a plurality of sensing devices comprises monitoring input signals from at least one of a rear door latch sensor, a rear seat belt/buckle sensor, a rear seat occupant sensor, front and rear microphones and a rear seat camera.

3. The method of claim 1, wherein monitoring the rear seating area further comprises monitoring actuator commands from control elements associated with the rear seating area.

4. The method of claim 3, wherein monitoring actuator commands from control elements associated with the rear seating area comprises monitoring actuator commands from at least one of a rear door window control switch, a rear seat position control, a rear seat HVAC control and a rear seat infotainment system and controls.

5. The method of claim 1, wherein executing the sensor fusion routine to evaluate the input signals and the actuator commands comprises employing logic operators to evaluate the input signals and the actuator commands.

6. The method of claim 1, further comprising dynamically executing a frequency spectrum analysis of the audio signals captured by the front and rear microphones to detect audible sounds associated with human speech and a magnitude of power associated therewith.

7. The method of claim 1, wherein executing a control routine based upon the vehicle operating state and the presence or absence of a passenger in the rear seating area comprises executing a rear seat-specific active noise cancellation routine only when a passenger is determined to be present in the rear seating area and the vehicle is in the key-on state.

8. A method for monitoring a rear seating area of a passenger compartment of a vehicle, the method comprising:

monitoring, by an on-vehicle controller, a vehicle operating state comprising one of a key-on state and a key-off state;

monitoring the rear seating area to detect presence or absence of a passenger in the rear seating area and

executing a control routine based upon the vehicle operating state and the presence or absence of a passenger in the rear seating area

wherein executing the control routine based upon the vehicle operating state and the presence or absence of a passenger in the rear seating area comprises executing an passenger distress detection routine when a passenger is present in the rear seating area and the vehicle is in the key-off state.

9. The method of claim 8, wherein executing a passenger distress detection routine comprises:

collecting, via an in-vehicle microphone, in-vehicle sounds;

executing a speech recognition routine including a frequency spectrum analysis of the in-vehicle sounds;

determining formants using the frequency spectrum analysis;

evaluating formants of the monitored audible data to determine whether they correspond to speech indicating passenger distress; and

executing appropriate action when the formants correspond to speech indicating passenger distress.

10. The method of claim 9, wherein executing appropriate action when the formants correspond to speech indicating passenger distress comprises one of commanding opening one or more of the vehicle windows, adjusting ambient temperature in the passenger compartment by starting the vehicle and activating the HVAC system, and employing an on-board extra-vehicle communications system and associated GPS to notify emergency personnel of the vehicle location.

11. A method for monitoring a rear seating area of a vehicle passenger compartment that includes an extra-vehicle communications system and a rear seat-specific active noise cancellation device, the method comprising:

monitoring a vehicle operating state comprising one of a key-on state and a key-off state;

monitoring the rear seating area to detect a presence of a passenger in the rear seating area;

executing a control routine including operating one of the extra-vehicle communications system and the rear seat-specific active noise cancellation device based upon the vehicle operating state when presence of a passenger is detected in the rear seating area; and

executing a distress detection routine when a passenger is present in the rear seating area and the vehicle is in the key-off state, the distress detection routine including;

collecting, via an in-vehicle microphone, in-vehicle sounds,

executing a speech recognition routine including a frequency spectrum analysis of the in-vehicle sounds,

determining formants using the frequency spectrum analysis,

evaluating formants of the monitored audible data to determine whether they correspond to speech indicating distress, and

executing appropriate action when the formants correspond to speech indicating distress;

wherein executing appropriate action when the formants correspond to speech indicating distress includes operating the extra-vehicle communications system.

12. The method of claim 11, further comprising dynamically executing a frequency spectrum analysis of the audio signals captured by the front and rear microphones to detect audible sounds associated with human speech and a magnitude of power associated therewith.

13. The method of claim 11, wherein monitoring the rear seating area to detect a presence of a passenger in the rear seating area comprises:

monitoring input signals associated with a plurality of sensing devices and monitoring actuator commands from control elements associated with the rear seating area, including executing an audio signal processing routine to detect presence or absence of a passenger in the rear seating area, including;

dynamically capturing audio signals employing the front and rear microphones,

determining differences in times of arrival of the audio signals between the front and rear microphones,

determining differences in magnitudes of power of the audio signals between the front and rear microphones, and

evaluating the differences in times of arrival of the audio signals and the differences in magnitudes of power of the audio signals to determine the presence of a passenger in the rear seating area; and

executing a sensor fusion routine to evaluate the input signals and the actuator commands.