Vehicular sound processing system

• US 10,536,791 B2
• Filed: 04/15/2019
• Issued: 01/14/2020
• Est. Priority Date: 07/24/2014
• Status: Active Grant

• Current Assignee: Magna Electronics Incorporated (Magna International Incorporated)
• Original Assignee: Magna Electronics Incorporated (Magna International Incorporated)
• Inventors: Wacquant, Sylvie, Biemer, Michael
• Primary Examiner(s): Huber, Paul W
• Application Number:
  US16/383,835
• Publication Number:
  US 20190246225A1
• Time in Patent Office: 274 Days
• Field of Search: None
• CPC Class Codes: G10K 11/346 using phase variation
• CPC Class Codes: G10K 2210/1282 Automobiles
• CPC Class Codes: G10L 2021/02087 the noise being separate speech, e.g. cocktail party
• CPC Class Codes: G10L 2021/02166 Microphone arrays; Beamforming
• CPC Class Codes: G10L 21/0208 Noise filtering
• CPC Class Codes: H04R 2227/009 Signal processing in [PA] systems to enhance the speech intelligibility
• CPC Class Codes: H04R 2420/03 Connection circuits to selectively connect loudspeakers or headphones to amplifiers
• CPC Class Codes: H04R 2499/13 Acoustic transducers and sound field adaptation in vehicles
• CPC Class Codes: H04R 27/00 Public address systems circuits for preventing acoustic reaction H04R3/02; circuits for distributing signals to loudspeakers H04R3/12; monitoring or testing arrangements for public address systems H04R29/007; amplifiers H03F
• CPC Class Codes: H04R 3/005 for combining the signals of two or more microphones specially adapted for hearing aids H04R25/407
• CPC Class Codes: H04R 3/12 for distributing signals to two or more loudspeakers specially adapted for hearing aids H04R25/407
• CPC Class Codes: H04S 7/302 Electronic adaptation of stereophonic sound system to listener position or orientation H04S7/301 takes precedence

Abstract

A vehicular sound processing system includes a plurality of interior microphones that detect interior sound emanating from within the interior cabin of the vehicle, and a plurality of exterior microphones that detect exterior sound emanating from exterior the vehicle. The interior microphones also detect exterior sound. A sound processor processes exterior microphone signals to determine exterior sound detected by the exterior microphones. The sound processor processes interior microphone signals to distinguish voices of occupants present within the interior cabin from non-vocal sound emanating from within the interior cabin and from exterior sound emanating from exterior the vehicle. The sound processor processes the exterior microphone signals to determine a sound of interest emanating from exterior of the vehicle. Responsive to determination of the sound of interest, the sound of interest is played by loudspeakers so that a driver of the vehicle can hear the sound of interest.

Claims

1. A vehicular sound processing system, said vehicular sound processing system comprising:

a plurality of interior microphones disposed at an interior cabin of a vehicle equipped with said vehicular sound processing system, wherein said plurality of interior microphones detects interior sound emanating from within the interior cabin of the equipped vehicle;

wherein said plurality of interior microphones also detects exterior sound emanating from exterior the equipped vehicle;

a plurality of loudspeakers disposed at the interior cabin of the equipped vehicle, wherein said plurality of loudspeakers comprises at least (i) a front left loudspeaker disposed at a front left region of the interior cabin of the equipped vehicle, (ii) a front right loudspeaker disposed at a front right region of the interior cabin of the equipped vehicle, (iii) a rear left loudspeaker disposed at a rear left region of the interior cabin of the equipped vehicle and (iv) a rear right loudspeaker disposed at a rear right region of the interior cabin of the equipped vehicle;

a plurality of exterior microphones disposed at the equipped vehicle and located exterior of the interior cabin of the equipped vehicle, wherein said plurality of exterior microphones detects exterior sound emanating from exterior the equipped vehicle;

wherein exterior microphone signals generated by said plurality of exterior microphones are provided to a sound processor of said vehicular sound processing system;

wherein interior microphone signals generated by said plurality of interior microphones are provided to the sound processor of said vehicular sound processing system;

wherein said sound processor processes exterior microphone signals generated by said plurality of exterior microphones to determine exterior sound detected by said plurality of exterior microphones;

wherein said sound processor processes interior microphone signals generated by said plurality of interior microphones to distinguish voices of occupants present within the interior cabin of the equipped vehicle from non-vocal sound emanating from within the interior cabin of the equipped vehicle and from exterior sound emanating from exterior the equipped vehicle;

wherein said sound processor processes the exterior microphone signals to determine a sound of interest emanating from exterior of the equipped vehicle;

wherein said vehicular sound processing system, responsive at least in part to determination by said sound processor of the sound of interest, determines a direction from the equipped vehicle towards the source of the sound of interest;

wherein, responsive to determination by said sound processor of the sound of interest, the sound of interest is played by loudspeakers of said vehicular sound processing system so that a driver of the equipped vehicle can hear the sound of interest;

wherein said vehicular sound processing system controls said plurality of loudspeakers inside the equipped vehicle so that sound representative of the sound of interest is heard by the driver of the equipped vehicle as if emanating from the determined direction towards the source of the sound of interest;

wherein said vehicular sound processing system controls said plurality of loudspeakers so that sound representative of the sound of interest is heard by the driver of the equipped vehicle as if emanating from the determined direction towards the source of the sound of interest by using at least two loudspeakers selected from the group consisting of (i) said front left loudspeaker, (ii) said front right loudspeaker, (iii) said rear left loudspeaker and (iv) said rear right loudspeaker; and

wherein, when said vehicular sound processing system controls said plurality of loudspeakers to play the sound of interest via said at least two loudspeakers, said vehicular sound processing system controls said plurality of loudspeakers to not play other sound detected by said plurality of interior microphones and said plurality of exterior microphones.

2. The vehicular sound processing system of claim 1, wherein, responsive to determination of the sound of interest, images representative of the source of the sound of interest are displayed at a display in the equipped vehicle for viewing by the driver of the equipped vehicle.

3. The vehicular sound processing system of claim 1, wherein, responsive to determination of the sound of interest, images derived from image data captured by at least one camera that is representative of the source of the sound of interest are displayed at a video display in the equipped vehicle for viewing by the driver of the equipped vehicle.

4. The vehicular sound processing system of claim 1, wherein location of a source vehicle of the determined sound of interest is transmitted to the equipped vehicle by the source vehicle and received by said vehicular sound processing system via a wireless car-to-car communication system.

5. The vehicular sound processing system of claim 1, wherein, responsive to determination of the sound of interest, a visual alert is generated in the equipped vehicle for viewing by the driver of the equipped vehicle.

6. The vehicular sound processing system of claim 1, wherein the direction towards the source of the sound of interest is determined in part by receiving at said vehicular sound processing system location information pertaining to location of the source of the sound of interest.

7. The vehicular sound processing system of claim 1, wherein the direction towards the source of the sound of interest is determined at least in part by processing of image data captured by at least one camera disposed at the equipped vehicle, and wherein images derived from image data captured by the at least one camera that is representative of the source of the sound of interest are displayed at a video display in the equipped vehicle for viewing by the driver of the equipped vehicle.

8. The vehicular sound processing system of claim 1, wherein the direction towards the source of the sound of interest is determined at least in part by processing of image data captured by at least one camera of a plurality of cameras disposed at the equipped vehicle, and wherein images derived from image data captured by the at least one camera that is representative of the source of the sound of interest are displayed at a video display in the equipped vehicle for viewing by the driver of the equipped vehicle.

9. The vehicular sound processing system of claim 1, wherein the direction towards the source of the sound of interest is determined at least in part by a wireless communication from a transmitter remote from the equipped vehicle.

10. The vehicular sound processing system of claim 9, wherein the transmitter is part of a vehicle to vehicle communication system or a vehicle to infrastructure communication system.

11. The vehicular sound processing system of claim 1, wherein said vehicular sound processing system actively cancels sound noise inside the equipped vehicle that is not attributable to voice signals of occupants present within the interior cabin of the equipped vehicle.

12. The vehicular sound processing system of claim 1, wherein the sound of interest is determined by said sound processor at least in part via a wireless communication from a transmitter remote from the equipped vehicle.

13. The vehicular sound processing system of claim 12, wherein the transmitter is part of a vehicle to vehicle communication system or a vehicle to infrastructure communication system.

14. The vehicular sound processing system of claim 1, wherein the sound of interest comprises a siren of an emergency vehicle.

15. The vehicular sound processing system of claim 14, wherein the emergency vehicle comprises an ambulance.

16. A vehicular sound processing system, said vehicular sound processing system comprising:

a plurality of interior microphones disposed at an interior cabin of a vehicle equipped with said vehicular sound processing system, wherein said plurality of interior microphones detects interior sound emanating from within the interior cabin of the equipped vehicle;

wherein said plurality of interior microphones also detects exterior sound emanating from exterior the equipped vehicle;

a plurality of loudspeakers disposed at the interior cabin of the equipped vehicle, wherein said plurality of loudspeakers comprises at least (i) a front left loudspeaker disposed at a front left region of the interior cabin of the equipped vehicle, (ii) a front right loudspeaker disposed at a front right region of the interior cabin of the equipped vehicle, (iii) a rear left loudspeaker disposed at a rear left region of the interior cabin of the equipped vehicle and (iv) a rear right loudspeaker disposed at a rear right region of the interior cabin of the equipped vehicle;

a plurality of exterior microphones disposed at the equipped vehicle and located exterior of the interior cabin of the equipped vehicle, wherein said plurality of exterior microphones detects exterior sound emanating from exterior the equipped vehicle;

wherein exterior microphone signals generated by said plurality of exterior microphones are provided to a sound processor of said vehicular sound processing system;

wherein interior microphone signals generated by said plurality of interior microphones are provided to the sound processor of said vehicular sound processing system;

wherein said sound processor processes exterior microphone signals generated by said plurality of exterior microphones to determine exterior sound detected by said plurality of exterior microphones;

wherein said sound processor processes interior microphone signals generated by said plurality of interior microphones to distinguish voices of occupants present within the interior cabin of the equipped vehicle from non-vocal sound emanating from within the interior cabin of the equipped vehicle and from exterior sound emanating from exterior the equipped vehicle;

wherein said sound processor processes the exterior microphone signals to determine a sound of interest emanating from exterior of the equipped vehicle;

wherein the sound of interest comprises a siren of an emergency vehicle;

wherein the equipped vehicle is equipped with at least one camera having a field of view exterior of the equipped vehicle, and wherein presence of the emergency vehicle that is the source of the sound of interest is determined at least in part by processing of image data captured by the at least one camera disposed at the equipped vehicle;

wherein said vehicular sound processing system, responsive at least in part to determination by said sound processor of the sound of interest, determines a direction from the equipped vehicle towards the emergency vehicle that is the source of the sound of interest;

wherein, responsive to determination by said sound processor of the sound of interest, the sound of interest is played by loudspeakers of said vehicular sound processing system so that a driver of the equipped vehicle can hear the sound of interest;

wherein said vehicular sound processing system controls said plurality of loudspeakers inside the equipped vehicle so that sound representative of the sound of interest is heard by the driver of the equipped vehicle as if emanating from the determined direction towards the emergency vehicle that is the source of the sound of interest;

wherein said vehicular sound processing system controls said plurality of loudspeakers so that sound representative of the sound of interest is heard by the driver of the equipped vehicle as if emanating from the determined direction towards the emergency vehicle that is the source of the sound of interest by using at least two loudspeakers selected from the group consisting of (i) said front left loudspeaker, (ii) said front right loudspeaker, (iii) said rear left loudspeaker and (iv) said rear right loudspeaker; and

wherein, when said vehicular sound processing system controls said plurality of loudspeakers to play the sound of interest via said at least two loudspeakers, said vehicular sound processing system controls said plurality of loudspeakers to not play other sound detected by said plurality of interior microphones and said plurality of exterior microphones.

17. The vehicular sound processing system of claim 16, wherein, responsive to determination of the sound of interest, images derived from image data captured by the at least one camera that is representative of the emergency vehicle that is the source of the sound of interest are displayed at a video display in the equipped vehicle for viewing by the driver of the equipped vehicle.

18. The vehicular sound processing system of claim 16, wherein, responsive to determination of the sound of interest, a visual alert is generated in the equipped vehicle for viewing by the driver of the equipped vehicle.

19. The vehicular sound processing system of claim 16, wherein the direction towards the emergency vehicle that is the source of the sound of interest is determined at least in part by said sound processor processing the exterior microphone signals of said plurality of exterior microphones.

20. The vehicular sound processing system of claim 16, wherein the direction towards the emergency vehicle that is the source of the sound of interest is determined at least in part by processing of image data captured by the at least one camera disposed at the equipped vehicle.

21. The vehicular sound processing system of claim 16, wherein the emergency vehicle comprises an ambulance.

22. A vehicular sound processing system, said vehicular sound processing system comprising:

a plurality of interior microphones disposed at an interior cabin of a vehicle equipped with said vehicular sound processing system, wherein said plurality of interior microphones detects interior sound emanating from within the interior cabin of the equipped vehicle;

wherein said plurality of interior microphones also detects exterior sound emanating from exterior the equipped vehicle;

a plurality of loudspeakers disposed at the interior cabin of the equipped vehicle, wherein said plurality of loudspeakers comprises at least (i) a front left loudspeaker disposed at a front left region of the interior cabin of the equipped vehicle, (ii) a front right loudspeaker disposed at a front right region of the interior cabin of the equipped vehicle, (iii) a rear left loudspeaker disposed at a rear left region of the interior cabin of the equipped vehicle and (iv) a rear right loudspeaker disposed at a rear right region of the interior cabin of the equipped vehicle;

a plurality of exterior microphones disposed at the equipped vehicle and located exterior of the interior cabin of the equipped vehicle, wherein said plurality of exterior microphones detects exterior sound emanating from exterior the equipped vehicle;

wherein exterior microphone signals generated by said plurality of exterior microphones are provided to a sound processor of said vehicular sound processing system;

wherein interior microphone signals generated by said plurality of interior microphones are provided to the sound processor of said vehicular sound processing system;

wherein said sound processor processes exterior microphone signals generated by said plurality of exterior microphones to determine exterior sound detected by said plurality of exterior microphones;

wherein said sound processor processes interior microphone signals generated by said plurality of interior microphones to distinguish voices of occupants present within the interior cabin of the equipped vehicle from non-vocal sound emanating from within the interior cabin of the equipped vehicle and from exterior sound emanating from exterior the equipped vehicle;

wherein said sound processor processes the exterior microphone signals to determine a sound of interest emanating from exterior of the equipped vehicle;

wherein the sound of interest comprises a siren of an emergency vehicle;

wherein location of the emergency vehicle that is the source of the determined sound of interest is transmitted to the equipped vehicle by the emergency vehicle and received by said vehicular sound processing system via a wireless car-to-car communication system;

wherein said vehicular sound processing system, responsive at least in part to determination by said sound processor of the sound of interest, determines a direction from the equipped vehicle towards the emergency vehicle that is the source of the sound of interest;

wherein, responsive to determination by said sound processor of the sound of interest, the sound of interest is played by loudspeakers of said vehicular sound processing system so that a driver of the equipped vehicle can hear the sound of interest;

wherein said vehicular sound processing system controls said plurality of loudspeakers inside the equipped vehicle so that sound representative of the sound of interest is heard by the driver of the equipped vehicle as if emanating from the determined direction towards the emergency vehicle that is the source of the sound of interest;

wherein said vehicular sound processing system controls said plurality of loudspeakers so that sound representative of the sound of interest is heard by the driver of the equipped vehicle as if emanating from the determined direction towards the emergency vehicle that is the source of the sound of interest by using at least two loudspeakers selected from the group consisting of (i) said front left loudspeaker, (ii) said front right loudspeaker, (iii) said rear left loudspeaker and (iv) said rear right loudspeaker; and

wherein, when said vehicular sound processing system controls said plurality of loudspeakers to play the sound of interest via said at least two loudspeakers, said vehicular sound processing system controls said plurality of loudspeakers to not play other sound detected by said plurality of interior microphones and said plurality of exterior microphones.

23. The vehicular sound processing system of claim 22, wherein, responsive to determination of the sound of interest, images derived from image data captured by at least one camera that is representative of the emergency vehicle that is the source of the sound of interest are displayed at a video display in the equipped vehicle for viewing by the driver of the equipped vehicle.

24. The vehicular sound processing system of claim 22, wherein, responsive to determination of the sound of interest, a visual alert is generated in the equipped vehicle for viewing by the driver of the equipped vehicle.

25. The vehicular sound processing system of claim 22, wherein said vehicular sound processing system actively cancels sound noise inside the equipped vehicle that is not attributable to voice signals of occupants present within the interior cabin of the equipped vehicle.

26. The vehicular sound processing system of claim 22, wherein the emergency vehicle comprises an ambulance.