Speech reproduction device configured for masking reproduced speech in a masked speech zone

• US 10,395,634 B2
• Filed: 07/17/2017
• Issued: 08/27/2019
• Est. Priority Date: 01/20/2015
• Status: Active Grant

• Current Assignee: Fraunhofer Gesellschaft Zur Foerderung Der Angewandten Forsching E.V.
• Original Assignee: Fraunhofer Gesellschaft Zur Foerderung Der Angewandten Forsching E.V.
• Inventors: Walther, Andreas, Schneider, Martin, Habets, Emanuel, Hellmuth, Oliver
• Primary Examiner(s): Laekemariam, Yosef K
• Application Number:
  US15/651,922
• Publication Number:
  US 20170316773A1
• Time in Patent Office: 771 Days
• Field of Search: 381 711, 381 719, 381 7114, 381 731, 381 58, 381 80, 381 83, 381119
• CPC Class Codes: G10K 11/1754 Speech masking
• CPC Class Codes: G10K 2210/103 Three dimensional
• CPC Class Codes: G10K 2210/111 Directivity control or beam pattern
• CPC Class Codes: G10K 2210/3049 Random noise used, e.g. in model identification
• CPC Class Codes: G10K 2210/509 Hybrid, i.e. combining different technologies, e.g. passive and active
• CPC Class Codes: G10L 2021/02166 Microphone arrays; Beamforming
• CPC Class Codes: H04K 2203/12 for acoustic communication
• CPC Class Codes: H04K 2203/34 involving multiple cooperating jammers
• CPC Class Codes: H04K 3/43 characterized by the control of the jamming power, signal-to-noise ratio or geographic coverage area
• CPC Class Codes: H04K 3/45 characterized by including monitoring of the target or target signal, e.g. in reactive jammers or follower jammers for example by means of an alternation of jamming phases and monitoring phases, called "look-through mode"
• CPC Class Codes: H04K 3/825 by jamming
• CPC Class Codes: H04K 3/84 related to preventing electromagnetic interference in petrol station, hospital, plane or cinema

Abstract

A speech reproduction device for reproducing speech based on a received speech signal so that the reproduced speech is intelligible in a clear speech zone and unintelligible in a masked speech zone includes an audio processing module configured for receiving the speech signal; a set of speech loudspeakers configured for reproducing the speech based on one or more speech loudspeaker signals; and a set of masking sound loudspeakers configured for producing a masking sound based on one or more masking sound loudspeaker signals, wherein the masking sound masks the speech in the masked speech zone; wherein the audio processing module includes a speech signal analysis module configured for producing one or more analysis signals based on spectral and/or temporal characteristics of the speech signal; wherein the audio processing module includes a masking sound generator configured for producing one or more masking sound signals based on the one or more analysis signals.

Claims

1. A speech reproduction device for reproducing speech based on a received speech signal so that the reproduced speech is intelligible in a clear speech zone and unintelligible in a masked speech zone, the speech reproduction device comprising:

an audio processing module configured for receiving the speech signal;

a set of speech loudspeakers configured for reproducing the speech based on one or more speech loudspeaker signals; and

a set of masking sound loudspeakers configured for producing a masking sound based on one or more masking sound loudspeaker signals, wherein the masking sound masks the speech in the masked speech zone;

wherein the audio processing module comprises a speech loudspeaker signal producer configured for producing the one or more speech loudspeaker signals based on the speech signal;

wherein the audio processing module comprises a speech signal analysis module configured for producing one or more analysis signals based on spectral and/or temporal characteristics of the speech signal;

wherein the audio processing module comprises a masking sound generator configured for producing one or more masking sound signals based on the one or more analysis signals; and

wherein the audio processing module comprises a masking sound loudspeaker signal producer configured for producing the one or more masking sound loudspeaker signals based on the one or more masking sound signals.

2. The speech reproduction device according to claim 1, wherein the speech loudspeaker signal producer is configured for producing a plurality of speech loudspeaker signals and for controlling characteristics of each speech loudspeaker signal of the plurality of speech loudspeaker signals independently in order to control spatial cues of the speech.

3. The speech reproduction device according to claim 1, wherein the masking sound loudspeaker signal producer is configured for producing a plurality of masking sound loudspeaker signals and for controlling characteristics of each masking sound loudspeaker signal of the plurality of masking sound loudspeaker signals independently in order to control spatial cues of the masking sound.

4. The speech reproduction device according to claim 1, wherein the masking sound generator comprises a plurality of masking sound sources configured to provide a raw masking sound signal is and a plurality of raw masking sound signal adaption module, wherein each of the raw masking sound signal adaption modules is assigned to one of the masking sound sources, wherein the assigned masking adaption module is configured to adapt the raw masking sound signal of the respective masking sound sources based on the analysis signal in order to produce one of the one or more masking sound signals.

5. The speech reproduction device according to claim 4, wherein the at least one masking sound source comprise a music source configured to provide a raw music masking sound signal, wherein the assigned masking adaption module is configured to adapt the raw music masking sound signal based on the analysis signal in order to produce one masking sound signal of the one or more masking sound signals.

6. The speech reproduction device according to claim 4, wherein the at least one masking sound source comprise a continuous noise source configured to provide a raw continuous noise masking sound signal, wherein the assigned masking adaption module is configured to adapt the raw continuous noise masking sound signal based on the analysis signal in order to produce one masking sound signal of the one or more masking sound signals.

7. The speech reproduction device according to claim 4, wherein the at least one masking sound source comprise a dynamic noise source configured to provide a raw dynamic noise masking sound signal, wherein the assigned masking adaption module is configured to adapt the raw dynamic noise masking sound signal based on the analysis signal in order to produce one masking sound signal of the one or more masking sound signals.

8. The speech reproduction device according to claim 1, wherein the audio processing module comprises an adaptive speech processing module configured to provide an adapted speech signal based on the speech signal, wherein the speech loudspeaker signal producer is configured to produce the one or more speech loudspeaker signals based on the adapted speech signal.

9. The speech reproduction device according to claim 1, wherein the audio processing module is configured to receive a setup signal comprising information regarding a setup of the set of speech loudspeakers and/or the setup of the set of masking sound loudspeakers.

10. The speech reproduction device according to claim 1, wherein the masking sound generator is configured to receive a weather signal comprising information regarding weather conditions and to produce the one or more masking sound signals based on the weather signal.

11. The speech reproduction device according to claim 1, wherein the masking sound generator is configured to receive a light signal comprising information regarding light conditions and to produce the one or more masking sound signals based on the light signal.

12. The speech reproduction device according to claim 1, wherein the masking sound generator is configured to receive a time signal comprising information regarding date and/or time and to produce the one or more masking sound signals based on the time signal.

13. The speech reproduction device according to claim 1, wherein the masking sound generator is configured to receive an engine signal comprising information regarding an operating parameter of an sound producing engine and to produce the one or more masking sound signals based on the engine signal.

14. The speech reproduction device according to claim 1, wherein the speech reproduction device comprises a tracking device configured for tracking a position and/or orientation of a person in the clear speech zone and/or for tracking a position and/or orientation of a person in the masked speech zone, wherein the tracking device is configured to produce a tracking signal comprising the position and/or orientation of the person in the clear speech zone and/or the position and/or orientation of the person in the masked speech zone, wherein the audio processing module is configured to receive the tracking signal and to produce the one or more masking sound loudspeaker signals based on the tracking signal.

15. The speech reproduction device according to claim 1, wherein the masking sound loudspeaker signal producer is configured to produce the masking sound loudspeaker signals in such way that the masking sound comprises the same spatial cues as the speech in the masked speech zone.

16. The speech reproduction device according to claim 1, wherein the speech reproduction device comprises one or more microphones assigned to the masked speech zone, wherein each of the microphones produces a microphone signal.

17. The speech reproduction device according to claim 15, wherein at least two microphone signals of the microphone signals are fed to the masking sound loudspeaker signal producer, and wherein the masking sound loudspeaker signal producer is configured to determine the spatial cues of the speech in the masked speech zone based on the at least two microphone signals.

18. The speech reproduction device according to claim 16, wherein at least one microphone signal of the microphone signals is fed to the masking sound generator, wherein the masking sound generator is configured to produce the one or more masking sound signals based on the at least one microphone signal.

19. The speech reproduction device according to claim 1, wherein the masking sound generator is configured to produce the one or more masking sound signals based on one or more room impulse responses and/or one or more transfer functions from the set of speech loudspeakers to the clear speech zone, based on one or more room impulse responses and/or one or more transfer functions from the set of masking sounds loudspeakers to the clear speech zone, based on one or more room impulse responses and/or one or more transfer functions from the set of speech loudspeakers to the masked speech zone and/or based on one or more room impulse responses and/or one or more transfers function from the set of masking sound loudspeakers to the masked speech zone.

22. The speech reproduction device according to claim 1, wherein the one or more masking sound signals are specific for the spectral and/or the temporal characteristics of the speech signal.

20. A method for reproducing speech based on a received speech signal so that the reproduced speech is intelligible in a clear speech zone and unintelligible in a masked speech zone, the method comprising:

receiving the speech signal using an audio processing module;

reproducing the speech based on one or more speech loudspeaker signals using a set of speech loudspeakers;

producing a masking sound based on one or more masking sound loudspeaker signals using a set of masking sound loudspeakers, wherein the masking sound masks the speech in the masked speech zone;

producing the one or more speech loudspeaker signals based on the speech signal using a speech loudspeaker signal producer of the audio processing module;

producing one or more analysis signals based on spectral and/or temporal characteristics of the speech signal using a speech signal analysis module of the audio processing module;

producing one or more masking sound signals based on the one or more analysis signals using a masking sound generator of the audio processing module; and

producing the one or more masking sound loudspeaker signals based on the one or more masking sound signals using a masking sound loudspeaker signal producer of the audio processing module.

23. The method of claim 20, wherein the one or more masking sound signals are specific for the spectral and/or the temporal characteristics of the speech signal.

21. A non-transitory digital storage medium having a computer program stored thereon to perform the method for reproducing speech based on a received speech signal so that the reproduced speech is intelligible in a clear speech zone and unintelligible in a masked speech zone, the method comprising:

receiving the speech signal using an audio processing module;

reproducing the speech based on one or more speech loudspeaker signals using a set of speech loudspeakers;

producing a masking sound based on one or more masking sound loudspeaker signals using a set of masking sound loudspeakers, wherein the masking sound masks the speech in the masked speech zone;

producing the one or more speech loudspeaker signals based on the speech signal using a speech loudspeaker signal producer of the audio processing module;

producing one or more analysis signals based on spectral and/or temporal characteristics of the speech signal using a speech signal analysis module of the audio processing module;

producing one or more masking sound signals based on the one or more analysis signals using a masking sound generator of the audio processing module; and

producing the one or more masking sound loudspeaker signals based on the one or more masking sound signals using a masking sound loudspeaker signal producer of the audio processing module,

when said computer program is run by a computer.

24. The non-transitory digital storage medium of claim 21, wherein the one or more masking sound signals are specific for the spectral and/or the temporal characteristics of the speech signal.