Systems and methods for reducing speech intelligibility while preserving environmental sounds

• US 8,140,326 B2
• Filed: 06/06/2008
• Issued: 03/20/2012
• Est. Priority Date: 06/06/2008
• Status: Active Grant

• Current Assignee: Fujifilm Business Innovation Corp. (Fujifilm Holdings Corporation)
• Original Assignee: Fuji Xerox Company Limited (Xerox Holdings Corp.)
• Inventors: Chen, Francine, Adcock, John
• Primary Examiner(s): SKED, MATTHEW J
• Application Number:
  US12/135,131
• Publication Number:
  US 20090306988A1
• Time in Patent Office: 1,383 Days
• Field of Search: None
• US Class Current: 704/226
• CPC Class Codes: G10L 21/0364 for improving intelligibility
• CPC Class Codes: G10L 25/93 Discriminating between voiced and unvoiced parts of speech signals G10L25/90 takes precedence
• CPC Class Codes: H04K 1/04 by frequency scrambling, i.e. by transposing or inverting parts of the frequency band or by inverting the whole band
• CPC Class Codes: H04K 1/06 by transmitting the information or elements thereof at unnatural speeds or in jumbled order or backwards

Abstract

An audio privacy system reduces the intelligibility of speech in an audio signal while preserving prosodic information, such as pitch, relative energy and intonation so that a listener has the ability to recognize environmental sounds but not the speech itself. An audio signal is processed to separate non-vocalic information, such as pitch and relative energy of speech, from vocalic regions, after which syllables are identified within the vocalic regions. Representations of the vocalic regions are computed to produce a vocal tract transfer function and an excitation. The vocal tract transfer function for each syllable is then replaced with the vocal tract transfer function from another prerecorded vocalic sound. In one aspect, the identity of the replacement vocalic sound is independent of the identity of the syllable being replaced. A modified audio signal is then synthesized with the original prosodic information and the modified vocal tract transfer function to produce unintelligible speech that preserves the pitch and energy of the speech as well as environmental sounds.

Claims

1. A method for reducing speech intelligibility while preserving environmental sounds, the method comprising:

receiving an audio signal;

processing the audio signal to separate a vocalic region that comprises vowels;

computing a representation of at least the vocalic region, the representation including at least a vocal tract transfer function and an excitation;

replacing the vocal tract transfer function of the vocalic region with a replacement sound transfer function of a replacement sound to create a modified vocal tract transfer function; and

synthesizing a modified audio signal of at least the vocalic region from the modified vocal tract transfer function and the excitation.

2. The method of claim 1, further comprising substituting the audio signal of at least the vocalic region with the modified audio signal to create an obfuscated audio signal.

3. The method of claim 1, further comprising processing the audio signal using a Linear Predictive Coding (“

LPC”

) technique.

4. The method of claim 3, further comprising computing LPC coefficients of the replacement sound and the vocalic region, and replacing the LPC coefficients of the vocalic region with the LPC coefficients of the replacement sound.

5. The method of claim 1, further comprising processing the audio signal using a cepstral technique.

6. The method of claim 1, further comprising processing the audio signal using a Multi-Band Excitation (“

MBE”

) vocoder.

7. The method of claim 1, further comprising identifying syllables within the vocalic region before computing the vocal tract transfer function.

8. The method of claim 7, further comprising identifying the syllables within each vocalic region by identifying voiced segments and identifying syllable boundaries.

9. The method of claim 8, further comprising identifying vocalic syllables within the range of human speech by evaluating a pitch and a voicing ratio computed by a voicing detector.

10. The method of claim 1, further comprising selecting a vocalic sound as the replacement sound.

11. The method of claim 1, further comprising selecting a tone or a synthesized vowel as the replacement sound.

12. The method of claim 10, further comprising selecting a vocalic sound spoken by another speaker as the replacement sound.

13. The method of claim 1, further comprising selecting the replacement sound independently of the vocal tract transfer function being replaced.

14. The method of claim 1, further comprising randomly selecting the replacement sound.

15. The method of claim 1, further comprising replacing each vocal tract transfer function with a different replacement sound transfer function.

16. The method of claim 1, further comprising modifying the excitation.

17. The method of claim 1, further comprising, upon receiving the audio signal, separating the audio signal into rapidly-varying components and slowly-varying components.

18. A system for reducing speech intelligibility while preserving environmental sounds, the system comprising:

a receiving module for receiving an audio signal;

a voicing detector for processing the audio signal to separate a vocalic region that comprises vowels;

a computation module for computing a representation of at least the vocalic regions, the representation including at least a vocal tract transfer function and an excitation;

a replacement module for replacing the vocal tract transfer function of the vocalic region with a replacement vocal tract transfer function of a replacement sound to create a modified vocal tract transfer function; and

an audio synthesizer for synthesizing a modified audio signal of at least the vocalic region from the modified vocal tract transfer function and the excitation.

19. The system of claim 18, further comprising a substitution module for substituting the audio signal of at least the vocalic region with the modified audio signal to create an obfuscated audio signal.

20. The system of claim 18, wherein the audio signal is processed using a Linear Predictive Coding (“

LPC”

) technique.

21. The system of claim 20, further comprising an LPC computation voicing detector to compute LPC coefficients of the replacement sound and the vocalic region, and wherein the replacement module replaces the LPC coefficients of the vocalic region with the LPC coefficients of the replacement sound.

22. The system of claim 18, wherein the audio signal is processed using a cepstral technique.

23. The system of claim 18, wherein the audio signal is processed using a Multi-Band Excitation (“

MBE”

) vocoder.

24. The system of claim 18, further comprising a vocalic syllable detector to identify the syllables within the vocalic region before computing the vocal tract transfer function.

25. The system of claim 24, wherein the syllable detector identifies the syllables by identifying voiced segments and syllable boundaries.

26. The system of claim 25, wherein the syllable detector identifies vocalic syllables within the range of human speech by evaluating the pitch and voicing ratio computed by a voicing detector.

27. The system of claim 18, wherein the replacement module selects a vocalic sound as the replacement sound.

28. The system of claim 18, wherein the replacement module selects a tone or synthesized vowel as the replacement sound.

29. The system of claim 27, wherein the replacement module replaces the vocal tract transfer function of each vocalic region with a vocalic sound spoken by another speaker.

30. The system of claim 18, wherein the replacement module selects the replacement sound independently of the vocal tract transfer function being replaced.

31. The system of claim 18, wherein the replacement module randomly selects the replacement sound.

32. The system of claim 18, wherein the replacement module replaces each vocal tract transfer function with a different replacement sound transfer function.

33. The system of claim 18, further comprising an excitation module for modifying the excitation.

34. The system of claim 18, wherein the receiving module, upon receiving the audio signal, separates the audio signal into rapidly-varying components and slowly-varying components.