Method and device for efficient frame erasure concealment in speech codecs

• US 8,255,207 B2
• Filed: 12/27/2006
• Issued: 08/28/2012
• Est. Priority Date: 12/28/2005
• Status: Active Grant

• Current Assignee: VoiceAge EVS LLC (SoftBank Group Corp.)
• Original Assignee: VoiceAge Corporation
• Inventors: Vaillancourt, Tommy, Jelinek, Milan, Gournay, Philippe, Salami, Redwan
• Primary Examiner(s): Abebe, Daniel D
• Application Number:
  US12/095,224
• Publication Number:
  US 20110125505A1
• Time in Patent Office: 2,071 Days
• Field of Search: 704/219, 704/223, 704/500, 375/240.27
• US Class Current: 704/219
• CPC Class Codes: G10L 19/005 Correction of errors induced by the transmission channel, if related to the coding algorithm

Abstract

A method and device for concealing frame erasures caused by frames of an encoded sound signal erased during transmission from an encoder to a decoder and for recovery of the decoder after frame erasures comprise, in the encoder, determining concealment/recovery parameters including at least phase information related to frames of the encoded sound signal. The concealment/recovery parameters determined in the encoder are transmitted to the decoder and, in the decoder, frame erasure concealment is conducted in response to the received concealment/recovery parameters. The frame erasure concealment comprises resynchronizing, in response to the received phase information, the erasure-concealed frames with corresponding frames of the sound signal encoded at the encoder. When no concealment/recovery parameters are transmitted to the decoder, a phase information of each frame of the encoded sound signal that has been erased during transmission from the encoder to the decoder is estimated in the decoder. Also, frame erasure concealment is conducted in the decoder in response to the estimated phase information, wherein the frame erasure concealment comprises resynchronizing, in response to the estimated phase information, each erasure-concealed frame with a corresponding frame of the sound signal encoded at the encoder.

Claims

1. A method for concealing frame erasures caused by frames of an encoded sound signal erased during transmission from an encoder to a decoder and for recovery of the decoder after frame erasures, the method comprising, in the decoder:

receiving from the encoder concealment/recovery parameters including at least phase information related to frames of the encoded sound signal, wherein the phase information comprises a position of a glottal pulse in each frame of the encoded sound signal;

conducting frame erasure concealment in response to the received concealment/recovery parameters,

wherein;

the frame erasure concealment comprises resynchronizing, in response to the received phase information, the erasure-concealed frames with corresponding frames of the encoded sound signal; and

resynchronizing an erasure-concealed frame with a corresponding frame of the encoded sound signal comprises;

determining, in the erasure-concealed frame, a position of a maximum amplitude pulse; and

aligning the position of the maximum amplitude pulse in the erasure-concealed frame with the position of the glottal pulse of the corresponding frame of the encoded sound signal.

2. A method as defined in claim 1, further comprising:

determining the concealment/recovery parameters in the encoder; and

transmitting to the decoder the concealment/recovery parameters determined in the encoder and received by the decoder.

3. A method as defined in claim 1, wherein the phase information comprises a position and sign of a last glottal pulse in each frame of the encoded sound signal.

4. A method as defined in claim 2, further comprising quantizing the position of the glottal pulse prior to transmitting the position of the glottal pulse to the decoder.

5. A method as defined in claim 2, wherein determination of the concealment/recovery parameters comprises determining as the phase information a position and sign of a last glottal pulse in each frame of the encoded sound signal, the method further comprising quantizing the position and sign of the last glottal pulse prior to transmitting the position and sign of the last glottal pulse to the decoder.

6. A method as defined in claim 4, further comprising encoding the quantized position of the glottal pulse into a future frame of the encoded sound signal.

7. A method as defined in claim 2, wherein determining the position of the glottal pulse comprises:

measuring the glottal pulse as a pulse of maximum amplitude in a predetermined pitch cycle of each frame of the encoded sound signal; and

determining the position of the pulse of maximum amplitude in the frame of the encoded sound signal.

9. A method as defined in claim 2, wherein determination of the concealment/recovery parameters comprises determining as the phase information a position and sign of a last glottal pulse in each frame of the encoded sound signal and wherein determining the position of the last glottal pulse comprises:

measuring the last glottal pulse as a pulse of maximum amplitude in each frame of the encoded sound signal; and

determining the position of the pulse of maximum amplitude in the frame of the encoded sound signal.

10. A method as defined in claim 9, wherein determining the sign of the last glottal pulse comprises:

measuring a sign of the maximum amplitude pulse in the frame of the encoded sound signal.

11. A method as defined in claim 1, wherein

the maximum amplitude pulse in the erasure-concealed frame has a sign similar to the sign of the glottal pulse of the corresponding frame of the encoded sound signal.

12. A method as defined in claim 1, wherein

the position of the maximum amplitude pulse in the erasure-concealed frame is a position of a maximum amplitude pulse closest to the position of said glottal pulse of said corresponding frame of said encoded sound signal.

13. A method as defined in claim 1, wherein aligning the position of the maximum amplitude pulse in the erasure-concealed frame with the position of the glottal pulse in the corresponding frame of the encoded sound signal comprises:

determining an offset between the position of the maximum amplitude pulse in the erasure-concealed frame and the position of the glottal pulse in the corresponding frame of the encoded sound signal; and

inserting/removing in the erasure-concealed frame a number of samples corresponding to the determined offset.

14. A method as defined in claim 13, wherein inserting/removing the number of samples comprises:

determining at least one region of minimum energy in the erasure-concealed frame; and

distributing the number of samples to be inserted/removed around the at least one region of minimum energy.

15. A method as defined in claim 14, wherein distributing the number of samples to be inserted/removed around the at least one region of minimum energy comprises distributing the number of samples around the at least one region of minimum energy using the following relation:

16. A method as defined in claim 15, wherein R(i) is in increasing order, so that samples are mostly added/removed towards an end of the erasure-concealed frame.

17. A method as defined in claim 1, wherein conducting frame erasure concealment in response to the received concealment/recovery parameters comprises, for voiced erased frames:

constructing a periodic part of an excitation signal in the erasure-concealed frame in response to the received concealment/recovery parameters; and

constructing a random innovative part of the excitation signal by randomly generating a non-periodic, innovative signal.

18. A method as defined in claim 1, wherein conducting frame erasure concealment in response to the received concealment/recovery parameters comprises, for unvoiced erased frames, constructing a random innovative part of an excitation signal by randomly generating a non-periodic, innovative signal.

19. A method as defined in claim 1, wherein the concealment/recovery parameters further include signal classification.

20. A method as defined in claim 19, wherein the signal classification comprises classifying successive frames of the encoded sound signal as unvoiced, unvoiced transition, voiced transition, voiced, or onset.

21. A method as defined in claim 20, wherein the classification of a lost frame is estimated based on the classification of a future frame and a last received good frame.

22. A method as defined in claim 21, wherein the classification of the lost frame is set to voiced if the future frame is voiced and the last received good frame is onset.

23. A method as defined in claim 22, wherein the classification of the lost frame is set to unvoiced transition if the future frame is unvoiced and the last received good frame is voiced.

24. A method as defined in claim 1, wherein:

the sound signal is a speech signal;

determination, in the encoder, of concealment/recovery parameters includes determining the phase information and a signal classification of successive frames of the encoded sound signal;

conducting frame erasure concealment in response to the concealment/recovery parameters comprises, when an onset frame is lost which is indicated by the presence of a voiced frame following frame erasure and an unvoiced frame before frame erasure, artificially reconstructing the lost onset frame; and

resynchronizing the erasure-concealed, lost onset frame in response to the phase information with the corresponding onset frame of the encoded sound signal.

25. A method as defined in claim 24, wherein artificially reconstructing the lost onset frame comprises artificially reconstructing a last glottal pulse in the lost onset frame as a low-pass filtered pulse.

26. A method as defined in claim 24, further comprising scaling the reconstructed lost onset frame by a gain.

27. A method as defined in claim 1, comprising, when the phase information is not available at the time of concealing an erased frame, updating the content of an adaptive codebook of the decoder with the phase information when available before decoding a next received, non erased frame.

28. A method as defined in claim 27, wherein

updating the adaptive codebook comprises resynchronizing the glottal pulse in the adaptive codebook.

8. A method as defined in 7, further comprising determining as phase information a sign of the glottal pulse by measuring a sign of the maximum amplitude pulse in the frame of the encoded sound signal.

29. A method for concealing frame erasures caused by frames of an encoded sound signal erased during transmission from an encoder to a decoder and for recovery of the decoder after frame erasures, the method comprising, in the decoder:

estimating a phase information of each frame of the encoded sound signal that has been erased during transmission from the encoder to the decoder; and

conducting frame erasure concealment in response to the estimated phase information, wherein the frame erasure concealment comprises resynchronizing, in response to the estimated phase information, each erasure-concealed frame with a corresponding frame of the encoded sound signal,

wherein;

the estimated phase information is an estimated position of a glottal pulse of each frame of the encoded sound signal that has been erased; and

resynchronizing an erasure-concealed frame with the corresponding frame of the encoded sound signal comprises determining a maximum amplitude pulse in the erasure-concealed frame, and aligning the maximum amplitude pulse in the erasure-concealed frame with the estimated position of the glottal pulse.

30. A method as defined in claim 29, wherein estimating the phase information comprises estimating a position of a last glottal pulse of each frame of the encoded sound signal that has been erased.

31. A method as defined in claim 30, wherein estimating the position of the last glottal pulse of each frame of the encoded sound signal that has been erased comprises:

estimating a glottal pulse from a past pitch value; and

interpolating the estimated glottal pulse with the past pitch value so as to determine estimated pitch lags.

32. A method as defined in claim 31, wherein aligning the maximum amplitude pulse in the erasure-concealed frame with the estimated glottal pulse comprises:

calculating pitch cycles in the erasure-concealed frame;

determining an offset between the estimated pitch lags and the pitch cycles in the erasure-concealed frame; and

inserting/removing a number of samples corresponding to the determined offset in the erasure-concealed frame.

33. A method as defined in claim 32, wherein inserting/removing the number of samples comprises:

determining at least one region of minimum energy in the erasure-concealed frame; and

distributing the number of samples to be inserted/removed around the at least one region of minimum energy.

34. A method as defined in claim 33, wherein distributing the number of samples to be inserted/removed around the at least one region of minimum energy comprises distributing the number of samples around the at least one region of minimum energy using the following relation:

35. A method as defined in claim 34, wherein R(i) is in increasing order, so that samples are mostly added/removed towards the end of the erasure-concealed frame.

36. A method as defined in claim 29, comprising attenuating a gain of each erasure-concealed frame, in a linear manner, from the beginning to the end of the erasure-concealed frame.

37. A method as defined in claim 36, wherein the gain of each erasure-concealed frame is attenuated until α

is reached, wherein α

is a factor for controlling a converging speed of the decoder recovery after frame erasure.

38. A method as defined in claim 37, wherein the factor α

is dependent on stability of a LP filter for unvoiced frames.

39. A method as defined in claim 38, wherein the factor α

further takes into consideration an energy evolution of voiced segments.

40. A device for concealing frame erasures caused by frames of an encoded sound signal erased during transmission from an encoder to a decoder and for recovery of the decoder after frame erasures, the device comprising, in the decoder:

means for receiving concealment/recovery parameters including at least phase information related to frames of the encoded sound signal, wherein the phase information comprises a position of a glottal pulse in each frame of the encoded sound signal; and

means for conducting frame erasure concealment in response to the received concealment/recovery parameters,

wherein;

the means for conducting frame erasure concealment comprises means for resynchronizing, in response to the received phase information, the erasure-concealed frames with corresponding frames of the encoded sound signal; and

the means of resynchronizing an erasure-concealed frame with a corresponding frame of the encoded sound signal comprises;

means for determining, in the erasure-concealed frame, a position of a maximum amplitude pulse; and

means for aligning the position of the maximum amplitude pulse in the erasure-concealed frame with the position of the glottal pulse of the corresponding frame of the encoded sound signal.

41. A device for concealing frame erasures caused by frames of an encoded sound signal erased during transmission from an encoder to a decoder and for recovery of the decoder after frame erasures, the device comprising, in the decoder:

a receiver of concealment/recovery parameters including at least phase information related to frames of the encoded sound signal, wherein the phase information comprises a position of a glottal pulse in each frame of the encoded sound signal; and

a frame erasure concealment module supplied with the received concealment/recovery parameters,

wherein;

the frame erasure concealment module comprises a synchronizer of the erasure-concealed frames with corresponding frames of the encoded sound signal in response to the received phase information; and

the synchronizer, for synchronizing an erasure-concealed frame with a corresponding frame of the encoded sound signal, determines in the erasure-concealed frame a position of a maximum amplitude pulse, and aligns the position of the maximum amplitude pulse in the erasure-concealed frame with the position of the glottal pulse of the corresponding frame of the encoded sound signal.

42. A device as defined in claim 41, comprising:

in the encoder, a generator of the concealment/recovery parameters; and

a communication link for transmitting to the decoder concealment/recovery parameters determined in the encoder.

43. A device as defined in claim 41, wherein the phase information comprises a position and sign of a last glottal pulse in each frame of the encoded sound signal.

44. A device as defined in claim 42, further comprising a quantizer of the position of the glottal pulse prior to transmission of the position of the glottal pulse to the decoder, via the communication link.

45. A device as defined in claim 42, wherein the generator of the concealment/recovery parameters determines as the phase information a position and sign of a last glottal pulse in each frame of the encoded sound signal, the device further comprising a quantizer of the position and sign of the last glottal pulse prior to transmission of the position and sign of the last glottal pulse to the decoder, via the communication link.

46. A device as defined in claim 44, further comprising an encoder of the quantized position of the glottal pulse into a future frame of the encoded sound signal.

47. A device as defined in claim 42, wherein the generator determines as the position of the glottal pulse a position of a maximum amplitude pulse in each frame of the encoded sound signal.

48. A device as defined in claim 42, wherein the generator of the concealment/recovery parameters determines as the phase information a position and sign of a last glottal pulse in each frame of the encoded sound signal, and wherein the generator determines as the position and sign of the last glottal pulse a position and sign of a maximum amplitude pulse in each frame of the encoded sound signal.

49. A device as defined in claim 47, wherein the generator determines as phase information a sign of the glottal pulse as a sign of the maximum amplitude pulse in the frame of the encoded sound signal.

50. A device as defined in claim 41, wherein the synchronizer:

determines an offset between the position of the maximum amplitude pulse in each erasure-concealed frame and the position of the glottal pulse in the corresponding frame of the encoded sound signal; and

inserts/removes a number of samples corresponding to the determined offset in each erasure-concealed frame so as to align the position of the maximum amplitude pulse in the erasure-concealed frame with the position of the glottal pulse in the corresponding frame of the encoded sound signal.

51. A device as defined in claim 43, wherein the synchronizer:

determines in each erasure-concealed frame, a position of a maximum amplitude pulse having a sign similar to the sign of the last glottal pulse, closest to the position of the last glottal pulse in the corresponding frame of the encoded sound signal;

determines an offset between the position of the maximum amplitude pulse in each erasure-concealed frame and the position of the last glottal pulse in the corresponding frame of the encoded sound signal; and

inserts/removes a number of samples corresponding to the determined offset in each erasure-concealed frame so as to align the position of the maximum amplitude pulse in the erasure-concealed frame with the position of the last glottal pulse in the corresponding frame of the encoded sound signal.

52. A device as defined in claim 50, wherein the synchronizer further:

determines at least one region of minimum energy in each erasure-concealed frame by using a sliding window; and

distributes the number of samples to be inserted/removed around the at least one region of minimum energy.

53. A device as defined in claim 52, wherein the synchronizer uses the following relation for distributing the number of samples to be inserted/removed around the at least one region of minimum energy:

54. A device as defined in claim 53, wherein R(i) is in increasing order, so that samples are mostly added/removed towards an end of the erasure-concealed frame.

55. A device as defined in claim 41, wherein the frame erasure concealment module supplied with the received concealment/recovery parameters comprises, for voiced erased frames:

a generator of a periodic part of an excitation signal in each erasure-concealed frame in response to the received concealment/recovery parameters; and

a random generator of a non-periodic, innovative part of the excitation signal.

56. A device as defined in claim 41, wherein the frame erasure concealment module supplied with the received concealment/recovery parameters comprises, for unvoiced erased frames, a random generator of a non-periodic, innovative part of an excitation signal.

57. A device as defined in claim 41, wherein the decoder updates, when the phase information is not available at the time of concealing an erased frame, the content of an adaptive codebook of the decoder with the phase information when available before decoding a next received, non erased frame.

58. A device as defined in claim 57, wherein

the decoder, for updating the adaptive codebook, resynchronizes the glottal pulse in the adaptive codebook.

59. A device as defined in claim 41, wherein the synchronizer determines, in each erasure-concealed frame, a position of a maximum amplitude pulse having a sign similar to the sign of the glottal pulse, closest to the position of said glottal pulse in the corresponding frame of the encoded sound signal.

60. A device as defined in claim 41, wherein the position of the maximum amplitude pulse in the erasure-concealed frame is a position of a maximum amplitude pulse closest to the position of the glottal pulse of the corresponding frame of the encoded sound signal.

61. A device for concealing frame erasures caused by frames of an encoded sound signal erased during transmission from an encoder to a decoder and for recovery of the decoder after frame erasures, the device comprising:

means for estimating, at the decoder, a phase information of each frame of the encoded sound signal that has been erased during transmission from the encoder to the decoder; and

means for conducting frame erasure concealment in response to the estimated phase information, the means for conducting frame erasure concealment comprising means for resynchronizing each erasure-concealed frame with a corresponding frame of the encoded sound signal;

wherein;

the estimated phase information is an estimated position of a glottal pulse of each frame of the encoded sound signal that has been erased; and

the means for resynchronizing each erasure-concealed frame with the corresponding frame of the encoded sound signal comprises means for determining a maximum amplitude pulse in the erasure-concealed frame, and aligning the maximum amplitude pulse in the erasure-concealed frame with the estimated position of the glottal pulse.

62. A device for concealing frame erasures caused by frames of an encoded sound signal erased during transmission from an encoder to a decoder and for recovery of the decoder after frame erasures, the device comprising:

at the decoder, an estimator of a phase information of each frame of the encoded signal that has been erased during transmission from the encoder to the decoder; and

an erasure concealment module supplied with the estimated phase information and comprising a synchronizer which, in response to the estimated phase information, resynchronizes each erasure-concealed frame with a corresponding frame of the encoded sound signal;

wherein;

the estimated phase information is an estimated position of a glottal pulse of each frame of the encoded sound signal that has been erased; and

the synchronizer determines a maximum amplitude pulse in the erasure-concealed frame, and aligns the maximum amplitude pulse in the erasure-concealed frame with the estimated position of the glottal pulse.

63. A device as defined in claim 62, wherein the estimator of the phase information estimates, from a past pitch value, a position and sign of a last glottal pulse in each frame of the encoded sound signal, and interpolates the estimated glottal pulse with the past pitch value so as to determine estimated pitch lags.

64. A device as defined in claim 63, wherein the synchronizer:

determines a maximum amplitude pulse and pitch cycles in each erasure-concealed frame;

determines an offset between the pitch cycles in each erasure-concealed frame and the estimated pitch lags in the corresponding frame of the encoded sound signal; and

inserts/removes a number of samples corresponding to the determined offset in each erasure-concealed frame so as to align the maximum amplitude pulse in the erasure-concealed frame with the estimated last glottal pulse.

65. A device as defined in claim 64, wherein the synchronizer further:

determines at least one region of minimum energy by using a sliding window; and

distributes the number of samples around the at least one region of minimum energy.

66. A device as defined in claim 65, wherein the synchronizer uses the following relation for distributing the number of samples around the at least one region of minimum energy:

67. A device as defined in claim 66, wherein R(i) is in increasing order, so that samples are mostly added/removed towards an end of the erasure-concealed frame.

68. A device as defined in claim 63, further comprising an attenuator for attenuating a gain of each erasure-concealed frame, in a linear manner, from a beginning to an end of the erasure-concealed frame.

69. A device as defined in claim 68, wherein the attenuator attenuates the gain of each erasure-concealed frame until α

, wherein α

is a factor for controlling a converging speed of the decoder recovery after frame erasure.

70. A device as defined in claim 69, wherein the factor α

is dependent on stability of a LP filter for unvoiced frames.

71. A device as defined in claim 70, wherein the factor α

further takes into consideration an energy evolution of voiced segments.

72. A device as defined in claim 62, wherein the estimator estimates a position of a last glottal pulse of each frame of the encoded sound signal that has been erased.