Partial spectral loss concealment in transform codecs

• US 7,356,748 B2
• Filed: 12/15/2004
• Issued: 04/08/2008
• Est. Priority Date: 12/19/2003
• Status: Active Grant

• Current Assignee: Telefonaktiebolaget LM Ericsson
• Original Assignee: Telefonaktiebolaget LM Ericsson
• Inventors: Taleb, Anisse
• Primary Examiner(s): Louis-Jacques; Jacques
• Assistant Examiner(s): Rizk; Sam
• Application Number:
  US11/011,780
• Publication Number:
  US 20050163234A1
• Time in Patent Office: 1,210 Days
• Field of Search: None
• US Class Current: 714/746
• CPC Class Codes: G06F 21/56 Computer malware detection or handling, e.g. anti-virus arrangements
• CPC Class Codes: G06F 2221/03 Indexing scheme relating to G06F21/50, monitoring users, programs or devices to maintain the integrity of platforms
• CPC Class Codes: H04B 1/667 using a division in frequency subbands for TV signals H04N19/63
• CPC Class Codes: H04L 51/212 using filtering or selective blocking
• CPC Class Codes: H04L 63/1441 Countermeasures against malicious traffic countermeasures against attacks on cryptographic mechanisms H04L9/002
• CPC Class Codes: H04L 63/1483 service impersonation, e.g. phishing, pharming or web spoofing detection of rogue wireless access points H04W12/12
• CPC Class Codes: H04L 63/20 for managing network security; network security policies in general filtering policies H04L63/0227
• CPC Class Codes: H04N 19/48 using compressed domain processing techniques other than decoding, e.g. modification of transform coefficients, variable length coding [VLC] data or run-length data motion estimation in a transform domain H04N19/547; processing of decoded motion vectors H04N19/513
• CPC Class Codes: H04N 19/895 in combination with error concealment

Abstract

The invention concerns a frequency-domain error concealment technique for information that is represented, on a frame-by-frame basis, by coding coefficients. The basic idea is to conceal an erroneous coding coefficient by exploiting coding coefficient correlation in both time and frequency. The technique is applicable to any information, such as audio, video and image data, that is compressed into coding coefficients and transmitted under adverse channel conditions. The error concealment technique proposed by the invention has the clear advantage of exploiting the redundancy of the original information signal in time as well as frequency. For example, this offers the possibility to exploit redundancy between frames (inter-frame) as well as within frames (intra-frame). The use of coding coefficients from the same frame as the erroneous coding coefficient is sometimes referred to as intra-frame coefficient correlation and it is a special case of the more general frequency correlation.

Claims

1. A frequency-domain error concealment method for information represented, on a frame-by-frame basis, by coding coefficients of a number of frequency bins, wherein said method comprises the steps of:

receiving information representative of an erroneous coding coefficient being detected for a certain frequency bin in a frame; and

concealing said erroneous coding coefficient for said frequency bin in said frame by exploiting coding coefficient correlation in both time and frequency, wherein said step of concealing said erroneous coding coefficient comprises the steps of;

estimating a new coding coefficient of said frequency bin in said frame at least partly based on at least one coding coefficient of at least one other frequency bin in said frame and at least one coding coefficient of the same frequency bin in at least one other frame; and

replacing said erroneous coding coefficient by said new coding coefficient.

2. The frequency-domain error concealment method according to claim 1, wherein said erroneous coding coefficient is at least one of a partially erroneous coding coefficient and a totally lost coding coefficient.

3. The frequency-domain error concealment method according to claim 1, wherein said coding coefficients are quantized coding coefficients.

4. The frequency-domain error concealment method according to claim 1, wherein said new coding coefficient of said frequency bin is estimated also based on at least one coding coefficient of at least one other frequency bin in at least one other frame.

5. The frequency-domain error concealment method according to claim 1, wherein said step of estimating a new coding coefficient comprises the step of predicting a spectral phase component based on approximate group delay matching between frames, using a predetermined approximation criterion.

6. The frequency-domain error concealment method according to claim 5, wherein said step of predicting a spectral phase component comprises the steps of:

estimating group delay from at least one other frame; and

calculating the spectral phase by at least approximately matching the group delay associated with the new spectral component to the estimated group delay.

7. The frequency-domain error concealment method according to claim 6, wherein said step of calculating the spectral phase includes the step of calculating the spectral phase {circumflex over (φ

)}_q(m,k) in frame m and frequency bin k based on the following recursive solution;

{circumflex over (φ

)}(m,k)={circumflex over (φ

)}(m,k−

1)+Δ

φ

(m−

1,k)+Δ

φ

_c, k=K+1, . . . ,K+N−

1,

where;

Δ

φ

(m−

1,k)=φ

(m−

1,k)−

φ

(m−

1,k−

1),

Δ

φ

_c=(1/N)·

(φ

(m,K+N)−

φ

(m−

1,K+N)−

φ

(m,K)+φ

(m−

1,K)),

and

φ

(m,K)=φ

(m,K)

is used to start the recursion.

8. The frequency-domain error concealment method according to claim 1, wherein said step of estimating a new coding coefficient comprises the step of predicting a spectral amplitude component based on spectral energy matching between frames.

9. The frequency-domain error concealment method according to claim 8, wherein said step of predicting a spectral amplitude component comprises the steps of:

calculating a weighting factor by matching the energy of spectral coefficients of the same frame as the erroneous coding coefficient with the energy of corresponding spectral coefficients of at least one other frame; and

calculating the spectral amplitude based on the spectral amplitude of the same frequency bin of said at least one other frame and said weighting factor.

10. The frequency-domain error concealment method according to claim 1, wherein said coding coefficients are complex spectral transform coefficients.

11. The frequency-domain error concealment method according to claim 10, wherein a new complex spectral coding coefficient of a certain frequency bin is estimated by predicting spectral amplitude and phase separately and subsequently combining the predicted spectral amplitude and phase.

12. The frequency-domain error concealment method according to claim 11, wherein the spectral amplitude is predicted based on the spectral amplitude of the same frequency bin of at least one other frame and a weighting factor, said weighting factor being calculated by matching the energy of spectral coefficients of said frame with the energy of corresponding spectral coefficients of said at least one other frame.

13. The frequency-domain error concealment method according to claim 11, wherein the spectral phase is predicted by estimating group delay from at least two spectral phase components of at least one other frame, and calculating the spectral phase by at least approximately matching a group delay associated with the new spectral component to the estimated group delay.

14. The frequency-domain error concealment method according to claim 1, wherein said information includes at least one of audio, video, and image data.

15. A frequency-domain error concealment arrangement for information represented, on a frame-by-frame basis, by coding coefficients of a number of frequency bins, wherein the arrangement comprises electronic circuitry configure to:

receive information representative of an erroneous coding coefficient being detected for a certain frequency bin in a frame, and

conceal said erroneous coding coefficient for said frequency bin in said frame based on coding coefficient correlation in both time and frequency by estimating a new coding coefficient of said frequency bin in said frame at least partly based on at least one coding coefficient of at least one other frequency bin in said frame and at least one coding coefficient of the same frequency bin in at least one other frame and replacing said erroneous coding coefficient by said new coding coefficient.

16. The frequency-domain error concealment arrangement according to claim 15, wherein the erroneous coding coefficient is at least one of a partially erroneous coding coefficient and a totally lost coding coefficient.

17. The frequency-domain error concealment arrangement according to claim 15, wherein the electronic circuitry is configured to estimate the new coding coefficient of the frequency bin also based on at least one coding coefficient of at least one other frequency bin in at least one other frame.

18. The frequency-domain error concealment arrangement according to claim 15, wherein the electronic circuitry is configured to predict a spectral phase component based on approximate group delay matching between frames using a predetermined approximation criterion.

19. The frequency-domain error concealment arrangement according to claim 18, wherein the electronic circuitry is configured to:

estimate group delay from at least one other frame; and

calculate the spectral phase by at least approximately matching the group delay associated with the new spectral component to the estimated group delay.

20. The frequency-domain error concealment arrangement according to claim 15, wherein said means for estimating a new coding coefficient comprises means for predicting a spectral amplitude component based on spectral energy matching between frames.

21. The frequency-domain error concealment arrangement according to claim 20, wherein the electronic circuitry is configured to:

calculate a weighting factor by matching the energy of spectral coefficients of the same frame as the erroneous coding coefficient with the energy of corresponding spectral coefficients of at least one other frame; and

calculate the spectral amplitude based on the spectral amplitude of the same frequency bin of said at least one other frame and said weighting factor.

22. The frequency-domain error concealment arrangement according to claim 15, wherein said coding coefficients are complex spectral transform coefficients.

23. The frequency-domain error concealment arrangement according to claim 22, wherein the electronic circuitry is configured to estimate a new complex spectral coding coefficient of a given frequency bin by predicting spectral amplitude and phase separately and subsequently combining the predicted spectral amplitude and phase.

24. The frequency-domain error concealment arrangement according to claim 23, wherein the electronic circuitry is configured to:

predict the spectral amplitude based on the spectral amplitude of the same frequency bin of at least one other frame and a weighting factor, and

calculate the weighting factor by matching the energy of spectral coefficients of said frame with the energy of corresponding spectral coefficients of said at least one other frame.

25. The frequency-domain error concealment arrangement according to claim 23, wherein the electronic circuitry is configured to predict the spectral phase by estimating group delay from at least two spectral phase components of at least one other frame and calculating the spectral phase by at least approximately matching a group delay associated with the new component to the estimated group delay.

26. The frequency-domain error concealment arrangement according to claim 15, wherein said information includes at least one of audio, video, and image data.

27. A decoder having a frequency-domain error concealment arrangement for information represented, on a frame-by-frame basis, by coding coefficients of a number of frequency bins, wherein said frequency-domain error concealment arrangement comprises:

means for receiving information representative of an erroneous coding coefficient being detected for a certain frequency bin in a frame; and

means for concealing said erroneous coding coefficient for said frequency bin in said frame based on coding coefficient correlation in both time and frequency, wherein said means for concealing said erroneous coding coefficient comprises;

means for estimating a new coding coefficient of said frequency bin in said frame at least partly based on at least one coding coefficient of at least one other frequency bin in said frame and at least one coding coefficient of the same frequency bin in at least one other frame; and

means for replacing said erroneous coding coefficient by said new coding coefficient.

28. A receiver having a frequency-domain error concealment arrangement for information represented, on a frame-by-frame basis, by coding coefficients of a number of frequency bins, wherein said frequency-domain error concealment arrangement comprises:

means for receiving information representative of an erroneous coding coefficient being detected for a certain frequency bin in a frame; and

means for concealing said erroneous coding coefficient for said frequency bin in said frame based on coding coefficient correlation in both time and frequency, wherein said means for concealing said erroneous coding coefficient comprises;

means for estimating a new coding coefficient of said frequency bin in said frame at least partly based on at least one coding coefficient of at least one other frequency bin in said frame and at least one coding coefficient of the same frequency bin in at least one other frame; and

means for replacing said erroneous coding coefficient by said new coding coefficient.