Video transmission system using adaptive sub-band coding

• US 5,128,757 A
• Filed: 06/18/1990
• Issued: 07/07/1992
• Est. Priority Date: 06/18/1990
• Status: Expired due to Term

• Current Assignee: LG Electronics, Inc. (LG Corporation)
• Original Assignee: Zenith Electronics Corporation (LG Corporation)
• Inventors: Citta, Richard W., Dicke, Stephen M.
• Primary Examiner(s): Kostak, Victor R.
• Application Number:
  US07/539,770
• Time in Patent Office: 750 Days
• Field of Search: 358/141, 358/133, 358/142, 358/147
• US Class Current: 375/240.01
• CPC Class Codes: G06F 17/147 Discrete orthonormal transforms, e.g. discrete cosine transform, discrete sine transform, and variations therefrom, e.g. modified discrete cosine transform, integer transforms approximating the discrete cosine transform G06F17/145 takes precedence
• CPC Class Codes: H04N 19/115 Selection of the code volume for a coding unit prior to coding
• CPC Class Codes: H04N 19/124 Quantisation
• CPC Class Codes: H04N 19/132 Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
• CPC Class Codes: H04N 19/14 Coding unit complexity, e.g. amount of activity or edge presence estimation H04N19/146 takes precedence
• CPC Class Codes: H04N 19/146 Data rate or code amount at the encoder output
• CPC Class Codes: H04N 19/149 by estimating the code amount by means of a model, e.g. mathematical model or statistical model
• CPC Class Codes: H04N 19/15 by monitoring actual compressed data size at the memory before deciding storage at the transmission buffer
• CPC Class Codes: H04N 19/176 the region being a block, e.g. a macroblock
• CPC Class Codes: H04N 19/60 using transform coding
• CPC Class Codes: H04N 19/63 using sub-band based transform, e.g. wavelets
• CPC Class Codes: H04N 19/645 by grouping of coefficients into blocks after the transform

Abstract

A video signal having a bandwidth on the order of 37 MHz is subjected to adaptive sub-band coding for transmission through a standard 6 MHz NTSC television channel. During each frame of the video signal a plurality of blocks of sub-band coefficients, each block representing the spectral content of a corresponding portion of the video image, are derived. The energy distribution of each block of coefficients is analyzed in a plurality of different spatial directions to establish a perceptual coding classification for each coefficient block. The coefficients are then variably quantized, e.g. truncated, in dependence upon the classification established for the corresponding block to reduce the required transmission bandwidth without introducing significant visible artifacts in the reproduced video image.

Claims

1. The method comprising developing a video information signal comprising a sequency domain representation of a first video component of a video image signal and a time domain representation of a second video component of the video image signal.

2. The method of claim 1 including providing said video information signal in the form of successive frames of scanning lines, each successive pair of said frames being separated by a plurality of vertical retrace lines, and transmitting said sequency domain representation during said scanning lines and said time domain representation during said retain lines.

3. The method of processing a video information signal comprising:

sub-band coding the video information signal to derive a plurality of spectral coefficients representative thereof;

transmitting a first portion of the information represented by said coefficients during the horizontal scanning lines of a video transmission signal; and

transmitting a second portion of the information represented by said coefficients during the vertical retrace lines of said video transmission signal.

4. The method of processing a video information signal comprising:

sub-band coding said video information signal to develop a plurality of spectral coefficients representative thereof; and

transmitting at least some of the information represented by said coefficients during the vertical retrace lines of a video transmission signal.

5. The method of processing a video image signal comprising:

sub-band coding the video image signal to develop a plurality of spectral coefficients representative thereof; and

processing the developed spectral coefficients for deriving an analog signal comprising a plurality of spectral coefficients representing a band of video frequencies of said video image signal having a relatively low energy content and a digital signal representing a band of video frequencies of said video image signal having a relatively high energy content.

6. The method of processing a video image signal comprising:

developing a plurality of sub-band coded spectral coefficients representing a relatively low energy component of the video image signal;

developing a digital signal representing a relatively high energy component of the video image signal;

transmitting said spectral coefficients during the horizontal scanning lines of a video transmission signal; and

transmitting said digital signal during the vertical retrace lines of said video transmission signal.

7. The method of claim 6 including providing said spectral coefficients in groups, each group of coefficients comprising a spectral representation of a respective spatial portion of the low energy component of said video image signal, analyzing the coefficients in each group of coefficients for estimating the relative energy distribution of the respective group in a plurality of different spatial directions and selectively reducing the bandwidth required for transmission of each group of coefficients in response to said analyzing step.

8. The method of claim 7 wherein said analyzing step comprising analyzing the coefficients in a given group of coefficients for determining the number of said different spatial directions over which the estimated relative energy of the group is predominately distributed.

9. The method of claim 8 including selectively reducing the bandwidth required for transmission of said given group of coefficients in direct relation to said number.

10. The method of claim 7 wherein said analyzing step comprises comparing the estimated relative energy in one or more of said different spatial directions of a given group of coefficients with the estimated relative energy in one or more of said different spatial directions of at least one other group of coefficients derived for a portion of said video image neighboring the portion corresponding to said given group.

11. The method of claim 10 including selectively reducing the bandwidth required for transmission of said given group of coefficients in response to said comparison.

12. The method of claim 7 wherein said analyzing step comprises assigning one of a plurality of perceptual classifications to each of said groups of coefficients in response to said analyzing step.

13. The method of claim 12 including selectively reducing the bandwidth required for transmission of each group of coefficients in response to the classification assigned thereto.

14. The method of claim 13 wherein said reducing step comprises establishing a first and a second threshold for each of said groups of coefficients in response to the classification assigned to the respective group, said first threshold being additionally established in relation to a characteristic of one or more of the coefficients of the respective group, and selectively reducing the bandwidth required for transmission of each group of coefficients in response to the first and second thresholds established therefore.

15. The method of claim 14 wherein said reducing step comprises truncating the coefficients of each group having a magnitude less than either the first or the second threshold established for the respective group.

16. The method of claim 7 wherein said analyzing step includes analyzing the coefficients in each of said groups of coefficients for detecting the presence of a distinct image boundary between adjacent spatial image portions, and reducing the bandwidth required for transmission of the corresponding groups of coefficients by a relatively small amount.

17. A method of processing a signal representing a source video image, comprising the steps of:

sub-band coding said signal for deriving a plurality of groups of spectral coefficients, each of said groups representing a respective spatial portion of said video image;

determining the distribution among a plurality of different spatial regions of a predetermined characteristic of at least some of the coefficients in each of said groups of coefficients, said plurality of different spatial regions comprising a first region representing horizontal information of said video image, a second region representing vertical information of said video image and a third region representing diagonal information of said video image; and

classifying each of said groups of coefficients in accordance with the distribution determined for the respective group.

18. The method of claim 17 including selectively reducing the bandwidth required for the transmission of each of said groups of coefficients in accordance with the classification assigned thereto.

19. A method of processing a signal representing a source video image, comprising the steps of:

sub-band coding said signal for deriving a plurality of groups of spectral coefficients, each of said groups representing a respective spatial portion of said video image;

determining the relative estimated energy distribution of the coefficients of each of said groups of coefficients over a plurality of different spatial regions, said plurality of different spatial regions comprising a first region representing horizontal information of said video image, a second region representing vertical information of said video image and a third region representing diagonal information of said video image;

classifying each of said groups of coefficients in accordance with the distribution determined for the respective group; and

selectively reducing the bandwidth required for the transmission of each of said groups of coefficients in accordance with the classification assigned thereto.

20. The method of claim 19 wherein said classifying step comprises determining the number of said different spatial regions over which the estimated relative energy of a group of coefficients is predominantly distributed and wherein said reducing step comprises reducing the bandwidth required for transmission of the respective group in direct dependence upon said number.

34. The method of claim 19 including transmitting said bandwidth reduced groups of coefficients through a channel of limited bandwidth, receiving said transmitted bandwidth reduced groups of coefficients and reproducing a video image representing said source video image in response thereto.

21. A method of processing a signal representing a source video image, comprising the steps of:

sub-band coding said signal for deriving a plurality of groups of spectral coefficients, each of said groups representing a respective portion of said video image;

determining the relative estimated energy distribution of the coefficients of each of said groups of coefficients over a plurality of different spatial regions,

classifying each of said groups of coefficients in accordance with the distribution determined for the respective group, including comparing the estimated relative energy in one or more of said different spatial regions of a given group of coefficients with the estimated relative energy in one or more of said different spatial regions of at least one other group of coefficients derived for a portion of said video image neighboring the potion corresponding to said given group; and

selectively reducing the bandwidth required for the transmission of each of said groups of coefficients in accordance with the classification assigned thereto.

22. The method of claim 21 wherein said comparing step comprises detecting the presence of a distinct image boundary between adjacent spatial image portions and wherein said reducing step comprises reducing the bandwidth required for transmission of the respective group by a relatively small amount.

23. A method of processing a signal representing a source video image, comprising the steps of:

sub-band coding said signal for deriving a plurality of groups of spectral coefficients, each of said groups representing a respective portion of said video image;

determining the relative estimated energy distribution of the coefficients of each of said groups of coefficients over a plurality of different spatial regions;

classifying each of said groups of coefficients in accordance with the distribution determined for the respective group, including classifying a given group of coefficients in relation to the classifications assigned to a plurality of groups of coefficients derived for respective portions of said video image neighboring the portion corresponding to said given group and

selectively reducing the bandwidth required for the transmission of each of said groups of coefficients in accordance with the classification assigned thereto.

24. A method of processing a signal representing a source video image, comprising the steps of:

sub-band coding said signal for deriving a plurality of groups of spectral coefficients, each of said groups representing a respective portion of said video image;

determining the relative estimated energy distribution of the coefficients of each of said groups of coefficients over a plurality of different spatial regions;

classifying each of said groups of coefficients in accordance with the distribution determined for the respective group;

establishing a first and a second threshold for each of said groups of coefficients in response to the classification assigned to the respective group, said first threshold being additionally established in relation to a characteristic of one or more of the coefficients of the respective group; and

selectively reducing the bandwidth required for transmission of each group of coefficients in response to the first and second thresholds established therefor.

25. The method of claim 24 wherein said reducing step comprises truncating the coefficients of each group having a magnitude less than either the first or the second threshold established for the respective group.

26. A method of processing a signal representing a source video image, comprising the steps of:

sub-band coding said signal for deriving a plurality of groups of spectral coefficients, each of said groups representing a respective portion of said video image;

determining the relative estimated energy distribution of the coefficients of each of said groups of coefficients over a plurality of different spatial regions;

classifying each of said groups of coefficients in accordance with the distribution determined for the respective group;

establishing respective first and second thresholds for each of said spatial regions of each of said groups of coefficients in response to the classification assigned to the respective group, said first thresholds being additionally established in relation to a characteristic of one or more of the coefficients of the respective region; and

selectively reducing the bandwidth required for the transmission of the coefficients of each spatial region of each group in response to the first and second thresholds established therefor.

27. The method of claim 26 wherein said reducing step comprises truncating the coefficients of each spatial region of each group of coefficients having a magnitude less than either the first or second threshold established therefor.

28. The method of processing a signal representing a source video image, comprising the steps of:

sub-band coding said signal for deriving a plurality of groups of spectral coefficients, each of said groups representing a respective portion of said video image;

determining the relative estimated energy distribution of the coefficients of each of said groups of coefficients over a plurality of different spatial regions;

classifying each of said groups of coefficients in accordance with the distribution determined for the respective group;

selectively reducing the bandwidth required for the transmission of each of said groups of coefficients in accordance with the classification assigned thereto;

deriving a data signal representing the bandwidth reduction effected for each of said groups of coefficients; and

transmitting said data signal and said bandwidth reduced groups of coefficients through a channel of limited bandwidth.

29. The method of claim 28 including receiving said transmitted data signal and said bandwidth reduced groups of coefficients and reproducing a video image representing said source video image in response thereto.

30. The method of claim 29 wherein said reproducing step comprises storing said received coefficients and processing the stored coefficients in response to the received data signal for reproducing said video image representing said source video image.

31. The method of claim 30 wherein said processing step comprises subjecting said stored coefficients to an operation comprising the inverse of said sub-band coding step to derive a plurality of video pixels representing said source video image.

32. The method of claim 31 wherein said processing step comprises storing said derived pixels in a memory having less than a frame of pixel storage locations.

33. The method of claim 31 wherein said processing step comprises multiplying each of the stored coefficients with a respective base function to derive said plurality of video pixels.

35. A method of receiving a transmitted signal representing a video image, said transmitted signal comprising a sequency domain representation of a first video component of the video image signal and a time domain representation of a second video component of the video image signal, said method comprising the steps of receiving said transmitted signal, separating said sequency and time domain representations of said received signal, separately processing said sequency and time domain representations for providing respective first and second processed time domain signals and combining said first and second processed time domain signals for providing a third processed signal representing said video image.

36. A method of receiving a transmitted signal representing a video image, said transmitted signal comprising a plurality of successive frames of scanning lines, each successive pair of said frames being separated by a plurality of vertical retrace lines, said scanning lines including a sequency domain representation of a first component of said video image and said retrace lines including a time domain representation of a second component of said video image, said method comprising the steps of receiving said transmitted signal, separating said scanning and retrace lines of said received signal, processing said scanning lines for deriving a first processed time domain signal in response to said sequency domain representation, processing said retrace lines for deriving a second processed time domain signal in response to said time domain representation and combining said first and second processed time domain signals for providing a third processed signal representing said video image.

37. A method of receiving a transmitted video image signal, said transmitted signal including an analog signal comprising a plurality of sub-band coded spectral coefficients representing a relatively low energy video component of said video image signal and a digital signal representing a relatively high energy video component of said video image signal, said method comprising the steps of receiving said transmitted signal, separating said spectral coefficients and said digital signal from said received signal, processing said separated spectral coefficients for deriving a first processed time domain signal representing said relatively low energy component of said video image signal, processing said separated digital signal for deriving a second processed time domain signal representing said relatively high energy component of said video image signal and combining said first and second processed time domain signals for providing a third time domain signal representing said video image signal.

38. A video signal transmitted system comprising means for transmitting a signal representing a video image, said transmitted signal comprising a sequency domain representation of a first video component of the video image signal and a time domain representation of a second video component of the video image signal, means for receiving said transmitted signal, means for separating said sequency and time domain representations of said received signal, means for processing said sequency and time domain representations for providing respective first and second processed time domain signals and means for combining said first and second processed time domain signals for providing a third processed signal representing said video image.

39. A video signal transmission system comprising means for transmitting a signal representing a video image, said transmitted signal comprising a plurality of successive frames of scanning lines, each successive pair of said frames being separated by a plurality of vertical retrace lines, said scanning lines including a sequency domain representation of a first component of said video image and said retrace lines including a time domain representation of a second component of said video image, means for receiving said transmitted signal, means for separating said scanning and retrace lines of said received signal, means for processing said scanning lines for deriving a first processed time domain signal in response to said sequency domain representation, means for processing said retrace lines for deriving a second processed time domain signal in response to said time domain representation and means for combining said first and second processed time domain signals for providing a third processed signal representing said video image.

40. A video signal transmitted system comprising means for transmitting a video image signal, said transmitted signal including an analog signal comprising a plurality of sub-band coded spectral coefficients representing a relatively low energy video component of said video image signal and a digital signal representing a relatively high energy video component of said video image signal, means for receiving said transmitted signal, means for separating said spectral coefficients and said digital signal from said received signal, means for processing said separated spectral coefficients for deriving a first processed time domain signal representing said relatively low energy component of said video image signal, means for processing said separated digital signal for deriving a second processed time domain signal representing said relatively high energy component of said video image signal and means for combining said first and second processed time domain signals for providing a third time domain signal representing said video image signal.

41. A video signal transmission system comprising:

means for sub-band coding a signal representing a source video image for deriving a plurality of groups of spectral coefficients, each of said groups representing a respective portion of said video image;

means for determining the distribution among a plurality of different spatial regions of a predetermined characteristic of at least some of the coefficients in each of said groups of coefficients, said plurality of different spatial regions comprising a first region representing horizontal information of said video image, a second region representing vertical information of said video image and a third region representing diagonal information of said video image;

means for selectively reducing the bandwidth required for the transmission of each of said groups of coefficients in response to said determining means;

means for transmitting said bandwidth reduced groups of coefficients through a channel of limited bandwidth;

means for receiving said transmitted bandwidth reduced groups of coefficients; and

means responsive to said received bandwidth reduced groups of coefficients for reproducing a video image representing said source video image.

42. The system of claim 41 including means for generating a data signal representing the bandwidth reduction effected for each of said groups of coefficients and wherein said transmitting and receiving means are respectively operable for transmitting and receiving said data signal, said reproducing means being responsive to said received data signal and to said received bandwidth reduced groups of coefficients for reproducing a video image representing said source video image.

43. Apparatus for receiving a transmitted signal representing a video image, said transmitted signal comprising a sequency domain representation of a first video component of the video image and a time domain representation of a second video component of the video image, comprising:

means for receiving said transmitted signal, means for separating said sequency and time domain representations of said received signal, means for separately processing said sequency and time domain representations for providing respective first and second processed time domain signals and means for combining said first and second processed time domain signals for providing a third processed signal representing said video image.

44. Apparatus for receiving a transmitted signal representing a video image, said transmitted signal comprising a plurality of successive frames of scanning lines, each successive pair of said frames being separated by a plurality of vertical retrace lines, said scanning lines including a sequency domain representation of a first component of said video image and said retrace lines including a time domain representation of a second component of said video image, comprising:

means for receiving said transmitted signal, means for separating said scanning and retrace lines of said received signal, means for processing said scanning lines for deriving a first processed time domain signal in response to said sequency domain representation, means for processing said retrace lines for deriving a second processed time domain signal in response to said time domain representation and means for combining said first and second processed time domain signals for providing a third processed signal representing said video image.

45. Apparatus for receiving a transmitted video image signal, said transmitted signal including an analog signal comprising a plurality of sub-band coded spectral coefficients representing a relatively low energy video component of said video image signal and a digital signal representing a relatively high energy video component of said video image signal, comprising:

means for receiving said transmitted signal, means for separating said spectral coefficients and said digital signal from said received signal, means for processing said separated spectral coefficients for deriving a first processed time domain signal representing said relatively low energy component of said video image signal, means for processing said separated digital signal for deriving a second processed time domain signal representing said relatively high energy component of said video image signal and means for combining said first and second processed time domain signals for providing a third time domain signal representing said video image signal.