Method and apparatus for transforming between fixed-rate vector quantized data and variable rate vector quantized data

• US 5,231,485 A
• Filed: 11/19/1991
• Issued: 07/27/1993
• Est. Priority Date: 11/19/1991
• Status: Expired due to Term

• Current Assignee: Cisco Technology, Inc. (Cisco Systems, Inc.)
• Original Assignee: Scientific-Atlanta Incorporated (Cisco Systems, Inc.)
• Inventors: Israelsen, Paul D., Lucas, Keith
• Primary Examiner(s): Britton, Howard W.
• Application Number:
  US07/794,491
• Time in Patent Office: 616 Days
• Field of Search: 358/86, 358/133, 358/135, 358/136, 358/138, 358/105, 341/67
• US Class Current: 375/240.03
• CPC Class Codes: G06T 9/008 Vector quantisation
• CPC Class Codes: G10L 19/038 Vector quantisation, e.g. TwinVQ audio
• CPC Class Codes: H04N 19/94 Vector quantisation
• CPC Class Codes: H04N 5/765 Interface circuits between an apparatus for recording and another apparatus
• CPC Class Codes: H04N 7/10 Adaptations for transmission by electrical cable H04N7/12 takes precedence

Abstract

A method and apparatus is disclosed wherein fixed rate vector quantized data is transmitted from a first location to a second location via a first medium. The fixed rate vector quantized data is received at the second location and transformed to variable rate vector quantized data. Then, the transformed variable rate vector quantized data is transmitted to a third location via a second medium. At the third location, the variable rate vector quantized data may be received, and if desired, transformed back to fixed rate form. A distortion adaptive vector quantization method is employed to transform the fixed rate vector quantization data to variable rate vector quantization data.

Claims

1. A method comprising the steps of:

transmitting fixed-rate vector quantized data from a first location to a second location via a first medium;

receiving the fixed-rate vector quantized data at the second location and transforming the fixed-rate vector quantized data to variable-rate vector quantized data; and

transmitting the variable-rate vector quantized data from the second location to a third location via a second medium.

2. Method according to claim 1 wherein the first location is a transmitter location of television signals, and the second location is a cable-head end, and the third location is a receiver location of television signals, and wherein the first medium is a satellite communications link and the second medium is a cable television distribution system.

3. Method according to claim 1 further comprising the steps of:

a) receiving the variable-rate vector quantized data at the third location; and

b) transforming the variable-rate vector quantized data to fixed-rate vector quantized data at the third location for storage on magnetic media at the third location.

4. Method of communicating image data from a transmitter location of television signals to at least one reception site, comprising the steps of:

a) receiving image data to be transmitted, and converting the image data to a plurality of multi-dimensional input vectors;

b) providing at the transmitter location, a vector quantization encoder of the type that employs a first tree structured codebook to vector quantize the input vectors and sequentially transmits vector quantized data for each of the input vectors, the first codebook having a plurality N of levels of codevectors, each codevector being representative of a possible input vector, the codevectors at each successive level representing possible input vectors with greater accuracy than codevectors at a preceding level, there being an address associated with each codevector having a length corresponding to the level of the codevector in the codebook, the addresses of codevectors at a same level having a same length and the lengths increasing with each successive level;

c) processing a one of the input vectors and selecting from the Nth level a codevector that most closely resembles the processed input vector, the address of the selected codevector having a length of M bits;

d) transmitting to an intermediate location via a first medium, an indication of at least the M bit address associated with the selected codevector;

e) repeating steps (c) and (d) for each other input vector, a plurality of the indications transmitted in step (d) representing fixed-rate vector quantized data;

f) performing the following steps at the intermediate location;

f1) receiving each indication transmitted in step (d) and obtaining the M bit addresses therefrom;

f2) transforming each M bit address to a derivative address having a length ranging from 1 to M bits and transmitting an indication of the derivative address to at least one reception site, a plurality of the transmitted derivative address indications representing variable-rate vector quantized data.

5. Method according to claim 4 wherein the intermediate location is a cable-head end, and wherein the first medium is a satellite communications link and the second medium is a cable television distribution network.

6. Method according to claim 4 wherein another tree structured vector quantization codebook substantially identical to the first codebook is provided at the reception site and wherein the following steps are performed at the reception site:

receiving each transmitted indication from the intermediate location and obtaining the derivative address therefrom, and for each obtained derivative address;

i) retrieving from the codebook at the reception site the codevector residing at the obtained derivative address to obtain at least a substantial representation of an associated codevector selected in step (c) from the first codebook, and, from the retrieved codevector, reproducing a representation of the input vector for which the associated codevector was selected in step (c);

ii) employing the reproduced representation of the input vector to substantially recreate the image data the reception site for display on a television set located at the reception site.

7. Method according to claim 4 wherein the codevectors in the first codebook are representative of possible second residual vectors.

8. Method according to claim 4 wherein the following steps are performed at the reception site:

a'"'"') receiving each transmitted indication from the intermediate location and obtaining the derivative address therefrom, the obtained derivative addresses having variable lengths ranging from 1 to M;

b'"'"') transforming each derivative address to an address having a length of S bits, all the derivative addresses being S bits in length; and

c'"'"') storing at least an indication of each transformed derivative address on a magnetic medium at the locale of the reception site, a plurality of the transformed derivative addresses representing fixed-rate vector quantized data.

9. Method according to claim 8 wherein S is equal to M.

10. Method according to claim 4 wherein step (c) comprises determining a mean value of the input vector and removing the mean value from the input vector to obtain a residual vector, the processed input vector comprising the residual vector.

11. Method according to claim 10 wherein step (d) further comprises transmitting the mean value with the indication.

12. Method according to claim 4 wherein a mean value of each input vector is determined and a mean vector for a current input vector is interpolated from the mean value of the current input vector and any adjacent vectors and wherein step (c) comprises subtracting the mean vector from the current input vector.

13. Method according to claim 12 wherein the result of the subtraction defines a first residual vector and step (c) further comprises calculating a mean value of the first residual vector and subtracting the mean value of the first residual vector from the first residual vector to define a second residual vector, the processed input vector comprising the second residual vector.

14. Method according to claim 4 wherein a second tree structured vector quantization codebook substantially identical to the first codebook is provided at the intermediate location and wherein step (f2) comprises:

for each obtained M bit address;

i) retrieving from the Nth level of the second codebook the codevector residing at the obtained M bit address to obtain a substantially identical representation of an associated codevector selected from the first codebook in step (c);

ii) selecting an initial level of the codebook and defining a currently selected level thereof as the initial level;

iii) selecting a portion of the obtained M bit address, the selected portion having an address length ranging from 1 to (M-1) and being suitable for addressing a codevector in the currently selected level of the second codebook, and defining a current codevector address as the selected portion;

iv) retrieving from the currently selected level of the second codebook the codevector residing at the current codevector address;

v) obtaining a measure of difference between the codevector retrieved in step (i) and the codevector retrieved in step (iv);

vi) proceeding to step (ix) only if the measure of difference is not greater than a threshold value, but otherwise selecting a next level of the second codebook succeeding the currently selected level and redefining the currently selected level as the next level and proceeding to step (vii);

vii) proceeding to step (viii) if the currently selected level is a last level of the codebook, but otherwise selecting another portion of the obtained M bit address, the selected portion having an address length ranging from 1 to (M-1) and being suitable for addressing a codevector in the currently selected level, and redefining the current codevector address as said another selected portion and repeating steps (iv) through (vi);

viii) redefining the current codevector address as the obtained M bit address and proceeding to step (ix);

ix) defining the derivative address as the current codevector address, the derivative address having a length ranging from 1 to M bits, and transmitting an indication of at least the derivative address.

15. Method according to claim 14 wherein M is equal to N.

16. Method according to claim 14 wherein M is equal to N multiplied by k, where k is a function of the tree structure of the fist codebook.

17. Method according to claim 14 further comprising the step of periodically adjusting the threshold value based upon an average length of data transmitted in step (ix).

18. Method according to claim 14 wherein a compression code is assigned to each derivative address, each compression code having a length that is substantially inversely proportional to a predetermined probability that a particular codevector will be selected in step (c), and wherein step (f2) comprises transmitting the compression code for each derivative address.

19. Method according to claim 18 wherein the compression codes are Huffman codes.

20. Method according to claim 14 further comprising the step of storing the indications of the derivative addresses to be transmitted in a buffer, periodically obtaining a measure of unused capacity of the buffer, and periodically and automatically adjusting the threshold value based upon the measure of unused capacity of the buffer.

21. Method according to claim 20 wherein the threshold value is adjusted by increasing the threshold value when the measure indicates that unused buffer capacity is decreasing and decreasing the threshold value when the measure indicates that unused buffer capacity is increasing, adjustment of the threshold value ensuring that the buffer does not empty or overflow.

22. Method according to claim 14 wherein prior to performing step (ii), the following steps are performed:

a'"'"') comparing a representation of a previous input vector, which previous input vector has already been vector quantized into fixed-rate vector quantized data at the encoder and transformed to variable-rate vector quantized data at the intermediate location and transmitted to the reception site, to a representation of a current input vector to obtain a measure of difference between the previous input vector and the current input vector; and

b'"'"') transmitting to the reception sites an instruction to reconstruct a substantial representation of the current input vector from the variable-rate vector quantized data already transmitted for the previous input vector only when the measure of difference between the previous input vector and the current input vector is not greater than the threshold, but otherwise performing steps (ii) through (ix);

whereby variable-rate vector quantized data for the current input vector need not be transmitted to reconstruct a representation of the current input vector at the reception site when the measure of difference between the previous input vector and the current input vector is not greater than the threshold value.

23. Method according to claim 22 wherein another tree structured vector quantization codebook substantially identical to the first codebook is provided at the reception site and wherein the following steps are performed at the reception site:

f1) for indications received at the reception site, obtaining the derivative address therefrom, retrieving from the codebook at the reception site the codevector residing at the obtained derivative address to obtain at least a substantial representation of an associated codevector selected in step (c) from the first codebook, and employing the retrieved codevector to substantially reproduce the input vector for which the associated codevector was selected from the first codebook in step (c);

f2) for instructions that are received at the reception site, obtaining from a memory at the reception site a previously obtained derivative address, retrieving from the codebook at the reception site the codevector residing at the previously obtained derivative address, and reproducing from the retrieved codevector a substantial representation of the current input vector that resulted in the transmission of the instruction;

f3) employing the reproduced representations of the input vectors to substantially recreate the image data at the reception site for display on a television set located at the reception site.

24. Method of communicating image data from a transmitter location of television signals to a plurality of reception sites, comprising the steps of:

a) receiving image data to be transmitted, and converting the image data to a plurality of multi-dimensional input vectors;

b) providing at the transmitter location, a vector quantization encoder of the type that employs a first tree structured codebook to vector quantize the input vectors and sequentially transmits vector quantized data for each of the input vectors, the first codebook having a plurality N of levels of codevectors, each codevector being representative of a possible input vector, the codevectors at each successive level representing possible input vectors with greater accuracy than codevectors at a preceding level, there being an address associated with each codevector having a length equal to L * k bits where L represents the level of the codevector in the codebook and has a value ranging from 1 to N, and where k is a function of the tree structure of the codebook, at least a portion of the address of a codevector at a given level L'"'"' of the codebook being capable of addressing a codevector at a given level P preceding level L'"'"';

c) processing a one of the input vectors and selecting from the Nth level a codevector that most closely resembles the processed input vector, the address of the selected codevector having a length equal to N * k bits;

d) transmitting to an intermediate location via a first medium, an indication of at least the N * k bit address associated with the selected codevector;

e) repeating steps (c) and (d) for each other input vector, a plurality of the indications transmitted in step (d) representing fixed-rate vector quantized data;

f) performing the following steps at the intermediate location, there being a second tree structured vector quantization codebook at the intermediate location, the second codebook being substantially identical to the first codebook;

f1) receiving a one of the indications from the transmitter location and obtaining the N * k bit address therefrom;

f2) retrieving from the Nth level of the second codebook the codevector residing at the obtained N * k bit address to obtain a substantially identical representation of an associated codevector selected from the first codebook in step (c);

f3) selecting an initial level of the second codebook preceding the Nth level and defining a currently selected level as the initial level and defining a value CL that identifies the currently selected level;

f4) selecting the CL * k most significant bits of the obtained N * k bit address, and defining a current codevector address as the selected CL * k bits;

f5) retrieving from the currently selected level of the second codebook the codevector residing at the current codevector address;

f6) obtaining a measure of difference between the codevector retrieved in step (f1) and the codevector retrieved in step (f5);

f7) proceeding to step (f10) only if the measure of difference is not greater than a threshold value, but otherwise selecting a next level of the second codebook succeeding the currently selected level and redefining the currently selected level as the next level, the value CL being modified to identify the currently selected level, and proceeding to step (f8);

f8) proceeding to step (f9) if the currently selected level is a last level of the second codebook, but otherwise selecting the CL * k most significant bits of the N * k bit address, and redefining the current codevector address as the selected CL * k bits, and repeating steps (f5) through (f7);

f9) redefining the current codevector address as the obtained N * k bit address and proceeding to step (f10);

f10) defining a derivative address as the current codevector address, the derivative address having a length ranging from k to N * k bits, and transmitting an indication of at least the derivative address to at least one reception site;

f11) repeating steps (f1) through (f10) for each other indication transmitted from the transmitter location in step (d), a plurality of the indications of the derivative addresses transmitted in step (f10) representing variable-rate vector quantized data.

25. Method according to claim 24 wherein the intermediate location is a cable-head end, and wherein the first medium is a satellite communications link and the second medium is a cable television distribution network.

26. Method according to claim 24 further comprising the step of periodically adjusting the threshold value based upon an average length of data transmitted in step (f10).

27. Method according to claim 24 wherein another tree structured vector quantization codebook substantially identical to the first codebook and the second codebook is provided at the reception site and wherein the following steps are performed at the reception site:

receiving each transmitted indication from the intermediate location and obtaining the derivative address therefrom, and for each obtained derivative address;

i) retrieving from the codebook at the reception site the codevector residing at the obtained derivative address to obtain at least a substantial representation of an associated codevector selected from the first codebook in step (c), and, from the retrieved codevector, reproducing a representation of the input vector for which the associated codevector was selected from the first codebook in step (c);

ii) employing the reproduced representation of the input vector to substantially re-create the image data at the reception site for display on a television set located at the reception site.

28. Method according to claim 24 wherein a compression code is assigned to each derivative address, each compression code having a length that is substantially inversely proportional to a predetermined probability that a particular codevector will be selected in step (c), and wherein step (f10) comprises transmitting the compression code for each derivative address.

29. Method according to claim 28 wherein the compression codes are Huffman codes.

30. Method according to claim 24 further comprising the step of temporarily storing the indications of the derivative addresses in a buffer prior to transmitting, periodically obtaining a measure of unused capacity of the buffer, and periodically and automatically adjusting the threshold value based upon the measure of unused capacity of the buffer.

31. Method according to claim 30 wherein the threshold value is adjusted by increasing the threshold value when the measure indicates that unused buffer capacity is decreasing and decreasing the threshold value when the measure indicates that unused buffer capacity is increasing, adjustment of the threshold value ensuring that the buffer does not empty or overflow.

32. Method according to claim 24 wherein the following steps are performed at the reception site:

a'"'"') receiving each transmitted indication from the intermediate location and obtaining the derivative address therefrom, the obtained derivative addresses having variable lengths ranging from k to N * k;

b'"'"') transforming each derivative address to an address having a length of S bits, all the transformed derivative addresses being S in length; and

c'"'"') storing at least an indication of each transformed derivative address on a magnetic medium at the locale of the reception site, a plurality of the transformed derivative addresses representing fixed-rate vector quantized data.

33. Method according to claim 32 wherein S is equal to N * k.

34. Method according to claim 24 wherein step (c) comprises determining a mean value of the input vector and removing the mean value from the input vector to obtain a residual vector, the processed input vector comprising the residual vector.

35. Method according to claim 34 wherein step (d) further comprises transmitting the mean value with the indication.

36. Method according to claim 24 wherein prior to performing step (f3), the following steps are performed:

a'"'"') comparing a representation of a previous input vector, which previous input vector has already been vector quantized into fixed-rate data at the transmitter location and transformed to variable-rate data at the intermediate location and transmitted to at least one reception site, to a representation of a current input vector to obtain a measure of difference between the previous input vector and the current input vector; and

b'"'"') transmitting to the reception site an instruction to reconstruct a substantial representation of the current input vector from the variable-rate data already received at the reception site for the previous input vector only when the measure of difference between the previous input vector and the current input vector is not greater than the threshold, but otherwise performing steps (f3) through (f10);

whereby variable-rate vector quantized data for the current input vector need not be transmitted to reconstruct a representation of the current input vector at the reception site when the measure of difference between the previous input vector and the current input vector is not greater than the threshold value.

37. Method according to claim 36 wherein another tree structured vector quantization codebook substantially identical to the first codebook is provided at the reception site and wherein the following steps are performed at the reception site:

i) for indications that are received at the reception site, obtaining the derivative address therefrom, retrieving from the codebook at the reception site the codevector residing at the obtained derivative address to obtain at least a substantial representation of an associated codevector selected from the first codebook in step (c), and employing the retrieved codevector to substantially reproduce the input vector for which the codevector was selected from the first codebook in step (c);

ii) for instructions that are received at the reception site, obtaining from a memory at the reception site a previously obtained derivative address, retrieving from the codebook at the reception site the codevector residing at the previously obtained derivative address, and reproducing from the retrieved codevector a substantial representation of the input vector that resulted in the transmission of the instruction;

iii) employing the reproduced representations of the input vectors to substantially recreate the image data at the reception site for display on a television set located at the reception site.

38. Method according to claim 24 wherein a mean value of each input vector is determined and a mean vector for a current input vector is interpolated from the mean value of the current input vector and any adjacent vectors and wherein step (c) comprises subtracting the mean vector from the current input vector.

39. Method according to claim 38 wherein the result of the subtraction defines a first residual vector and step (c) further comprises calculating a mean value of the first residual vector and subtracting the mean value of the first residual vector from the first residual vector to define a second residual vector, the processed input vector comprising the second residual vector.

40. Method according to claim 39 wherein the codevectors in the codebook are representative of possible second residual vectors.

52. Method according to claim 4, 24 or 41 wherein the codevectors are transformed to a transform domain before being provided in the codebooks, and the codevectors are stored in the codebooks in the transform domain, and wherein each input vector is transformed to the transform domain for selecting one of the codevectors from the codebook.

53. Method according to claim 52 wherein the transform domain is the frequency domain and the codevectors and input vectors are transformed to the frequency domain by a Fourier transform.

41. Method of transforming fixed-rate vector quantized data to variable-rate vector quantized data wherein the fixed-rate vector quantized data comprises a plurality of M bit codevector addresses, each M bit address being associated with a codevector selected from an Nth level of a first tree structured vector quantization codebook, comprising the steps of:

for each M bit address;

i) retrieving from the Nth level of a second codebook that is substantially identical to the first codebook the codevector residing at the M bit address to obtain a representation of the codevector selected from the M bit address of the Nth level of the first codebook;

ii) selecting an initial level of the second codebook preceding the Nth level and defining a currently selected level as the initial level;

iii) selecting a portion of the M bit address, the selected portion having an address length ranging from 1 to (M-1) bits and being suitable for addressing a codevector in the currently selected level of the second codebook, and defining a current codevector address as the selected portion;

iv) retrieving from the currently selected level of the second codebook the codevector residing at the current codevector address;

v) obtaining a measure of difference between the codevector retrieved in step (i) and the codevector retrieved in step (iv);

vi) proceeding to step (ix) only if the measure of difference is not greater than a threshold value, but otherwise selecting a next level of the second codebook succeeding the currently selected level and redefining the currently selected level as the next level and proceeding to step (vii);

vii) proceeding to step (viii) if the currently selected level is a last level of the codebook, but otherwise selecting another portion of the M bit address, said selected another portion having an address length ranging from 1 to (M-1) bits and being suitable for addressing a codevector in the currently selected level, and redefining the current codevector address as the selected portion and repeating steps (iv) through (vi);

viii) redefining the current codevector address as the M bit address and proceeding to step (ix);

ix) defining a derivative address as the current codevector address, the derivative address having a length ranging from 1 to M bits, a plurality of the derivative addresses representing variable-rate vector quantized data.

42. Method according to claim 41 wherein M is equal to N.

43. Method according to claim 41 wherein M is equal N multiplied by k, where k is a function of the tree structure of the first codebook.

44. An apparatus for transforming fixed rate vector quantized data to variable rate vector quantized data for use by operators of a television signal distribution system employing, at a transmitter location thereof, a tree search vector quantization data compressor for compressing input vectors and having a first codebook having a plurality N of levels of codevectors each representative of a possible input vector, there being an address associated with each codevector, the transmitter location transmitting for each input vector an indication of the associated address of a codevector selected from the Nth level of the first codebook that most closely resembles the input vector, the associated addresses of the selected codevectors each having a length of M bits, a plurality of the indications of the associated addresses representing fixed-rate vector quantized data, the apparatus comprising:

first means for receiving each indication transmitted from the transmitter location and for obtaining the M bit address therefrom;

second means for transforming the obtained M bit address to a derivative address having a length ranging from 1 to M bits; and

transmitter means for transmitting at least an indication of the derivative address, a plurality of transmitted indications of derivative addresses representing variable-rate vector quantized data.

45. Apparatus according to claim 44 wherein the second means for transforming the obtained M bit address to a derivative address having a length ranging from 1 to M bits comprises:

a second codebook being substantially identical to the first codebook;

third means for retrieving from the Nth level of the second codebook a first codevector residing at the obtained M bit address;

a controller for selecting at least a portion of the obtained M bit address, the selected portion representing an intermediate address and having a length ranging from 1 to (M-1) bits, and for retrieving from the second codebook a second codevector residing at the intermediate address, and for obtaining a measure of difference between the first codevector and the second codevector, and for selecting another portion of the obtained M bit address only if the measure of difference is not greater than a threshold value, a finally selected portion of the obtained M bit address representing the derivative address.

46. Apparatus according to claim 45 further comprising a lossless compression encoder for assigning a compression code to each derivative address, the compression code having a length that is substantially inversely proportional to a probability that a particular derivative address will be selected, the transmitted indications of the derivative addresses comprising the compression codes.

47. Apparatus according to claim 45 further comprising means for obtaining a measure of difference between a codevector currently retrieved by the third means and a codevector previously retrieved by the third means and for providing, based upon the measure of difference and the threshold value, an indication that the currently retrieved codevector is substantially similar to the previously retrieved codevector and may be copied therefrom.

48. Apparatus according to claim 45 further comprising fourth means for temporarily storing the indications of the derivative addresses prior to being transmitted by the transmitter means and for periodically adjusting the threshold value based upon a measure of unused capacity of the fourth means.

49. Apparatus according to claim 48 further comprising a feedback loop coupling the fourth means to the controller for supplying the threshold value.

50. A decoder for use by recipients of television signals employing, at a transmitter thereof, a vector quantization data compressor for compressing input vectors representative of image data to be communicated to the recipients, and having a first codebook having plural levels of codevectors representative of possible input vectors, there being an address associated with each codevector, the transmitter transmitting variable-rate vector quantized data comprising data indicative of the addresses of codevectors selected from the first codebook that most closely resemble the input vectors, the addresses of the selected codevectors having variable lengths, the decoder comprising:

a second codebook being substantially identical to the first codebook;

first means for receiving the variable-rate vector quantized data and for obtaining the variable length addresses therefrom;

second means for retrieving from the second codebook the codevector residing at each obtained address;

converter means for converting the retrieved codevectors to NTSC image data and for providing the NTSC image data at an output thereof for substantially reproducing images input to the transmitter; and

,

transformer means for optionally transforming the variable-rate vector quantized data received by the first means to fixed-rate vector quantized data when it is desired to store vector quantized image data on magnetic media in the vicinity of the decoder.

51. Decoder according to claim 50 wherein the transformer means comprises means for transforming each of the variable length addresses to a same pre-determined length, all the transformed addresses having the same predetermined length, at least a plurality of the transformed addresses representing fixed-rate vector quantized data.