Adaptive video compression and decompression

• US 6,072,836 A
• Filed: 05/17/1999
• Issued: 06/06/2000
• Est. Priority Date: 04/16/1993
• Status: Expired due to Term

• Current Assignee: Acoustic Technology LLC (Intellectual Ventures LLC)
• Original Assignee: Media 100, Inc.
• Inventors: Hardiman, James M.
• Primary Examiner(s): LIN, BRYAN T
• Application Number:
  US09/312,681
• Time in Patent Office: 386 Days
• Field of Search: 348/384, 348/390, 348/403, 348/405, 348/409, 348/415, 348/416, 348/419, 382/232, 382/233, 382/236, 382/238, 382/251, 375/240
• US Class Current: 375/240.03
• CPC Class Codes: G09G 2340/02 Handling of images in compressed format, e.g. JPEG, MPEG
• CPC Class Codes: H04N 19/124 Quantisation
• CPC Class Codes: H04N 19/126 Details of normalisation or weighting functions, e.g. normalisation matrices or variable uniform quantisers
• CPC Class Codes: H04N 19/146 Data rate or code amount at the encoder output
• CPC Class Codes: H04N 19/149 by estimating the code amount by means of a model, e.g. mathematical model or statistical model
• CPC Class Codes: H04N 19/15 by monitoring actual compressed data size at the memory before deciding storage at the transmission buffer
• CPC Class Codes: H04N 19/16 for a given display mode, e.g. for interlaced or progressive display mode
• CPC Class Codes: H04N 19/176 the region being a block, e.g. a macroblock
• CPC Class Codes: H04N 19/186 the unit being a colour or a chrominance component
• CPC Class Codes: H04N 19/42 characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation H04N19/635 takes precedence
• CPC Class Codes: H04N 19/423 characterised by memory arrangements H04N19/433 takes precedence
• CPC Class Codes: H04N 19/46 Embedding additional information in the video signal during the compression process H04N19/517, H04N19/68, H04N19/70 take precedence
• CPC Class Codes: H04N 19/61 in combination with predictive coding
• CPC Class Codes: H04N 21/4143 embedded in a Personal Computer [PC]
• CPC Class Codes: H04N 7/54 the signals being synchronous H04N21/23602, H04N21/23614, H04N21/2365, H04N21/2368, H04N21/4341, H04N21/4342, H04N21/4347, H04N21/4348 take precedence

Abstract

Apparatus that compresses video data using a compression coder having control registers loaded with compression parameters, the apparatus being controlled to sense the size of compressed video data resulting from compressing a portion of source video data using a set of compression parameters, to automatically reload compression parameters that change as a function of the sensed size of compressed video data (the changed parameters being used with the next portion of video data to be compressed), and to store with each compressed portion an indication of the compression parameters used in compressing the portion.

Claims

1. A method for compressing video data using a compression coder on a video controller of a video editing system employing a host computer and video editing software running on said host computer, the video data comprising a sequence of consecutive portions, the compression method used by said compression coder to compress a portion being controlled by compression parameters loaded into control registers of said compression coder, the method comprising the steps of:

compressing a first portion of said video data into compressed video data using said compression coder, said control registers having been loaded with compression parameters;

sensing the size of said compressed video data resulting from compressing said first portion using said compression parameters;

automatically reloading into said control registers compression parameters changed as a function of said size of said compressed video data; and

storing said compressed video data and the compression parameters used in compressing said portion, said compressed video data for each said portion being stored together with its respective compression parameters, said compression parameters being a full set of quantization factors, such that a full set of quantization factors is stored with its respective said portion.

2. The method of claim 1 wherein said reloading step further comprises the steps of:

determining whether the size of said compressed video data exceeds a predetermined upper threshold value, and, if so, loading into said control registers new compression parameters that specify greater compression and lower quality than said original compression parameters; and

determining whether the size of said compressed video data is less than a predetermined lower threshold value, and, if so, loading into said control registers new compression parameters that specify lower compression and greater quality than said original compression parameters.

3. The method of claim 1 wherein said compression parameters are loaded into said control registers under the control of a state machine that performs said loading at times between said portions.

4. The method of claim 1 wherein said compressed video data are stored into buffers for a mass storage device of a host computer, said buffers being located in the memory of said host computer.

5. The method of claim 4 further comprising the steps of:

communicating to said host computer an index value indicating the compression parameters with which said portion of said video data were compressed and with which said compressed video data can be decompressed; and

storing said compressed video data and decompression parameters corresponding to said index value onto a mass storage device of said host computer.

6. The method of claim 4 further comprising the steps of:

communicating to said host computer a count indicating the size of said compressed video data; and

storing said compressed video data and said count onto a mass storage device of said host computer.

7. The method of claim 4 wherein said buffers have space reserved to allow the insertion of an indication of the compression parameters used to compress said compressed data and the size of said compressed video data.

8. The method of claim 1 wherein said compressed video data are queued through a FIFO before said storing, said FIFO allowing a host computer to process said stored compressed video data asynchronously from said compressing.

9. The method of claim 1 wherein each of said portions of said video data consists of one frame.

10. The method of claim 1 wherein said video data are presented to said compression coder in an interlaced order, and each of said portions of said video data consists of one field of said video data.

11. A video editing apparatus, the apparatus comprising:

a host computer having a mass storage device and being programmed with video editing software;

a video controller, the video controller comprising;

a video input port configured to receive video input;

a compression coder taking as input said video input and producing as output compressed video data, the compression method applied by said compression coder being controlled by compression parameters loaded into control registers of said compression coder;

a counter configured to count a portion of said compressed video data as said portion is output by said compression coder;

compression adjustment means for automatically reloading into said control registers new compression parameters determined as a function of said count of said compressed video data; and

a bus control circuit taking as input said compressed video data, and configured to transfer each of said portions of said compressed video data and the respective compression parameters that were used to obtain each of said portions of compressed video data to be stored together in said mass storage device of said host computer, said compression parameters being a full set of quantization factors, such that a full set of quantization factors is stored with its respective said portion.

12. The apparatus of claim 11 wherein said compression adjustment means comprises:

means for determining whether the size of said compressed video data exceeds a predetermined upper threshold value, and, if so, loading into said control registers new compression parameters that specify greater compression and lower quality than said original compression parameters; and

means for determining whether the size of said compressed video data is less than a predetermined lower threshold value, and, if so, loading into said control registers new compression parameters that specify lower compression and greater quality than said original compression parameters.

13. The apparatus of claim 11 further comprising a state machine that loads said compression parameters into said control registers.

14. The apparatus of claim 11 wherein said host computer has buffers for said mass storage device located in a memory of said host computer, and said bus control circuit transfers said compressed video data into said buffers.

15. The apparatus of claim 14 wherein said host computer has means to receive an index value indicating the compression parameters with which said portion of said video data were compressed and with which said compressed video data can be decompressed;

and means to store said compressed video data and decompression parameters corresponding to said index value onto said mass storage device.

16. The apparatus of claim 14 wherein said host computer has means to receive a count for a respective portion of said compressed video data from said counter and to store said count in said mass storage device with said respective portion of said compressed video.

17. The apparatus of claim 14 wherein said buffers have space reserved to allow the insertion of an indication of the compression parameters used to compress said compressed data and the size of said compressed video data.

18. The apparatus of claim 14 wherein said host computer is programmed with software implementing a video editing system.

19. The apparatus of claim 11 wherein said video controller further comprises FIFO in which said compressed video data are queued awaiting transfer to said host computer.

20. The apparatus of claim 11 wherein each of said portions of said video data consists of one frame.

21. The apparatus of claim 11 wherein said video data are presented to said compression coder in an interlaced order, and each of said portions of said video data consists of one field of said video data.

22. A method of decoding an encoded video program using a decoder of a video controller of a video editing system employing a host computer and video editing software running on said host computer, the encoded video program comprising a sequence of data packets stored on mass storage of said host computer, said decoder being controlled by decoding parameters loaded into control registers of said decoder, the method comprising the steps of:

acquiring each of said data packets in sequence from said mass storage of said host computer, each said data packet of said video program comprising decoding parameters and encoded video data, said decoding parameters being a full set of quantization factors, such that a full set of quantization factors is stored with its respective said encoded video; and

processing each of said data packets as it is acquired by a method comprising the steps of;

storing said decoding parameters into said control registers; and

decoding said encoded video data by said decoder as specified by said stored decoding parameters.

23. The method of claim 22 wherein said decoding comprises decompressing said encoded video program from a compressed form, said decoder comprises a decompression decoder, and said decoding parameters comprise decompression parameters.

24. The method of claim 22 further comprising the steps of:

extracting from said data packet a data count, said data count specifying the number of words of encoded video data in said data packet; and

storing said data count into a storage register.

25. The method of claim 24 wherein said extracting is performed by a state machine.

26. The method of claim 22 wherein each said data packet describes one field of a sequence of frames of interlaced video.

27. A video editing apparatus for decompressing a digital representation of video data, the apparatus comprising:

a host computer having a mass storage device and being programmed with video editing software;

said mass storage device storing digital video data, said digital video data comprising a sequence of data packets, each said data packet comprising a block of parameter values and compressed image data, said decoding parameters being a full set of quantization factors, such that a full set of quantization is factors is stored with its respective said compressed image data; and

a decompression decoder connected to receive said compressed image data and said block of parameter values in said packets for decompressing said compressed image data into decompressed image data, the decoder having control registers accepting said block of parameter values to alter the decompression method applied, an input port for accepting said compressed image data as input and an output port for outputting decompressed data corresponding to said compressed data.

28. The apparatus of claim 27 further comprising a state machine connected to control input of said block of parameters into said registers and said compressed image data into said input port.

29. The apparatus of claim 28 wherein said data packet further comprises a data count indicating the size of the compressed image data, and said state machine is connected to access said data count.

30. The apparatus of claim 27 wherein each said data packet represents one field of an interlaced video frame.

31. The apparatus of claim 27 wherein said host computer has a peripheral board plugged into an expansion slot of said computer, and said peripheral board carries said decompression decoder.

32. A method for processing video data using a compression coder and compression decoder on a video controller of a video editing system employing a host computer and video editing software running on said host computer, the video data comprising a sequence of consecutive portions, the compression method used by said compression coder and compression decoder to compress and decompress a portion being controlled by compression parameters loaded into control registers of said compression coder and compression decoder, the method comprising the steps of:

compressing a first portion of said video data into compressed video data using said compression coder, said control registers having been loaded with compression parameters;

sensing the size of said compressed video data resulting from compressing said first portion using said compression parameters;

automatically reloading into said control registers compression parameters changed as a function of said size of said compressed video data;

storing said compressed video data and the compression parameters used in compressing said portion on mass storage of said host computer, said compressed video data for each said portion being stored together with its respective compression parameters in respective data packets, said decoding parameters being a full set of quantization factors, such that a full set of quantization factors is stored with its respective said compressed video data;

acquiring each of said data packets in sequence from said mass storage of said host computer; and

processing each of said data packets as it is acquired by a method comprising the steps of;

storing said compression parameters into said control registers; and

decompressing said compressed video data by said compression decoder as specified by said stored compression parameters.

33. A video editing apparatus, the apparatus comprising:

a host computer having a mass storage device and being programmed with video editing software;

a video controller, the video controller comprising;

a video input port configured to receive video input;

a compression coder taking as input said video input and producing as output compressed video data, the compression method applied by said compression coder being controlled by compression parameters loaded into control registers of said compression coder;

a counter configured to count a portion of said compressed video data as said portion is output by said compression coder;

compression adjustment means for automatically reloading into said control registers new compression parameters determined as a function of said count of said compressed video data;

a bus control circuit taking as input said compressed video data, and configured to transfer each of said portions of said compressed video data and the respective compression parameters that were used to obtain each of said portions of compressed video data to be stored together in packets in said mass storage device of said host computer, said decoding parameters being a full set of quantization factors, such that a full set of quantization factors is stored with its respective said portion; and

a decompression decoder connected to receive said compressed video data and said respective parameter values in said packets from said mass storage device for decompressing said compressed video data into decompressed video data, the decoder having control registers accepting said respective parameter values to alter the decompression method applied.