Ordering and formatting coded image data and reconstructing partial images from the data

• US 5,339,108 A
• Filed: 06/09/1992
• Issued: 08/16/1994
• Est. Priority Date: 04/09/1992
• Status: Expired due to Term

• Current Assignee: Ampex Corporation (Delta Information Systems, Inc.)
• Original Assignee: Ampex Corporation (Delta Information Systems, Inc.)
• Inventors: Coleman, Charles H., Miller, Sidney D., Smidth, Peter
• Primary Examiner(s): Britton, Howard W.
• Application Number:
  US07/896,511
• Time in Patent Office: 798 Days
• Field of Search: 358/13, 358/133, 358/136, 358/310, 358/335, 358/312
• US Class Current: 375/240.2
• CPC Class Codes: H04N 19/30 using hierarchical techniques, e.g. scalability H04N19/63 takes precedence
• CPC Class Codes: H04N 19/60 using transform coding
• CPC Class Codes: H04N 5/783 Adaptations for reproducing at a rate different from the recording rate
• CPC Class Codes: H04N 9/8047 using transform coding

Abstract

Editing of information recovered from a relatively high speed communications medium such as a communications channel or magnetic tape often times allows only a portion of the information to be recovered. Storing information in complete segments from which portions of an image, called "snatches," may be recovered helps. An image signal is compressed in such a way that a snatch can be used during decompression to reconstruct a recognizable image from less than all the information that defines the image-thereby giving rise to the notion of a partially reconstructed image. The image information comprises several pixel data blocks with each block including sufficient pixel image data to reconstruct a portion of the image. The pixel data blocks are discrete cosine transformed ("dct") to generate a set of dct coefficient blocks. The dct coefficients for a group of dct coefficient blocks are rank ordered from highest visibility coefficient (corresponding to lowest dct frequency coefficient) to lowest visibility coefficient (corresponding to highest dct frequency coefficient), and then are quantized, entropy encoded, and formatted together with synchronization information and parity checks from the error correction encoding before being transmitted on a channel or recorded on magnetic tape. A decompression and reconstruction arrangement functions essentially as the inverse of the compression arrangement. It is during the decompression that snatches are retrieved and used to reconstruct a partial (video) image by using some but not necessarily all the dct coefficients that define the image.

Claims

1. A method for compressing a digital image signal and for decompressing the compressed digital image signal, the method comprising the steps of:

receiving the image signal;

stratifying the received image signal into a plurality of image blocks, each image block being of predetermined size and each image block including image data from the image signal for defining a respective portion of the image signal;

transforming each respective image block of the image signal to obtain a respective transform coefficient block, a transform coefficient block including a plurality of transform coefficients, the respective transform coefficients of a transform coefficient block being usable for reconstructing the corresponding portion of the image signal;

structuring the plurality of transform coefficients of the transform coefficient block into a predetermined visibility order;

generating an ordered block of image transform coefficients from the visibility ordered transform coefficients;

providing the ordered block of transform coefficients to a communications medium as a segment of predetermined size;

retrieving at least a snatch from an ordered block of transform coefficients from the communications medium; and

reconstructing a partial image signal from the snatch of retrieved transform coefficients.

2. The method of claim 1 further comprising the steps of:

quantizing each of the plurality of ordered transform coefficient blocks; and

formatting each of the quantized plurality of ordered transform coefficient blocks into a segment of predetermined size.

3. The method of claim 1 further comprising the step of:

recording the ordered block of transform coefficients on a magnetic medium as a segment of predetermined size.

4. The method of claim 1 further comprising the step of:

transmitting the ordered block of transform coefficients on a communications medium as a segment of predetermined size.

5. The method of claim 1 wherein the structuring and generating steps comprise the steps of:

multiplexing a plurality of the transform coefficient blocks and

rank ordering the transform coefficients of a transform coefficient block according to a visibility ordering measure.

6. The method of claim 5 wherein the rank ordering step comprises the step of:

rank ordering the transform coefficients of a transform coefficient block from a highest visibility measure to a lowest visibility measure.

7. The method of claim 6 wherein the rank ordering step comprise the step of:

rank ordering the transform coefficients of a transform coefficient block from a lowest frequency component to a highest frequency component.

8. The method of claim 1 wherein the transforming step comprises the step of:

transforming each respective image block using a discrete cosine transformation methodology.

9. The method of claim 8 wherein the structuring and generating steps comprise the step of:

rank ordering the dct transform coefficients of a dct transform coefficient block from lowest frequency component to highest frequency component.

10. The method of claim 8 wherein the structuring and generating steps comprise the steps of:

multiplexing a plurality of the dct transform coefficient blocks and

rank ordering the dct transform coefficients of a dct transform coefficient block according to a visibility ordering measure.

11. The method of claim 10 wherein the rank ordering step comprises the step of:

rank ordering the dct transform coefficients of a dct transform coefficient block from a highest visibility measure to a lowest visibility measure.

12. The method of claim 11 wherein the rank ordering step comprise the step of:

rank ordering the dct transform coefficients of a dct transform coefficient block from lowest frequency component to highest frequency component.

13. A system for compressing a digital image signal and for decompressing the compressed digital image signal, the system comprising:

means for receiving the image signal;

means for stratifying the received image signal into a plurality of image blocks of predetermined size where each image block includes image data from the image signal for defining a respective portion of the image signal;

means for transforming a respective image block to obtain a corresponding transform coefficient block that includes a corresponding set of transform coefficients, the corresponding transform coefficients being usable for reconstructing a portion of the image signal;

means responsive to a predetermined visibility measure for generating an ordered block of image transform coefficients;

means for providing the ordered block of transform coefficients to a communications medium as a segment of predetermined size;

means for retrieving at least a snatch from an ordered block of transform coefficients from the communications medium; and

means for reconstructing a partial image signal from the snatch of retrieved transform coefficients.

14. The system of claim 13 wherein the generating means comprises:

means for rank ordering the transform coefficients of a transform coefficient block from a highest visibility measure to a lowest visibility measure.

15. The system of claim 13 further comprising:

means for recording the ordered block of transform coefficients on a magnetic medium as a segment of predetermined size.

16. The system of claim 13 further comprising:

means for transmitting the ordered block of transform coefficients on a communications medium as a segment of predetermined size.

17. The system of claim 13 wherein the transforming means comprises:

means for transforming each respective image block using a discrete cosine transformation methodology.

18. The system of claim 17 wherein the generating means comprises:

means for multiplexing a plurality of the dct transform coefficient blocks and

means for rank ordering the dct transform coefficients of a dct transform coefficient block according to a visibility ordering measure.

19. The system of claim 18 wherein the rank ordering means comprises:

means for rank ordering the transform coefficients of a transform coefficient block from a highest visibility measure to a lowest visibility measure.

20. The system of claim 19 wherein the rank ordering means further comprises:

means for rank ordering the transform coefficients of a transform coefficient block from a highest visibility measure, which corresponds to a lowest frequency component, to a lowest visibility measure, which corresponds to a highest frequency component.

21. A method for compressing a digital image signal and for decompressing the compressed digital image signal, the method comprising the steps of:

(a) receiving the image signal;

(b) transforming a plurality of image blocks into a plurality of coefficient blocks, each image block representing a portion of the image and each coefficient block including transform coefficients which are usable to reconstruct the portion of the image represented by the image block;

(c) generating a data set of coefficient blocks;

(d) selecting an i-th transform coefficient from a corresponding i-th position in each coefficient block in the data set;

(e) generating an i-th group of transform coefficients, each transform coefficient in the i-th group of transform coefficients comprising the transform coefficient situated at the i-th position in each coefficient block in the data set;

(f) repeating steps (d) and (e) for each transform coefficient in each coefficient block comprising the data set of coefficient blocks;

(g) rank ordering the respective groups of transform coefficients by applying a visibility measure to each group of selected transform coefficients;

(h) retrieving a snatch from an ordered block of transform coefficients; and

(i) reconstructing a partial image signal from the snatch of retrieved transform coefficients.

22. The method for compressing a digital image signal as defined in claim 21 further comprising the step of:

recording each group of visibility ordered transform coefficients on a magnetic tape medium.

23. The method for compressing a digital image signal as defined in claim 21 further comprising the step of:

quantizing each group of visibility ordered transform coefficients;

Huffman coding the quantized transform coefficients; and

recording each group of visibility ordered transform coefficients on a magnetic tape medium.

24. The method for compressing a digital image signal as defined in claim 21 further comprising the step of:

transmitting each group of visibility ordered transform coefficients to a receiver.

25. A system for compressing a digital image signal and for decompressing the compressed digital image signal comprising:

means for receiving the image signal;

means for transforming a plurality of image blocks into a plurality of coefficient blocks, each image block representing a portion of the image and each coefficient block including transform coefficients which are usable to reconstruct the portion of the image represented by the image block;

means for generating a data set of coefficient blocks;

means for iteratively generating each group of transform coefficients, each transform coefficient in a group of transform coefficients comprising the transform coefficient situated at a respective position in each coefficient block in the data set;

means for rank ordering the respective groups of transform coefficients by applying a visibility measure to each group of selected transform coefficients;

means for retrieving a snatch from an ordered block of transform coefficients; and

means for reconstructing a partial image signal from the snatch of retrieved transform coefficients.

26. The compression system defined in claim 25 further comprising:

means for recording each group of visibility ordered transform coefficients on a magnetic tape medium.

27. The compression system defined in claim 25 further comprising:

means for transmitting each group of visibility ordered transform coefficients to a receiver.

28. A method for reconstructing a partial digital image signal, the method comprising the steps of:

retrieving a snatch of transform coefficients,

the snatch including one or more rank ordered groups of transform coefficients, each group of transform coefficients comprising a plurality of similarly significant transform coefficients, the plurality of similarly significant transform coefficients comprising one similarly significant transform coefficient from each of the plurality of transform coefficient blocks that comprises a data set of coefficient blocks, the group having been rank ordered among a plurality of groups of different similarly significant transform coefficients, the rank ordering being in response to a visibility measure having been applied to the transform coefficients of a transform coefficient block and each transform coefficient block including transform coefficients which are usable to reconstruct a portion of the image represented by an image block corresponding to the inverse transform of the transform coefficient block;

generating a plurality of coefficient blocks equal to the size of the data set;

providing each of the plurality of coefficient blocks with respective and corresponding transform coefficients from the retrieved snatch;

inversely transforming the plurality of generated coefficient blocks to obtain a corresponding plurality of image blocks;

each image block representing a portion of the image and;

generating a reconstruction of the partial image from the plurality of image blocks.

29. A system for reconstructing a partial digital image signal, the system comprising:

means for retrieving a snatch of transform coefficients, the snatch including one or more rank ordered groups of transform coefficients, each group of transform coefficients comprising a plurality of similarly significant transform coefficients, the plurality of similarly significant transform coefficients comprising one similarly significant transform coefficient from each of the plurality of transform coefficient blocks that comprises a data set of coefficient blocks, the group having been rank ordered among a plurality of groups of different similarly significant transform coefficients, the rank ordering being in response to a visibility measure having been applied to the transform coefficients of a transform coefficient block and each transform coefficient block including transform coefficients which are usable to reconstruct a portion of the image represented by an image block corresponding to the inverse transform of the transform coefficient block;

means for generating a plurality of coefficient blocks equal to the size of the data set;

means for providing each of the plurality of coefficient blocks with respective and corresponding transform coefficients from the retrieved snatch;

means for inversely transforming the plurality of generated coefficient blocks to obtain a corresponding plurality of image blocks;

each image block representing a portion of the image and;

means for generating a partial reconstruction of the image from the plurality of image blocks.

30. A method for locating an image that is stored as an image signal on a magnetic tape medium, the method comprising the steps of:

retrieving a first snatch of information from the magnetic tape,

recovering a rank ordered group of transform coefficients from the first snatch of retrieved information, the group of transform coefficients comprising a transform coefficient from each of a plurality of transform coefficient blocks comprising the data set, each transform coefficient of a transform coefficient block having had applied thereto a visibility measure;

inversely transforming the retrieved first snatch of transform coefficients;

generating a plurality of image blocks from the inversely transformed first snatch of retrieved transform coefficients, each image block representing a portion of a retrieved image and each image block including a plurality of image pixels which are usable to reconstruct the portion of the image represented by the image block;

generating a partial image during the reconstruction of the retrieved image from the plurality of image blocks comprising the first snatch of information; and

comparing the retrieved image with the image to be located on the tape.

31. The method defined in claim 30 for locating an image that is stored as an image signal on a magnetic tape medium, the method further comprising the steps of:

retrieving a second snatch of information from the magnetic tape; and

repeating on the second snatch of information those same steps that were performed on the first snatch.

32. The method defined in claim 31 for locating an image that is stored as an image signal on a magnetic tape medium, the method further comprising the steps of:

repeating the retrieving of such additional number of snatches snatch of information from the magnetic tape; and

repeating on each retrieved snatch those same steps that were performed on the second snatch until the comparing step show a match between the retrieved image and the image to be located on the tape whereupon the image to be located on the magnetic tape is deemed to have been located.

33. A system for locating an image that is recoverable from a communications medium as an image signal on the communications medium, the system comprising:

means for retrieving a first snatch of information from the communications medium,

means for recovering a rank ordered group of transform coefficients from the first snatch of retrieved information, the group of transform coefficients comprising a transform coefficient from each of a plurality of transform coefficient blocks comprising the data set, each transform coefficient of a transform coefficient block having had applied thereto a visibility measure;

means for inversely transforming the retrieved first snatch of transform coefficients;

means for generating a plurality of image blocks from the inversely transformed first snatch of retrieved transform coefficients;

means for generating a partial image from the reconstruction of the retrieved image from the plurality of image blocks comprising the first snatch of information; and

means for comparing the retrieved image with the image to be located on the communications medium.

34. The image locating system defined in claim 33 further comprising repeating means, the repeating means including:

retrieving means for retrieving at least a second snatch of information from the communications medium; and

iteratively generating means for repeating on the second snatch of information those same functions that were performed on the first snatch by the image block generating means and the partial reconstruction generating means.

35. The image locating system defined in claim 34 wherein the communications medium is a magnetic tape and wherein the repeating means further comprises:

means for iteratively retrieving additional numbers of snatches of information from the communications medium; and

means for repeating on each retrieved snatch those same functions that were performed on the second snatch until the comparing means shows a match between the retrieved image and the image to be located on the magnetic tape whereupon the image to be located on the magnetic tape is deemed to have been located.

36. The image locating system defined in claim 34 wherein the communications medium is a communication channel and wherein the repeating means further comprises:

means for iteratively retrieving additional numbers of snatches of information from the communications medium; and

means for repeating on each retrieved snatch those same functions that were performed on the second snatch until the comparing means shows a match between the retrieved image and the image to be located on the communications channel whereupon the image to be located on the communication channel is deemed to have been located.