Compression and decompression method of image data

• US 20050012645A1
• Filed: 08/11/2003
• Published: 01/20/2005
• Est. Priority Date: 08/12/2002
• Status: Active Grant

• Current Assignee: Yamaha Corporation
• Original Assignee: Yamaha Corporation
• Inventors: Funakubo, Noriyuki
• Granted Patent: US 7,248,735 B2
• Time in Patent Office: Days
• US Class Current: 341/50
• CPC Class Codes: H04N 19/129 Scanning of coding units, e.g. zig-zag scan of transform coefficients or flexible macroblock ordering [FMO]
• CPC Class Codes: H04N 19/15 by monitoring actual compressed data size at the memory before deciding storage at the transmission buffer
• CPC Class Codes: H04N 19/42 characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation H04N19/635 takes precedence
• CPC Class Codes: H04N 19/63 using sub-band based transform, e.g. wavelets

Abstract

A compressing method of image data is carried out by a first process of dividing the image data into a plurality of blocks, a second process of linearly scanning the image data within the block by a given scan method defining a pattern of linearly scanning the image data of the block so as to arrange the image data in series, and a third process of compressing the arranged image data so as to reduce an amount of the image data of the block. The second process and the third process are repeatedly applied to the same block with using different scan methods defining different patterns of linearly scanning the image data, then an optimum one of the different scan methods is selected, which succeeds in most reducing the amount of the image data, and the compressed image data arranged by the selected scan method is outputted together with indication of the selected scan method.

Claims

1. A method of compressing image data comprising:

a first process of dividing the image data into a plurality of blocks;

a second process of linearly scanning the image data within the block by a given scan method defining a pattern of linearly scanning the image data of the block so as to arrange the image data in series; and

a third process of compressing the arranged image data so as to reduce an amount of the image data of the block, wherein

the second process and the third process are repeatedly applied to the same block with using different scan methods defining different patterns of linearly scanning the image data, then an optimum one of the different scan methods is selected, which succeeds in most reducing the amount of the image data, and the compressed image data arranged by the selected scan method is outputted together with indication of the selected scan method.

2. The method according to claim 1, further comprising a conversion process performed between the first process and the second process for converting a format of the image data from an initial RGB format to a YUV format suitable for the compressing performed by the third process.

3. The method according to claim 1, wherein the third process includes a wavelet transform process for applying a wavelet transform to the image data arranged in series.

4. The method according to claim 3, wherein the third process further includes a quantizing process for performing quantization of the image data after the wavelet transform, a differential process for performing differential operation of the image data after the quantization, and a coding process for performing coding of the image data after the differential operation.

5. A method of applying either of a reversible compression and an irreversible compression to image data in response to a compressing instruction, the method comprising:

a first process of dividing the image data into a plurality of blocks;

a second process of linearly scanning the image data within the block by a given scan method defining a pattern of linearly scanning the image data of the block so as to arrange the image data in series;

a third process of applying a wavelet transform to the image data obtained by the second process;

a fourth process of performing quantization of the image data after the wavelet transform;

a fifth process of performing differential operation of the image data after the quantization; and

a sixth process of performing coding of the image data after the differential operation, wherein

the method responds when the compressing instruction indicates the irreversible compression for repeatedly applying the first process through sixth process to the same block so as to reduce an amount of the image data by the irreversible compression while using different scan methods defining different patterns of linearly scanning the image data, then selecting an optimum one of the different scan methods, which succeeds in most reducing the amount of the image data, and outputting the irreversibly compressed image data after arranged by the selected scan method together with indication of the selected scan method, and wherein

the method responds when the compressing instruction indicates the reversible compression for repeatedly applying the first process, second process, fifth process and sixth process to the same block with skipping the third process and fourth process so as to reduce an amount of the image data by the reversible compression while using different scan methods defining different patterns of linearly scanning the image data, then selecting an optimum one of the different scan methods, which succeeds in most reducing the amount of the image data, and outputting the reversibly compressed image data after arranged by the selected scan method together with indication of the selected scan method.

6. The method according to claim 5, further comprising a conversion process performed between the first process and the second process for converting a format of the image data from an initial RGB format to a YUV format suitable for the wavelet transform.

7. The method according to claim 5, further comprising a threshold process performed between the fourth process and the fifth process for thresholding the image data representing a plurality of numerical values such as to replace each numerical value less than a predetermined threshold value by the 0 value.

8. The method according to claim 5, further comprising a process of creating mask data which defines a mask pattern corresponding to a portion of the image data requiring the reversible compression, wherein the method applies the first process, second process, fifth process and sixth process to the mask data so as to reduce an amount of the mask data by the reversible compression, and outputs the reversibly compressed mask data together with the compressed image data.

9. The method according to claim 5, wherein the sixth process performs the coding on the image data containing a continuous series of 0 data such that the continuous series of the 0 data is replaced by a combination of a first specific code indicating the continuous series of the 0 data and a number of the 0 data constituting the continuous series.

10. The method according to claim 5, wherein the sixth process performs the coding on the image data containing a short continuous series of 0 data where a number of 0 data is not more than a reference zero run length and a long continuous series of 0 data where a number of 0 data is more than the reference zero run length, such that the short continuous series is replaced by a combination of a first specific code indicating the short continuous series and the number of the 0 data thereof denoted by a reduced bit length, and the long continuous series is replaced by a combination of the first specific code with an additional code discriminating the long continuous series from the short continuous series and the number of the 0 data thereof denoted by a bit length longer than the reduced bit length.

11. The method according to claim 10, wherein the sixth process performs the coding on the image data while changing the reference zero run length so as to detect an optimum reference zero run length, by which the amount of the image data is most reduced.

12. The method according to claim 5, wherein the sixth process performs the coding on the image data arranged in the series containing a preceding data and a succeeding data which is immediately after the preceding data and which has an absolute value identical to that of the preceding data, such that the succeeding data is replaced by a combination of a second specific code indicating that the absolute value of the succeeding data is identical to that of the preceding data and a sign bit indicating a sign of the succeeding data.

13. The method according to claim 5, wherein the sixth process performs the coding on the image data containing an insignificant data having a small value not more than a reference value and a significant data having a great value more than the reference value, such that the insignificant data is replaced by a combination of a third specific code indicating the insignificant data and the small value thereof denoted by a reduced bit length, and the significant data is replaced by a combination of a fourth specific code indicating the significant data and the great value thereof denoted by a bit length longer than the reduced bit length.

14. The method according to claim 13, wherein the sixth process performs the coding on the image data while changing the reference value so as to detect an optimum reference value, by which the amount of the image data is most reduced.

15. A decompression apparatus for decompressing image data which is provided in a compressed form together with indication of a scan method applied to the image data, which is compressed by a dividing process of dividing the image data into a plurality of blocks, a scanning process of linearly scanning the image data within the block by a given scan method defining a pattern of linearly scanning the image data of the block so as to arrange the image data in series, and a compressing process of compressing the arranged image data so as to reduce an amount of the image data of the block, wherein the scanning process and the compressing process are repeatedly applied to the same block with using different scan methods defining different patterns of linearly scanning the image data, then an optimum one of the different scan methods is selected, which succeeds in most reducing the amount of the image data, and the compressed image data arranged by the selected scan method is provided together with indication of the selected scan method, the apparatus comprising:

a decompressing section that decompresses the image data by reversely performing the compressing process;

a rearranging section that rearranges the series of the decompressed image data by an order reverse to that defined by the selected scanning method so as to restore each of the blocks; and

a storing section that collectively stores the restored blocks of the image data.

16. The decompression apparatus according to claim 15, wherein the compression process includes a quantizing process for performing quantization of the image data, and wherein the decompressing section decompresses the image data by reversely performing the quantizing process on the image data.

17. The decompression apparatus according to claim 16, wherein the compression process further includes a wavelet transform process for applying a wavelet transform to the image data, and wherein the decompressing section decompresses the image data by reversely performing the wavelet transform on the image data.

18. A decompression apparatus for decompressing image data which is provided in a compressed form together with indication of a scan method and a compressing instruction applied to the image data, which has been compressed by a compression method comprising a dividing process of dividing the image data into a plurality of blocks, a scanning process of linearly scanning the image data within the block by a given scan method defining a pattern of linearly scanning the image data of the block so as to arrange the image data in series, a transform process of applying a wavelet transform to the image data obtained by the scanning process, a quantizing process of performing quantization of the image data after the wavelet transform, a differential process of performing differential operation of the image data after the quantization, and a coding process of performing coding of the image data after the differential operation, wherein the compression method responds when the compressing instruction indicates an irreversible compression for repeatedly applying the dividing process, scanning process, transform process, quantizing process, differential process and coding process to the same block so as to reduce an amount of the image data by the irreversible compression while using different scan methods defining different patterns of linearly scanning the image data, then selecting an optimum one of the different scan methods, which succeeds in most reducing the amount of the image data, and outputting the irreversibly compressed image data after arranged by the selected scan method together with indication of the selected scan method, and wherein the compression method responds when the compressing instruction indicates a reversible compression for repeatedly applying the dividing process, scanning process, differential process and coding process to the same block with skipping the transform process and quantizing process so as to reduce an amount of the image data by the reversible compression while using different scan methods defining different patterns of linearly scanning the image data, then selecting an optimum one of the different scan methods, which succeeds in most reducing the amount of the image data, and outputting the reversibly compressed image data after arranged by the selected scan method together with indication of the selected scan method, the decompression apparatus comprising:

a first decoding section that decodes the image data by reversely performing the coding applied to the compressed image data;

an adding section that performs adding operation of the decoded image data to remove the differential operation applied to the image data;

a second decoding section being operative when the compressing instruction indicates that the image data has been irreversibly compressed for performing a reverse quantization and a reverse wavelet transform to the image data fed from the adding section so as to decompress the image data, and being operative when the compressing instruction indicates that the image data has been reversibly compressed for applying no operation to the image data fed from the adding section;

a rearranging section that rearranges the series of the image data fed from the second decoding section by an order reverse to that defined by the selected scanning method so as to restore each of the blocks; and

a storing section that stores each of the restored blocks to thereby obtain an expanded form of the compressed image data.

19. The decompression apparatus according to claim 18, wherein the compression method further comprises a conversion process performed between the dividing process and the scanning process for converting a format of the image data from an initial RGB format to a YUV format suitable for the wavelet transform, the decompression apparatus further comprising a converting section that converts back the YUV format of the image data fed from the second decoding section into the initial RGB format, and that provides the image data of the RGB format to the storing section.

20. The decompression apparatus according to claim 18, wherein the coding process has performed the coding on the image data containing a continuous series of 0 data such that the continuous series of the 0 data has been replaced by a combination of a first specific code indicating the continuous series of the 0 data and an additional data indicating a number of the 0 data constituting the continuous series, and wherein the first decoding section operates when the first specific code is detected in the compressed image data for restoring the continuous series of the 0 data having the number of the 0 data indicated by the additional data.

21. The decompression apparatus according to claim 18, wherein the coding process has performed the coding on the image data containing a short continuous series of 0 data where a number of 0 data is not more than a reference zero run length and a long continuous series of 0 data where a number of 0 data is more than the reference zero run length, such that the short continuous series has been replaced by a combination of a first specific code indicating the short continuous series and an additional data denoting the number of the 0 data by a reduced bit length, and the long continuous series has been replaced by a combination of the first specific code with an additional code discriminating the long continuous series from the short continuous series and an additional data denoting the number of the 0 data by a bit length longer than the reduced bit length, and wherein the first decoding section operates when the first specific code is detected in the compressed image data for restoring the short continuous series of the 0 data having the number of the 0 data indicated by the additional data, and the first decoding section operates when the first specific code attached with the additional code is detected in the compressed image data for restoring the long continuous series of the 0 data having the number of the 0 data indicated by the additional data.

22. The decompression apparatus according to claim 18, wherein the coding process has performed the coding on the image data arranged in the series containing a preceding data and a succeeding data which is immediately after the preceding data and which has an absolute value identical to that of the preceding data, such that the succeeding data is replaced by a combination of a second specific code indicating that the absolute value of the succeeding data is identical to that of the preceding data and a sign bit indicating a sign of the succeeding data, and wherein the first decoding section operates when the second specific code is detected together with the sign bit after the preceding data in the compressed image data for restoring the succeeding data having the absolute value identical to that of the preceding data and having the sign indicated by the sign bit.

23. The decompression apparatus according to claim 18, wherein the coding process has performed the coding on the image data containing an insignificant data having a small value not more than a reference value and a significant data having a great value more than the reference value, such that the insignificant data is replaced by a combination of a third specific code indicating the insignificant data and an additional data denoting the small value thereof by a reduced bit length, and the significant data is replaced by a combination of a fourth specific code indicating the significant data and an additional data denoting the great value thereof by a bit length longer than the reduced bit length, and wherein the first decoding section operates when the third specific code is detected together with the additional data for restoring the insignificant data having the small value denoted by the additional data, and the first decoding section operates when the fourth specific code is detected together with the additional data for restoring the significant data having the great value denoted by the additional data.

24. A decompression program executable in a decompression apparatus for decompressing image data which is provided in a compressed form together with indication of a scan method applied to the image data, which has been compressed by a dividing process of dividing the image data into a plurality of blocks, a scanning process of linearly scanning the image data within the block by a given scan method defining a pattern of linearly scanning the image data of the block so as to arrange the image data in series, and a compressing process of compressing the arranged image data so as to reduce an amount of the image data of the block, wherein the scanning process and the compressing process are repeatedly applied to the same block with using different scan methods defining different patterns of linearly scanning the image data, then an optimum one of the different scan methods is selected, which succeeds in most reducing the amount of the image data, and the compressed image data arranged by the selected scan method is provided together with indication of the selected scan method, the decompression program being executed to perform a decompression method comprising:

a decompressing process for decompressing the image data by reversely performing the compressing process;

a rearranging process for rearranging the series of the decompressed image data by an order reverse to that defined by the selected scanning method so as to restore each of the blocks; and

a storing process for collectively storing the restored blocks of the image data.

25. The decompression program according to claim 24, wherein the compression process includes a quantizing process for performing quantization of the image data, and wherein the decompressing process decompresses the image data by reversely performing the quantizing process on the image data.

26. The decompression program according to claim 25, wherein the compression process further includes a wavelet transform process for applying a wavelet transform to the image data, and wherein the decompressing process decompresses the image data by reversely performing the wavelet transform on the image data.

27. A decompression program executable in a decompression apparatus for decompressing image data which is provided in a compressed form together with indication of a scan method and a compressing instruction applied to the image data, which has been compressed by a compression method comprising a dividing process of dividing the image data into a plurality of blocks, a scanning process of linearly scanning the image data within the block by a given scan method defining a pattern of linearly scanning the image data of the block so as to arrange the image data in series, a transform process of applying a wavelet transform to the image data obtained by the scanning process, a quantizing process of performing quantization of the image data after the wavelet transform, a differential process of performing differential operation of the image data after the quantization, and a coding process of performing coding of the image data after the differential operation, wherein the compression method responds when the compressing instruction indicates an irreversible compression for repeatedly applying the dividing process, scanning process, transform process, quantizing process, differential process and coding process to the same block so as to reduce an amount of the image data by the irreversible compression while using different scan methods defining different patterns of linearly scanning the image data, then selecting an optimum one of the different scan methods, which succeeds in most reducing the amount of the image data, and outputting the irreversibly compressed image data after arranged by the selected scan method together with indication of the selected scan method, and wherein the compression method responds when the compressing instruction indicates a reversible compression for repeatedly applying the dividing process, scanning process, differential process and coding process to the same block with skipping the transform process and quantizing process so as to reduce an amount of the image data by the reversible compression while using different scan methods defining different patterns of linearly scanning the image data, then selecting an optimum one of the different scan methods, which succeeds in most reducing the amount of the image data, and outputting the reversibly compressed image data after arranged by the selected scan method together with indication of the selected scan method, the decompression program being executable to perform a decompression method comprising:

a first decoding process for decoding the image data by reversely performing the coding applied to the compressed image data;

an adding process for performing adding operation of the decoded image data to remove the differential operation applied to the image data;

a second decoding process being commenced when the compressing instruction indicates that the image data has been irreversibly compressed for performing a reverse quantization and a reverse wavelet transform to the image data fed from the adding process so as to decompress the image data, and being commenced when the compressing instruction indicates that the image data has been reversibly compressed for applying no operation to the image data fed from the adding process;

a rearranging process for rearranging the series of the image data fed from the second decoding process by an order reverse to that defined by the selected scanning method so as to restore each of the blocks; and

a storing process for storing each of the restored blocks to thereby obtain an expanded form of the compressed image data.

28. The decompression program according to claim 27, wherein the compression method further comprises a conversion process performed between the dividing process and the scanning process for converting a format of the image data from an initial RGB format to a YUV format suitable for the wavelet transform, and wherein the decompression method further comprises a converting process for converting back the YUV format of the image data fed from the second decoding process into the initial RGB format, and for providing the image data of the RGB format to the storing process.

29. The decompression program according to claim 27, wherein the coding process has performed the coding on the image data containing a continuous series of 0 data such that the continuous series of the 0 data has been replaced by a combination of a first specific code indicating the continuous series of the 0 data and an additional data indicating a number of the 0 data constituting the continuous series, and wherein the first decoding process is performed when the first specific code is detected in the compressed image data for restoring the continuous series of the 0 data having the number of the 0 data indicated by the additional data.

30. The decompression program according to claim 27, wherein the coding process has performed the coding on the image data containing a short continuous series of 0 data where a number of 0 data is not more than a reference zero run length and a long continuous series of 0 data where a number of 0 data is more than the reference zero run length, such that the short continuous series has been replaced by a combination of a first specific code indicating the short continuous series and an additional data denoting the number of the 0 data by a reduced bit length, and the long continuous series has been replaced by a combination of the first specific code with an additional code discriminating the long continuous series from the short continuous series and an additional data denoting the number of the 0 data by a bit length longer than the reduced bit length, and wherein the first decoding process is performed when the first specific code is detected in the compressed image data for restoring the short continuous series of the 0 data having the number of the 0 data indicated by the additional data, and the first decoding process is performed when the first specific code attached with the additional code is detected in the compressed image data for restoring the long continuous series of the 0 data having the number of the 0 data indicated by the additional data.

31. The decompression apparatus according to claim 27, wherein the coding process has performed the coding on the image data arranged in the series containing a preceding data and a succeeding data which is immediately after the preceding data and which has an absolute value identical to that of the preceding data, such that the succeeding data is replaced by a combination of a second specific code indicating that the absolute value of the succeeding data is identical to that of the preceding data and a sign bit indicating a sign of the succeeding data, and wherein the first decoding process is performed when the second specific code is detected together with the sign bit after the preceding data in the compressed image data for restoring the succeeding data having the absolute value identical to that of the preceding data and having the sign indicated by the sign bit.

32. The decompression program according to claim 27, wherein the coding process has performed the coding on the image data containing an insignificant data having a small value not more than a reference value and a significant data having a great value more than the reference value, such that the insignificant data is replaced by a combination of a third specific code indicating the insignificant data and an additional data denoting the small value thereof by a reduced bit length, and the significant data is replaced by a combination of a fourth specific code indicating the significant data and an additional data denoting the great value thereof by a bit length longer than the reduced bit length, and wherein the first decoding process is performed when the third specific code is detected together with the additional data for restoring the insignificant data having the small value denoted by the additional data, and the first decoding process is performed when the fourth specific code is detected together with the additional data for restoring the significant data having the great value denoted by the additional data.

33. A decompression method for decompressing image data which is provided in a compressed form together with indication of a scan method applied to the image data, which has been compressed by a dividing process of dividing the image data into a plurality of blocks, a scanning process of linearly scanning the image data within the block by a given scan method defining a pattern of linearly scanning the image data of the block so as to arrange the image data in series, and a compressing process of compressing the arranged image data so as to reduce an amount of the image data of the block, wherein the scanning process and the compressing process are repeatedly applied to the same block with using different scan methods defining different patterns of linearly scanning the image data, then an optimum one of the different scan methods is selected, which succeeds in most reducing the amount of the image data, and the compressed image data arranged by the selected scan method is provided together with indication of the selected scan method, the decompression method comprising:

a decompressing process for decompressing the image data by reversely performing the compressing process;

a rearranging process for rearranging the series of the decompressed image data by an order reverse to that defined by the selected scanning method so as to restore each of the blocks; and

a storing process for collectively storing the restored blocks of the image data.

34. A decompression method for decompressing image data which is provided in a compressed form together with indication of a scan method and a compressing instruction applied to the image data, which has been compressed by a compression method comprising a dividing process of dividing the image data into a plurality of blocks, a scanning process of linearly scanning the image data within the block by a given scan method defining a pattern of linearly scanning the image data of the block so as to arrange the image data in series, a transform process of applying a wavelet transform to the image data obtained by the scanning process, a quantizing process of performing quantization of the image data after the wavelet transform, a differential process of performing differential operation of the image data after the quantization, and a coding process of performing coding of the image data after the differential operation, wherein the compression method responds when the compressing instruction indicates an irreversible compression for repeatedly applying the dividing process, scanning process, transform process, quantizing process, differential process and coding process to the same block so as to reduce an amount of the image data by the irreversible compression while using different scan methods defining different patterns of linearly scanning the image data, then selecting an optimum one of the different scan methods, which succeeds in most reducing the amount of the image data, and outputting the irreversibly compressed image data after arranged by the selected scan method together with indication of the selected scan method, and wherein the compression method responds when the compressing instruction indicates a reversible compression for repeatedly applying the dividing process, scanning process, differential process and coding process to the same block with skipping the transform process and quantizing process so as to reduce an amount of the image data by the reversible compression while using different scan methods defining different patterns of linearly scanning the image data, then selecting an optimum one of the different scan methods, which succeeds in most reducing the amount of the image data, and outputting the reversibly compressed image data after arranged by the selected scan method together with indication of the selected scan method, the decompression method comprising:

a first decoding process for decoding the image data by reversely performing the coding applied to the compressed image data;

an adding process for performing adding operation of the decoded image data to remove the differential operation applied to the image data;

a second decoding process being commenced when the compressing instruction indicates that the image data has been irreversibly compressed for performing a reverse quantization and a reverse wavelet transform to the image data fed from the adding process so as to decompress the image data, and being commenced when the compressing instruction indicates that the image data has been reversibly compressed for applying no operation to the image data fed from the adding process;

a rearranging process for rearranging the series of the image data fed from the second decoding process by an order reverse to that defined by the selected scanning method so as to restore each of the blocks; and

a storing process for storing each of the restored blocks to thereby obtain an expanded form of the compressed image data.