Apparatus and methods for recompression of digital images

• US 9,866,837 B2
• Filed: 09/14/2016
• Issued: 01/09/2018
• Est. Priority Date: 10/05/2009
• Status: Active Grant

• Current Assignee: Beamr Imaging Ltd.
• Original Assignee: Beamr Imaging Ltd.
• Inventors: Carmel, Sharon, Gill, Dror, Shoham, Tamar
• Primary Examiner(s): TSAI, TSUNG YIN
• Application Number:
  US15/265,353
• Publication Number:
  US 20170150149A1
• Time in Patent Office: 482 Days
• CPC Class Codes: H04N 19/124 Quantisation
• CPC Class Codes: H04N 19/126 Details of normalisation or weighting functions, e.g. normalisation matrices or variable uniform quantisers
• CPC Class Codes: H04N 19/136 Incoming video signal characteristics or properties
• CPC Class Codes: H04N 19/14 Coding unit complexity, e.g. amount of activity or edge presence estimation H04N19/146 takes precedence
• CPC Class Codes: H04N 19/154 Measured or subjectively estimated visual quality after decoding, e.g. measurement of distortion use of rate-distortion criteria H04N19/147
• CPC Class Codes: H04N 19/17 the unit being an image region, e.g. an object
• CPC Class Codes: H04N 19/176 the region being a block, e.g. a macroblock
• CPC Class Codes: H04N 19/182 the unit being a pixel
• CPC Class Codes: H04N 19/192 the adaptation method, adaptation tool or adaptation type being iterative or recursive
• CPC Class Codes: H04N 19/50 using predictive coding H04N19/61 takes precedence
• CPC Class Codes: H04N 19/60 using transform coding
• CPC Class Codes: H04N 19/625 using discrete cosine transform [DCT]
• CPC Class Codes: H04N 19/86 involving reduction of coding artifacts, e.g. of blockiness

Abstract

A system and method for generating a second reduced size digital image from a first digital image, the method including iteratively compressing the first digital image to an extent determined by a quality measure comprising at least a blockiness measure quantifying added artifactual edges along coding block boundaries of the second image and/or use of a quantization matrix generated by computing a weighted average of the quantization matrix of the first digital image and a scaled second quantization matrix.

Claims

1. A computerized method of image recompression, comprising:

compressing each individual block in at least one image plane of an image to be re-compressed, including;

JPEG-coding said individual block, using a global quantization matrix, thereby obtaining a proposed output block of integers; and

for at least one individual region in the at least one image plane;

generating a regional compression parameter defining a region-specific level of compression which guarantees no more than a controlled amount of perceptual degradation of said individual region;

generating a regional quantization matrix from said regional compression parameter; and

for at least one particular block in said individual region, determining whether at least one entry in the proposed output block of integers JPEG-coded from said particular block would have been zero if said JPEG-coding step applied to said particular block had used said regional quantization matrix rather than said global quantization matrix, and if so, zeroing said at least one entry.

2. The computerized method according to claim 1, wherein said JPEG-coding comprises DCT-transforming said individual block, quantizing each DCT-transformed individual block by dividing each entry therein by a corresponding entry in the global quantization matrix, thereby obtaining a block of numbers, and rounding said block of numbers to obtain the proposed output block of integers.

3. The computerized method according to claim 1, wherein said regional compression parameter is generated by performing a search, within a set of suitable values for said regional compression parameter, for a suitable parameter value to be used for recompression of said individual region.

4. The computerized method according to claim 3, wherein said search is performed for at least one first region and subsequently for at least one additional region adjacent to said at least one first region and wherein, when the search is performed for said additional region, a suitable value of said set of suitable values initiating the search is based at least partly on a final regional compression parameter value generated by said search for said at least one first region.

5. The computerized method according to claim 4, wherein said at least one first region comprises a region adjacent to said additional region along a row and a region adjacent to said additional region along a column and wherein said suitable value initiating the search is based at least partly on combining final regional compression parameter values generated by said search for said regions adjacent along said row and said column.

6. The computerized method according to claim 3, wherein said performing includes selecting one parameter value in said set over at least one other parameter value which is found to be less suited for recompression of said region.

7. The computerized method according to claim 1, wherein said regional compression parameter comprises an MQF value.

8. The computerized method according to claim 1 further comprising computing said region-specific level of compression, for a first region comprising a plurality of blocks, including:

compressing the first region giving rise to a second region, using a current level of compression;

using a measure of added artifactual edges along coding block boundaries to compute a region quality score for said first region;

comparing said region quality score to a desired quality threshold, including increasing or decreasing said current level of compression if said region quality score is respectively higher or lower than said quality threshold and returning to said compressing of the first region including using said increased or decreased level of compression as a current level; and

using said current level of compression as said region-specific level of compression if said region quality score is predetermined to be close to said quality threshold.

9. The computerized method according to claim 8, wherein said using a measure comprises:

computing a difference image between the first and second images;

within said first region, computing for each boundary between two coding blocks a respective added-blockiness score indicating an extent of added artifactual edges along the respective boundary; and

computing a region quality score based on the added-blockiness scores computed for each boundary within the first region.

10. The computerized method according to claim 9 wherein said measure is also based on a computation of local similarity and texture.

11. The computerized method according to claim 8 wherein said measure is based on a computation of local similarity and texture.

12. A computerized system of image recompression, comprising a processor operatively connected to a memory, the processor configured to:

compress each individual block in at least one image plane of an image to be re-compressed, including;

JPEG-code said individual block, using a global quantization matrix, thereby obtaining a proposed output block of integers; and

for at least one individual region in the at least one image plane;

generate a regional compression parameter defining a region-specific level of compression which guarantees no more than a controlled amount of perceptual degradation of said individual region;

generate a regional quantization matrix from said regional compression parameter; and

for at least one particular block in said individual region, determine whether at least one entry in the proposed output block of integers JPEG-coded from said particular block would have been zero if said JPEG-coding step applied to said particular block had used said regional quantization matrix rather than said global quantization matrix, and if so, zero said at least one entry.

13. The computerized system according to claim 12, wherein said JPEG-coding comprises DCT-transforming said individual block, quantizing each DCT-transformed individual block by dividing each entry therein by a corresponding entry in the global quantization matrix, thereby obtaining a block of numbers, and rounding said block of numbers to obtain the proposed output block of integers.

14. The computerized system according to claim 12, wherein the processor is configured to generate said regional compression parameter by performing a search, within a set of suitable values for said regional compression parameter, for a suitable parameter value to be used for recompression of said individual region.

15. The computerized system according to claim 14, wherein said search is performed for at least one first region and subsequently for at least one additional region adjacent to said at least one first region and wherein, when the search is performed for said additional region, a suitable value of said set of suitable values initiating the search is based at least partly on a final regional compression parameter value generated by said search for said at least one first region.

16. The computerized system according to claim 15, wherein said at least one first region comprises a region adjacent to said additional region along a row and a region adjacent to said additional region along a column and wherein said suitable value initiating the search is based at least partly on combining final regional compression parameter values generated by said search for said regions adjacent along said row and said column.

17. The computerized system according to claim 14, wherein said search is performed by selecting one parameter value in said set over at least one other parameter value which is found to be less suited for recompression of said region.

18. The computerized system according to claim 12, wherein said regional compression parameter comprises an MQF value.

19. The computerized system according to claim 12, wherein the processor is further configured to compute said region-specific level of compression, for a first region comprising a plurality of blocks, including:

compress the first region giving rise to a second region, using a current level of compression;

use a measure of added artifactual edges along coding block boundaries to compute a region quality score for said first region;

compare said region quality score to a desired quality threshold, including increase or decrease said current level of compression if said region quality score is respectively higher or lower than said quality threshold and return to said compressing of the first region including using said increased or decreased level of compression as a current level; and

use said current level of compression as said region-specific level of compression if said region quality score is predetermined to be close to said quality threshold.

20. The computerized system according to claim 19, wherein said using a measure comprises:

computing a difference image between the first and second images;

within said first region, computing for each boundary between two coding blocks a respective added-blockiness score indicating an extent of added artifactual edges along the respective boundary; and

computing a region quality score based on the added-blockiness scores computed for each boundary within the first region.

21. The computerized system according to claim 20 wherein said measure is also based on a computation of local similarity and texture.

22. The computerized system according to claim 19 wherein said measure is based on a computation of local similarity and texture.

23. A non-transitory computer readable storage medium tangibly embodying a program of instructions executable by a computer to perform a method of image recompression, comprising the steps:

compressing each individual block in at least one image plane of an image to be re-compressed, including;

JPEG-coding said individual block, using a global quantization matrix, thereby obtaining a proposed output block of integers; and

for at least one individual region in the at least one image plane;

generating a regional compression parameter defining a region-specific level of compression which guarantees no more than a controlled amount of perceptual degradation of said individual region;

generating a regional quantization matrix from said regional compression parameter; and

for at least one particular block in said individual region, determining whether at least one entry in the proposed output block of integers JPEG-coded from said particular block would have been zero if said JPEG-coding step applied to said particular block had used said regional quantization matrix rather than said global quantization matrix, and if so, zeroing said at least one entry.