Region based processing

• US 10,453,221 B2
• Filed: 04/10/2017
• Issued: 10/22/2019
• Est. Priority Date: 04/10/2017
• Status: Active Grant

• Current Assignee: Intel Corporation
• Original Assignee: Intel Corporation
• Inventors: Kambhatla, Srikanth, Parikh, Kunjal, Wang, Changliang, Smith, Gary
• Primary Examiner(s): Niu, Feng
• Application Number:
  US15/483,854
• Publication Number:
  US 20180293757A1
• Time in Patent Office: 925 Days
• Field of Search: None
• CPC Class Codes: G06T 1/20 Processor architectures; Processor configuration, e.g. pipelining
• CPC Class Codes: G06T 2207/10024 Color image
• CPC Class Codes: G06T 7/11 Region-based segmentation
• CPC Class Codes: G06T 7/136 involving thresholding
• CPC Class Codes: G06T 7/194 involving foreground-background segmentation
• CPC Class Codes: G06T 9/00 Image coding bandwidth or redundancy reduction for static pictures H04N1/41; coding or decoding of static colour picture signals H04N1/64; methods or arrangements for coding, decoding, compressing or decompressing digital video signals H04N19/00
• CPC Class Codes: H04N 19/115 Selection of the code volume for a coding unit prior to coding
• CPC Class Codes: H04N 19/136 Incoming video signal characteristics or properties
• CPC Class Codes: H04N 19/146 Data rate or code amount at the encoder output
• CPC Class Codes: H04N 19/167 Position within a video image, e.g. region of interest [ROI]
• CPC Class Codes: H04N 19/17 the unit being an image region, e.g. an object
• CPC Class Codes: H04N 19/176 the region being a block, e.g. a macroblock
• CPC Class Codes: H04N 19/186 the unit being a colour or a chrominance component
• CPC Class Codes: H04N 19/42 characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation H04N19/635 takes precedence
• CPC Class Codes: H04N 19/98 Adaptive-dynamic-range coding [ADRC]

Abstract

Systems, apparatuses and methods may provide for technology that partitions a high dynamic range (HDR) image into a plurality of regions and determines, on a per region basis, a luminance level of the HDR image. Additionally, the technology may select, on the per image basis, a encoding amount for each region in the plurality of regions based on the luminance level.

Claims

1. A computing system comprising:

a transmitter, implemented in one or more of configurable logic or fixed-functionality hardware logic, to output a high dynamic range (HDR) image;

a memory storing a set of instructions; and

a processor, wherein when executed by the processor, the instructions cause the system to;

partition the HDR image into a plurality of regions including brighter regions and darker regions that are each darker than the brighter regions,

determine, on a per region basis, a luminance level of the HDR image, wherein the luminance levels of the brighter regions are greater than the luminance levels of the darker regions,

select, on the per region basis, an encoding amount for each region in the plurality of regions through

an increase in the encoding amount when the luminance level is identified as being not greater than a first threshold, wherein the increased encoding amount is to increase image compression, and

a decrease in the encoding amount when the luminance level is identified as being greater than a second threshold, wherein the second threshold is to be greater than the first threshold, wherein the decreased encoding amount is to decrease image compression,

wherein the encoding amounts of the brighter regions are less than the encoding amounts of the darker regions.

2. The computing system of claim 1, further including a codec to encode the brighter regions in the plurality of regions at the encoding amounts of the brighter regions and encode the darker regions in the plurality of regions at the encoding amounts of the darker regions.

3. The computing system of claim 1, wherein the instructions, when executed, cause the computing system to:

detect one or more foreground regions in the plurality of regions; and

decrease the encoding amount in the one or more foreground regions, wherein the decreased encoding amount in the one or more foreground regions is to decrease image compression in the one or more foreground regions.

4. The computing system of claim 1, wherein the instructions, when executed, cause the computing system to:

detect one or more background regions in the plurality of regions; and

increase the encoding amount in the one or more background regions, wherein the increased encoding amount in the one or more background regions is to increase image compression in the one or more background regions.

5. The computing system of claim 1, wherein the instructions, when executed, cause the computing system to:

generate a luminance histogram for the HDR image, wherein the luminance histogram is to identify a first percentage of a first region from the plurality of regions as falling into a first luminance bin and a second percentage of the first region falling into a second luminance bin;

determine that the first percentage is greater than the second percentage; and

determine that the luminance level of the first region is the first luminance bin based on the first percentage being greater than the second percentage.

6. The computing system of claim 1, wherein the processor is to:

determine, on the per region basis, that the encoding amount is to remain unmodified when the luminance level is identified as being both greater than the first threshold, and less than the second threshold; and

identify, on the per region basis, a quantization parameter for each region in the plurality of regions based on the encoding amount, wherein the quantization parameters of the brighter regions are different from the quantization parameters of the darker regions.

7. An apparatus comprising:

a substrate; and

logic coupled to the substrate, wherein the logic is implemented in one or more of configurable logic or fixed-functionality hardware logic, the logic to;

partition a high dynamic range (HDR) image into a plurality of regions including brighter regions and darker regions that are each darker than the brighter regions;

determine, on a per region basis, a luminance level of the HDR image, wherein the luminance levels of the brighter regions are greater than the luminance levels of the darker regions;

select, on the per region basis, an encoding amount for each region in the plurality of regions through

an increase in the encoding amount when the luminance level is identified as being not greater than a first threshold, wherein the increased encoding amount is to increase image compression, and

a decrease in the encoding amount when the luminance level is identified as being greater than a second threshold, wherein the second threshold is to be greater than the first threshold, wherein the decreased encoding amount is to decrease image compression,

wherein the encoding amounts of the brighter regions are less than the encoding amounts of the darker regions.

8. The apparatus of claim 7, wherein the logic is to:

encode the brighter regions in the plurality of regions at the encoding amounts of the brighter regions; and

encode the darker regions in the plurality of regions at the encoding amounts of the darker regions.

9. The apparatus of claim 7, wherein the logic is to:

detect one or more foreground regions in the plurality of regions; and

decrease the encoding amount in the one or more foreground regions, wherein the decreased encoding amount in the one or more foreground regions is to decrease image compression in the one or more foreground regions.

10. The apparatus of claim 7, wherein the logic is to:

detect one or more background regions in the plurality of regions; and

increase the encoding amount in the one or more background regions, wherein the increased encoding amount in the one or more background regions is to increase image compression in the one or more background regions.

11. The apparatus of claim 7, wherein the logic is to generate a luminance histogram for the HDR image, wherein the luminance histogram is to identify a first percentage of a first region from the plurality of regions as falling into a first luminance bin and a second percentage of the first region falling into a second luminance bin;

determine that the first percentage is greater than the second percentage; and

determine that the luminance level of the first region is the first luminance bin based on the first percentage being greater than the second percentage.

12. The apparatus of claim 7, wherein the logic is to:

determine, on the per region basis, that the encoding amount is to remain unmodified when the luminance level is identified as being both greater than the first threshold, and less than the second threshold; and

identify, on the per region basis, a quantization parameter for each region in the plurality of regions based on the encoding amount, wherein the quantization parameters of the brighter regions are different from the quantization parameters of the darker regions.

13. A method comprising:

partitioning a high dynamic range (HDR) image into a plurality of regions including brighter regions and darker regions that are each darker than the brighter regions;

determining, on a per region basis, a luminance level of the HDR image, wherein the luminance levels of the brighter regions are greater than the luminance levels of the darker regions;

selecting, on the per region basis, an encoding amount for each region in the plurality of regions through

an increase in the encoding amount when the luminance level is identified as being not greater than a first threshold, wherein the increased encoding amount is to increase image compression, and

a decrease in the encoding amount when the luminance level is identified as being greater than a second threshold, wherein the second threshold is to be greater than the first threshold, wherein the decreased encoding amount is to decrease image compression,

wherein the encoding amounts of the brighter regions are less than the encoding amounts of the darker regions.

14. The method of claim 13, further including:

encoding the brighter regions in the plurality of regions at the encoding amounts of the brighter regions; and

encoding the darker regions in the plurality of regions at the encoding amounts of the darker regions.

15. The method of claim 13, further including:

detecting one or more foreground regions in the plurality of regions; and

decreasing the encoding amount in the one or more foreground regions, wherein the decreased encoding amount in the one or more foreground regions decreases image compression in the one or more foreground regions.

16. The method of claim 13, further including:

detecting one or more background regions in the plurality of regions; and

increasing the encoding amount in the one or more background regions, wherein the increased encoding amount in the one or more background regions increases image compression in the one or more background regions.

17. The method of claim 13, wherein determining the luminance level includes generating a luminance histogram for the HDR image, wherein the luminance histogram is to identify a first percentage of a first region from the plurality of regions as falling into a first luminance bin and a second percentage of the first region falling into a second luminance bin;

determining that the first percentage is greater than the second percentage; and

determining that the luminance level of the first region is the first luminance bin based on the first percentage being greater than the second percentage.

18. The method of claim 13, further including:

determining, on the per region basis, that the encoding amount is to remain unmodified when the luminance level is identified as being both greater than the first threshold, and less than the second threshold; and

identifying, on the per region basis, a quantization parameter for each region in the plurality of regions based on the encoding amount, wherein the quantization parameters of the brighter regions are different from the quantization parameters of the darker regions.

19. At least one computer readable storage medium storing a set of instructions, which when executed by a computing system, cause the computing system to:

partition a high dynamic range (HDR) image into a plurality of regions including brighter regions and darker regions that are each darker than the brighter regions;

determine, on a per region basis, a luminance level of the HDR image, wherein the luminance levels of the brighter regions are greater than the luminance levels of the darker regions;

select, on the per region basis, an encoding amount for each region in the plurality of regions through

an increase in the encoding amount when the luminance level is identified as being not greater than a first threshold, wherein the increased encoding amount is to increase image compression, and

a decrease in the encoding amount when the luminance level is identified as being greater than a second threshold, wherein the second threshold is to be greater than the first threshold, wherein the decreased encoding amount is to decrease image compression,

wherein the encoding amounts of the brighter regions are less than the encoding amounts of the darker regions.

20. The at least one computer readable storage medium of claim 19, wherein the instructions, when executed, cause the computing system to:

encode the brighter regions in the plurality of regions at the encoding amounts of the brighter regions; and

encode the darker regions in the plurality of regions at the encoding amounts of the darker regions.

21. The at least one computer readable storage medium of claim 19, wherein the instructions, when executed, cause the computing system to:

detect one or more foreground regions in the plurality of regions; and

decrease the encoding amount in the one or more foreground regions, wherein the decreased encoding amount in the one or more foreground regions is to decrease image compression in the one or more foreground regions.

22. The at least one computer readable storage medium of claim 19, wherein the instructions, when executed, cause the computing system to:

detect one or more background regions in the plurality of regions; and

increase the encoding amount in the one or more background regions, wherein the increased encoding amount in the one or more background regions is to increase image compression in the one or more background regions.

23. The at least one computer readable storage medium of claim 19, wherein the instructions, when executed, cause the computing system to generate a luminance histogram for the HDR image, wherein the luminance histogram is to identify a first percentage of a first region from the plurality of regions as falling into a first luminance bin and a second percentage of the first region falling into a second luminance bin;

and

determine that the first percentage is greater than the second percentage; and

determine that the luminance level of the first region is the first luminance bin based on the first percentage being greater than the second percentage.

24. The at least one computer readable storage medium of claim 19, wherein the instructions, when executed, cause the computing system to:

determine, on the per region basis, that the encoding amount is to remain unmodified when the luminance level is identified as being both greater than the first threshold, and less than the second threshold; and

identify, on the per region basis, a quantization parameter for each region in the plurality of regions based on the encoding amount, wherein the quantization parameters of the brighter regions are different from the quantization parameters of the darker regions.