DATA PROCESSING SYSTEMS FOR ENCODING VIDEO DATA

• US 20190320208A1
• Filed: 04/11/2018
• Published: 10/17/2019
• Est. Priority Date: 04/11/2018
• Status: Active Grant

• Current Assignee: Arm Limited (SoftBank Group Corp.)
• Original Assignee: Arm Limited (SoftBank Group Corp.)
• Inventors: Bjorklund, John Nils Andreas, Hugosson, Sven Ola Johannes, Stolt, Fredrik Peter
• Granted Patent: US 10,764,607 B2
• Time in Patent Office: Days
• CPC Class Codes: H04N 19/117 Filters, e.g. for pre-processing or post-processing sub-band filter banks H04N19/635
• CPC Class Codes: H04N 19/147 according to rate distortion criteria rate-distortion as a criterion for motion estimation H04N19/567
• CPC Class Codes: H04N 19/176 the region being a block, e.g. a macroblock
• CPC Class Codes: H04N 19/46 Embedding additional information in the video signal during the compression process H04N19/517, H04N19/68, H04N19/70 take precedence
• CPC Class Codes: H04N 19/70 characterised by syntax aspects related to video coding, e.g. related to compression standards
• CPC Class Codes: H04N 19/82 involving filtering within a prediction loop
• CPC Class Codes: H04N 19/86 involving reduction of coding artifacts, e.g. of blockiness

Abstract

When encoding an array of data elements of a stream of arrays of data elements, a set of sample adaptive offset options to be used for encoding the array are selecting on the basis of a distortion value that is determined for a particular set of sample adaptive offset options. The distortion value is determined by generating one or more filtered reconstructed source blocks by applying a sample adaptive offset filter in accordance with the particular set of sample adaptive offset options to one or more reconstructed source blocks corresponding to a source block, and by then determining a distortion value for the particular set of sample adaptive offset options by comparing the one or more filtered reconstructed source blocks with the source block. When the particular set of sample adaptive offset options comprises an edge offset type, the distortion value is determined using a set of error values comprising fewer data elements than the source block of data elements.

Claims

1. A method of selecting sample adaptive offset options to use when encoding an array of data elements of a stream of arrays of data elements, the method comprising:

determining a distortion value for a particular set of sample adaptive offset options by;

generating one or more filtered reconstructed source blocks by applying a sample adaptive offset filter in accordance with the particular set of sample adaptive offset options to one or more reconstructed source blocks corresponding to a source block of the array of data elements being encoded;

generating a set of error values by comparing the one or more filtered reconstructed source blocks with the source block; and

determining a distortion value for the particular set of sample adaptive offset options using the set of error values;

the method further comprising;

selecting, based on the distortion value, whether to encode the source block using the particular set of sample adaptive offset options;

wherein when the particular set of sample adaptive offset options comprises an edge offset, the distortion value is determined using a set of error values comprising fewer data values than the source block of data elements.

2. The method of claim 1, further comprising using the source block and one or more reference blocks of data elements derived from one or more arrays of data elements of the stream of arrays of data elements to generate the one or more reconstructed source blocks corresponding to the source block.

3. The method of claim 1, wherein when the particular set of sample adaptive offset options comprises an edge offset, the one or more filtered reconstructed source blocks comprise fewer data elements than the source block of data elements.

4. The method of claim 1, wherein the particular set of sample adaptive offset options comprise (i) a sample adaptive offset filter type;

(ii) one or more particular offset values; and

/or (iii) a direction in which an offset or offsets should be applied.

5. The method of claim 1, wherein:

the set of error values that is used to determine the distortion value comprises an array of error values; and

when the particular set of sample adaptive offset options comprises an edge offset, the array of error values corresponds to an inner sub-region of a reconstructed source block.

6. The method of claim 5, wherein when the particular set of sample adaptive offset options comprises an edge offset, the array of error values corresponds to all of the inner data elements of a reconstructed source block.

7. The method of claim 1, wherein when the particular set of sample adaptive offset options comprises a band offset, the distortion value is determined using a set of error values comprising the same number of data values as or fewer data values than the source block of data elements.

8. The method of claim 1, further comprising:

generating a de-blocked reconstructed source block by applying a de-blocking filter to the one or more reconstructed source blocks.

9. The method of claim 8, further comprising:

generating a filtered de-blocked reconstructed source block by applying a sample adaptive offset filter in accordance with the selected set of sample adaptive offset options to the de-blocked reconstructed source block.

10. The method of claim 1, comprising:

selecting whether to encode the source block using the particular set of sample adaptive offset options based on the distortion value and a bit count value for the particular set of sample adaptive offset options.

11. An apparatus for selecting sample adaptive offset options to use when encoding an array of data elements of a stream of arrays of data elements, the apparatus comprising:

distortion value determining circuitry, operable to determine a distortion value for a particular set of sample adaptive offset options by;

generating one or more filtered reconstructed source blocks by applying a sample adaptive offset filter in accordance with the particular set of sample adaptive offset options to one or more reconstructed source blocks corresponding to a source block of the array of data elements being encoded;

generating a set of error values by comparing the one or more filtered reconstructed source blocks with the source block; and

determining a distortion value for the particular set of sample adaptive offset options using the set of error values; and

sample adaptive offset option selection circuitry operable to select a set of sample adaptive offset options to be used when encoding the source block based on the distortion value;

wherein the distortion value determining circuitry is operable, when the particular set of sample adaptive offset options comprises an edge offset, to determine the distortion value using a set of error values comprising fewer data values than the source block of data elements.

12. The apparatus of claim 11, further comprising reconstructed source block generating circuitry operable to generate one or more reconstructed source blocks corresponding to the source block using the source block and one or more reference blocks of data elements derived from one or more arrays of data elements of the stream of arrays of data elements.

13. The apparatus of claim 11, wherein the distortion value determining circuitry is operable, when the particular set of sample adaptive offset options comprises an edge offset, to generate one or more filtered reconstructed source blocks comprising fewer data elements than the source block of data elements.

14. The apparatus of claim 11, wherein the particular set of sample adaptive offset options comprise (i) a sample adaptive offset filter type;

(ii) one or more particular offset values; and

/or (iii) a direction in which an offset or offsets should be applied.

15. The apparatus of claim 11, wherein:

the set of error values that is used to determine the distortion value comprises an array of error values; and

when the particular set of sample adaptive offset options comprises an edge offset, the array of error values corresponds to an inner sub-region of a reconstructed source block.

16. The apparatus of claim 15, wherein when the particular set of sample adaptive offset options comprises an edge offset, the array of error values corresponds to all of the inner data elements of a reconstructed source block.

17. The apparatus of claim 11, wherein the distortion value determining circuitry is operable, when the particular set of sample adaptive offset options comprises a band offset, to determine the distortion value using a set of error values comprising the same number of data values as or fewer data values than the source block of data elements.

18. The apparatus of claim 11, further comprising de-blocking circuitry operable to generate a de-blocked reconstructed source block by applying a de-blocking filter to the one or more reconstructed source blocks.

19. The apparatus of claim 18, further comprising:

sample adaptive offset circuitry operable to generate a filtered de-blocked reconstructed source block by applying a sample adaptive offset filter in accordance with the selected set of sample adaptive offset options to the de-blocked reconstructed source block.

20. The apparatus of claim 11, wherein the sample adaptive offset option selection circuitry is operable to select a set of sample adaptive offset options to be used when encoding the source block based on the distortion value and a bit count value for the particular set of sample adaptive offset options.

21. A non-transitory computer readable storage medium storing computer software code which when executing on a processor performs a method of selecting sample adaptive offset options to use when encoding an array of data elements of a stream of arrays of data elements, the method comprising:

determining a distortion value for a particular set of sample adaptive offset options by;

generating one or more filtered reconstructed source blocks by applying a sample adaptive offset filter in accordance with the particular set of sample adaptive offset options to one or more reconstructed source blocks corresponding to a source block of the array of data elements being encoded;

generating a set of error values by comparing the one or more filtered reconstructed source blocks with the source block; and

determining a distortion value for the particular set of sample adaptive offset options using the set of error values;

the method further comprising;

selecting, based on the distortion value, whether to encode the source block using the particular set of sample adaptive offset options;

wherein when the particular set of sample adaptive offset options comprises an edge offset, the distortion value is determined using a set of error values comprising fewer data values than the source block of data elements.