Method and system of video coding with post-processing indication

• US 10,798,422 B2
• Filed: 04/14/2016
• Issued: 10/06/2020
• Est. Priority Date: 10/20/2015
• Status: Active Grant

• Current Assignee: Intel Corporation
• Original Assignee: Intel Corporation
• Inventors: Boyce, Jill M.
• Primary Examiner(s): Hilaire, Clifford
• Application Number:
  US15/099,506
• Publication Number:
  US 20170111661A1
• Time in Patent Office: 1,636 Days
• Field of Search: 37524026, 37524002
• CPC Class Codes: H04N 19/44 Decoders specially adapted therefor, e.g. video decoders which are asymmetric with respect to the encoder
• CPC Class Codes: H04N 19/70 characterised by syntax aspects related to video coding, e.g. related to compression standards
• CPC Class Codes: H04N 19/85 using pre-processing or post-processing specially adapted for video compression

Abstract

Methods, systems, and articles are described herein related to video coding with post-processing indication.

Claims

1. A computer-implemented method of video coding with post-processing indication comprising:

obtaining image data of at least one image;

encoding the image data in conformance with a video coding profile having a profile_tier_level syntax comprising profile syntax elements indicating conformance parameters of a video coding standard and for decoded video;

using one of the profile syntax elements of the profile_tier_level syntax that is a general context interpretation code associated with alternative values and to indicate that the image is to be post-processed after decoding to modify the image data of the image to affect a display of the image, wherein a value of the general context interpretation code is one of three available alternatives of;

a first value to indicate decoding without required post-processing,

a second value to indicate post-processing is necessary after decoding, and

any other value to indicate decoding may be skipped for the image data, and

wherein the general context interpretation code is an existing profile syntax element originally established for reasons other than post-processing and used without modifying the video coding standard by adding codes for the post-processing; and

providing the image data and profile_tier_level syntax settings in a bitstream to be transmitted to a decoder to have the image data decoded, post-processed after decoding depending on a setting of the general context interpretation code, and available to display images.

2. The method of claim 1 wherein the video coding profile is a high efficiency video coding (HEVC) profile and the general context interpretation code is a general_profile_space code.

3. The method of claim 1 comprising setting a value of the general context interpretation code so that a decoder that does not have access to a type of post-processing expected by a use of a value of the profile code setting does not decode the image data, while a decoder that does have access to a type of post-processing expected by the use of the value of the profile code does decode the image data.

4. The method of claim 1 wherein the general context interpretation code has a plurality of values that indicate post-processing, and wherein individual values indicate a different type of post-processing or a combination of post-processing types.

5. The method of claim 1 wherein the post-processing is related to at least one of:

converting image data from standard dynamic range (SDR) to high dynamic range (HDR),

converting YUV image data to RGB color space image data, and

modifying a color temperature of the image data.

6. The method of claim 1 wherein the video coding profile is a high efficiency video coding (HEVC) profile and the general context interpretation code is a general_profile_space code;

the method comprising setting the value of the general context interpretation code so that a decoder that does not have access to a type of post-processing expected by a use of a value of the profile code setting does not decode the image data, while a decoder that does have access to a type of post-processing expected by the use of the profile code value does decode the image data;

wherein the general context interpretation code has a plurality of values that indicate post-processing, and wherein individual values indicate a different type of post-processing or a combination of post-processing types;

wherein the post-processing is related to at least one of;

converting image data from standard dynamic range (SDR) to high dynamic range (HDR),

converting YUV image data to RGB color space image data, and

modifying a color temperature of the image data.

7. A computer-implemented method of video coding with post-processing indication comprising:

obtaining encoded image data of at least one image and profile_tier_level syntax settings of a video coding profile and having profile syntax elements indicating conformance parameters of a video coding standard and for decoded video;

using one profile syntax element of the profile_tier_level syntax to indicate that the image is to be post-processed after decoding to modify the image data of the image to affect a display of the image, wherein a value of the general context interpretation code is one of three available alternatives of;

a first value to indicate decoding without required post-processing,

a second value to indicate post-processing is necessary after decoding, and

any other value to indicate decoding may be skipped for the image data, and

wherein the one profile syntax element is an existing profile syntax element that is a single code associated with alternative values and originally established for reasons other than post-processing and used without modifying the video coding standard by adding codes for the post-processing;

decoding the encoded image data to generate decoded image data; and

depending on the setting of the one profile syntax element, providing the decoded image data to be post-processed to use post-processed image data to display images.

8. The method of claim 7 wherein the one profile syntax element is a general context interpretation code.

9. The method of claim 7 wherein the video coding profile is a high efficiency video coding (HEVC) profile and the one profile syntax element is a general_profile_space code.

10. The method of claim 7 wherein the post-processing indicated by the one profile syntax element establishes normative post-processing to form a profile conformance point after the post-processing of image data.

11. The method of claim 7 comprising obtaining non-profile data that indicates at least one type of post-processing indicated by the profile code setting.

12. The method of claim 7 comprising skipping the decoding of a video sequence at a decoder when a setting of the one profile syntax element indicates that the image data is to be post-processed but the decoder does not have capability to perform the post-processing indicated by the profile code setting.

13. The method of claim 7 wherein the one profile syntax element is a general context interpretation code;

wherein the video coding profile is a high efficiency video coding (HEVC) profile and the one profile syntax element is a general_profile_space code;

wherein the post-processing indicated by the one profile syntax element establishes normative post-processing to form a profile conformance point after the post-processing of image data;

the method comprising;

obtaining non-profile data that indicates at least one type of post-processing indicated by a profile code setting; and

skipping the decoding of a video sequence at a decoder when a setting of the one profile syntax element indicates that the image data is to be post-processed but the decoder does not have capability to perform the post-processing indicated by the profile code setting.

14. A computer-implemented system of video coding with post-processing indication comprising:

at least one memory;

at least one display;

at least one processor communicatively connected to the at least one display and at least one memory; and

an encoder operated by the at least one processor and arranged to;

obtain image data of at least one image;

encode the image data in conformance with a video coding profile having a profile_tier_level syntax comprising profile syntax elements indicating conformance parameters of a video coding standard and for decoded video;

using one of the profile syntax elements of the profile_tier_level syntax that is a general context interpretation code associated with alternative values and to indicate that the image is to be post-processed after decoding to modify the image data of the image to affect a display of the image, wherein a value of the general context interpretation code is one of three available alternatives of;

a first value to indicate decoding without required post-processing,

a second value to indicate post-processing is necessary after decoding, and

any other value to indicate decoding may be skipped for the image data, and wherein the general context interpretation code is an existing profile syntax element originally established for reasons other than post-processing and used without modifying the video coding standard by adding codes for the post-processing; and

provide the image data and profile_tier_level syntax settings in a bitstream to be transmitted to a decoder to have the image data decoded, post-processed after decoding depending on a setting of the general context interpretation code, and available to display images.

15. The system of claim 14 wherein the video coding profile is a high efficiency video coding (HEVC) profile and the general context interpretation code is a general_profile_space code.

16. The system of claim 14 wherein the general context interpretation code has a plurality of post-processing values wherein individual post-processing value indicate a different type of post-processing or a combination of post-processing types.

17. The system of claim 14 wherein the post-processing indicated by the one profile syntax element establishes normative post-processing to form a profile conformance point after the post-processing of image data.

18. The system of claim 14 wherein the video coding profile is a high efficiency video coding (HEVC) profile and the general context interpretation code is a general_profile_space code;

wherein the general context interpretation code has a plurality of post-processing values wherein individual post-processing value indicate a different type of post-processing or a combination of post-processing types;

wherein the post-processing indicated by the one profile syntax element establishes normative post-processing to form a profile conformance point after the post-processing of image data.

19. A non-transitory computer-readable medium having instructions thereon that when executed by a computing device cause the computing device to:

obtain encoded image data of at least one image and profile_tier_level syntax settings of a video coding profile and having profile syntax elements indicating conformance parameters of a video coding standard and for decoded video;

using one profile syntax element of the profile_tier_level syntax to indicate that the image is to be post-processed after decoding to modify the image data of the image to affect a display of the image, wherein a value of the general context interpretation code is one of three available alternatives of;

a first value to indicate decoding without required post-processing,

a second value to indicate post-processing is necessary after decoding, and

any other value to indicate decoding may be skipped for the image data, and wherein the one profile syntax element is an existing profile syntax element that is a single code associated with alternative values and originally established for reasons other than post-processing and used without modifying the video coding standard by adding codes for the post-processing;

decode the encoded image data; and

depending on the setting of the one profile syntax element, provide decoded image data to be post-processed to use the post-processed image data to display images.

20. The medium of claim 19 wherein the one profile syntax element is a general context interpretation code.

21. The medium of claim 19 wherein the video coding profile is a high efficiency video coding (HEVC) profile and the one profile syntax element is a general_profile_space code.

22. The medium of claim 19 wherein the post-processing indicated by the profile syntax element establishes normative post-processing to form a profile conformance point after the post-processing of image data.

23. The medium of claim 19 wherein the video coding profile is a high efficiency video coding (HEVC) profile and the general context interpretation code is a general_profile_space code;

the executed instructions cause the computing device to operate by setting a value of the general context interpretation code so that a decoder that does not have access to a type of post-processing expected by a use of a value of a profile code setting does not decode the image data, while a decoder that does have access to a type of post-processing expected by the use of the value of the profile code setting does decode the image data;

wherein the general context interpretation code has a plurality of values that indicate post-processing, and wherein individual values indicate a different type of post-processing or a combination of post-processing types;

wherein the post-processing is related to at least one of;

converting image data from standard dynamic range (SDR) to high dynamic range (HDR),

converting YUV image data to RGB color space image data, and

modifying a color temperature of the image data.