COLOUR REMAPPING INFORMATION SUPPLEMENTAL ENHANCEMENT INFORMATION MESSAGE PROCESSING

• US 20170070735A1
• Filed: 09/08/2016
• Published: 03/09/2017
• Est. Priority Date: 09/09/2015
• Status: Active Grant

• Current Assignee: Qualcomm, Inc.
• Original Assignee: Qualcomm, Inc.
• Inventors: Bugdayci Sansli, Done, Ramasubramonian, Adarsh Krishnan, Rusanovskyy, Dmytro, Lee, Sungwon, Sole Rojals, Joel, Karczewicz, Marta
• Granted Patent: US 10,536,695 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: H04N 19/124 Quantisation
• CPC Class Codes: H04N 19/186 the unit being a colour or a chrominance component
• CPC Class Codes: H04N 19/70 characterised by syntax aspects related to video coding, e.g. related to compression standards

Abstract

In an example, a method of processing video may include receiving a bitstream including encoded video data and a colour remapping information (CRI) supplemental enhancement information (SEI) message. The CRI SEI message may include information corresponding to one or more colour remapping processes. The method may include decoding the encoded video data to generate decoded video data. The method may include applying a process that does not correspond to the CRI SEI message to the decoded video data before applying at least one of the one or more colour remapping processes to the decoded video data to produce processed decoded video data.

Claims

1. A method of processing video data, the method comprising:

receiving a bitstream including encoded video data and a colour remapping information (CRI) supplemental enhancement information (SEI) message, wherein the CRI SEI message includes information corresponding to one or more colour remapping processes;

decoding the encoded video data to generate decoded video data; and

applying a process that does not correspond to the CRI SEI message to the decoded video data before applying at least one of the one or more colour remapping processes to the decoded video data to produce processed decoded video data.

2. The method of claim 1, further comprising:

applying at least one of the one or more colour remapping processes to the processed decoded video data.

3. The method of claim 1, wherein the process that does not correspond to the CRI SEI message includes at least one of:

an upsampling process;

a downsampling process;

a colour space conversion process;

an inverse quantization process;

or

a change of colour primaries used to represent components of the decoded video data.

4. The method of claim 1, further comprising:

receiving, as part of the CRI SEI message, a value corresponding to a syntax element indicative of;

whether the processed decoded video data, with or without additional processing, is compatible for presentment by a Standard Dynamic Range (SDR) display or a High Dynamic Range (HDR) display,

whether the one or more colour remapping processes corresponding to the CRI SEI message are configured such that an input and an output respectively corresponding to each colour remapping process of the one or more colour remapping processes are equal, or

whether the process that does not correspond to the CRI SEI message is to be applied between two colour remapping processes corresponding to the CRI SEI message.

5. The method of claim 1, wherein the CRI SEI message is a first CRI SEI message, the method further comprising:

receiving, in the bitstream, the first CRI SEI message and a second CRI SEI message that both correspond to the same decoded video data, wherein the second CRI SEI message includes information corresponding to one or more colour remapping processes.

6. The method of claim 5, wherein the first CRI SEI message includes a first identification value and the second CRI SEI message includes a second identification value.

7. The method of claim 6, further comprising:

determining, based on the first identification value and the second identification value, an order in which to apply the one or more colour remapping processes corresponding to the first CRI SEI message or the second CRI SEI message to the processed decoded video data.

8. The method of claim 7, further comprising at least one of:

applying, to the processed decoded video data, each of the one or more colour remapping processes corresponding to the first CRI SEI message to generate colour remapped decoded video data, and then applying each of the one or more colour remapping processes corresponding to the second CRI SEI message to the colour remapped decoded video data;

or

applying, to the processed decoded video data, each of the one or more colour remapping processes corresponding to the second CRI SEI message to generate colour remapped decoded video data, and then applying each of the one or more colour remapping processes corresponding to the first CRI SEI message to the colour remapped decoded video data.

9. A device configured to process video data, the device comprising:

a memory; and

one or more processors configured to;

process a bitstream including encoded video data and a colour remapping information (CRI) supplemental enhancement information (SEI) message, wherein the CRI SEI message includes information corresponding to one or more colour remapping processes;

decode the encoded video data to generate decoded video data;

store the decoded video data in the memory; and

apply a process that does not correspond to the CRI SEI message to the decoded video data before applying at least one of the one or more colour remapping processes to the decoded video data to produce processed decoded video data.

10. The device of claim 9, wherein the one or more processors are further configured to:

apply at least one of the one or more colour remapping processes to the processed decoded video data.

11. The device of claim 9, wherein the process that does not correspond to the CRI SEI message includes at least one of:

an upsampling process;

a downsampling process;

a colour space conversion process;

an inverse quantization process;

or

a change of colour primaries used to represent components of the decoded video data.

12. The device of claim 9, wherein the one or more processors are further configured to:

receive, as part of the CRI SEI message, a value corresponding to a syntax element indicative of;

whether the processed decoded video data, with or without additional processing, is compatible for presentment by a Standard Dynamic Range (SDR) display or a High Dynamic Range (HDR) display,

whether the one or more colour remapping processes corresponding to the CRI SEI message are configured such that an input and an output respectively corresponding to each colour remapping process of the one or more colour remapping processes are equal, or

whether the process that does not correspond to the CRI SEI message is to be applied between two colour remapping processes corresponding to the CRI SEI message.

13. The device of claim 9, wherein the CRI SEI message is a first CRI SEI message, wherein the one or more processors are further configured to:

receive, in the bitstream, the first CRI SEI message and a second CRI SEI message that both correspond to the same decoded video data, wherein the second CRI SEI message includes information corresponding to one or more colour remapping processes.

14. The device of claim 13, wherein the first CRI SEI message includes a first identification value and the second CRI SEI message includes a second identification value.

15. The device of claim 14, wherein the one or more processors are further configured to:

determine, based on the first identification value and the second identification value, an order in which to apply the one or more colour remapping processes corresponding to the first CRI SEI message or the second CRI SEI message to the processed decoded video data.

16. The device of claim 15, wherein the one or more processors are further configured to perform at least one of:

apply, to the processed decoded video data, each of the one or more colour remapping processes corresponding to the first CRI SEI message to generate colour remapped decoded video data, and then apply each of the one or more colour remapping processes corresponding to the second CRI SEI message to the colour remapped decoded video data;

or

apply, to the processed decoded video data, each of the one or more colour remapping processes corresponding to the second CRI SEI message to generate colour remapped decoded video data, and then apply each of the one or more colour remapping processes corresponding to the first CRI SEI message to the colour remapped decoded video data.

17. An apparatus comprising:

means for receiving a bitstream including encoded video data and a colour remapping information (CRI) supplemental enhancement information (SEI) message, wherein the CRI SEI message includes information corresponding to one or more colour remapping processes;

means for decoding the encoded video data to generate decoded video data; and

means for applying a process that does not correspond to the CRI SEI message to the decoded video data before applying at least one of the one or more colour remapping processes to the decoded video data to produce processed decoded video data.

18. The apparatus of claim 17, further comprising:

means for applying at least one of the one or more colour remapping processes to the processed decoded video data.

19. The apparatus of claim 17, wherein the process that does not correspond to the CRI SEI message includes at least one of:

an upsampling process;

a downsampling process;

a colour space conversion process;

an inverse quantization process;

or

a change of colour primaries used to represent components of the decoded video data.

20. The apparatus of claim 17, further comprising:

means for receiving, as part of the CRI SEI message, a value corresponding to a syntax element indicative of;

whether the processed decoded video data, with or without additional processing, is compatible for presentment by a Standard Dynamic Range (SDR) display or a High Dynamic Range (HDR) display,

whether the one or more colour remapping processes corresponding to the CRI SEI message are configured such that an input and an output respectively corresponding to each colour remapping process of the one or more colour remapping processes are equal, or

whether the process that does not correspond to the CRI SEI message is to be applied between two colour remapping processes corresponding to the CRI SEI message.

21. The apparatus of claim 17, wherein the CRI SEI message is a first CRI SEI message, the method further comprising:

means for receiving, in the bitstream, the first CRI SEI message and a second CRI SEI message that both correspond to the same decoded video data, wherein the second CRI SEI message includes information corresponding to one or more colour remapping processes.

22. The apparatus of claim 21, wherein the first CRI SEI message includes a first identification value and the second CRI SEI message includes a second identification value.

23. The apparatus of claim 22, further comprising:

means for determining, based on the first identification value and the second identification value, an order in which to apply the one or more colour remapping processes corresponding to the first CRI SEI message or the second CRI SEI message to the processed decoded video data.

24. The apparatus of claim 23, further comprising at least one of:

means for applying, to the processed decoded video data, each of the one or more colour remapping processes corresponding to the first CRI SEI message to generate colour remapped decoded video data, and then applying each of the one or more colour remapping processes corresponding to the second CRI SEI message to the colour remapped decoded video data;

or

means for applying, to the processed decoded video data, each of the one or more colour remapping processes corresponding to the second CRI SEI message to generate colour remapped decoded video data, and then applying each of the one or more colour remapping processes corresponding to the first CRI SEI message to the colour remapped decoded video data.

25. A method of processing video data, the method comprising:

receiving a bitstream including encoded video data and a plurality of colour remapping information (CRI) supplemental enhancement information (SEI) messages, wherein each CRI SEI message of the plurality of CRI SEI messages includes information corresponding to one or more colour remapping processes, wherein the plurality of CRI SEI messages include a first CRI SEI message and a second CRI SEI message; and

decoding the encoded video data to generate decoded video data, wherein plurality of CRI SEI messages correspond to the same decoded video data.

26. A method of processing video data, the method comprising:

receiving a bitstream including encoded video data and a colour remapping information (CRI) supplemental enhancement information (SEI) message, wherein the CRI SEI message includes information corresponding to one or more colour remapping processes and a value corresponding to a syntax element; and

decoding the encoded video data to generate decoded video data, wherein the value corresponding to the syntax element is indicative of;

whether the decoded video data, with or without additional processing, is compatible for presentment by a Standard Dynamic Range (SDR) display or a High Dynamic Range (HDR) display,

whether the one or more colour remapping processes corresponding to the CRI SEI message are configured such that an input and an output respectively corresponding to each colour remapping process of the one or more colour remapping processes are equal, or

whether a process that does not correspond to the CRI SEI message is to be applied between two colour remapping processes corresponding to the CRI SEI message.