Generic use of HEVC SEI messages for multi-layer codecs

• US 10,178,397 B2
• Filed: 03/23/2015
• Issued: 01/08/2019
• Est. Priority Date: 03/24/2014
• Status: Active Grant

• Current Assignee: Qualcomm, Inc.
• Original Assignee: Qualcomm, Inc.
• Inventors: Wang, Ye-Kui, Ramasubramonian, Adarsh Krishnan, Hendry, Fnu
• Primary Examiner(s): Beasley, Dierdre L
• Application Number:
  US14/665,923
• Publication Number:
  US 20150271498A1
• Time in Patent Office: 1,387 Days
• Field of Search: 37524002
• CPC Class Codes: H04N 19/30 using hierarchical techniques, e.g. scalability H04N19/63 takes precedence
• CPC Class Codes: H04N 19/37 with arrangements for assigning different transmission priorities to video input data or to video coded data
• CPC Class Codes: H04N 19/60 using transform coding
• CPC Class Codes: H04N 19/70 characterised by syntax aspects related to video coding, e.g. related to compression standards
• CPC Class Codes: H04N 19/88 involving rearrangement of data among different coding units, e.g. shuffling, interleaving, scrambling or permutation of pixel data or permutation of transform coefficient data among different blocks
• CPC Class Codes: H04N 19/89 involving methods or arrangements for detection of transmission errors at the decoder

Abstract

In an example, a method of coding video data includes coding one or more non-video coding layer (VCL) network abstraction layer (NAL) units of a layer of a multi-layer bitstream, where the one or more non-VCL NAL units contain a decoded picture hash SEI message. The method also includes determining a set of layers of the multi-layer bitstream to which the decoded picture hash SEI message is applicable based on a layer identifier of the one or more non-VCL NAL units containing the decoded picture hash SEI message.

Claims

1. A method of coding video data, the method comprising:

coding one or more non-video coding layer (VCL) network abstraction layer (NAL) units of a layer of a multi-layer bitstream, wherein the one or more non-VCL NAL units contain a non-nested decoded picture hash SEI message;

coding one or more syntax elements that indicate a layer identifier of the one or more non-VCL NAL units; and

determining a set of layers of the multi-layer bitstream to which the non-nested decoded picture hash SEI message is applicable based on the one or more syntax elements that indicate the layer identifier of the one or more non-VCL NAL units containing the non-nested decoded picture hash SEI message.

2. The method of claim 1, further comprising:

coding a picture of the layer included in the set of layers; and

checking the picture for errors using the non-nested decoded picture hash SEI message.

3. The method of claim 1, further comprising:

coding one or more second non-VCL NAL units of the multi-layer bitstream, wherein the one or more second non-VCL NAL units contain an active parameter sets SEI message; and

determining that the active parameter sets SEI message is applicable to all layers of the multi-layer bitstream based on the one or more second non-VCL NAL units containing the active parameter set SEI message.

4. The method of claim 3, wherein coding the one or more second non-VCL NAL units containing the active parameter sets SEI message comprises only coding a non-nested SEI message.

5. The method of claim 1, further comprising:

coding one or more syntax elements indicating that frame field information is present in a picture timing SEI message of the multi-layer bitstream; and

applying the frame field information to all layers in all operation points to which the picture timing SEI message applies.

6. The method of claim 1, further comprising:

coding the determined set layers of the multi-layer bitstream;

using the non-nested decoded picture hash message to determine whether the determined set of layers include one or more errors.

7. The method of claim 6, wherein coding comprises encoding, and wherein encoding the determined set of layers comprises:

generating residual data for the determined set of layers indicating a difference between predictive data and actual video data;

applying a transform to the residual data the generate transform coefficients; and

generating a bitstream that includes an indication of the transform coefficients.

8. The method of claim 1, wherein coding comprises decoding, and wherein decoding the determined set of layers comprises:

obtaining transform coefficients for the determined set of layers from an encoded bitstream;

applying an inverse transform to the transform coefficients to generate residual data; and

determining the video data based on the generated residual data.

9. A device for coding video data, the device comprising:

a memory configured to store at least a portion of a multi-layer bitstream; and

one or more processors configured to;

code one or more non-video coding layer (VCL) network abstraction layer (NAL) units of a layer of a multi-layer bitstream, wherein the one or more non-VCL NAL units contain a non-nested decoded picture hash SEI message;

code one or more syntax elements that indicate a layer identifier of the one or more non-VCL NAL units; and

determine a set of layers of the multi-layer bitstream to which the non-nested decoded picture hash SEI message is applicable based on the one or more syntax elements that indicate the layer identifier of the one or more non-VCL NAL units containing the non-nested decoded picture hash SEI message.

10. The device of claim 9, wherein the one or more processors are further configured to:

code a picture of the layer included in the set of layers; and

check the picture for errors using the non-nested decoded picture hash SEI message.

11. The device of claim 9, wherein the one or more processors are further configured to:

code one or more second non-VCL NAL units of the multi-layer bitstream, wherein the one or more second non-VCL NAL units contain an active parameter sets SEI message; and

determine that the active parameter sets SEI message is applicable to all layers of the multi-layer bitstream based on the one or more second non-VCL NAL units containing the active parameter set SEI message.

12. The device of claim 11, wherein to code the one or more second non-VCL NAL units containing the active parameter sets SEI message, the one or more processors are configured to only code a non-nested SEI message.

13. The device of claim 9, wherein the one or more processors are further configured to:

code one or more syntax elements indicating that frame field information is present in a picture timing SEI message of the multi-layer bitstream; and

apply the frame field information to all layers in all operation points to which the picture timing SEI message applies.

14. The device of claim 9, wherein the one or more processors are further configured to:

code the determined set layers of the multi-layer bitstream;

use the non-nested decoded picture hash message to determine whether the determined set of layers include one or more errors.

15. The device of claim 14, wherein coding comprises encoding, and wherein to encode the determined set of layers, the one or more processors are configured to:

generate residual data for the determined set of layers indicating a difference between predictive data and actual video data;

apply a transform to the residual data the generate transform coefficients; and

generate a bitstream that includes an indication of the transform coefficients.

16. The device of claim 9, wherein coding comprises decoding, and wherein to decode the determined set of layers, the one or more processors are configured to:

obtain transform coefficients for the determined set of layers from an encoded bitstream;

apply an inverse transform to the transform coefficients to generate residual data; and

determine the video data based on the generated residual data.

17. The device of claim 9, wherein the device comprises at least one of:

an integrated circuit;

a microprocessor;

or

a wireless communication device.

18. An apparatus for coding video data, the apparatus comprising:

means for coding one or more non-video coding layer (VCL) network abstraction layer (NAL) units of a layer of a multi-layer bitstream, wherein the one or more non-VCL NAL units contain a non-nested decoded picture hash SEI message;

means for coding one or more syntax elements that indicate a layer identifier of the one or more non-VCL NAL units; and

means for determining a set of layers of the multi-layer bitstream to which the non-nested decoded picture hash SEI message is applicable based on the one or more syntax elements that indicate the layer identifier of the one or more non-VCL NAL units containing the non-nested decoded picture hash SEI message.

19. The apparatus of claim 18, further comprising:

means for coding the picture of a layer included in the set of layers; and

means for checking the picture for errors using the non-nested decoded picture hash SEI message.

20. A non-transitory computer-readable medium having instructions stored thereon that, when executed, cause one or more processors to:

code one or more non-video coding layer (VCL) network abstraction layer (NAL) units of a layer of a multi-layer bitstream, wherein the one or more non-VCL NAL units contain a non-nested decoded picture hash SEI message;

code one or more syntax elements that indicate a layer identifier of the one or more non-VCL NAL units; and

determine a set of layers of the multi-layer bitstream to which the non-nested decoded picture hash SEI message is applicable based on the one or more syntax elements that indicate the layer identifier of the one or more non-VCL NAL units containing the non-nested decoded picture hash SEI message.

21. The non-transitory computer-readable medium of claim 20, wherein the instructions further cause the one or more processors to:

code a picture of the layer included in the set of layers; and

check the picture for errors using the non-nested decoded picture hash SEI message.