Apparatus for dynamically adjusting video decoding complexity, and associated method

• US 9,930,361 B2
• Filed: 09/19/2016
• Issued: 03/27/2018
• Est. Priority Date: 04/26/2011
• Status: Active Grant

• Current Assignee: Xueshan Technologies Inc. (Wi-LAN Inc.)
• Original Assignee: MediaTek, Inc.
• Inventors: Hsieh, Fang-Yi, Lin, Jian-Liang
• Primary Examiner(s): SUH, JOSEPH JINWOO
• Application Number:
  US15/268,642
• Publication Number:
  US 20170006307A1
• Time in Patent Office: 554 Days
• CPC Class Codes: H04N 19/105 Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
• CPC Class Codes: H04N 19/11 among a plurality of spatial predictive coding modes
• CPC Class Codes: H04N 19/117 Filters, e.g. for pre-processing or post-processing sub-band filter banks H04N19/635
• CPC Class Codes: H04N 19/132 Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
• CPC Class Codes: H04N 19/139 Analysis of motion vectors, e.g. their magnitude, direction, variance or reliability
• CPC Class Codes: H04N 19/152 by measuring the fullness of the transmission buffer
• CPC Class Codes: H04N 19/156 Availability of hardware or computational resources, e.g. encoding based on power-saving criteria
• CPC Class Codes: H04N 19/159 Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
• CPC Class Codes: H04N 19/172 the region being a picture, frame or field
• CPC Class Codes: H04N 19/177 the unit being a group of pictures [GOP]
• CPC Class Codes: H04N 19/43 Hardware specially adapted for motion estimation or compensation
• CPC Class Codes: H04N 19/44 Decoders specially adapted therefor, e.g. video decoders which are asymmetric with respect to the encoder
• CPC Class Codes: H04N 19/59 involving spatial sub-sampling or interpolation, e.g. alteration of picture size or resolution

Abstract

An apparatus for dynamically adjusting video decoding complexity includes a decoding resolution control circuit and an adaptive spatial resolution decoder. The decoding resolution control circuit is arranged to dynamically determine whether at least one portion of multiple frames should be decoded in accordance with a specific resolution differing from an original resolution of the frames. In addition, the adaptive spatial resolution decoder is arranged to decode the frames according to whether the at least one portion of the frames should be decoded in accordance with the specific resolution. In particular, the apparatus further includes a system capability analyzing circuit arranged to analyze system capability of at least a portion of the apparatus, in order to generate analyzing results for being sent to the decoding resolution control circuit. An associated method is also provided.

Claims

1. An apparatus for dynamically adjusting video decoding complexity, the apparatus comprising:

a decoding resolution control circuit configured to dynamically determine, based on system capability of the apparatus and a target frame rate of a plurality of frames, whether at least one portion of the plurality of frames is to be decoded in accordance with a predetermined resolution differing from any intended resolution of the plurality of frames; and

an adaptive spatial resolution decoder circuit configured to decode the at least one portion of the plurality of frames according to the predetermined resolution by partially omitting encoded data of the at least one portion of the plurality of frames.

2. The apparatus of claim 1, wherein the at least one portion of the plurality of frames comprises a non-reference frame.

3. The apparatus of claim 2, wherein the adaptive spatial resolution decoder circuit is configured to decode the non-reference frame by controlling the adaptive spatial resolution decoder circuit to operate in accordance with the predetermined resolution.

4. The apparatus of claim 2, wherein the non-reference frame is a bi-directional predicted frame (B-frame).

5. The apparatus of claim 1, wherein the at least one portion of the plurality of frames comprises a reference frame.

6. The apparatus of claim 5, wherein the reference frame is an intra frame (I-frame), a predicted frame (P-frame), or a reference bi-directional predicted frame (B-frame).

7. The apparatus of claim 1, further comprising:

a system capability analyzing circuit configured to analyze the system capability of the apparatus, and to generate analyzing results indicating the system capacity for being sent to the decoding resolution control circuit, wherein the analyzing results correspond to one or a combination of a portion or all of a number of frames in a display buffer, system loading, and a decoding time of a frame.

8. The apparatus of claim 7, wherein the analyzing results further correspond to power consumption.

9. A method for dynamically adjusting video decoding complexity, the method comprising:

dynamically determining, by circuitry of an apparatus based on system capability of the apparatus and a target frame rate of a plurality of frames, whether at least one portion of the plurality of frames is to be decoded in accordance with a predetermined resolution differing from any intended resolution of the plurality of frames; and

decoding, by an adaptive spatial resolution decoder circuit of the apparatus, the at least one portion of the plurality of frames according to the predetermined resolution by partially omitting encoded data of the at least one portion of the plurality of frames.

10. The method of claim 9, wherein the at least one portion of the plurality of frames comprises a non-reference frame.

11. The method of claim 10, wherein the decoding the plurality of frames further comprises:

decoding the non-reference frame by controlling the adaptive spatial resolution decoder circuit to operate in accordance with the predetermined resolution.

12. The method of claim 10, wherein the non-reference frame is a bi-directional predicted frame (B-frame).

13. The method of claim 9, wherein the at least one portion of the plurality of frames comprises a reference frame.

14. The method of claim 13, wherein the reference frame is an intra frame (I-frame), a predicted frame (P-frame), or a reference bi-directional predicted frame (B-frame).

15. The method of claim 9, further comprising:

analyzing the system capability, and generating analyzing results indicating the system capacity, wherein the analyzing results correspond to one or a combination of a portion or all of a number of frames in a display buffer, system loading, and a decoding time of a frame.

16. The method of claim 15, wherein the analyzing results further correspond to power consumption.