POWER AND COMPUTATIONAL LOAD MANAGEMENT TECHNIQUES IN VIDEO PROCESSING

• US 20100046637A1
• Filed: 12/16/2008
• Published: 02/25/2010
• Est. Priority Date: 08/19/2008
• Status: Active Grant

• Current Assignee: Qualcomm, Inc.
• Original Assignee: Qualcomm, Inc.
• Inventors: Raveendran, Vijayalakshmi
• Granted Patent: US 8,948,270 B2
• Time in Patent Office: Days
• US Class Current: 375/240.260
• CPC Class Codes: H04N 19/127 Prioritisation of hardware or computational resources
• CPC Class Codes: H04N 19/174 the region being a slice, e.g. a line of blocks or a group of blocks
• CPC Class Codes: H04N 19/42 characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation H04N19/635 takes precedence
• CPC Class Codes: H04N 19/44 Decoders specially adapted therefor, e.g. video decoders which are asymmetric with respect to the encoder
• CPC Class Codes: H04N 21/4348 Demultiplexing of additional data and video streams
• CPC Class Codes: H04N 21/4382 Demodulation or channel decoding, e.g. QPSK demodulation analog front ends or means for connecting modulators, demodulators or transceivers to a transmission line H04L27/0002
• CPC Class Codes: H04N 21/4424 Monitoring of the internal components or processes of the client device, e.g. CPU or memory load, processing speed, timer, counter or percentage of the hard disk space used error monitoring in general G06F11/30; arrangements for monitoring conditions of receiving stations in broadcast systems H04H60/32; diagnosis, testing or measuring for television receivers H04N17/04
• CPC Class Codes: H04N 21/443 OS processes, e.g. booting an STB, implementing a Java virtual machine in an STB or power management in an STB
• CPC Class Codes: H04N 21/4432 Powering on the client, e.g. bootstrap loading using setup parameters being stored locally or received from the server resetting in general G06F1/14; program loading or initiating in general G06F9/445; bootstrapping in general G06F9/4401; secure boots of computer platforms G06F21/57
• CPC Class Codes: H04N 21/4436 Power management, e.g. shutting down unused components of the receiver power management in computer systems G06F1/3203; hibernate or awake process in computer systems G06F9/4418

Abstract

Techniques for power and computational load management in video processing and decoding are provided. In one configuration, an apparatus comprising a processor having a set of instructions operative to extract and compile information from a data stream having video is provided. The processor is operative to prioritize a set of parsing or decoding operations to process the data stream referred to as power management (PM) sequences based on the information and calculate projections of at least one of power and computational loading for each of the prioritized PM sequences.

Claims

1. A method of processing a data stream that includes video data, comprising the steps of:

extracting and compiling information from the data stream;

prioritizing power management (PM) sequences from the data stream for decoding and parsing operations based on the extracted and compiled information.

2. The method of claim 1, wherein:

prioritizing is based on look-ahead processing of at least one of decoding and parsing operations.

3. The method of claim 1, further comprising the step of:

calculating at least one of a projection of a power required by each of the prioritized power management (PM) sequences and a projection of a computational load required for each of the prioritized power management (PM) sequences.

4. The method of claim 1, further comprising the step of:

generating a hierarchical list of low power modes based on the prioritization of the power management (PM) sequences.

5. The method of claim 1, wherein the prioritizing of power management (PM) sequences is based on at least one of visual quality of the video and granularity of the decoding and parsing operations.

6. The method of claim 4, further comprising the steps of:

selecting a low power mode in response to an amount of available electrical power or processing power; and

selectively decoding one or more of the prioritized power management sequences in response to the selected low power mode.

7. The method of claim 6, wherein:

the selective decoding is based on at least one of a power required by each of the prioritized power management (PM) sequences and a computational load required for each of the prioritized power management (PM) sequences.

8. A device for processing a data stream that includes video data, comprising:

a parser for extracting and compiling information from the data stream; and

a processing unit for prioritizing power management (PM) sequences from the data stream for decoding operations based on the extracted and compiled information

9. The device of claim 8, further comprising a projector for calculating at least one of a projection of a power required by each of the prioritized power management (PM) sequences and a projection of a computational load required for each of the prioritized power management (PM) sequences.

10. The device of claim 8, wherein the prioritizing of power management (PM) sequences is based on at least one of visual quality of the video and granularity of the decoding operations.

11. The device of claim 8, further comprising a generator for generating a hierarchical list of low power modes based on the prioritization of the power management (PM) sequences.

12. The device of claim 11, wherein the processing unit:

selects a low power mode in response to an amount of available electrical power or processing power; and

selectively decodes one or more of the prioritized power management (PM) sequences in response to the selected low power mode.

13. An apparatus for processing a data stream that includes video data, comprising:

means for extracting and compiling information from the data stream; and

means for prioritizing power management (PM) sequences from the data stream for decoding operations based on the extracted and compiled information

14. The apparatus of claim 13, wherein the means for prioritizing power management (PM) sequences prioritizes based on look-ahead processing of the decoding operations.

15. The apparatus of claim 13, further comprising:

means for calculating at least one of a projection of a power required by each of the prioritized power management (PM) sequences and a projection of a computational load required for each of the prioritized power management (PM) sequences.

16. The apparatus of claim 13, wherein the the prioritizing of power management (PM) sequences is based on at least one of visual quality of the video and granularity of the decoding operations.

17. The apparatus of claim 13, further comprising:

means for generating a hierarchical list of low power modes based on the prioritization of the power management (PM) sequences.

18. The apparatus of claim 17, further comprising:

means for selecting a low power mode in response to an amount of available electrical power or processing power; and

means for selectively decoding one or more of the prioritized power management (PM) sequences in response to the selected low power mode.

19. The apparatus of claim 18, wherein the selective decoding is based on at least one of a power required by each of the prioritized power management (PM) sequences and a computational load required for each of the prioritized power management (PM) sequences.

20. A computer program product for processing a data stream that includes video data, the computer program product including a computer readable medium storing instructions that when executed cause a processor to:

extract and compile information from the data stream; and

prioritize power management (PM) sequences from the data stream for decoding operations based on the extracted and compiled information

21. The computer program product of claim 20, wherein the prioritizing of power management (PM) sequences is based on look-ahead processing of the decoding operations.

22. The computer program product of claim 20, wherein the computer readable medium further stores instructions that when executed cause a processor to:

calculate at least one of a projection of a power required by each of the prioritized power management (PM) sequences and a projection of a computational load required for each of the prioritized power management (PM) sequences.

23. The computer program product of claim 20, wherein the prioritizing of power management (PM) sequences is based on at least one of visual quality of the video and granularity of the decoding operations.

24. The computer program product of claim 20, wherein the computer readable medium further stores instructions that when executed cause a processor to:

generate a hierarchical list of low power modes based on the prioritization of the power management (PM) sequences.

25. The computer program product of claim 24, wherein the computer readable medium further stores instructions that when executed cause a processor to:

select a low power mode in response to an amount of available electrical power or processing power; and

selectively decode one or more of the prioritized power management (PM) sequences in response to the selected low power mode.

26. The computer program product of claim 25, wherein the selective decoding is based on at least one of a power required by each of the prioritized power management (PM) sequences and a computational load required for each of the prioritized power management (PM) sequences.