Power efficient video playback based on display hardware feedback

• US 10,257,487 B1
• Filed: 01/16/2018
• Issued: 04/09/2019
• Est. Priority Date: 01/16/2018
• Status: Active Grant

• Current Assignee: Qualcomm, Inc.
• Original Assignee: Qualcomm, Inc.
• Inventors: Tamatam, Raviteja, Nukala, Prashant, Thota, Kalyan, Shekhar, Jayant, Devarakonda, Krishna Chaitanya
• Primary Examiner(s): Dang, Hung Q
• Application Number:
  US15/872,702
• Time in Patent Office: 448 Days
• Field of Search: 386232, 386239-248
• CPC Class Codes: G06F 3/147 using display panels
• CPC Class Codes: G06T 1/60 Memory management
• CPC Class Codes: G06V 10/28 Quantising the image, e.g. histogram thresholding for discrimination between background and foreground patterns
• CPC Class Codes: G06V 10/50 by performing operations within image blocks; by using histograms, e.g. histogram of oriented gradients [HoG]; by summing image-intensity values; Projection analysis
• CPC Class Codes: G06V 10/56 relating to colour
• CPC Class Codes: G06V 10/98 Detection or correction of errors, e.g. by rescanning the pattern or by human intervention; Evaluation of the quality of the acquired patterns
• CPC Class Codes: G09G 2320/0666 for control of colour parameters, e.g. colour temperature
• CPC Class Codes: G09G 2340/0442 Handling or displaying different aspect ratios, or changing the aspect ratio
• CPC Class Codes: G09G 2340/12 Overlay of images, i.e. displayed pixel being the result of switching between the corresponding input pixels
• CPC Class Codes: G09G 2340/125 wherein one of the images is motion video
• CPC Class Codes: G09G 5/005 Adapting incoming signals to the display format of the display terminal
• CPC Class Codes: G09G 5/024 using colour registers, e.g. to control background, foreground, surface filling G09G5/06 takes precedence
• CPC Class Codes: G09G 5/026 Control of mixing and/or overlay of colours in general G09G5/022 and G09G5/024 take precedence
• CPC Class Codes: H04N 5/272 Means for inserting a foreground image in a background image, i.e. inlay, outlay
• CPC Class Codes: H04N 9/8715 involving the mixing of the reproduced video signal with a non-recorded signal, e.g. a text signal

Abstract

Techniques are described for reducing the number of fetches performed when a background layer (e.g., letter or pillar box) to be displayed is of a constant fill color. One or more processors (e.g., a display processor) may be configured to detect that a background layer is of a constant fill color. If so, rather than fetching the background layer from memory, the one or more processors may be configured to generate the constant fill color for the background layer. In doing so, there may be a reduction in the number of memory fetches performed, as the constant fill background layer is not fetched or is only partially fetched. This may reduce memory fetch operations (as only the video layer is fetched) and therefore power savings (e.g., battery usage) at memory and bus interfaces, decreased use of the bandwidth at the bus and memory, and decreased processor usage.

Claims

1. A method of displaying video data, the method comprising:

detecting that a background layer comprising first pixel data of a constant color is being provided from a memory for display, wherein the background layer is of an application associated with a plurality of layers;

generating second pixel data of the constant color for the background layer of the application without fetching all of the first pixel data of the constant color for the background layer from the memory in response to the detecting that the background layer comprises pixel data of the constant color;

retrieving a foreground layer of the application associated with the plurality of layers from the memory; and

compositing the retrieved foreground layer and the generated second pixel data of the constant color for the background layer for display.

2. The method of claim 1, wherein the foreground layer comprises a video layer, and the background layer, when composited with the foreground layer, produces a letter box or a pillar box around the video layer.

3. The method of claim 2, wherein detecting that the background layer is being provided for display is based on detecting that an aspect ratio of the foreground layer is different from the aspect ratio of a display panel.

4. The method of claim 1, wherein detecting that the background layer comprising first pixel data of the constant color is being provided for display comprises:

monitoring a cyclic redundancy check (CRC) of a Multiple-Input Signature Register (MISR) block over a plurality of frames of the background layer; and

determining that the CRC of the MISR block remains constant over the plurality of frames of the background layer.

5. The method of claim 1, wherein detecting that the background layer comprising first pixel data of the constant color is being provided for display comprises:

monitoring a histogram color distribution of the background layer over a plurality of frames; and

determining that the histogram color distribution remains constant over the plurality of frames of the background layer.

6. The method of claim 5, wherein monitoring the histogram color distribution of the background layer over the plurality of frames comprises determining a number of colors in the background layer.

7. The method of claim 1, further comprising, sending the second pixel data of the constant color for display.

8. The method of claim 1, further comprising removing the background layer in response to the detecting that the background layer comprises pixel data of the constant color.

9. The method of claim 1, wherein compositing the retrieved foreground layer and the generated second pixel data of the constant color for the background layer for display comprises compositing the retrieved foreground layer and the generated second pixel data of the constant color for the background layer into a first frame for display, and the method further comprises:

when processing a subsequent frame for display, determining the background layer has changed; and

based on the determination that the background layer has changed, stopping generation of the second pixel data for the background layer and fetching third pixel data for the background layer from the memory.

10. The method of claim 1, wherein generating the second pixel data of the constant color for the background layer comprises generating the constant color using a constant fill color.

11. The method of claim 1, wherein generating the constant color for the background layer comprises generating the constant color with a dim layer using a constant fill color, the dim layer configured to uniformly darken at least a portion of the plurality of layers.

12. An apparatus configured for displaying video data, the apparatus comprising:

at least one internal memory; and

one or more processors in communication with the at least one internal memory, the one or more processors configured to;

detect that a background layer comprising first pixel data of a constant color is being provided from a memory for display, wherein the background layer is of an application associated with a plurality of layers;

generate second pixel data of the constant color for the background layer of the application without fetching all of the first pixel data of the constant color for the background layer from the at least one internal memory in response to the detecting that the background layer comprises pixel data of the constant color;

retrieve a foreground layer of the application associated with the plurality of layers from the at least one internal memory; and

composite the retrieved foreground layer and the generated second pixel data of the constant color for the background layer for display.

13. The apparatus of claim 12, wherein the foreground layer comprises a video layer and the background layer, when composited with the foreground layer, produces a letter box or a pillar box around the video layer.

14. The apparatus of claim 13, wherein detecting that the background layer is being provided for display is based on detecting that an aspect ratio of the foreground layer is different from the aspect ratio of a display panel.

15. The apparatus of claim 12, wherein detecting that the background layer comprising first pixel data of the constant color is being provided for display comprises:

monitoring a cyclic redundancy check (CRC) of a Multiple-Input Signature Register (MISR) block over a plurality of frames of the background layer; and

determining that the CRC of the MISR block remains constant over the plurality of frames of the background layer.

16. The apparatus of claim 12, wherein detecting that the background layer comprising first pixel data of the constant color is being provided for display comprises:

monitoring a histogram color distribution of the background layer over a plurality of frames; and

determining that the histogram color distribution remains constant over the plurality of frames of the background layer.

17. The apparatus of claim 16, wherein monitoring the histogram color distribution of the background layer over the plurality of frames comprises determining a number of colors in the background layer.

18. The apparatus of claim 12, wherein the one or more processors are further configured to send the second pixel data of the constant color for display.

19. The apparatus of claim 12, wherein the one or more processors are further configured to remove the background layer in response to the detecting that the background layer comprises pixel data of the constant color.

20. The apparatus of claim 12, wherein compositing the retrieved foreground layer and the generated second pixel data of the constant color for the background layer for display comprises compositing the retrieved foreground layer and the generated second pixel data of the constant color for the background layer into a first frame for display, and wherein the one or more processors are further configured to:

when processing a subsequent frame for display, determine the background layer has changed; and

based on the determination that the background layer has changed, stop generation of the second pixel data for the background layer and fetching third pixel data for the background layer from the at least one internal.

21. The apparatus of claim 12, wherein generating the second pixel data of the constant color for the background layer comprises generating the constant color using a constant fill color.

22. The apparatus of claim 12, wherein generating the constant color for the background layer comprises generating the constant color with a dim layer using a constant fill color, the dim layer configured to uniformly darken at least a portion of the plurality of layers.

23. An apparatus configured for displaying video data, the apparatus comprising:

means for detecting that a background layer comprising first pixel data of a constant color is being provided from a memory for display, wherein the background layer is of an application associated with a plurality of layers;

means for generating second pixel data of the constant color for the background layer of the application without fetching all of the first pixel data of the constant color for the background layer from the memory in response to the detecting that the background layer comprises pixel data of the constant color;

means for retrieving a foreground layer of the application associated with the plurality of layers from the memory; and

means for compositing the retrieved foreground layer and the generated second pixel data of the constant color for the background layer for display.

24. The apparatus of claim 23, wherein the foreground layer comprises a video layer, and the background layer, when composited with the foreground layer, produces a letter box or a pillar box around the video layer.

25. The apparatus of claim 23, wherein the means for detecting that the background layer comprising first pixel data of the constant color is being provided for display comprises:

means for monitoring a cyclic redundancy check (CRC) of a Multiple-Input Signature Register (MISR) block over a plurality of frames of the background layer; and

means for determining that the CRC of the MISR block remains constant over the plurality of frames of the background layer.

26. The apparatus of claim 23, wherein the means for detecting that the background layer comprising first pixel data of the constant color is being provided for display comprises:

means for monitoring a histogram color distribution of the background layer over a plurality of frames; and

means for determining that the histogram color distribution remains constant over the plurality of frames of the background layer.

27. The apparatus of claim 23, further comprising, the means for sending the generated pixel data of the constant color for display.

28. A non-transitory computer-readable storage medium storing instructions that, when executed, causes one or more processors to:

detect that a background layer comprising first pixel data of a constant color is being provided from a memory for display, wherein the background layer is of an application associated with a plurality of layers;

generate second pixel data of the constant color for the background layer of the application without fetching all of the first pixel data of the constant color for the background layer from the memory in response to the detecting that the background layer comprises pixel data of the constant color;

retrieve a foreground layer of the application associated with the plurality of layers from the memory; and

composite the retrieved foreground layer and the generated second pixel data of the constant color for the background layer for display.

29. The non-transitory computer-readable storage medium of claim 28, wherein detecting that the background layer comprising first pixel data of the constant color is being provided for display comprises:

monitoring a cyclic redundancy check (CRC) of a Multiple-Input Signature Register (MISR) block over a plurality of frames of the background layer; and

determining that the CRC of the MISR block remains constant over the plurality of frames of the background layer.

30. The non-transitory computer-readable storage medium of claim 28, wherein detecting that the background layer comprising first pixel data of the constant color is being provided for display comprises:

monitoring a histogram color distribution of the background layer over a plurality of frames; and

determining that the histogram color distribution remains constant over the plurality of frames of the background layer.