Static frame image quality improvement for sink displays

• US 9,589,543 B2
• Filed: 03/18/2015
• Issued: 03/07/2017
• Est. Priority Date: 03/18/2015
• Status: Active Grant

• Current Assignee: Intel Corporation
• Original Assignee: Intel Corporation
• Inventors: Lawrence, Sean J., Angadimani, Raghavendra
• Primary Examiner(s): THOMAS, ASHISH
• Application Number:
  US14/661,991
• Publication Number:
  US 20160275919A1
• Time in Patent Office: 720 Days
• US Class Current: 1/1
• CPC Class Codes: G09G 2340/02 Handling of images in compressed format, e.g. JPEG, MPEG
• CPC Class Codes: G09G 2360/127 Updating a frame memory using a transfer of data from a source area to a destination area
• CPC Class Codes: G09G 2360/18 Use of a frame buffer in a display terminal, inclusive of the display panel
• CPC Class Codes: G09G 2370/10 Use of a protocol of communication by packets in interfaces along the display data pipeline
• CPC Class Codes: G09G 2370/12 Use of DVI or HDMI protocol in interfaces along the display data pipeline
• CPC Class Codes: G09G 2370/16 Use of wireless transmission of display information
• CPC Class Codes: G09G 5/006 Details of the interface to the display terminal specific for a display terminal using a CRT G09G1/167; using a flat panel G09G3/2096; circuits for interfacing with colour displays G09G5/04
• CPC Class Codes: G09G 5/363 Graphics controllers
• CPC Class Codes: G09G 5/39 Control of the bit-mapped memory

Abstract

One or more system, apparatus, method, and computer readable media is described for improving the quality of static image frames having a relatively long residence time in a frame buffer on a sink device. Where a compressed data channel links a source and sink, the source may encode additional frame data to improve the quality of a static frame presented by a sink display. A display source may encode frame data at a nominal quality and transmit a packetized stream of the compressed frame data. In the absence of a timely frame buffer update, the display source encodes additional information to improve the image quality of the representation of the now static frame. A display sink device presents a first representation of the frame at the nominal image quality, and presents a second representation of the frame at the improved image quality upon subsequently receiving the frame quality improvement data.

Claims

1. An image frame display source apparatus, comprising:

one or more processors to generate image frames for display;

a transmitter to stream an encoded first representation of a first of the image frames to a display device;

a display buffer to store the first image frame during a panel self-refresh (PSR) mode;

a source display panel to statically refresh the first image frame during the PSR mode;

an image frame encoder to encode a residual between the first image frame stored in the display buffer and the first encoded representation, wherein the residual includes high frequency components present in the first image frame but absent from the first encoded representation; and

wherein

the processors are to cause the transmitter to initiate streaming of additional data encoding information for a second representation of the first image frame having higher quality than that of the first encoded representation in the event a second of the image frames is not generated within a predetermined time, wherein the additional data comprises the encoded residual.

2. The apparatus of claim 1, wherein the first encoded representation comprises a first I-frame or P-frame, and the additional data comprises a second P-frame.

3. The apparatus of claim 2, wherein:

the second P-frame encodes the high frequency components;

the additional data further comprises a third P-frame transmitted subsequent to the second P-frame; and

the third P-frame encodes high frequency components present in the first image frame but absent from the second encoded representation.

4. The apparatus of claim 1, wherein:

the processors are to generate the second image frame; and

the processors are to terminate streaming of the additional data in response to the generation of the second image frame.

5. The apparatus of claim 4, wherein the processors are to cause the second image frame to be encoded as an I-frame or scene change frame regardless of a position of the image frame within a group of pictures (GOP).

6. The apparatus of claim 1, wherein the additional data comprises a re-encoding of the first image frame.

7. The apparatus of claim 1, wherein:

the first encoded representation comprises a base layer of a scalable video coding (SVC) stream; and

the additional data comprises one or more enhancement layer for the SVC stream.

8. A wireless display system, comprising:

the source apparatus of claim 1 to stream through a wireless transmission protocol; and

a sink apparatus to;

present the first representation of the first image frame on a sink display panel;

decode the additional data; and

present on the sink display panel the second representation of the first image frame based on at least the additional data.

9. The display system of claim 8, wherein the sink display panel is to self-refresh the second representation of the first image frame until the second image frame is received from the source apparatus.

10. A method for improving the quality of a static image presented on a sink display, the method comprising:

generating an image frame for display;

streaming an encoded first representation of the image frame to a display device;

storing the image frame in a display buffer during a panel self-refresh (PSR) mode;

refreshing the image frame during the PSR mode;

encoding a residual between the image frame stored in the display buffer and the first encoded representation, wherein the residual includes high frequency components present in the first image frame but absent from the first encoded representation; and

streaming additional data encoding the image frame in the event a second image frame is not generated within a predetermined time, wherein the additional data encodes information for a second representation of the first image frame having higher quality than that of the first encoded representation, and wherein the additional data comprises the encoded residual.

11. The method of claim 10, wherein:

the first encoded representation comprises a first I-frame or P-frame, and the additional data comprises a second P-frame encoding high frequency components present in the image frame but absent from the first encoded representation; and

wherein the method further comprises transmitting a third P-frame subsequent to the second P-frame, the third P-frame encoding high frequency components present in the image frame but absent from the second encoded representation.

12. The method of claim 10, further comprising:

encoding the first encoded representation into at least a base layer of a scalable video coding (SVC) stream; and

encoding the additional data into one or more enhancement layer of the SVC stream.

13. One or more non-transitory computer readable media including instruction stored thereon, which when executed by a processing system, cause one or more processors of the system to perform a method comprising:

generating an image frame for display;

streaming an encoded first representation of the image frame to a display device;

storing the image frame in a display buffer during a panel self-refresh (PSR) mode;

refreshing the image frame during the PSR mode;

encoding a residual between the image frame stored in the display buffer and the first encoded representation, wherein the residual includes high frequency components present in the first image frame but absent from the first encoded representation; and

streaming additional data encoding the image frame in the event a second image frame is not generated within a predetermined time, wherein the additional data encodes information for a second representation of the first image frame having higher quality than that of the first encoded representation, and wherein the additional data comprises the encoded residual.

14. The media of claim 13, wherein:

the first encoded representation comprises a first I-frame or P-frame, and the additional data comprises a second P-frame encoding high frequency components present in the image frame but absent from the first encoded representation; and

the media further comprises instructions to cause the system to transmit a third P-frame subsequent to the second P-frame, the third P-frame encoding high frequency components present in the image frame but absent from the second encoded representation.