System and method for adaptive bandwidth management

• US 9,438,917 B2
• Filed: 04/18/2013
• Issued: 09/06/2016
• Est. Priority Date: 04/18/2013
• Status: Active Grant

• Current Assignee: Huawei Cloud Computing Technologies Company Limited (Huawei Investment & Holding Co., Ltd.)
• Original Assignee: Futurewei Technologies Incorporated (Huawei Investment & Holding Co., Ltd.)
• Inventors: Xia, Guangsong
• Primary Examiner(s): Richer, Joni
• Application Number:
  US13/865,769
• Publication Number:
  US 20140314139A1
• Time in Patent Office: 1,237 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: H04N 19/00 Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
• CPC Class Codes: H04N 19/10 using adaptive coding
• CPC Class Codes: H04N 19/115 Selection of the code volume for a coding unit prior to coding
• CPC Class Codes: H04N 19/136 Incoming video signal characteristics or properties
• CPC Class Codes: H04N 19/15 by monitoring actual compressed data size at the memory before deciding storage at the transmission buffer
• CPC Class Codes: H04N 19/169 characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
• CPC Class Codes: H04N 19/17 the unit being an image region, e.g. an object

Abstract

System and method embodiments are provided for adaptive bandwidth management for transporting rendered graphics in a virtual desktop infrastructure. The embodiments include a video detection algorithm that enables a driver for a graphics processor at the server'"'"'s end to identify displayed video data at the user'"'"'send. The driver identifies video traffic that is sent to the user device by tracking repeated bitmap operations at the same display area or block of an application displayed window at the user device. When the number of bitmap operations reaches a pre-determined threshold, then the corresponding area is considered a video display area. When detecting that a bandwidth threshold for transporting graphics data from the server to the device is reached, the data corresponding to the detected video area is compressed using a higher compression rate, thus increasing the loss rate of transferred video data to improve playback experience for the user.

Claims

1. A method for adaptive bandwidth management to handle graphics for a virtual desktop infrastructure (VDI), the method comprising:

determining, at a server, that graphics data transmitted to a remote user device has reached a threshold bandwidth;

upon determining that the graphics data has reached the threshold bandwidth, detecting video data among the graphics data by using a table to track a number of bitmap blits at window display areas of an application, wherein a bitmap blit is a computer graphics operation in which multiple bitmaps are combined into one bitmap using a raster operator, and wherein the graphics data includes at least some non-video graphics data, wherein detecting the video data by using the table to track the number of bitmap blits comprises recording, in the table, a number of bitmap blits detected in a given window display area during a period, and determining that video data is present in the window display area during the period when the number of bitmap blits recorded in the table exceeds a threshold; and

upon detecting the video data among the graphics data, compressing the video data at a higher compression rate than the non-video graphics data before transmitting the video data with the non-video graphics data to the remote user device.

2. The method of claim 1 further comprising:

determining that the transmitted the graphics data has reached a tolerated bandwidth level; and

upon determining that the transmitted graphics data has reached the tolerated bandwidth level, cease compressing the video data at the higher compression rate such that the video data and the non-video graphics data is compressed at the same compression rate.

3. The method of claim 1 further comprising:

determining that the transmitted video data has reached a tolerated bandwidth level; and

upon determining that the transmitted video data has reached the tolerated bandwidth level, cease compressing the video data at the higher compression rate such that the video data and the non-video graphics data is compressed at the same compression rate.

4. The method of claim 1, wherein the application is a web browser application that displays the graphics data on the remote user device.

5. The method of claim 4, wherein detecting video data among the graphics data further comprises:

determining that a window display area is a video display area when the number of bitmap blits for the window display area has reached a pre-determined number.

6. The method of claim 1, wherein the video data is compressed at a higher compression rate than a standard or initial compression rate of the video data and the non-video graphics data used prior to determining that the graphics data has reached the threshold bandwidth.

7. The method of claim 1, wherein the video data is detected at a driver for graphics data processing at a virtual machine (VM) on the server.

8. A method for adaptive bandwidth management to handle graphics for a virtual desktop infrastructure (VDI), the method comprising:

tracking, at a driver for graphics rendering at a virtual machine (VM), a number of bitmap blits for window display areas of an application that displays graphics data on a remote user device, wherein a bitmap blit is a computer graphics operation in which multiple bitmaps are combined into one bitmap using a raster operator, and wherein the graphics data includes at least some non-video graphics data, wherein tracking the number of bitmap blits comprises recording, in a table, a number of bitmap blits detected in a given window display area during a period, and determining that video data is present in the window display area during the period when the number of bitmap blits recorded in the table has reached a pre-determine number;

upon detecting that the number of bitmap blits of a window display area has reached the pre-determined number, identifying the graphics data for the window display area as video data;

tracking a bandwidth of the graphics data;

upon detecting that the bandwidth has reached a threshold, increasing a compressing rate of the video data to a pre-determined rate; and

sending the graphics data including the video data compressed at the pre-determined rate to the remote user device.

9. The method of claim 8, wherein the bandwidth of the video data is tracked after identifying the video data, and wherein the compression rate of the video data is increased when the bandwidth of the video data has reached the threshold.

10. The method of claim 8, wherein the bandwidth of the graphics data including the video data is tracked, and wherein the compression rate of the video data is increased when the bandwidth of the graphics data including the video data has reached the threshold.

11. The method of claim 8 further comprising hashing the number of bitmap blits for each window display area of the application on the remote user device to a table entry at the VM.

12. The method of claim 11 further comprising resetting the number of bitmap blits to zero in the table entry for a corresponding window display area when there is no change in the number of bitmap blits over a pre-determined period of time.

13. The method of claim 12 further comprising:

identifying the graphics data for the corresponding window display area as non-video data; and

resuming compression of the graphics data at a lower or standard compression rate for the corresponding window display area.

14. The method of claim 8, wherein the graphics data includes video data that is initially compressed before the bandwidth reaches the threshold at a compression rate substantially less than the pre-determined rate that is used to compress the video data after the bandwidth reaches the threshold.

15. A network component configured for adaptive bandwidth management for graphics rendering, the network component comprising:

a virtual machine (VM);

a processor; and

a computer readable storage medium storing programming for execution by the processor, the programming including instructions to;

determine that graphics data transmitted from the VM to a remote user device has reached a threshold bandwidth;

upon determining that the graphics data has reached the threshold bandwidth, detect video data among the graphics data by using a table to track a number of bitmap blits for window display areas of an application, wherein a bitmap blit is a computer graphics operation in which multiple bitmaps are combined into one bitmap using a raster operator, and wherein the graphics data includes at least some non-video graphics data, wherein the instructions to detect the video data by using the table to track the number of bitmap blits includes instructions to record, in the table, a number of bitmap blits detected in a given window display area during a period, and to determine that video data is present in the window display area during the period when the number of bitmap blits recorded in the table exceeds a threshold; and

upon detecting the video data among the graphics data, compress the video data at a higher compression rate than the non-video graphics data before transmitting the video data with the non-video graphics data to the remote user device.

16. The network component of claim 15, wherein the VM comprises:

a graphics processing unit (GPU) configured for rendering the graphics data including the video data; and

a driver configured to serve as an interface between the GPU and the application, and wherein the application displays the graphics data including the video data in a window on the remote user device.

17. The network component of claim 15, wherein the programming includes further instructions to:

determine whether the transmitted graphics data or video data has reached a tolerated bandwidth level; and

upon determining that the transmitted graphics data or video data has reached the tolerated bandwidth level, stop the higher compression rate of the video data.

18. The network component of claim 15, wherein the instructions to detect the video data further includes instructions to:

determine that a window display area is a video display area when the number of bitmap blits for the same window display area has reached a pre-determined number.