Enhanced wireless display

• US 9,756,333 B2
• Filed: 12/20/2011
• Issued: 09/05/2017
• Est. Priority Date: 12/20/2011
• Status: Active Grant

• Current Assignee: Intel Corporation
• Original Assignee: Intel Corporation
• Inventors: Lipman, Justin, Yi, Zhaohua L.
• Primary Examiner(s): Perungavoor, Sath V
• Assistant Examiner(s): Young, Patricia I
• Application Number:
  US13/977,574
• Publication Number:
  US 20140233629A1
• Time in Patent Office: 2,086 Days
• CPC Class Codes: G06F 3/1438 using more than one graphics controller
• CPC Class Codes: G06F 3/1454 involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
• CPC Class Codes: G09G 2340/02 Handling of images in compressed format, e.g. JPEG, MPEG
• CPC Class Codes: G09G 2354/00 Aspects of interface with display user
• CPC Class Codes: G09G 2360/02 Graphics controller able to handle multiple formats, e.g. input or output formats
• CPC Class Codes: G09G 2370/10 Use of a protocol of communication by packets in interfaces along the display data pipeline
• CPC Class Codes: G09G 2370/16 Use of wireless transmission of display information
• CPC Class Codes: G09G 5/14 Display of multiple viewports
• CPC Class Codes: H04N 19/436 using parallelised computational arrangements
• CPC Class Codes: H04N 19/507 using conditional replenishment
• CPC Class Codes: H04N 21/43637 involving a wireless protocol, e.g. Bluetooth, RF or wireless LAN [IEEE 802.11] arrangements for wireless networking or broadcasting of information in indoor or near-field type systems H04B10/114

Abstract

A device source provides an ability to decompose a graphical display into multiple data streams (i.e., different layers). The multiple data streams may include multimedia data streams, operating system (OS) desktop data streams, and mouse data streams. The multiple data streams may be encoded and transmitted independently by the device source to a wireless display device.

Claims

1. A method performed by a device source comprising:

decomposing a graphical display at the device source into multiple data streams that include multimedia data stream, an operating system desktop data stream, and a pointing device data stream;

encoding separately and independently the multiple data streams for transmission;

transmitting the encoded multiple data streams;

detecting an image change to a block of an image, wherein the image change is detected by comparing two successive frames using a parallelized graphical processing unit based algorithm;

determining an assigned update—

importance of the detected image change, wherein the assigned update—

importance is different for a particular region of a desktop operating system (OS) screen; and

transmitting updates, wherein a transmission-priority of the transmitting updates is based on the determined assigned update—

importance.

2. The method of claim 1, wherein the decomposing of the multiple data streams is processed independently of operating system desktop manager at the device source.

3. The method of claim 1, wherein the multiple data streams include different level of quality of service.

4. The method of claim 1, wherein the transmitting adopts real time protocol for the multimedia data stream, and transmission control protocol or user datagram protocol for the operating system desktop and mouse data streams.

5. The method of claim 1, wherein the detecting includes the parallelized graphical processing unit based algorithm that compares individual cells of the two successive frames.

6. The method of claim 1, further comprising dividing a frame into blocks that include dynamic number of pixels, wherein the dynamic number of pixels is adjusted to fit a single frame to limit effect of corrupted or lost frame.

7. The method of claim 1, wherein the detecting is stopped once a cell modification is detected by the parallelized graphical processing unit based algorithm.

8. A device source comprising:

one or more processors;

memory configured to the one or more processors that comprises;

an updating unit that decomposes a graphical display into multiple data streams that include multimedia data stream, an operating system desktop data stream, and a mouse data stream, wherein the updating unit detects an image change to a block of an image by comparing two successive frames using a parallelized graphical processing unit based algorithm, wherein the detected image change includes an assigned update—

importance, wherein the assigned update—

importance is different for a particular region of a desktop operating system (OS) screen;

a multi-streams encoder that encodes independently the multiple data streams; and

a communication layer that implements different communication protocols to transmit the encoded multiple data streams that include the detected image change, wherein a transmission—

priority of the detected image change is based on the detected assigned update—

importance.

9. The device source of claim 8, wherein the updating unit processes the decomposition of the multiple data streams independently of operating system desktop manager at the device source.

10. The device source of claim 8, wherein the multiple data streams include different level of quality of service.

11. The device source of claim 8, wherein the updating unit detects the image change by comparing individual cells of the two successive frames.

12. The device source of claim 8, wherein the updating unit stops detecting once a cell modification is detected by the parallelized graphical processing unit based algorithm.

13. The device source of claim 8, wherein the updating unit divides a frame into blocks that include dynamic number of pixels, wherein the dynamic number of pixels is adjusted to fit a single frame to limit effect of corrupted or lost frame.

14. The device source of claim 8, wherein the communication layer adopts real time protocol for the multimedia data stream, and transmission control protocol or user datagram protocol for the operating system desktop and mouse data streams.

15. A display device comprising:

one or more processors; and

memory configured to the one or more processors that comprises;

an updating unit and frame buffer that receives multiple data streams, which include a multimedia data stream, an operating system desktop data stream, and a mouse data stream, wherein the updating unit/frame buffer merges detected updates to a current frame buffer, the detected updates includes an image change to a block of an image derived by a device source by comparing two successive frames using a parallelized graphical processing unit based algorithm, wherein the detected updates includes an assigned update—

importance of the detected image change, the assigned update—

importance is different for a particular region of a desktop operating system (OS) screen.

16. The display device of claim 15, wherein the updating unit/frame buffer receives the multiple data streams that were processed independently of operating system desktop manager at the device source.

17. The display device of claim 15, wherein the multiple data streams include different level of quality of service.

18. The display device of claim 15, wherein the updating unit and frame buffer is configured to receive a dynamic number of pixels that are adjusted to fit a single frame to limit effect of corrupted or lost frames.

19. The display device of claim 15, wherein the display data displays the merge updates configured to give priority to specified regions of operating system desktop.

20. The display device of claim 15 further comprising a multi-streams decoder to decode the multiple data streams that were encoded and transmitted independently at the device source.

21. The display device of claim 15 further comprising a communication layer that adopts real time protocol for the multimedia data stream, and transmission control protocol or user datagram protocol for the operating system desktop and mouse data streams.

22. At least one non-transitory computer accessible medium that performs a method comprising:

decomposing a graphical display at into multiple data streams that includes one or more of the following;

multimedia data stream, an operating system desktop data stream, and a pointing device data stream;

encoding separately and independently the multiple data streams;

transmitting the encoded multiple data streams;

detecting an image change to a block of an image for display, wherein the image change is detected by comparing two successive frames;

determining an assigned update—

importance of the detected image change, wherein the assigned update—

importance is different for a particular region of a desktop operating system (OS) screen;

transmitting updates, wherein a transmission—

priority of the transmitting updates is based on the determined assigned update—

importance; and

merging the detected image change to a current display in the display device.

23. The non-transitory computer accessible medium of claim 22, wherein the decomposing of the multiple data streams, which include different level of quality of service, is processed independently of operating system desktop manager at the device source.

24. The non-transitory computer accessible medium of claim 22, wherein the transmitting the encoded multiple data streams adopts real time protocol for the multimedia data stream, and transmission control protocol or user datagram protocol for the operating system desktop and mouse data streams.

25. The non-transitory computer accessible medium of claim 22, wherein the detecting includes a parallelized graphical processing unit based algorithm that compares individual cells of the two successive frames.

26. The non-transitory computer accessible medium of claim 22, further comprising dividing a frame into blocks that include a dynamic number of pixels, wherein the dynamic number of pixels is adjusted to fit a single frame to limit effect of corrupted or lost frame.