Low latency wireless display for graphics
First Claim
Patent Images
1. A method of transmitting video data from a wireless source device to a wireless sink device, the method comprising:
- exchanging capability information with the wireless sink device;
based on the exchange of capability information with the wireless sink device, selecting an operating mode for the wireless source device, wherein the operating mode comprises one of a video component mode or a pixel domain mode;
when the selected operating mode for the wireless source device comprises the video component mode, intercepting a first video component prior to the first video component being rendered at the wireless source device, wherein the first video component comprises a call to a driver of a graphics processing unit, and wherein the driver supports a graphics application program interface (API), and wherein the first video component further comprises one or more commands supported by the graphics API;
generating first metadata describing the first video component, wherein the first metadata comprises an identifier of a screen location to which the first video component is to be rendered;
intercepting a second video component prior to rendering at the wireless source device, wherein the second video component comprises pixel data;
generating second metadata describing the second video component, wherein the second metadata comprises an identifier of a screen location to which the second video component is to be rendered;
transmitting the first video component, the second video component, the first metadata, and the second metadata to the wireless sink device; and
rendering at the wireless source device a frame of video based on the first video component and the second video component.
1 Assignment
0 Petitions
Accused Products
Abstract
As part of a communication session, a wireless source device can transmit video component data and metadata to a wireless sink device. The wireless source device can intercept the video component data prior to the video component data being rendered by the wireless source device, and the wireless sink device can generate a frame of video data based on the video component data and the metadata.
298 Citations
17 Claims
-
1. A method of transmitting video data from a wireless source device to a wireless sink device, the method comprising:
-
exchanging capability information with the wireless sink device; based on the exchange of capability information with the wireless sink device, selecting an operating mode for the wireless source device, wherein the operating mode comprises one of a video component mode or a pixel domain mode; when the selected operating mode for the wireless source device comprises the video component mode, intercepting a first video component prior to the first video component being rendered at the wireless source device, wherein the first video component comprises a call to a driver of a graphics processing unit, and wherein the driver supports a graphics application program interface (API), and wherein the first video component further comprises one or more commands supported by the graphics API; generating first metadata describing the first video component, wherein the first metadata comprises an identifier of a screen location to which the first video component is to be rendered; intercepting a second video component prior to rendering at the wireless source device, wherein the second video component comprises pixel data; generating second metadata describing the second video component, wherein the second metadata comprises an identifier of a screen location to which the second video component is to be rendered; transmitting the first video component, the second video component, the first metadata, and the second metadata to the wireless sink device; and rendering at the wireless source device a frame of video based on the first video component and the second video component. - View Dependent Claims (2, 3, 4, 5, 6, 7)
-
-
8. A wireless source device comprising:
-
a memory; one or more processors communicatively coupled to the memory, the one or more processors configured to; exchange capability information with the wireless sink device; based on the exchange of capability information with the wireless sink device, select an operating mode for the wireless source device, wherein the operating mode comprises one of a video component mode or a pixel domain mode; when the selected operating mode for the wireless source device comprises the video component mode, intercept a first video component prior to the first video component being rendered at the wireless source device, wherein the first video component comprises a call to a driver of a graphics processing unit, and wherein the driver supports a graphics application program interface (API), and wherein the first video component further comprises one or more commands supported by the API; generate first metadata describing the first video component, wherein the first metadata comprises an identifier of a screen location to which the first video component is to be rendered; intercept a second video component prior to rendering at the wireless source device, wherein the second video component comprises pixel data; generate second metadata describing the second video component, wherein the second metadata comprises an identifier of a screen location to which the second video component is to be rendered; transmit the first video component and the first metadata to a wireless sink device; transmit the second video component to the wireless sink device; and render at the wireless source device a frame of video based on the first video component and the second video component. - View Dependent Claims (9, 10, 11, 12, 13, 14, 15)
-
-
16. A non-transitory, computer-readable storage medium storing instructions that upon execution by one or more processors cause the one or more processors to:
-
exchange capability information with the wireless sink device; based on the exchange of capability information with the wireless sink device, select an operating mode for the wireless source device, wherein the operating mode comprises one of a video component mode or a pixel domain mode; when the selected operating mode for the wireless source device comprises the video component mode, intercept a first video component prior to the first video component being rendered at the wireless source device, wherein the first video component comprises a call to a driver of a graphics processing unit, and wherein the driver supports a graphics application program interface (API), and wherein the first video component further comprises one or more commands supported by the API; generate first metadata describing the first video component, wherein the first metadata comprises an identifier of a screen location to which the first video component is to be rendered; intercept a second video component prior to rendering at the wireless source device, wherein the second video component comprises pixel data; generate second metadata describing the second video component, wherein the second metadata comprises an identifier of a screen location to which the second video component is to be rendered; transmit the first video component, the second video component, the first metadata, and the second metadata to the wireless sink device; and render at the wireless source device a frame of video based on the first video component and the second video component.
-
-
17. A wireless source device configured to transmit video data to a wireless sink device, the wireless source device comprising:
-
means for exchanging capability information with the wireless sink device; means for selecting an operating mode for the wireless source device based on the exchange of capability information with the wireless sink device, wherein the operating mode comprises one of a video component mode or a pixel domain mode; means for intercepting a first video component prior to the first video component being rendered at the wireless source device when the selected operating mode for the wireless source device comprises the video component mode, wherein the first video component comprises a call to a driver of a graphics processing unit, and wherein the driver supports a graphics application program interface (API), and wherein the first video component further comprises one or more commands supported by the API; means for generating first metadata describing the first video component, wherein the first metadata comprises an identifier of a screen location to which the first video component is to be rendered; means for intercepting a second video component prior to rendering at the wireless source device, wherein the second video component comprises pixel data; means for generating second metadata describing the second video component, wherein the second metadata comprises an identifier of a screen location to which the second video component is to be rendered; means for transmitting the first video component, the second video component, the first metadata, and the second metadata to the wireless sink device; and means for rendering at the wireless source device a frame of video based on the first video component and the second video component.
-
Specification