Video adaptation for content-aware wireless streaming

• US 9,819,717 B2
• Filed: 12/28/2011
• Issued: 11/14/2017
• Est. Priority Date: 12/28/2011
• Status: Expired due to Fees

• Current Assignee: Intel Corporation
• Original Assignee: Intel Corporation
• Inventors: Oyman, Ozgur, Lin, Xintian E.
• Primary Examiner(s): Chan, Wing F
• Assistant Examiner(s): Krishnan, Raji
• Application Number:
  US13/977,039
• Publication Number:
  US 20140258552A1
• Time in Patent Office: 2,148 Days
• CPC Class Codes: H04L 47/263 Rate modification at the source after receiving feedback
• CPC Class Codes: H04L 65/70 Media network packetisation
• CPC Class Codes: H04L 65/762 at the source reformatting of additional data in video distribution servers H04N21/2355
• CPC Class Codes: H04L 65/80 Responding to QoS
• CPC Class Codes: H04N 19/10 using adaptive coding
• CPC Class Codes: H04N 19/146 Data rate or code amount at the encoder output
• CPC Class Codes: H04N 19/152 by measuring the fullness of the transmission buffer
• CPC Class Codes: H04N 21/2402 Monitoring of the downstream path of the transmission network, e.g. bandwidth available traffic monitoring in data switching networks H04L43/00; monitoring data switching networks utilization H04L43/0876
• CPC Class Codes: H04N 21/4122 additional display device, e.g. video projector digital output for controlling a plurality of local displays G06F3/1423
• CPC Class Codes: H04N 21/41407 embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop constructional details of equipment or arrangements specially adapted for portable computer application G06F1/1626; arrangements specially adapted for mobile receivers in broadcast systems H04H20/57
• CPC Class Codes: H04N 21/43637 involving a wireless protocol, e.g. Bluetooth, RF or wireless LAN [IEEE 802.11] arrangements for wireless networking or broadcasting of information in indoor or near-field type systems H04B10/114
• CPC Class Codes: H04N 21/4402 involving reformatting operations of video signals for household redistribution, storage or real-time display details of conversion of video standards at pixel level H04N7/01; video transcoding H04N19/40; adapting incoming signals to the display format of the display terminal G09G5/005; media handling at the source in data packet switching networks H04L65/764
• CPC Class Codes: H04N 21/44227 Monitoring of local network, e.g. connection or bandwidth variations; Detecting new devices in the local network configuring of peripheral devices in general G06F9/4411; monitoring connectivity in data switched networks H04L43/0811

Abstract

Described herein are techniques related to wirelessly streaming content to a remote display device. Parameters are selected for the streaming based on content information received via an application programming interface (API) associated with a media player. This Abstract is submitted with the understanding that it will not be used to interpret or limit the scope or meaning of the claims.

Claims

1. A method of wirelessly streaming multimedia content from a wireless transmission device to a remote display device, the method comprising:

receiving a content information from a media player of the wireless transmission device via an application programming interface (API) associated with the media player, wherein the content information corresponds to the multimedia content played by the media player;

receiving a link quality information of a link between the wireless transmission device and the remote display device from an output component of the wireless transmission device through a feedback element using another API;

selecting a video encoder bitrate based on the received content information and the link quality information;

encoding the multimedia content based on the selected video encoder bitrate;

outputting the encoded content through the output component for wirelessly streaming the encoded multimedia content to the remote display device.

2. The method of claim 1, wherein the content information comprises at least one of:

a minimum bitrate, a maximum bitrate, a current bitrate, a resolution, a frame rate, a content type, and a codec information.

3. The method of claim 1, wherein the another API is associated with a physical radio layer of the wireless transmission device.

4. The method of claim 1, wherein the another API is associated with a transport layer of a transmission control protocol (TCP) of the wireless transmission device.

5. The method of claim 1, further comprising receiving one or more signals from the remote display device and selecting the video encoder bitrate based at least in part on the one or more signals received.

6. The method of claim 1, wherein the video encoder bitrate is increased by a preselected increment for a latency that is lesser than or equal to a preselected latency threshold.

7. The method of claim 1, further comprising requesting a lower resolution version of the multimedia content when a number of packets in a queue at the wireless transmission device exceeds a preselected queue size threshold or a latency value exceeds a preselected latency threshold.

8. The method of claim 1, further comprising:

increasing a quality of service (QoS) priority and associated enhanced distributed channel access (EDCA) parameters when a content bitrate is greater than a scaled wireless link throughput; and

decreasing the quality of service (QoS) priority and the associated enhanced distributed channel access (EDCA) parameters when the content bitrate is less than the scaled wireless link throughput, modified by a QoS bandwidth ratio.

9. The method of claim 1, wherein the content information is received through a feed-forward component of the media player.

10. At least one non-transitory computer accessible medium comprising computer executable instructions that, when executed by a wireless transmission device, direct the wireless transmission device to perform operations including:

receiving a content information from a media player of the wireless transmission device via an application programming interface (API) associated with the media player, wherein the content information corresponds to a multimedia content played by the media player;

receiving a link quality information of a link between the wireless transmission device and a remote display device from another API through a feedback element of the wireless transmission device;

selecting a video encoder bitrate based on the received content information and the link quality information;

encoding the multimedia content based on the selected video encoder bit rate; and

outputting the encoded multimedia content to an output component of the wireless transmission device to wirelessly stream the encoded content to the remote display device.

11. The at least one non-transitory computer accessible medium of claim 10, wherein the content information comprises at least one of:

a minimum bitrate, a maximum bitrate, a current bitrate, a resolution, a frame rate, a content type, and a codec information.

12. The at least one non-transitory computer accessible medium of claim 10, wherein the computer executable instructions direct the computer to perform further operations comprising:

decreasing the video encoder bitrate when the video encoder bitrate is greater than at least one of a content bitrate and a wireless link throughput.

13. The at least one non-transitory computer accessible medium of claim 10, wherein the computer executable instructions direct the computer to perform further operations comprising:

increase a quality of service (QoS) priority and associated enhanced distributed channel access (EDCA) parameters when a content bitrate is greater than a scaled wireless link throughput; and

decrease the quality of service (QoS) priority and the associated enhanced distributed channel access (EDCA) parameters when the content bitrate is less than the scaled wireless link throughput, modified by a QoS bandwidth ratio.

14. The at least one non-transitory computer accessible medium of claim 10, wherein the computer executable instructions direct the computer to perform further operations comprising:

decrease the video encoder bitrate by a preselected increment when a latency of the wireless stream exceeds a preselected latency threshold or a number of packets in a queue at the wireless transmission device exceeds a preselected queue size threshold.

15. The at least one non-transitory computer accessible medium of claim 10, wherein the computer executable instructions direct the computer to perform further operations comprising:

increase the video encoder bitrate by a preselected increment when a latency of the wireless stream is less than or equal to a preselected latency threshold or a number of packets in a queue at the wireless transmission device is less than or equal to a preselected queue size threshold, and the incremented video encoder bitrate is less than a content bitrate and a wireless link throughput, scaled to account for communication overhead.

16. A wireless transmission device, comprising:

a processor;

memory coupled to the processor;

a media component stored in the memory and operable on the processor to play a received multimedia content;

an adaptive streaming component stored in the memory and operable on the processor to;

receive a content information corresponding to the multimedia content from the media component via an application programming interface (API);

receive a link quality information of a link between the wireless transmission device and a remote display device from another API through a feedback element of an output component operable on the wireless transmission device;

select a video encoder bitrate based on the received content information and the link quality information;

encode the multimedia content based on the selected video encoder bitrate; and

output the encoded content to the output component; and

an output component stored in the memory and operable on the processor to output the encoded content; and

a transmission component configured to wirelessly stream the encoded multimedia content to the remote display device.

17. The wireless transmission device of claim 16, wherein the feedback element is coupled to the output component.

18. The wireless transmission device of claim 16, wherein the content information comprises at least one of:

a minimum bitrate, a maximum bitrate, a current bitrate, a resolution, a frame rate, a content type, and a codec information.