Dynamic modification of video properties

• US 20080115185A1
• Filed: 10/31/2006
• Published: 05/15/2008
• Est. Priority Date: 10/31/2006
• Status: Abandoned Application

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Crinon, Regis J., Qiu, Jingyu, Moore, Timothy Mark
• Application Number:
  US11/591,297
• Publication Number:
  US 20080115185A1
• Time in Patent Office: Days
• US Class Current: 725/118
• CPC Class Codes: H04N 17/004 for digital television systems
• CPC Class Codes: H04N 19/114 Adapting the group of pictures [GOP] structure, e.g. number of B-frames between two anchor frames H04N19/107 takes precedence
• CPC Class Codes: H04N 19/132 Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
• CPC Class Codes: H04N 19/154 Measured or subjectively estimated visual quality after decoding, e.g. measurement of distortion use of rate-distortion criteria H04N19/147
• CPC Class Codes: H04N 19/164 Feedback from the receiver or from the transmission channel
• CPC Class Codes: H04N 19/177 the unit being a group of pictures [GOP]
• CPC Class Codes: H04N 19/587 involving temporal sub-sampling or interpolation, e.g. decimation or subsequent interpolation of pictures in a video sequence
• CPC Class Codes: H04N 21/2343 involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements video transcoding H04N19/40; media packet handling at the source H04L65/762
• CPC Class Codes: H04N 21/2402 Monitoring of the downstream path of the transmission network, e.g. bandwidth available traffic monitoring in data switching networks H04L43/00; monitoring data switching networks utilization H04L43/0876
• CPC Class Codes: H04N 21/6437 Real-time Transport Protocol [RTP]
• CPC Class Codes: H04N 21/64792 Controlling the complexity of the content stream, e.g. by dropping packets intermediate media network packet handling H04L65/765; proxy provisioning conversion or adaptation for reducing the amount or size of exchanged application data H04L67/5651; negotiation of resources in wireless networks H04W28/16

Abstract

Aspects of the present invention are directed at improving the quality of a video stream that is transmitted between networked computers. In accordance with one embodiment, a method is provided that dynamically modifies the properties of a video stream based on network conditions. In this regard, the method includes collecting quality of service data that describes the network conditions that exist when the video stream is being transmitted. Then, the amount of predicted artifact in the video stream is calculated using the collected data. In response to identifying a triggering event, the method modifies the properties of the video stream to account for the network conditions.

Claims

1. In a networking environment that includes a sending device and a receiving device, a method of minimizing artifact in a video stream, the method comprising:

(a) establishing default properties for transmitting the video stream;

(b) initiating transmission of the video stream based on the default properties;

(c) collecting data about the network conditions that exist while the video stream is being transmitted; and

(d) modifying the default properties of the video stream to account for the network conditions.

2. The method as recited in claim 1, wherein establishing default properties for transmitting the video stream includes identifying a group of picture value, frame rate, and distribution of frame types that will minimize artifact in the video stream given the anticipated network conditions.

3. The method as recited in claim 1, wherein frames in the video stream are communicated using the real time transport protocol and wherein data that describe the network conditions are communicated in accordance with the real-time control protocol.

4. The method as recited in claim 1, wherein frames in the video stream are compressed into a plurality of different frame types and wherein modifying the default properties of the video stream includes changing the distribution of frame types.

5. The method as recited in claim 1, wherein collecting data about the network conditions that exist when the video stream is being transmitted includes identifying the packet loss rate.

6. The method as recited in claim 1, wherein collecting data about network conditions that exist while the video stream is being transmitted includes calculating the amount of predicted artifact in the video stream.

7. The method as recited in claim 6, wherein the default properties of the video stream are modified in response to the predicted artifact in the video stream intersecting a threshold value.

8. The method as recited in claim 1, wherein modifying the default properties of the video stream includes applying a different strength to the redundancy in channel coding for the video stream if a threshold increase in the packet loss rate is identified.

9. The method as recited in claim 1, wherein modifying the default properties of the video stream includes:

determining whether error recovery is being performed; and

if error recovery is being performed, increasing the group of picture value to achieve a corresponding reduction in artifact.

10. The method as recited in claim 9, further comprising, if error recovery is not being performed, decreasing the group of picture value to achieve a corresponding reduction in artifact.

11. A system for modifying the properties of a video stream based on network conditions, the system comprising:

(a) a sending device that includes at least one software component for encoding a video stream and sending the encoded video stream over an upstream network connection;

(b) one or more receiving devices that include at least one software component for receiving and decoding the video stream received on a downstream network connection; and

(c) a control unit device with one or more software components that establish default properties to transmit the video stream, collect data about the network conditions that exist when the video stream is being transmitted on the upstream and downstream network connections, and modify the default properties to account for the network conditions.

12. The system as recited in claim 11, wherein the control unit device is further configured to:

aggregate data that describes the network conditions on the downstream network connections;

use a mathematical model to identify an optimized set of video properties to encode the video stream on the sending device;

wherein the set of optimized video properties account for network conditions observed on the downstream network connections; and

cause the video stream to be encoded on the sending device in accordance with the set of optimized video properties for transmission on the upstream network connection.

13. The system as recited in claim 11, wherein the control unit device is further configured to:

obtain data that describes the network conditions on a downstream network connection;

use a mathematical model to identify an optimized set of video properties to transcode the video stream on the control unit device;

wherein the set of optimized video properties account for network conditions observed on the downstream network connection; and

cause the video stream to be transcoded in accordance with the set of optimized video properties for transmission on the downstream network connection.

14. A computer-readable medium containing computer-readable instructions which, when executed in a networking environment that includes a sending device and a receiving device, performs a method of dynamically modifying the properties of a video stream, the method comprising:

(a) collecting quality of service data about a video stream being transmitted from the sending device to the receiving device;

(b) using the quality of service data to calculate the predicted artifact in the video stream; and

(c) in response to identifying a triggering event, modifying the properties of the video stream to minimize artifact.

15. The computer-readable medium as recited in claim 14, wherein calculating the predicted artifact includes determining whether error recovery is being performed;

wherein if error recovery is being performed, modifying the properties of the video stream includes increasing the group of picture value to achieve a corresponding reduction in artifact; and

wherein if error recovery is not being performed, modifying the properties of the video stream includes decreasing the group of picture value to achieve a corresponding reduction in artifact.

16. The computer readable-medium as recited in claim 14, wherein frames in the video stream are compressed into a plurality of different frame types, and wherein modifying the properties of the video stream, includes:

identifying a compression mode used by an encoder to compress each frame type in the video stream;

using a mathematical model to identify an optimized set of video properties to encode each frame type in the video stream.

17. The computer-readable medium as recited in claim 14, wherein a triggering event that initiates a modification in the properties of the video stream is the amount of predicted artifact intersecting a threshold value.

18. The computer-readable medium as recited in claim 14, wherein a triggering event that initiates a modification in the properties of the video stream is a change in the packet loss rate.

19. The computer-readable medium as recited in claim 14, wherein modifying the default properties of the video stream includes applying a different strength of redundancy in channel coding that is dependent on the frame type.

20. The computer-readable medium as recited in claim 14, wherein the properties of the video stream that are modified include the group of picture values, frame rate, and/or distribution of frame types.