Adaptive video streaming system and method

• US 8,228,982 B2
• Filed: 09/22/2009
• Issued: 07/24/2012
• Est. Priority Date: 09/23/2008
• Status: Active Grant

• Current Assignee: UTC Fire & Security Corporation (Raytheon Technologies Corporation d/b/a RTX)
• Original Assignee: UTC Fire & Security Corporation (Raytheon Technologies Corporation d/b/a RTX)
• Inventors: Qian, Zhebin, Zhang, Yu, Xu, Li, Liu, Ping
• Primary Examiner(s): Lai, Andrew
• Assistant Examiner(s): NGO, NGUYEN HOANG
• Application Number:
  US12/564,303
• Publication Number:
  US 20100074324A1
• Time in Patent Office: 1,036 Days
• Field of Search: 37524016-24021, 375/240, 375/240.02, 375/240.12
• US Class Current: 375/240.02
• CPC Class Codes: H04L 47/10 Flow control; Congestion control
• CPC Class Codes: H04L 47/2416 Real-time traffic
• CPC Class Codes: H04L 47/25 with rate being modified by the source upon detecting a change of network conditions
• CPC Class Codes: H04L 47/38 by adapting coding or compression rate
• CPC Class Codes: H04N 21/234327 by decomposing into layers, e.g. base layer and one or more enhancement layers
• CPC Class Codes: H04N 21/2402 Monitoring of the downstream path of the transmission network, e.g. bandwidth available traffic monitoring in data switching networks H04L43/00; monitoring data switching networks utilization H04L43/0876
• CPC Class Codes: H04N 21/2404 Monitoring of server processing errors or hardware failure error or fault detection G06F11/07; monitoring in general G06F11/30
• CPC Class Codes: H04N 21/64322 IP
• CPC Class Codes: H04N 21/64723 Monitoring of network processes or resources, e.g. monitoring of network load traffic related reporting in data switching networks H04L43/062

Abstract

A method of transmitting a video stream over an IP network. The method includes encoding a source video into a plurality of packets. The method also includes measuring a real-time transmission status of a current set of the plurality of packets. The method also includes mapping a utility curve for the video which reflects utilities of the video at corresponding sending rates. The method also includes calculating a target sending rate for a next set of the plurality of packets according to the real-time transmission status of the current set of the plurality of packets and the utility curve. The method also includes determining a proper strategy to meet the target sending rate for the next set of the plurality of packets.

Claims

1. A method of transmitting a video stream over an IP network, the method comprising:

encoding a source video into a plurality of packets;

measuring a real-time transmission status of a current set of the plurality of packets, wherein measuring the real-time transmission status includes measuring a sending rate and a receiving rate of the current set of the plurality of packets by a receiver;

mapping a utility curve for the source video which reflects utilities of the source video at corresponding sending rates;

calculating a target sending rate for a next set of the plurality of packets according to the, real-time transmission status of the current set of the plurality of packets and the utility curve; and

determining a proper strategy to meet the target sending rate for the next set of the plurality of packets.

2. The method of claim 1, wherein encoding a source video includes encoding the source video with selectable layers.

3. The method of claim 2, wherein encoding the source video into selectable layers includes encoding the source video temporally into selectable temporal layers.

4. The method of claim 2, wherein encoding the source video into selectable layers includes encoding the source video spatially into selectable spatially layers.

5. The method of claim 2, wherein encoding the source video into selectable layers includes encoding the source video both temporally and spatially.

6. The method of claim 2, wherein encoding a source video into a plurality of packets includes encoding the source video into a series of groups of pictures, each group of pictures having a plurality of frames, and each group of pictures beginning with an independently encoded I frame and including one or more following P frames.

7. The method of claim 6, wherein mapping a utility curve for the video includes mapping the utilities at different selectable layers, the layers corresponding to a different sending rate.

8. The method of claim 6, wherein utilities of the utility curve at a corresponding layer is determined by importance of the frames at the corresponding layer.

9. The method of claim 2, wherein determining a proper strategy to get the target sending rate of the next set of the plurality of packets comprises selecting a corresponding layer according to the target sending rate.

10. The method of claim 1, wherein calculating a target sending rate for a next set of the plurality of packets according to the real-time transmission status of the current set of the plurality of packets and the utility curve includes mapping the sending rate of the current set of plurality of packets measured by the receiver to a nearest point on the utility curve and calculating the target sending rate according to a ratio of a gradient of the nearest point with a maximum gradient of the utility curve.

11. The method of claim 1, comprising:

mapping a utility curve for each video stream in an IP network.

12. The method of claim 11, comprising:

calculating a target sending rate of a next set of packet for each video stream independently.

13. A control system, comprising:

an encoder configured to encode a video stream with selectable layers for extraction;

a link-sensing module configured to measure a real-time transmission status for a current set of packets of the video stream;

a rate allocation module configured to get the real-time transmission status information from the link-sensing module, the rate allocation module defining a utility curve which reflects utilities of the video stream at corresponding selectable layers, the rate allocation module being configured to determine a target sending rate for a next set of packets according to the real-time transmission status of the current set of packets and the utility curve; and

a stream optimization module configured to determine a control strategy to meet the target sending rate for the next set of packets.

14. The control system according to claim 13, wherein the encoder is configured to encode the video stream temporally.

15. The control system according to claim 13, wherein the encoder is configured to encode the video spatially.

16. The control system according to claim 13 comprising:

at least two rate allocation modules, each rate allocation module defining a utility curve for a corresponding video stream.

17. The control system according to claim 13, wherein the link-sensing module comprise an application interface for inputting an application parameter.

18. A method of transmitting a video stream over an IP network, the method comprising:

encoding a source video into a plurality of packets;

measuring a real-time transmission status of a current set of the plurality of packets, wherein measuring the real-time transmission status includes measuring a sending rate and a receiving rate of the, current set of the, plurality of packets by a receiver;

mapping a utility curve for the source video which reflects utilities of the source video at corresponding sending rates;

calculating a target sending rate for a next set of the plurality of packets according to the real-time transmission status of the current set of the plurality of packets and the utility curve; and

transmitting at the target sending rate for the next set of the plurality of packets.

19. The method of claim 18, further comprising:

mapping a utility curve for each video stream in an IP network.

20. The method of claim 19, further comprising:

calculating a target sending rate of a next set of packet for each video stream independently.