Data streaming through time-varying transport media

• US 8,135,856 B2
• Filed: 11/03/2010
• Issued: 03/13/2012
• Est. Priority Date: 07/28/2008
• Status: Active Grant

• Current Assignee: Masimo Corporation
• Original Assignee: Vantrix Corporation
• Inventors: Labonte, Francis Roger, Cote, Sebastien, Lefebvre, Yves
• Primary Examiner(s): SERRAO, RANODHI N
• Application Number:
  US12/939,062
• Publication Number:
  US 20110047283A1
• Time in Patent Office: 496 Days
• Field of Search: 709/203, 709/231, 709/233, 370/229, 370/235
• US Class Current: 709/233
• CPC Class Codes: H04L 41/142 using statistical or mathematical methods
• CPC Class Codes: H04L 43/00 Arrangements for monitoring or testing data switching networks
• CPC Class Codes: H04L 43/0829 Packet loss
• CPC Class Codes: H04L 43/0852 Delays
• CPC Class Codes: H04L 43/16 Threshold monitoring
• CPC Class Codes: H04L 47/10 Flow control; Congestion control
• CPC Class Codes: H04L 47/283 in response to processing delays, e.g. caused by jitter or round trip time [RTT]
• CPC Class Codes: H04L 47/29 using a combination of thresholds
• CPC Class Codes: H04L 47/30 in combination with information about buffer occupancy at either end or at transit nodes
• CPC Class Codes: H04L 47/38 by adapting coding or compression rate
• CPC Class Codes: H04L 65/00 Network arrangements, protocols or services for supporting real-time applications in data packet communication real-time or near real-time messaging, e.g. instant messaging [IM] H04L51/04; selective video distribution H04N21/00
• CPC Class Codes: H04L 65/613 for the control of the source by the destination control signals issued by the client directed to the server or network components specially adapted for selective content distribution H04N21/637
• CPC Class Codes: H04L 65/65 Network streaming protocols, e.g. real-time transport protocol [RTP] or real-time control protocol [RTCP]
• CPC Class Codes: H04L 65/752 adapting media to network capabilities
• CPC Class Codes: H04L 65/80 Responding to QoS
• CPC Class Codes: H04N 21/4126 The peripheral being portable, e.g. PDAs or mobile phones
• CPC Class Codes: H04N 21/47815 Electronic shopping payment schemes, payment architectures or payment protocols for electronic shopping systems G06Q20/12
• CPC Class Codes: H04N 21/64322 IP
• CPC Class Codes: H04N 21/812 involving advertisement data advertising per se G06Q30/02

Abstract

Methods of data streaming from an encoder to a decoder through a connection subjected to time-varying conditions are disclosed. The connection is assigned a nominal flow rate and an encoding coefficient associated with the connection modifies the nominal flow rate to determine a permissible flow rate compatible with a time-varying state of the connection. Multiple performance characteristics are associated with the connection and corresponding sets of performance measurements taken over adaptively selected time windows are acquired. Performance metrics having one-to-one correspondence to the performance characteristics are determined and compared with lower bounds and upper bounds of respective predefined acceptance intervals. A current encoding coefficient is computed as a function of the performance metrics and used to determine the permissible flow rate. The encoder'"'"'s configuration is adapted to produce an encoded signal which maximizes signal fidelity under the constraint of the permissible flow rate.

Claims

1. A method of data streaming from an encoder to a decoder through a time-varying connection, the method comprising:

employing a hardware processor coupled to said encoder to perform;

associating an encoding coefficient with said time-varying connection, said encoding coefficient determining a flow rate of an output of said encoder;

associating multiple performance characteristics with said time-varying connection;

defining multiple performance metrics having one-to-one correspondence to said multiple performance characteristics;

at a current encoding coefficient, acquiring multiple sets of performance measurements of said time-varying connection over a time window, each set of performance measurements corresponding to one of said multiple performance characteristics;

determining a current value of each performance metric using a corresponding set of performance measurements to produce a set of current values of performance metrics;

determining a preferred encoding coefficient according to said current value of each performance metric;

determining a set of acceptance intervals, each acceptance interval corresponding to a respective performance metric and having a respective lower bound and a respective upper bound;

increasing said current encoding coefficient to produce said preferred encoding coefficient subject to a determination that each element in said set of current values is lower than a lower bound of a corresponding acceptance interval; and

decreasing said current encoding coefficient to produce said preferred encoding coefficient subject to a determination that at least one element in said set of current values exceeds an upper bound of a corresponding acceptance interval.

2. The method of claim 1 wherein said multiple performance characteristics comprise transfer delay, data loss, and occupancy of a decoder buffer holding data received through said time-varying connection and said multiple performance metrics comprise:

a parameter of transfer delay from said encoder to said decoder during said time window;

a parameter of data loss during said time window; and

a parameter of occupancy of said decoder buffer during said time window.

3. The method of claim 2 wherein:

said parameter of transfer delay is a mean value of a selected number of transfer-delay measurements;

said parameter of data loss is a mean value of a selected number of data-loss-ratio measurements; and

said parameter of occupancy is a mean value of a selected number of measurements of occupancy of said decoder buffer.

4. The method of claim 2 wherein:

said parameter of transfer delay is a moving-average of transfer-delay measurements;

said parameter of data loss is a moving-average of data-loss-ratio measurements; and

said parameter of occupancy is a moving-average of measurements of occupancy of said decoder buffer.

5. The method of claim 2 wherein:

said parameter of transfer delay is a summation of transfer-delay measurements for a predefined number of measurements;

said parameter of data loss is a summation of data-loss-ratio measurements for said predefined number of measurements; and

said parameter of occupancy is a summation of measurements of occupancy of said decoder buffer for said predefined number of measurements.

6. The method of claim 1 wherein said increasing comprises multiplying said current encoding coefficient by a first factor, said decreasing comprises multiplying said current encoding coefficient by a second factor and wherein a product of said first factor and said second factor is less than 1.

7. The method of claim 1 further comprising a step of selecting said time window to succeed a preceding time window by at least a predefined minimum time gap.

8. The method of claim 1 wherein said acquiring comprises exchanging control data between said encoder and said decoder using the real-time transport protocol (RTP) and the real-time transport control protocol (RTCP).

9. The method of claim 1 further comprising determining a composite metric as a weighted sum of normalized values of said multiple performance metrics.

10. The method of claim 1 wherein said time window is one of a succession of disjoint time windows.

11. The method of claim 1 wherein said time window is one of a succession of overlapping time windows.

12. The method of claim 1 further comprising determining said encoding coefficient as a predefined function of said multiple performance metrics.

13. A system for data streaming comprising:

a plurality of client devices, each client device having a client processor and a decoding device; and

a streaming server in communication with said plurality of client devices through a communication network, said streaming server comprising at least one server processor, an encoder, and a flow controller configured to;

associate an encoding coefficient with a time-varying connection between said streaming server and a selected client device, said encoding coefficient determining a flow rate of an output of said encoder;

acquire multiple sets of performance measurements of said time-varying connection over a time window, each set of performance measurements corresponding to one of predefined multiple performance characteristics of said time-varying connection;

determine a set of current values of performance metrics, having a one-to-one correspondence to said multiple performance characteristics, using a corresponding set of performance measurements;

determine a preferred encoding coefficient according to said current values;

maintain a set of acceptance intervals, each acceptance interval corresponding to a respective performance metric and having a respective lower bound and a respective upper bound; and

increasing a current encoding coefficient to produce said preferred encoding coefficient subject to a determination that each element in said set of current values is lower than a lower bound of a corresponding acceptance interval; and

decreasing said current encoding coefficient to produce said preferred encoding coefficient subject to a determination that at least one element in said set of current values exceeds an upper bound of a corresponding acceptance interval.

14. The system of claim 13 further comprising a decoder buffer coupled to said decoding device for holding data received from said streaming server.

15. The system of claim 13 wherein said multiple performance characteristics comprise:

transfer delay;

data loss; and

occupancy of said decoder buffer;

and wherein said multiple performance metrics comprise;

a parameter of transfer delay from said encoder to said decoder during said time window;

a parameter of data loss during said time window; and

a parameter of occupancy of said decoder buffer during said time window.

16. The system of claim 13 wherein said flow controller is further configured to determine a first factor for increasing said current encoding coefficient and a second factor for decreasing said current encoding coefficient, where a product of said first factor and said second factor is less than 1.

17. The system of claim 13 wherein said flow controller is further configured to select said time window to succeed a preceding time window by at least a predefined minimum time gap.

18. The system of claim 13 wherein said streaming server is configured to exchange control data between said encoder and said decoder using the real-time transport protocol (RTP) and the real-time transport control protocol (RTCP) in order to acquire said multiple sets of performance measurements.

19. The system of claim 13 wherein said connection carries a video signal and wherein said flow controller is further configured to cause said encoder to control said flow rate by modifying at least one of:

a frame rate of said video signal; and

content per frame.