Transmitting and receiving real-time data

• US 7,974,200 B2
• Filed: 11/28/2001
• Issued: 07/05/2011
• Est. Priority Date: 11/29/2000
• Status: Active Grant

• Current Assignee: British Telecommunications PLC (BT Group PLC)
• Original Assignee: British Telecommunications PLC (BT Group PLC)
• Inventors: Walker, Matthew D, Jacobs, Richard J, Nilsson, Michael E
• Primary Examiner(s): Ngo; Ricky
• Assistant Examiner(s): Yuen; Kan
• Application Number:
  US10/415,819
• Publication Number:
  US 20040153951A1
• Time in Patent Office: 3,506 Days
• Field of Search: 370/230, 370/329, 370/337, 370/342, 370/412, 370/441, 370/487, 370/229, 370/230.1, 370/231, 370/232, 370/233, 370/234, 370/235, 370/395.2, 370/395.21, 375/147, 375/240.01, 375/240.12, 709/229, 345/531, 348/390.1, 725/87, 725/93, 725/94, 725/96, 725/118, 725/119
• US Class Current: 370/235
• CPC Class Codes: H04L 65/1083 In-session procedures
• CPC Class Codes: H04L 65/1101 Session protocols
• CPC Class Codes: H04L 65/70 Media network packetisation
• CPC Class Codes: H04L 65/752 adapting media to network capabilities
• CPC Class Codes: H04L 65/80 Responding to QoS
• CPC Class Codes: H04N 21/23406 involving management of server-side video buffer
• CPC Class Codes: H04N 21/23439 for generating different versions
• CPC Class Codes: H04N 21/2402 Monitoring of the downstream path of the transmission network, e.g. bandwidth available traffic monitoring in data switching networks H04L43/00; monitoring data switching networks utilization H04L43/0876
• CPC Class Codes: H04N 21/4384 involving operations to reduce the access time, e.g. fast-tuning for reducing channel switching latency
• CPC Class Codes: H04N 21/44209 Monitoring of downstream path of the transmission network originating from a server, e.g. bandwidth variations of a wireless network arrangements for maintenance or administration in data switching networks involving bandwidth and capacity management H04L41/0896
• CPC Class Codes: H04N 21/47202 for requesting content on demand, e.g. video on demand
• CPC Class Codes: H04N 21/6373 for rate control , e.g. request to the server to modify its transmission rate flow control in packet networks H04L47/10
• CPC Class Codes: H04N 21/6375 for requesting retransmission , e.g. of data packets lost or corrupted during transmission from serverARQ protocols H04L1/18; implementation or adaptation of Internet protocol [IP], of transmission control protocol [TCP] or of user datagram protocol [UDP] H04L69/16
• CPC Class Codes: H04N 21/64322 IP

Abstract

Real-time data (e.g. video) is streamed over packet networks (e.g. the Internet). Streamed video is provided without the start-up delay by transmitting data from a video streamer to the video viewer more rapidly than the video viewer consumes the data and using the excess data to build a buffer at the video viewer. When a suitable sized buffer is built the transmission rate of data to the buffer may be reduced. In order to deliver the best quality material for the available bandwidth, the supply of video data may be switched to a higher bit-rate source when the reservoir is filled. Fluctuations in network throughput may be accommodated during the transmission of data on a fine scale by adjusting the transmission rate of the data and on a coarse scale by switching between data streams encoded at different bit-rates. Fluctuations in network throughput are determined by counting the number of missing packets at the video viewer which information may then be fed back to the video streamer to adjust the flow of data accordingly.

Claims

1. A method of operating a real-time communication apparatus comprising a real-time data sender, a real-time data display device having a store, and a network connecting said sender and said display device, said method comprising:

operating said sender to transmit a plurality of first-encoding-rate data packets encoded at a first encoding rate and representing a first part of a real-time presentation to said display device at a transmission rate higher than said first encoding rate of said first-encoding-rate data packets;

operating said display device to;

receive said first-encoding-rate data packets into said store;

read-out said received first-encoding-rate data packets from said store at a data rate equal to said first encoding rate of said first-encoding-rate data packets for decoding so as to present said first part of said real-time presentation to a user at a first level of quality;

on said store being filled with said first-encoding-rate data to a predetermined level, sending an indication that said level has been reached to said data sender;

operating said data sender, on receipt of said indication from said display device, to send second-encoding-rate data packets encoded at a second encoding rate and representing subsequent parts of said real-time presentation to said display device, said second encoding rate of said second-encoding-rate data packets being higher than said first encoding rate of said first-encoding-rate data packets;

operating said display device to;

receive the second-encoding-rate data packets representing the subsequent part of real-time presentation into said store;

read out said second-encoding-rate data packets from said store at a data rate equal to said second encoding rate of said second-encoding-rate data packets for decoding so as to present said subsequent part of said real-time presentation to said user at a second level of quality which is higher than said first level of quality.

2. A operating a real-time communication system according to claim 1, wherein:

the rates at which the first-encoding-rate or second-encoding-rate data packets are written into said store are dependent on the quantity of data in the store.

3. A method of operating a real-time communication system in accordance with claim 1, wherein said real-time presentation represents, at least in part, video data.

4. A method of operating a communication apparatus comprising a data sender, a data presentation device having a store, and a network connecting said data sender and said data presentation device, said method comprising:

operating said data sender to transmit a first plurality of first-encoding-rate data packets encoded at a first encoding rate to said data presentation device, wherein said first plurality of first-encoding-rate data packets are transmitted at a first transmission rate which is higher than said first encoding rate of said first-encoding-rate data packets;

operating said data presentation device to;

receive said first plurality of first encoding rate data packets into said store;

read out said received first-encoding-rate data packets from said store at a data rate equal to said first encoding rate of said first-encoding-rate data packets for decoding so as to present to a user at a first level of quality, wherein the removing of said first-encoding-rate data packets from said store is initiated when said first-encoding-rate data packets first arrive at said store;

on said store being filled with data packets to a predetermined level, sending an indication to said data sender that said predetermined level has been reached;

operating said data sender, on receipt of said indication from said data presentation device, to transmit a second plurality of second-encoding-rate data packets encoded at a second encoding rate to said data presentation device, wherein said second plurality of second-encoding-rate data packets are transmitted at a second transmission rate which is higher than said first transmission rate; and

wherein said second encoding rate is higher than said first encoding rate;

operating said data presentation device to;

receive said second plurality of second-encoding-rate data packets into said store;

read out said second-encoding-rate data packets from said store at a data rate equal to said second encoding rate of said second-encoding-rate data packets for decoding, so as to present to said user at a second level of quality, wherein said second level of quality is higher than said first level of quality.

5. A method of operating a real-time communication apparatus comprising a real-time data sender, a real-time data display device having a store, and a network connecting said sender and said display device, said method comprising:

operating said sender to transmit a plurality of first-encoding-rate data packets encoded at a first encoding rate and representing a first part of a real-time presentation to said display device at a transmission rate higher than said first encoding rate of said first-encoding-rate data packets;

operating said display device to;

receive said first-encoding-rate data packets into said store;

read-out said received first-encoding-rate data packets from said store at a data rate equal to said first encoding rate of said first-encoding-rate data packets for decoding so as to present said first part of said real-time presentation to a user at a first level of quality;

on said store being filled with said first-encoding-rate data to a predetermined level, sending an indication that said level has been reached to said data sender;

operating said data sender, on receipt of said indication from said display device, to send second-encoding-rate data packets encoded at a second encoding rate and representing subsequent parts of said real-time presentation to said display device, said second encoding rate of said second-encoding-rate data packets being higher than said first encoding rate of said first-encoding-rate data packets;

operating said display device to;

receive the second-encoding-rate data packets representing the subsequent part of real-time presentation into said store;

read out said second-encoding-rate data packets from said store at a data rate equal to said second encoding rate of said second-encoding-rate data packets for decoding so as to present said subsequent part of said real-time presentation to said user at a second level of quality which is higher than said first level of quality;

wherein said display device sends packet loss information to the sender and

in response to receiving said packet loss information, said sender reduces the transmission rate of said second-encoding rate data packets to the display device.

6. A method according to claim 5, wherein said sender determines whether sustained packet loss has occurred and

in response to such a determination, sends first encoding rate data packets to the display device.

7. A real-time communication system comprising:

a real-time data sender;

a real-time data display device having a store; and

a network connecting said sender and said display device,

wherein;

said sender is operable to transmit first-encodingrate data packets encoded at a first encoding rate and representing a first part of a real-time presentation to said display device with a transmission rate higher than said first encoding rate of said first-encoding-rate data packets;

said display device being operable to;

receive said first-encoding rate data packets into said store;

read out said received first-encoding-rate data packets from said store at a data rate equal to said first encoding rate of said first-encoding-rate data packets for decoding, so as to present said first part of said real-time presentation to a user at a first level of quality; and

on said store being filled with said first encoding rate data to a predetermined level, sending an indication that said level has been reached to said sender;

characterised in that;

said sender is operable, on receipt of said indication, to send second-encoding-rate data packets encoded at a second encoding rate and representing subsequent parts of said real-time presentation to said display device, said second encoding rate of said second-encoding-rate data packets being higher than said first encoding rate of said first-encoding-rate data packets;

wherein said display device is further operable to;

receive second encoding rate data packets representing a subsequent part of the real-time presentation into said store;

read out the second encoding rate data packets from said store at a data rate equal to said second encoding rate of said second-encoding-rate data packets for decoding, so as to present said subsequent part of said real-time presentation to said user at a second level of quality which is higher than said first level of quality.

8. A real-time communication system comprising:

a real-time data sender;

a real-time data display device having a store; and

a network connecting said sender and said display device,

wherein;

said sender is operable to transmit first-encoding-rate data packets encoded at a first encoding rate and representing a first part of a real-time presentation to said display device with a transmission rate higher than said first encoding rate of said first-encoding-rate data packets;

said display device being operable to;

receive said first-encoding rate data packets into said store;

read out said received first-encoding-rate data packets from said store at a data rate equal to said first encoding rate of said first-encoding-rate data packets for decoding, so as to present said first part of said real-time presentation to a user at a first level of quality; and

on said store being filled with said first encoding rate data to a predetermined level, sending an indication that said level has been reached to said sender;

characterised in that;

said sender is operable, on receipt of said indication, to send second-encoding-rate data packets encoded at a second encoding rate and representing subsequent parts of said real-time presentation to said display device, said second encoding rate of said second-encoding-rate data packets being higher than said first encoding rate of said first-encoding-rate data packets;

wherein said display device is further operable to;

receive second encoding rate data packets representing a subsequent part of the real-time presentation into said store;

read out the second encoding rate data packets from said store at a data rate equal to said second encoding rate of said second-encoding-rate data packets for decoding, so as to present said subsequent part of said real-time presentation to said user at a second level of quality which is higher than said first level of quality

wherein said display device further comprises packet loss detecting means for detecting packet loss and sending packet loss information to the sender; and

in response to receiving said packet loss information, said sender is further operable to reduce the transmission rate of said second encoding rate data packets to the display device.

9. A system according to claim 8, wherein said sender further comprises determining means for determining whether sustained packet loss has occurred;

and

in response to said determining means making a determination of sustained packet loss, sending first encoding rate data packets to the display device.

10. A real-time data display device configured to communicate with a real-time data sender over a network, the real-time data display device comprising:

a store; and

a processing system having a configuration operable to;

receive, at the display device and from the real-time data sender, first-encoding-rate data packets encoded at a first encoding rate and representing a first part of a real-time presentation for said display device with a transmission rate higher than said first encoding rate of said first-encoding-rate data packets;

receive said first-encoding rate data packets into said store;

read out said received first-encoding-rate data packets from said store at a data rate equal to said first encoding rate of said first-encoding-rate data packets for decoding, so as to present said first part of said real-time presentation to a user at a first level of quality;

on said store being filled with said first encoding rate data to a predetermined level, send an indication that said level has been reached to said sender;

after the indication has been sent, receive, at the display device and from the real-time data sender, second-encoding-rate data packets encoded at a second encoding rate and representing subsequent parts of said real-time presentation for said display device, said second encoding rate of said second-encoding-rate data packets being higher than said first encoding rate of said first-encoding-rate data packets;

receive second encoding rate data packets representing a subsequent part of the real-time presentation into said store; and

read out the second encoding rate data packets from said store at a data rate equal to said second encoding rate of said second-encoding-rate data packets for decoding, so as to present said subsequent part of said real-time presentation to said user at a second level of quality which is higher than said first level of quality.

11. A real-time data display device according to claim 10 wherein:

said processing system is configured to detect packet loss and send packet loss information to the sender; and

the display device is configured to, after sending said packet loss information, receive said second encoding rate data packets at a reduced rate.

12. A real-time data display device according to claim 11, wherein the display device is configured to, after a determination that sustained packet loss has occurred, receive first encoding rate data packets at the display device.