System for transmitting stream data from server to client based on buffer and transmission capacities and delay time of the client

• US 7,016,970 B2
• Filed: 07/05/2001
• Issued: 03/21/2006
• Est. Priority Date: 07/06/2000
• Status: Active Grant

• Current Assignee: Sun Patent Trust
• Original Assignee: Matsushita Electric Industrial Company Limited (Panasonic Holdings Corporation)
• Inventors: Horiuchi, Masaki, Harumoto, Hideaki, Fujita, Takahisa
• Primary Examiner(s): Luu, Le Hien
• Application Number:
  US09/898,004
• Publication Number:
  US 20020004840A1
• Time in Patent Office: 1,720 Days
• Field of Search: 709/231, 709/203, 709/206, 709/233, 709/219, 709/237
• US Class Current: 709/233
• CPC Class Codes: H04L 47/10 Flow control; Congestion control
• CPC Class Codes: H04L 47/2416 Real-time traffic
• CPC Class Codes: H04L 47/263 Rate modification at the source after receiving feedback
• CPC Class Codes: H04L 47/30 in combination with information about buffer occupancy at either end or at transit nodes
• CPC Class Codes: H04L 65/612 for unicast
• CPC Class Codes: H04L 65/762 at the source reformatting of additional data in video distribution servers H04N21/2355
• CPC Class Codes: H04L 65/80 Responding to QoS
• CPC Class Codes: H04N 2007/17381 the upstream transmission being initiated by the user terminal
• CPC Class Codes: H04N 21/23406 involving management of server-side video buffer
• CPC Class Codes: H04N 21/234381 by altering the temporal resolution, e.g. decreasing the frame rate by frame skipping
• CPC Class Codes: H04N 21/2383 Channel coding or modulation of digital bit-stream, e.g. QPSK modulation arrangements for detecting or preventing errors in the information received by adapting the channel coding H04L1/0009; analogue front ends or means for connecting modulators, demodulators or transceivers to a transmission line H04L27/0002
• CPC Class Codes: H04N 21/25808 Management of client data terminal profiles in network data switching protocols H04L67/303
• CPC Class Codes: H04N 21/2662 Controlling the complexity of the video stream, e.g. by scaling the resolution or bitrate of the video stream based on the client capabilities
• CPC Class Codes: H04N 21/4331 Caching operations, e.g. of an advertisement for later insertion during playback
• CPC Class Codes: H04N 21/4382 Demodulation or channel decoding, e.g. QPSK demodulation analog front ends or means for connecting modulators, demodulators or transceivers to a transmission line H04L27/0002
• CPC Class Codes: H04N 21/44004 involving video buffer management, e.g. video decoder buffer or video display buffer
• CPC Class Codes: H04N 21/440281 by altering the temporal resolution, e.g. by frame skipping television signal recording using magnetic recording on tape for reproducing at a rate different from the recording rate H04N5/783
• CPC Class Codes: H04N 21/44209 Monitoring of downstream path of the transmission network originating from a server, e.g. bandwidth variations of a wireless network arrangements for maintenance or administration in data switching networks involving bandwidth and capacity management H04L41/0896
• CPC Class Codes: H04N 21/6373 for rate control , e.g. request to the server to modify its transmission rate flow control in packet networks H04L47/10
• CPC Class Codes: H04N 21/6377 directed to server one-way streaming services wherein the source is controlled by the destination H04L65/613
• CPC Class Codes: H04N 21/643 : Communication protocols network streaming protocols, e.g. real-time transport protocol [RTP] or real-time control protocol [RTCP], H04L65/65
• CPC Class Codes: H04N 21/658 : Transmission by the client directed to the server
• CPC Class Codes: Y02D 30/50 : in wire-line communication networks, e.g. low power modes or reduced link rate

Abstract

A terminal determines a target value of stream data to be stored in its buffer in relation to its buffer capacity and the transmission capacity of the network. Also, the terminal arbitrarily determines a delay time from when the terminal writes a head data of the stream data to the buffer to when the terminal reads the data to start playback in a range not exceeding a value obtained by dividing the buffer capacity by the transmission capacity. The target value and the delay time are then both notified to a server. Based on those notified values, the server controls the transmission speed so that the buffer occupancy of the terminal changes in the vicinity of the target value without exceeding the target value.

Claims

1. A streaming method in which a server transmits stream data to a terminal over a network, and the terminal plays back the stream data while receiving the stream data from the server,

wherein, in the terminal, said method comprises:

determining a target value of the stream data to be stored in a buffer of the terminal in relation to a buffer capacity of the terminal and a transmission capacity of the network;

arbitrarily determining, in a range not exceeding a value obtained by dividing the buffer capacity by the transmission capacity, a delay time from when the terminal writes head data of the stream data to the buffer to when the terminal reads the data to start playback;

notifying the server of the determined target value and the determined delay time; and

wherein, in the server, said method comprises controlling a transmission speed based on the notified target value and the notified delay time when the server transmits the stream data to the terminal over the network.

2. The streaming method according to claim 1, wherein in said controlling of the transmission speed, the server controls the transmission speed so that an amount of the stream data stored in the buffer of the terminal changes in the vicinity of the target value without exceeding the target value.

3. The streaming method according to claim 2, wherein in said controlling of the transmission speed, the server estimates and calculates the amount of the stream data stored in the buffer of the terminal based on the transmission speed, the delay time, and a speed of the terminal decoding the stream data.

4. The streaming method according to claim 1, wherein, in the terminal said method further comprises:

detecting whether the transmission capacity of the network exceeds a predetermined threshold value;

changing the target value based on a result detected in said detecting; and

notifying the server of a new target value after the target value is changed in said changing of the target value; and

wherein, in said controlling of the transmission speed, when receiving the new target value after the target value is changed, the server controls the transmission speed so that the amount of the stream data stored in the buffer of the terminal changes in the vicinity of the new target value after the target value is changed without exceeding the new target value after the target value is changed.

5. The streaming method according to claim 4, wherein:

in said detecting, when detecting that the transmission capacity of the network falls short of a first threshold value, the terminal controls the target value to be increased in said changing of the target value; and

in said controlling of the transmission speed, in response to the target value being increased, the server controls the transmission speed to be increased.

6. The streaming method according to claim 5, wherein the first threshold value is approximately a median value of an achievable maximum transmission capacity and a transmission capacity with which a stream data transfer loss starts occurring.

7. The streaming method according to claim 4, wherein:

in said detection, when detecting that the transmission capacity of the network falls short of a second threshold value which is smaller than a first threshold value, the terminal controls the target value to be decreased in said changing of the target value; and

in said control of the transmission speed, in response to the target value being decreased, the server controls the transmission speed to be decreased.

8. The streaming method according to claim 7, wherein the second threshold value is a value corresponding to the transmission capacity with which the stream data transfer loss starts occurring.

9. The streaming method according to claim 8, wherein, when the terminal controls the target value to be decreased in said changing of the target value, the server controls the transmission speed to be decreased by comparing a presentation time of each frame structuring the stream data to be transmitted with a current time, and by skipping transmitting any frame whose presentation time is older than the current time.

10. The streaming method according to claim 8, wherein, when the terminal controls the target value to be decreased in said changing of the target value, the server, in said controlling the transmission speed,

compares a priority level of each frame structuring the stream data to be transmitted with a reference value,

skips transmitting each frame whose priority level is lower than the reference value, and

compares each presentation time for any frame whose priority level is higher than the reference value with the current time, and skips transmitting any frame whose presentation time is older than the current time.

11. A system including a server for transmitting stream data over a network, and a terminal for playing back the stream data while receiving the stream data from said server,

wherein said terminal comprises:

target value determination means for determining a target value of stream data to be stored in a buffer of said terminal in relation to a buffer capacity of said terminal and a transmission capacity of the network;

delay time determination means for arbitrarily determining, in a range not exceeding a value obtained by dividing the buffer capacity by the transmission capacity, a delay time from when said terminal writes head data of the stream data to the buffer to when said terminal reads the data to start playback; and

notifying means for notifying the server of the target value determined by said target value determination means and the delay time determined by said delay time determination means; and

wherein said server comprises control means for controlling a transmission speed based on the notified target value and the delay time when transmitting the stream data to said terminal over the network.

12. A terminal working with a server for transmitting stream data over a network, and playing back the stream data while receiving the stream data from said server,

wherein said server comprises control means for controlling a transmission speed based on a target value and a delay time when transmitting the stream data to said terminal over the network;

and

wherein said terminal comprises;

target value determination means for determining the target value of the stream data to be stored in a buffer of said terminal in relation to a buffer capacity of said terminal and a transmission capacity of the network;

delay time determination means for arbitrarily determining, in a range not exceeding a value obtained by dividing the buffer capacity by the transmission capacity, the delay time from when said terminal writes head data of the stream data to the buffer to when said terminal reads the data to start playback; and

notifying means for notifying said server of the target value determined by said target value determination means and the delay time determined by said delay time determination means.

13. A server for transmitting stream data over a network, and working together with a terminal for playing back the stream data while receiving the stream data from said server,

wherein said terminal comprises:

target value determination means for determining a target value of the stream data to be stored in a buffer of said terminal in relation to a buffer capacity of said terminal and a transmission capacity of the network;

delay time determination means for arbitrarily determining, in a range not exceeding a value obtained by dividing the buffer capacity by the transmission capacity, a delay time from when said terminal writes head data of the stream data to the buffer to when said terminal reads the data to start playback; and

notifying means for notifying said server of the target value determined by said target value determination means and the delay time determined by said delay time determination means;

wherein said server comprises control means for controlling a transmission speed based on the notified target value and the delay time when said server transmits the stream data to said terminal over the network; and

wherein said control means controls the transmission speed so that the amount of the stream data stored in the buffer of said terminal changes in the vicinity of the target value without exceeding the target value.

14. A computer-readable recording medium storing a program describing a streaming method in which a server transmits stream data to a terminal through a network, and the terminal plays back the stream data while receiving the stream data from the server,

wherein, in the terminal, said method comprises:

determining a target value of the stream data to be stored in a buffer of the terminal in relation to a buffer capacity of the terminal and a transmission capacity of the network;

arbitrarily determining, in a range not exceeding a value obtained by dividing the buffer capacity by the transmission capacity, a delay time from when the terminal writes head data of the stream data to the buffer to when the terminal reads the data to start playback;

notifying the server of the determined target value and the determined delay time; and

wherein, in the server, said method comprises controlling a transmission speed based on the notified target value and the notified delay time when the server transmits the stream data to the terminal over the network.

15. A computer-readable recording medium on which a program is recorded, said program describing a streaming method in which a server transmits stream data to a terminal through a network and the terminal plays back the stream data while receiving the stream data from the server,

wherein said program causes the terminal to perform an operation of:

determining a target value of the stream data to be stored in a buffer of the terminal in relation to a buffer capacity of the terminal and a transmission capacity of the network;

arbitrarily determining, in a range not exceeding a value obtained by dividing the buffer capacity by the transmission capacity, a delay time from when the terminal writes head data of the stream data to the buffer to when the terminal reads the data to start playback; and

notifying the server of the determined target value and the determined delay time; and

wherein said program causes the server to perform an operation of controlling a transmission speed based on the notified target value and the notified delay time when the server transmits the stream data to the terminal over the network.