Streaming media player varying a play speed from an original to a maximum allowable slowdown proportionally in accordance with a buffer state

• US 6,665,751 B1
• Filed: 04/17/1999
• Issued: 12/16/2003
• Est. Priority Date: 04/17/1999
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Chen, Jeane Shu-Chun, Feig, Ephraim
• Primary Examiner(s): Park, Ilwoo
• Application Number:
  US09/293,644
• Time in Patent Office: 1,704 Days
• Field of Search: 370/229, 370/230, 370/232-234, 369/47.32, 369/47.33, 375/240.48, 386/68, 386/96, 709/231-235, 710/29, 710/52, 710/57, 710/60, 725/94, 700/94, 365/191, 365/194
• US Class Current: 710/52
• CPC Class Codes: H04N 21/23406 involving management of server-side video buffer
• CPC Class Codes: H04N 21/43072 of multiple content streams on the same device
• CPC Class Codes: H04N 21/4325 by playing back content from the storage medium reproduction of recorded television signals H04N5/76; reproduction of recorded television signals H04N9/79
• CPC Class Codes: H04N 21/4392 involving audio buffer management
• CPC Class Codes: H04N 21/4398 involving reformatting operations of audio signals details of audio signal transcoding G10L19/173
• CPC Class Codes: H04N 21/44004 involving video buffer management, e.g. video decoder buffer or video display buffer
• CPC Class Codes: H04N 21/440281 by altering the temporal resolution, e.g. by frame skipping television signal recording using magnetic recording on tape for reproducing at a rate different from the recording rate H04N5/783

Abstract

A media player for playing streaming media is capable of dynamically changing its play rate according to network conditions, so as to compensate for delayed packets. The player nominally plays at the prescribed data rate. When packets are delayed, instead of stopping to rebuffer, the player plays the stream slower. Audio pitch is unchanged as it is slowed, and video frame rate is slowed as necessary. A threshold is set so that slowing down beyond the threshold is not allowed. Should the buffer contents fall below a predescribed minimum, the player will then stop playing and rebuffer.

Claims

1. A streaming media player for receiving media stream input and for producing output of a media stream, comprising:

a buffer for receiving media stream input and for generating at least one buffer state value representing the amount of media stream input in said buffer;

at least one output component for generating output of said media stream; and

at least one rate means, coupled to said buffer means and said output means, for receiving at least one buffer state value from said buffer and for varying the rate of output of said media stream from said output means based on said buffer state value;

wherein data first fills some portion-of a buffer before the player starts to play the media content, and wherein the speed change varies according to the formula $S=M<br><br>\left(\frac{\mathrm{T1}-B}{\mathrm{T1}-\mathrm{T2}}\right)$

where

S is the slowdown or speedupvalue, in percentage of original speed;

M is the maximum allowable slowdown, in percentage of original speed;

B is the buffer state (the actual amount of data in the buffer when sampled);

T1 and T2 are values with (size of the buffer) >

T1>

T2.

2. The streaming media player of claim 1, wherein the media comprises audio.

3. The streaming media player of claim 2, wherein the change in the rate of output of the audio does not alter its pitch.

4. The streaming media player of claim 1, wherein the media comprises synchronized audio and video.

5. The streaming media player of claim 4, wherein the change in the rate of output of the synchronized audio and video does not alter the pitch of the audio.

6. The streaming media player of claim 1, wherein the media comprises audio synchronized with a plurality of images.

7. The streaming media player of claim 6, wherein the change in the rate of output of the audio and the corresponding change in the time at which the images are displayed does not alter the pitch of the audio.

8. A method for a streaming media player having a buffer to produce output of a media stream, comprising:

receiving media stream input into said buffer;

generating at least one buffer state value representing the amount of media stream input in said buffer; and

varying the rate of output of said media stream based on said buffer state value;

wherein data first fills some portion of a buffer before the player starts to play the media content, and wherein the speed change varies according to the formula $S=M<br><br>\left(\frac{\mathrm{T1}-B}{\mathrm{T1}-\mathrm{T2}}\right)$

where

S is the slowdown or speedup value, in percentage of original speed;

M is the maximum allowable slowdown, in percentage of original speed;

B is the buffer state (the actual amount of data in the buffer when sampled);

T1 and T2 are values with (size of the buffer) >

T1>

T2.

9. The method of claim 8 wherein said generating of said at least one buffer state value is done periodically.

10. The method of claim 8 wherein said generating of said at least one buffer state value comprises the steps of:

comparing the amount of media stream input to at least one threshold value, and

generating a buffer state value when said amount of media stream input falls below said at least one threshold value.

11. The method of claim 8 wherein said varying the rate of output of said media stream comprises slowing the rate of output.

12. The method of claim 8 further comprising dynamically adjusting the slowdown rate.

13. The method of claim 10 wherein said at least one threshold value comprises a first and a second threshold value and wherein said generating a buffer state value is done when said amount of media stream input falls below a first threshold value.

14. The method of claim 13 further comprising terminating output of said media stream when said at least one buffer state value falls below a second threshold value.

15. A program storage device readable by machine, tangibly embodying a program of instructions executable by the machine to perform the method steps for a streaming media player having a buffer to produce output of a media stream, said method steps comprising:

receiving media stream input into said buffer;

generating at least one buffer state value representing the amount of media stream input in said buffer; and

varying the rate of output of said media stream based on said buffer state value;

wherein data first fills some portion of a buffer before the player starts to play the media content, and wherein the speed change varies according to the formula $S=M<br><br>\left(\frac{\mathrm{T1}-B}{\mathrm{T1}-\mathrm{T2}}\right)$

where

S is the slowdown or speedup value, in percentage of original speed;

M is the maximum allowable slowdown, in percentage of original speed;

B is the buffer state (the actual amount of data in the buffer when sampled);

T1 and T2 are values with (size of the buffer) >

T1>

T2.