Multimedia timeline modification in networked client/server systems

• US 20040039837A1
• Filed: 08/25/2003
• Published: 02/26/2004
• Est. Priority Date: 09/15/1998
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Anoop Gupta, Nosakhare D. Omoigui
• Inventors: Gupta, Anoop, Omoigui, Nosakhare D.
• Granted Patent: US 7,734,800 B2
• Time in Patent Office: Days
• US Class Current: 709/231
• CPC Class Codes: H04L 65/1101 Session protocols
• CPC Class Codes: H04L 65/613 for the control of the source by the destination control signals issued by the client directed to the server or network components specially adapted for selective content distribution H04N21/637
• CPC Class Codes: H04L 65/752 adapting media to network capabilities
• CPC Class Codes: H04L 65/764 at the destination reformatting of additional data in video clients H04N21/4355

Abstract

Multimedia content is streamed over a network system from a server computer to a client computer. The client allows a user to enter a variable playback speed and varies the speed at which the multimedia content is rendered at the client. Time-scale modification technology is used to maintain the original pitch of any audio content, thereby maintaining its intelligibility.

Claims

1. A method of obtaining and presenting multimedia content, the method comprising:

selecting multimedia content to be rendered at a network client;

accepting a speed designation at the network client from a human user independently of the selecting;

streaming a composite media stream from a network server, the composite media stream representing the selected multimedia content;

rendering the composite media stream as it is streamed to produce the multimedia content at the network client; and

varying the speed of the multimedia content depending on the speed designation from the human user.

2. A method as recited in claim 1, wherein:

the composite media stream has a timeline; and

the varying the speed of the multimedia content is performed by altering the timeline of the composite media stream at the network server before streaming the composite media stream.

3. A method as recited in claim 1, further comprising:

storing multiple composite media streams at the network server corresponding to particular multimedia content, each of the multiple composite media streams having a timeline that is modified by a different degree; and

selecting that composite media stream that most closely accords with the speed designation and streaming that composite media stream from the network server to the network client.

4. A computer-readable storage medium containing a program for streaming multimedia content to a network client, the program having instructions that are executable by a network server to perform steps comprising:

receiving a speed designation for playback of the multimedia content at a network client;

composing a composite media stream that represents the multimedia content, the composite media stream having a timeline that is modified in accordance with the speed designation;

streaming the timeline-modified composite media stream from the network server to the network client.

5. A computer-readable storage medium as recited in claim 4, further comprising:

storing multiple media streams at the network server corresponding to the multimedia content, said multiple media streams having timelines that are modified by different degrees and including streams corresponding to at least first and second media types, wherein media types of the first and second types can be rendered in combination to produce the multimedia content;

the step of composing a composite media stream comprising a step of selecting those stored media streams of the first and second types that have modified timelines most closely according with the speed designation.

6. A computer-readable storage medium as recited in claim 4, further comprising:

determining available bandwidth from the network server to the network client;

storing multiple media streams at the network server corresponding to the multimedia content, the multiple media streams including streams corresponding to at least first and second media types, wherein media types of the first and second types can be rendered in combination to produce the multimedia content;

the media streams of the first type having timelines that are modified by different degrees;

the media streams of the second type being of varying quality and requiring varying bandwidth;

wherein the composing step comprises;

selecting one of the media streams of the first type that most closely accords with the speed designation, wherein said selected one of the media streams of the first type consumes part of the available bandwidth;

selecting one of the media streams of the second type that requires no more bandwidth than the difference between the available bandwidth and the bandwidth consumed by the selected one of the media streams of the first type.

7. A computer-readable storage medium as recited in claim 4, further comprising:

determining available bandwidth from the network server to the network client;

storing a plurality of audio streams representing the multimedia content, the audio streams having timelines that are modified by different degrees;

storing a plurality of video streams representing the multimedia content, the video streams being of varying quality and requiring varying bandwidth;

wherein one of the audio streams and one of the video streams can be rendered in combination to produce the multimedia content;

wherein the composing step comprises;

selecting one of the audio streams having a timeline that most closely accords with the speed designation, wherein said selected audio stream consumes part of the available bandwidth;

selecting one of the video streams that requires no more bandwidth than the difference between the available bandwidth and the bandwidth consumed by the selected audio stream.

8. A computer-readable storage medium as recited in claim 4, further comprising:

determining available bandwidth from the network server to the network client;

storing an audio stream representing the multimedia content;

storing a plurality of video streams representing the multimedia content, the video streams being of varying quality and requiring varying bandwidth;

wherein the audio streams and one of the video streams can be rendered in combination to produce the multimedia content;

wherein the composing step comprises selecting one of the video streams that requires no more bandwidth than the difference between the available bandwidth and the bandwidth consumed by the audio stream when streamed at a rate that is proportional to the speed designation.

9. A computer-readable storage medium as recited in claim 4, further comprising:

determining available bandwidth from the network server to the network client;

storing an audio stream representing the multimedia content;

storing a plurality of video streams representing the multimedia content, the video streams having different timelines and requiring varying bandwidth;

wherein the audio streams and one of the video streams can be rendered in combination to produce the multimedia content;

wherein the composing step comprises selecting one of the video streams that requires no more bandwidth than the difference between the available bandwidth and the bandwidth consumed by the audio stream when streamed at a rate that is proportional to the speed designation.

10. A method of obtaining and presenting multimedia content, the method comprising:

selecting multimedia content that is available from a network server, the multimedia content having first and second types of media content;

accepting a speed designation for playback of the multimedia content at a network client;

determining available bandwidth from the network server to the network client;

streaming a first individual media stream from the network server to the network client at a rate that is proportional to the speed designation, the first individual media stream representing the first type of media content and consuming part of the available bandwidth;

selecting a second individual media stream that represents the second type of media content, the second individual media stream being selected to have a quality that requires no more bandwidth than the difference between the available bandwidth and the bandwidth consumed by the first individual media stream;

streaming the second individual media stream from the network server to the network client;

modifying the timeline of the first individual media stream at the network client in accordance with the speed designation; and

rendering the first and second individual media streams at the network client.

11. A method as recited in claim 10, wherein the first individual media stream is an audio stream and the second individual media stream is a video stream.

12. A method as recited in claim 10, further comprising modifying the timeline of the second individual media stream in accordance with the speed designation before it is streamed to the network client.