Managing timeline modification and synchronization of multiple media streams in networked client/server systems

• US 7,096,271 B1
• Filed: 03/29/2000
• Issued: 08/22/2006
• Est. Priority Date: 09/15/1998
• Status: Expired due to Fees

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Gupta, Anoop, Omoigui, Nosakhare D.
• Primary Examiner(s): Vaughn, Jr., William C.
• Assistant Examiner(s): JACOBS, LASHONDA T
• Application Number:
  US09/538,624
• Time in Patent Office: 2,337 Days
• Field of Search: 709/217, 709/219, 709231-234, 725/41, 725/43, 725/90, 725/94, 725/96, 715/727, 715/748, 715/725, 715/883
• US Class Current: 709/231
• CPC Class Codes: H04L 65/1101 Session protocols
• CPC Class Codes: H04L 65/613 for the control of the source by the destination control signals issued by the client directed to the server or network components specially adapted for selective content distribution H04N21/637
• CPC Class Codes: H04L 65/752 adapting media to network capabilities
• CPC Class Codes: H04L 65/764 at the destination reformatting of additional data in video clients H04N21/4355

Abstract

In a client/server network system, multimedia content is streamed from one or more servers to the client. The multimedia content includes multiple media streams that can be streamed to the client from the same server or from different servers. The user is able to modify the playback speed of the multimedia content, allowing the playback to be either speeded up or slowed down.

Claims

1. An apparatus comprising:

a master control component to maintain a master timeline for a multimedia presentation having a plurality of individual data streams; and

for each of the plurality of individual data streams, an individual stream control corresponding to the individual data streams of the multimedia presentation, wherein each individual stream control is to maintain a timeline for the corresponding individual data stream and wherein an individual stream control determines when the master timeline is modified by the master control so that the individual stream controls can modify the corresponding individual data streams to accommodate the modified master timeline;

wherein the master control component is also to receive a user request for a new playback speed and communicate the new playback speed to the plurality of individual stream controls, and the master control component is to communicate the new playback speed to the plurality of individual stream controls by sending a message to each of the plurality of individual stream controls.

2. An apparatus as recited in claim 1, wherein each of the plurality of individual stream controls is to monitor the master timeline and adjust the timeline maintained by each such stream control to maintain synchronization with the master timeline.

3. An apparatus as recited in claim 1, wherein the individual data streams include one or more of an image stream, a text stream, and an animation stream.

4. A method in a network client for synchronizing streams of a multimedia presentation having a plurality of streams, the streams located at one or more network servers, the method comprising:

maintaining a presentation timeline using a master control;

receiving from the one or more network servers the plurality of streams, each stream of the plurality of streams having a slave control;

detecting an event that causes a change in the presentation timeline;

modifying the master control'"'"'s presentation timeline in response to the event; and

notifying each slave control of the plurality of streams that the presentation timeline has been modified, so that the slave controls can alter their corresponding streams to accommodate the modified presentation timeline;

wherein the master control is also to receive a user request for a new playback speed and communicate the new playback speed to the plurality of individual slave controls, and the master control is to communicate the new playback speed to the plurality of individual slave controls by sending a message to each of the plurality of individual slave controls.

5. The method recited in claim 4, wherein the event is a decrease in the available bandwidth from one or more of the servers to the client.

6. The method recited in claim 4, wherein the event is an increase in the available bandwidth from one or more of the servers to the client.

7. The method recited in claim 4, wherein the event is a change in the speed of playback selected by a user viewing the presentation.

8. The method recited in claim 4 wherein the modifying of the master control'"'"'s presentation timeline further comprises selecting particular streams for alteration.

9. The method recited in claim 8 wherein the selecting of particular streams is performed using a priority ranking provided to the master control.

10. The method recited in claim 8 wherein the selecting of particular streams is performed using a user-supplied ordered list provided to the master control.

11. The method recited in claim 4 wherein the altering of a stream by a slave control is selected from the group consisting of jumping ahead in the stream, pausing the stream, and time-scale modification of the stream.

12. The method recited in claim 4 wherein the event is generated by the user choosing the manner of change to the presentation timeline.

13. The method recited in claim 4 wherein the individual streams include one or more of an image stream, a text stream, and an animation stream.

14. The method recited in claim 4 wherein the slave controls are located at the network servers.

15. The method recited in claim 4 wherein the slave controls are located at the network client.

16. The method recited in claim 4 wherein multiple slave controls are located at the same network server.

17. The method recited in claim 4 wherein the streams are received from different servers.

18. A computer-readable medium whose contents cause a computing system to perform a method in a network client for synchronizing a plurality of streams of a presentation, the method comprising:

maintaining a presentation timeline for the presentation using a master control;

receiving the plurality of streams from network servers, each of the plurality of streams having a slave control;

detecting an event that causes a change in the presentation timeline of the presentation; and

modifying the master control'"'"'s presentation timeline in response to the event

wherein the master control notifies the slave controls for the plurality of streams that the presentation timeline has been modified so that the slave controls can alter their streams to accommodate the modified presentation timeline;

wherein the master control is also to receive a user request for a new playback speed and communicate the new playback speed to the plurality of individual slave controls, and the master control is to communicate the new playback speed to the plurality of individual slave controls by sending a message to each of the plurality of individual slave controls.

19. The computer-readable medium of claim 18, wherein the event is a decrease in the available bandwidth from one or more of the servers to the client.

20. The computer-readable medium of claim 18, wherein the event is an increase in the available bandwidth from one or more of the servers to the client.

21. The computer-readable medium of claim 18, wherein the event is a change in the speed of playback selected by a user viewing the presentation.

22. The computer-readable medium of claim 18 wherein the modifying of the master control'"'"'s presentation timeline further comprises selecting particular streams for alteration.

23. The computer-readable medium of claim 22 wherein the selecting of particular streams is performed using a priority ranking provided to the master control.

24. The computer-readable medium of claim 22 wherein the selecting of particular streams is performed using a user-supplied ordered list provided to the master control.

25. The computer-readable medium of claim 18 wherein the altering of a stream by a slave control is selected from the group consisting of jumping ahead in the stream, pausing the stream, and time-scale modification of the stream.

26. The computer-readable medium of claim 18 wherein the event is generated when a user indicates how to change the presentation timeline.

27. The computer-readable medium of claim 18 wherein the individual streams include one or more of an image stream, a text stream, and an animation stream.

28. The computer-readable medium of claim 18 wherein the slave controls are located at network servers.

29. The computer-readable medium of claim 18 wherein the slave controls are located at the network client.

30. The computer-readable medium of claim 18 wherein multiple slave controls are located at the same network server.

31. The computer-readable medium of claim 18 wherein the streams are received from different servers.

32. A system for synchronizing streams of a presentation having a plurality of streams comprising:

a master control component located at a network client for maintaining a presentation timeline;

a first slave control component located at a first network server for controlling a stream being transmitted by the first network server; and

a second slave control component located at a second network server for controlling a stream being transmitted by the second network server;

wherein the master control detects an event that causes a change in the presentation timeline, modifies the presentation timeline in response to the event, and notifies the slave control components that the presentation timeline has been modified so that the slave control components can alter their streams to accommodate the modified presentation timeline; and

wherein the master control component is also to receive a user request for a new playback speed and communicate the new playback speed to the plurality of individual slave control components, and the master control component is to communicate the new playback speed to the plurality of individual slave control components by sending a message to each of the plurality of individual slave control components.

33. The system of claim 32, wherein the event is a decrease in the available bandwidth from one or more of the servers to the client.

34. The system of claim 32, wherein the event is an increase in the available bandwidth from one or more of the servers to the client.

35. The system of claim 32, wherein the event is a change in the speed of playback selected by a user viewing the presentation.

36. The system of claim 32 wherein the modifying of the master control'"'"'s presentation timeline further comprises selecting particular streams for alteration.

37. The system of claim 36 wherein the selecting of particular streams is performed using a priority ranking provided to the master control.

38. The system of claim 36 wherein the selecting of particular streams is performed using a user-supplied ordered list provided to the master control.

39. The system of claim 32 wherein the altering of the stream is selected from the group consisting of jumping ahead in the stream, pausing the stream, and time-scale modification of the stream.