Collaborative video delivery over heterogeneous networks

• US 20020112244A1
• Filed: 12/13/2001
• Published: 08/15/2002
• Est. Priority Date: 12/19/2000
• Status: Abandoned Application

• Current Assignee: Siemens Corporate Research Incorporated (Siemens AG)
• Original Assignee: Siemens Corporate Research Incorporated (Siemens AG)
• Inventors: Heckrodt, Kilian, Liou, Shih-Ping, Schollmeier, Ruediger
• Application Number:
  US10/022,081
• Publication Number:
  US 20020112244A1
• Time in Patent Office: Days
• US Class Current: 725/93
• CPC Class Codes: H04L 12/1827 Network arrangements for conference optimisation or adaptation
• CPC Class Codes: H04L 12/1836 with heterogeneous network architecture
• CPC Class Codes: H04L 65/1101 Session protocols
• CPC Class Codes: H04L 65/612 for unicast
• CPC Class Codes: H04L 65/613 for the control of the source by the destination control signals issued by the client directed to the server or network components specially adapted for selective content distribution H04N21/637
• CPC Class Codes: H04L 65/70 Media network packetisation
• CPC Class Codes: H04L 65/752 adapting media to network capabilities
• CPC Class Codes: H04N 21/23655 Statistical multiplexing, e.g. by controlling the encoder to alter its bitrate to optimize the bandwidth utilization
• CPC Class Codes: H04N 21/2402 Monitoring of the downstream path of the transmission network, e.g. bandwidth available traffic monitoring in data switching networks H04L43/00; monitoring data switching networks utilization H04L43/0876
• CPC Class Codes: H04N 21/4786 e-mailing message switching systems, e.g. electronic mail systems H04L51/00
• CPC Class Codes: H04N 21/4788 communicating with other users, e.g. chatting arrangements for providing for computer conferences, e.g. chat rooms, to substation in data switching networks H04L12/1813; distributed application using peer-to-peer [P2P] networks H04L67/104
• CPC Class Codes: H04N 21/6379 directed to encoder , e.g. for requesting a lower encoding rate
• CPC Class Codes: H04N 21/6581 Reference data, e.g. a movie identifier for ordering a movie or a product identifier in a home shopping application
• CPC Class Codes: H04N 21/6587 Control parameters, e.g. trick play commands, viewpoint selection
• CPC Class Codes: H04N 5/783 Adaptations for reproducing at a rate different from the recording rate
• CPC Class Codes: H04N 5/93 Regeneration of the television signal or of selected parts thereof
• CPC Class Codes: H04N 7/155 involving storage of or access to video conference sessions tracking arrangements for later retrieval of a computer conference content or participants activities H04L12/1831
• CPC Class Codes: H04N 7/173 with two-way working, e.g. subscriber sending a programme selection signal

Abstract

There is provided a system for collaboratively delivering a video stream over a heterogeneous network. The video stream includes a plurality of frames. The system includes a session controller for synchronizing with client devices, receiving messages, and outputting encoder control commands based on the messages. The system further includes a plurality of encoders. Each encoder is dedicated to a corresponding one of the client devices for receiving user control commands from the corresponding one of the client devices that correspond to a playback of the video stream, outputting the messages based on the user control commands, and respectively controlling a transmission of the video stream to the corresponding one of the client devices using a shared timeline, including respectively and dynamically transmitting or discarding each of the plurality of frames so as to cooperatively maintain a minimum quality of service for all of the client devices.

Claims

1. A system for collaboratively delivering a video stream over a heterogeneous network, the video stream including a plurality of frames, the system comprising:

a session controller for synchronizing with client devices, receiving messages, and outputting encoder control commands based on the messages; and

a plurality of encoders, each of the plurality of encoders being dedicated to a corresponding one of the client devices for receiving user control commands from the corresponding one of the client devices that correspond to a playback of the video stream, outputting the messages based on the user control commands, and respectively controlling a transmission of the video stream to the corresponding one of the client devices using a timeline shared between the client devices, including respectively and dynamically transmitting or discarding each of the plurality of frames so as to cooperatively maintain a minimum quality of service for all of the client devices.

2. The system of claim 1, wherein each of said plurality of encoders dynamically controls the transmission of the video stream further based on a requirement that at least a pre-designated minimum number of frames must be received by all of the client devices, the pre-designated minimum number of frames being comprised in the plurality of frames and corresponding to a basic content of the plurality of frames.

3. The system of claim 1, wherein each of said plurality of encoders dynamically controls the transmission of the video stream further based on a requirement that at least a pre-designated subset of the plurality of frames must be received by all of the client devices, the pre-designated subset of the plurality of frames corresponding to a basic content of the plurality of frames.

4. The system of claim 1, wherein each of said plurality of encoders dynamically optimizes the transmission of the video stream to the corresponding one of the client devices based on at least a prediction of available bandwidth for the corresponding one of the client devices and the priority of each of the plurality of frames.

5. The system of claim 1, wherein each of said plurality of encoders dynamically optimizes the transmission of the video stream to the corresponding one of the client devices based on at least parameters of a respective connection of the corresponding one of the client devices to said system.

6. A system for collaboratively delivering a video stream over a heterogeneous network, the video stream including a plurality of frames, the system comprising:

a session controller for synchronizing with client devices, receiving messages, and outputting encoder control commands based on the messages; and

a plurality of encoders, each of the plurality of encoders being dedicated to a corresponding one of the client devices for receiving user control commands from the corresponding one of the client devices that correspond to a playback of the video stream, outputting the messages based on the user control commands, and dynamically and respectively controlling a transmission of the video stream to the corresponding one of the client devices, including respectively transmitting or discarding each of the plurality of frames so as to cooperatively maintain a minimum quality of service for all of the client devices, based upon at least a prediction of available bandwidth for the corresponding one of the client devices, any pending encoder control commands, a priority of each of the plurality of frames, and a shared timeline between the client devices, whereby the user control command allows a user of one of the client devices to control the playback of the video stream on all of the client devices.

7. The system of claim 6, wherein the user control commands correspond to virtual VCR control commands.

8. The system of claim 6, wherein each of said plurality of encoders transmits a client device command to the corresponding one of the client devices based on the encoder control commands, the client device command respectively corresponding to the playback of the video stream on the corresponding one of the client devices.

9. The system of claim 6, wherein each of said plurality of encoders dynamically optimizes the transmission of the video stream to the corresponding one of the client devices based on at least the prediction of available bandwidth for the corresponding one of the client devices and the priority of each of the plurality of frames.

10. The system of claim 6, wherein each of said plurality of encoders dynamically optimizes the transmission of the video stream to the corresponding one of the client devices based on at least parameters of a respective connection of the corresponding one of the client devices to said system.

11. The system of claim 6, wherein said session controller generates each of said plurality of encoders upon respectively receiving a connect request from each of the client devices.

12. The system of claim 6, wherein each of said plurality of encoders dynamically controls the transmission of the video stream further based on a requirement that at least a pre-designated minimum number of frames must be received by all of the client devices, the pre-designated minimum number of frames being comprised in the plurality of frames and corresponding to a basic content of the plurality of frames.

13. The system of claim 6, wherein each of said plurality of encoders dynamically controls the transmission of the video stream further based on a requirement that at least a pre-designated subset of the plurality of frames must be received by all of the client devices, the pre-designated subset of the plurality of frames corresponding to a basic content of the plurality of frames.

15. The method of claim 14, further comprising the steps of:

respectively generating a data socket connection for each of the client devices; and

respectively providing parameters of the data socket connection for each of the client devices to the plurality of encoders, wherein said parameters include information other than the measurement of available bandwidth, and said controlling step is further based upon the parameters.

16. The method of claim 14, wherein the user control commands correspond to virtual VCR control commands.

17. The method of claim 14, wherein said controlling step comprises the step of respectively and dynamically optimizing the transmission of the video stream to each of the client devices based on at least the prediction of available bandwidth and the priority of each of the plurality of frames.

18. The method of claim 14, wherein said controlling step comprises the step of respectively and dynamically optimizing the transmission of the video stream to each of the client devices based on at least parameters of a respective connection of the client devices to said system.

19. The method of claim 14, wherein said controlling step respectively and dynamically controls the transmission of the video stream to each of the client devices so as to transmit at least a pre-designated minimum number of frames, the pre-designated minimum number of frames being comprised in the plurality of frames and corresponding to a basic content of the video stream.

20. The method of claim 14, wherein said controlling step respectively and dynamically controls the transmission of the video stream to each of the client devices so as to transmit at least a pre-designated subset of the plurality of frames that represent a basic content of the video stream.

21. The method of claim 14, wherein said method is implemented by a program storage device readable by machine, tangibly embodying a program of instructions executable by the machine to perform said method steps.

14. A method for collaboratively delivering a video stream over a heterogeneous network, the video stream including a plurality of frames, the method comprising the steps of:

generating a plurality of encoders, each of the plurality of encoders being dedicated to a corresponding one of the client devices;

respectively providing to each of the plurality of encoders a measurement of available bandwidth for the corresponding one of the client devices and a priority of each of the plurality of frames;

respectively generating a prediction of available bandwidth for each of the client devices based upon the measurement of available bandwidth;

receiving user control commands, if any, from the client devices, the user control commands corresponding to a playback of the video stream on the client devices; and

respectively and dynamically controlling a transmission of the video stream from the plurality of encoders to the client devices, including respectively transmitting or discarding each of the plurality of frames so as to cooperatively maintain a minimum quality of service for all of the client devices, based upon at least the prediction of available bandwidth for each of the client devices, the priority of each of the plurality of frames, any pending user control commands, and a shared timeline between the client devices, whereby the user control command allows a user of one of the client devices to control the playback of the video stream on all of the clients.