Video conferencing with adaptive client-controlled resource utilization

• US 6,453,336 B1
• Filed: 09/14/1998
• Issued: 09/17/2002
• Est. Priority Date: 09/14/1998
• Status: Expired due to Term

• Current Assignee: Enterprise Systems Technologies S.a.r.l. (Atos SE)
• Original Assignee: Siemens Information And Communication Networks, Inc. (Siemens AG)
• Inventors: Beyda, William Joseph, Shaffer, Shmuel, Mehta, Vinesh R.
• Primary Examiner(s): Harrell, Robert B.
• Assistant Examiner(s): Jaroenchonwanit, Bunjob
• Application Number:
  US09/152,872
• Time in Patent Office: 1,464 Days
• Field of Search: 709/204, 709/205, 370/260, 707/201
• US Class Current: 709/204
• CPC Class Codes: H04L 65/1101 Session protocols
• CPC Class Codes: H04L 65/403 Arrangements for multi-party communication, e.g. for conferences data switching systems for conference H04L12/18; arrangements for connecting several subscribers to a common circuit, i.e. affording conference facilities H04M3/56; television conferencing systems H04N7/15
• CPC Class Codes: H04L 65/4046 with distributed floor control
• CPC Class Codes: H04L 65/80 Responding to QoS
• CPC Class Codes: H04L 9/40 Network security protocols

Abstract

Techniques to dynamically control the allocation of resources between audio and video (and perhaps data) streams of a video conference are disclosed. By providing the dynamic control, a participant to a video conference is able to alter the quality levels for the audio and video (and perhaps data) streams that they receive while the video conference is ongoing. A tool bar, window or the like can be used to enable a participant to dynamically control the quality levels. The techniques are particularly well suited for personal computer based video conferencing.

Claims

1. A method for providing a video conference, comprising:

initiating a video conference having an audio quality level and a video quality level, the video conference using resources to provide audio and video between first and second stations coupled together by a network;

displaying, at the first station, a quality level adjustment tool that allows a participant to adjust at least one of the audio quality level and the video quality level as the video conference is ongoing;

receiving, from the quality level adjustment tool, an adjustment request to modify at least one of the audio quality level and the video quality level;

sending the adjustment request from the first station to the second station; and

thereafter receiving, at the first station from the second station, the audio and video of the video conference such that at least one of the audio quality level and the video quality level has been adjusted in accordance with the adjustment request.

2. A method as recited in claim 1, wherein the network, through which the video conference is provided between the stations, includes a Local Area Network.

3. A method as recited in claim 1, wherein the network, through which the video conference is provided between the stations, includes the Internet.

4. A method as recited in claim 1, wherein the quality level adjustment tool being displayed is a window displayed on a display screen of at least a particular one of the stations.

5. A method as recited in claim 4, wherein the window includes a video level control and an audio level control, the video level control is used to set a new video quality level, and the audio level control is used to set a new audio quality level.

6. A method as recited in claim 5, wherein the new video quality level is a video rate and the new audio quality level is an audio rate.

7. A method as recited in claim 5,

wherein the video conference is also initiated with a data rate level for the transmission of data between the first and second stations during the video conference, and

wherein said adjusting operates to adjust at least one of the audio quality level, the video quality level and the data rate level in accordance with the adjustment amount.

8. A method as recited in claim 4, wherein a participant of the station having the window displayed thereon can request quality level adjustment in which video quality is improved while audio quality is degraded, assuming that one of which needs to be degraded due to resource limitations.

9. A method as recited in claim 4, wherein a participant of the station having the window displayed thereon can request quality level adjustment in which audio quality is improved while video quality is degraded, assuming that one of which needs to be degraded due to resource limitations.

10. A method as recited in claim 1,

wherein the video conference is also initiated with a data rate level for the transmission of data between the first and second stations during the video conference, and

wherein said adjusting operates to adjust at least one of the audio quality level, the video quality level and the data rate level in accordance with the adjustment amount.

11. A method as recited in claim 1, wherein the quality level adjustment tool permits dynamic control over the audio quality level and the video quality level while the video conference is ongoing.

12. A method as recited in claim 1, wherein the quality level adjustment tool permits incremental control over the audio quality level and the video quality level while the video conference is ongoing.

13. A method as recited in claim 12, wherein the quality level adjustment tool is displayed on a display screen of a particular one of the stations, and the quality level adjustment tool includes a video level control and an audio level control, the video level control is used to set a video quality level, and the audio level control is used to set an audio quality level.

14. A method as recited in claim 13, wherein the new video quality level is a video rate and the new audio quality level is an audio rate.

15. A method for providing a video conference, comprising:

initiating a video conference having an audio quality level and a video quality level, the video conference providing audio and video between two stations coupled together by a network;

monitoring, by a computer system, a conference quality level for the video conference as the video conference is ongoing;

determining, by the computer system, if a loss of quality for the video conference has been detected or anticipated;

displaying a request for a quality level adjustment when said determining determines that a loss of quality has been detected or anticipated;

receiving an adjustment request to modify at least one of the audio quality level and the video quality level; and

adjusting at least one of the audio quality level and the video quality level in accordance with the adjustment amount.

16. A method as recited in claim 15, wherein said monitoring is monitoring resource conditions used in providing the video conference through the network, and

wherein said determining operates to determine the loss of quality for the video conference based on the resource conditions being monitored.

17. A method as recited in claim 16, wherein the resource conditions being monitored include at least one of processing resources of at least one of the stations, latency of the network, and bandwidth of the network.

18. A method as recited in claim 16, wherein said determining operates to determine the loss of quality for the video conference based on the resource conditions being monitored.

19. A method as recited in claim 18, wherein said determining of the loss of quality comprises:

comparing levels of the monitored resource conditions with thresholds; and

determining the loss of quality for the video conference when at least one of the levels of the monitored resource conditions exceeds the at least one of the thresholds associated therewith.

20. A method as recited in claim 19, wherein the thresholds are set based on prior levels of resource conditions.

21. A method as recited in claim 20, wherein the thresholds represent a predetermined drop in resource conditions from the prior levels of the resource conditions.

22. A method for providing a video conference, comprising:

initiating a video conference having an audio quality level and a video quality level, the video conference using resources to provide audio and video between two stations coupled together by a network;

monitoring available resources for the video conference as the video conference is ongoing;

determining if a reduction of the available resources for the video conference has been detected or anticipated;

displaying a request for a quality level adjustment when said determining determines that a reduction of the available resources has been detected or anticipated;

receiving, in response to the request being displayed, an adjustment request to modify at least one of the audio quality level and the video quality level; and

adjusting at least one of the audio quality level and the video quality level in accordance with the adjustment request.

23. A method as recited in claim 22, wherein the available resources being monitored include at least one of processing, resources of at least one of the station, latency of the network, and bandwidth of the network.

24. A method as recited in claim 22, wherein the request for quality level adjustment being displayed is a window displayed on a display screen of at least a particular one of the stations.

25. A method as recited in claim 24, wherein the window includes a video level control and an audio level control, the video level control is used to set a video quality level, and the audio level control is used to set an audio quality level.

26. A method as recited in claim 22,

wherein the video conference is also initiated with a data rate level for the transmission of data between the two stations during the video conference, and

wherein said adjusting can adjust a data rate level in accordance with the adjustment request.

27. A method as recited in claim 22, wherein said method further comprises:

setting the quality adjustment request to a default request if no adjustment request is received after a predetermined period of time after said displaying of the request for the quality level adjustment.

28. A method as recited in claim 27, wherein said method further comprises:

after receiving the adjustment request, removing the request for quality level adjustment being displayed.

29. A method for providing a video conference using a conference server, said method comprising:

receiving incoming streams of audio and video from stations participating in the video conference, the incoming streams having incoming quality levels;

receiving requested quality levels from the stations participating in the video conference;

processing the incoming streams to produce outgoing streams in accordance with the requested quality levels; and

transmitting the outgoing streams to the stations participating in the video conference,

wherein said receiving of the requested quality levels from the stations can occur dynamically as the video conference is ongoing.

30. A method as recited in claim 29, wherein said method further comprises:

determining whether the incoming quality level of one of the incoming streams from one of the stations exceeds a maximum quality level for the corresponding output stream; and

instructing the one of the stations to reduce the quality level of its corresponding transmitted stream when it is determined that the incoming quality level of one of the incoming streams from one of the stations exceeds the maximum quality level for the corresponding output stream.

31. A computer readable medium including computer program code for providing a video conference, said computer readable medium comprising:

computer program code for initiating a video conference having an audio quality level and a video quality level, the video conference using resources to provide audio and video between first and second stations coupled together by a network;

computer program code for displaying, at the first station, a quality level adjustment tool that allows a participant to adjust at least one of the audio quality level and the video quality level as the video conference is ongoing;

computer program code for receiving, from the quality level adjustment tool, an adjustment request to modify at least one of the audio quality level and the video quality level;

computer program code for sending the adjustment request from the first station to the second station; and

computer program code for thereafter receiving, at the first station from the second station, the audio and video of the video conference such that at least one of the audio quality level and the video quality level has been adjusted in accordance with the adjustment request.

32. A computer readable medium including computer program code for providing a video conference using a conference server, said computer readable medium comprising:

computer program code for receiving incoming streams of audio and video from stations participating in the video conference, the incoming streams having incoming quality levels;

computer program code for receiving requested quality levels from the stations participating in the video conference;

computer program code for processing the incoming streams to produce outgoing streams in accordance with the requested quality levels; and

computer program code for transmitting the outgoing streams to the stations participating in the video conference,

wherein said receiving of the requested quality levels from the stations can occur dynamically as the video conference is ongoing.

33. A computer readable medium as recited in claim 32, wherein said computer readable medium further comprises:

computer program code for determining whether the incoming quality level of one of the incoming streams from one of the stations exceeds a maximum quality level for the corresponding output stream; and

computer program code for instructing the one of the stations to reduce the quality level of its corresponding transmitted stream when it is determined that the incoming quality level of one of the incoming streams from one of the stations exceeds the maximum quality level for the corresponding output streams.

34. A computer system for supporting a video conference with a remote computer system through a network, said computer system comprising:

a camera for receiving local images;

a display for displaying remote images from a remote computer system participating in the video conference;

a microphone for picking up local audio;

a speaker for reproducing remote audio from the remote computer system participating in the video conference; and

a conference controller that controls the transmission of the local video and the local audio as well as the reception of the remote video and the remote audio, said video controller operates to (1) initiate the video conference having an audio quality level and a video quality level, (2) display a quality level adjustment tool that allows a participant to adjust at least one of the audio quality level and the video quality level as the video conference is ongoing, (3) receive, from the quality level adjustment tool, an adjustment request to modify at least one of the audio quality level and the video quality level;

(4) send the adjustment request to the remote computer system; and

thereafter receive the remote audio and remote video of the video conference such that at least one of the audio quality level and the video quality level has been adjusted in accordance with the adjustment request.

35. A computer system as recited in claim 34,

wherein the quality level adjustment tool being displayed is a window displayed on a display screen of at least a particular one of the stations, and

wherein the window includes a video level control and an audio level control, the video level control is used to set a new video quality level, and the audio level control is used to set a new audio quality level.

36. A computer system as recited in claim 34,

wherein the quality level adjustment tool being displayed is a window displayed on a display screen of at least a particular one of the stations, and

wherein the window includes an audio-video mixture control that set a resource allocation level between the audio and video which is used in determining the adjustment amount.