System and method for dynamically altering videoconference bit rates and layout based on participant activity

• US 20070211141A1
• Filed: 03/16/2006
• Published: 09/13/2007
• Est. Priority Date: 03/09/2006
• Status: Active Grant

• Current Assignee: GOTO Group Incorporated (LogMeIn, Inc.)
• Original Assignee: Citrix Online LLC (Cloud Software Group)
• Inventors: Christiansen, Bernd
• Granted Patent: US 7,768,543 B2
• Time in Patent Office: Days
• US Class Current: 348/14.80
• CPC Class Codes: H04L 65/1101 Session protocols
• CPC Class Codes: H04L 65/4038 with floor control
• CPC Class Codes: H04L 65/752 adapting media to network capabilities
• CPC Class Codes: H04L 65/756 adapting media to device capabilities
• CPC Class Codes: H04L 65/80 Responding to QoS
• CPC Class Codes: H04N 7/147 Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals selecting H04Q
• CPC Class Codes: H04N 7/15 Conference systems
• CPC Class Codes: H04N 7/157 defining a virtual conference space and using avatars or agents computer conference optimisation or adaptation H04L12/1827

Abstract

Systems and Methods to transmit and simultaneously display all video streams in a video conference by dynamically adapting video streams based on audio volume of the participants include allocating an amount of bandwidth to a participant in a videoconference; determining a level of activity exhibited by the participant during the videoconference, and changing the amount of bandwidth allocated to the participant responsive to the determined level of activity. In another aspect, a method for displaying video streams includes creating a graphical representation of a participant in a videoconference; displaying the created graphical representation; determining a level of activity exhibited by the participant during the videoconference; and altering the displayed graphical representation of the participant responsive to the determined level of activity.

Claims

1. A method of generating a dynamic graphical representation of a participant in a videoconference that reflects the participant'"'"'s level of activity during the videoconference, the method comprising:

(a) creating a graphical representation of a participant in a videoconference;

(b) displaying the created graphical representation;

(c) determining a level of activity exhibited by the participant during the videoconference; and

(d) altering the displayed graphical representation of the participant responsive to the determined level of activity.

2. The method of claim 1 wherein step (a) comprises creating a two-dimensional graphical representation of a participant in a videoconference.

3. The method of claim 1 wherein step (a) comprises creating a three-dimensional graphical representation of a participant in a videoconference.

4. The method of claim 1 wherein step (a) comprises creating a two-dimensional graphical representation of a participant in a videoconference using an image of the participant.

5. The method of claim 1 wherein step (a) comprises creating a two-dimensional video representation of a participant in a videoconference.

6. The method of claim 1 wherein step (c) comprises determining the participant'"'"'s absolute volume level during the videoconference.

7. The method of claim 1 wherein step (c) comprises determining the participant'"'"'s volume level during the videoconference relative to other participants.

8. The method of claim 1 wherein step (c) comprises determining the participant'"'"'s volubility during the videoconference.

9. The method of claim 1 wherein step (c) comprises determining the participant'"'"'s level of animation during the videoconference.

10. The method of claim 1 wherein step (c) comprises determining the participant'"'"'s level of animation during the videoconference relative to other participants.

11. The method of claim 1 wherein step (d) comprises changing the size of the displayed graphical representation of the participant responsive to the determined level of activity.

12. The method of claim 1 wherein step (d) comprises changing the relative position of the displayed graphical representation of the participant responsive to the determined level of activity.

13. The method of claim 1 wherein step (d) comprises changing the color bit depth of the displayed graphical representation of the participant responsive to the determined level of activity.

14. The method of claim 1 wherein step (d) comprises replacing a color graphical representation of the participant with a grayscale representation of the participant responsive to the determined level of activity.

15. The method of claim 1 wherein step (d) comprises replacing a color graphical representation of the participant with a black and white representation of the participant responsive to the determined level of activity.

16. The method of claim 1 wherein step (d) comprises replacing a video representation of the participant with a still image responsive to the determined level of activity.

17. The method of claim 1 wherein step (d) comprises changing the z-axis ordering of the displayed graphical representation of the participant responsive to the determined level of activity.

18. The method of claim 1 wherein step (d) comprises changing the transformation of the displayed graphical representation of the participant responsive to the determined level of activity.

19. An apparatus for generating a dynamic graphical representation of a participant in a videoconference that reflects the activity level of the participant during the videoconference, the apparatus comprising:

a display engine displaying a graphical representation of a participant in a videoconference;

an activity monitor in communication with the display engine, the activity monitor determining a level of activity exhibited by the participant during the videoconference,

wherein the display engine alters the displayed graphical representation of the participant responsive to the determined level of activity.

20. The apparatus of claim 19 wherein the display engine creates a two-dimensional graphical representation of a participant in a videoconference.

21. The apparatus of claim 19 wherein the display engine creates a three-dimensional graphical representation of a participant in a videoconference.

22. The apparatus of claim 19 wherein the display engine creates a two-dimensional graphical representation of a participant in a videoconference using an image of the participant.

23. The apparatus of claim 19 wherein the display engine creates a two-dimensional video representation of a participant in a videoconference.

24. The apparatus of claim 19 wherein the activity monitor determines the participant'"'"'s absolute volume level during the videoconference.

25. The apparatus of claim 19 wherein the activity monitor determines the participant'"'"'s volume level during the videoconference relative to other participants.

26. The apparatus of claim 19 wherein the activity monitor determines the participant'"'"'s volubility during the videoconference.

27. The apparatus of claim 19 wherein the activity monitor determines the participant'"'"'s level of animation during the videoconference.

28. The apparatus of claim 19 wherein the activity monitor determines the participant'"'"'s level of animation during the videoconference relative to other participants.

29. The apparatus of claim 19 wherein the display engine changes the size of the displayed graphical representation of the participant responsive to the determined level of activity.

30. The apparatus of claim 19 wherein the display engine changes the relative position of the displayed graphical representation of the participant responsive to the determined level of activity.

31. The apparatus of claim 19 wherein the display engine changes the color bit depth of the displayed graphical representation of the participant responsive to the determined level of activity.

32. The apparatus of claim 19 wherein the display engine replaces a color graphical representation of the participant with a grayscale representation of the participant responsive to the determined level of activity.

33. The apparatus of claim 19 wherein the display engine replaces a color graphical representation of the participant with a black and white representation of the participant responsive to the determined level of activity.

34. The apparatus of claim 19 wherein the display engine replaces a video representation of the participant with a still image responsive to the determined level of activity.

35. The apparatus of claim 19 wherein the display engine changes the z-axis ordering of the displayed graphical representation of the participant responsive to the determined level of activity.

36. The apparatus of claim 19 wherein the display engine changes the transformation of the displayed graphical representation of the participant responsive to the determined level of activity.

37. A method of allocating bandwidth to participants in a videoconference, the method comprising:

(a) allocating an amount of bandwidth to a participant in a videoconference;

(b) determining a level of activity exhibited by the participant during the videoconference; and

(c) changing the amount of bandwidth allocated to the participant responsive to the determined level of activity.

38. The method of claim 37 wherein step (b) comprises determining the participant'"'"'s absolute volume level during the videoconference.

39. The method of claim 37 wherein step (b) comprises determining the participant'"'"'s volume level during the videoconference relative to other participants.

40. The method of claim 37 wherein step (b) comprises determining the participant'"'"'s volubility during the videoconference.

41. The method of claim 37 wherein step (b) comprises determining the participant'"'"'s level of animation during the videoconference.

42. The method of claim 37 wherein step (b) comprises determining the participant'"'"'s level of animation during the videoconference relative to other participants.

43. The method of claim 37 wherein step (b) comprises (b-a) receiving a communication from another participant in the video conference, the communication including an indication of the activity level exhibited by the another participant;

and (b-b) comparing an indication of the participant'"'"'s level of activity to the another participant3 s level of activity.

44. The method of claim 37 wherein step (c) comprises increasing the amount of bandwidth allocated to the participant.

45. The method of claim 37 wherein step (c) comprises decreasing the amount of bandwidth allocated to the participant.

46. The method of claim 37 further comprising changing the size of the transmitted graphical representation of the participant responsive to the bandwidth allocated to the participant.

47. The method of claim 37 further comprising changing the color bit depth of the transmitted graphical representation of the participant responsive to the bandwidth allocated to the participant.

48. The method of claim 37 further comprising replacing a color graphical representation of the participant with a grayscale representation of the participant responsive to the bandwidth allocated to the participant.

49. The method of claim 37 further comprising replacing a color graphical representation of the participant with a black and white representation of the participant responsive to the bandwidth allocated to the participant.

50. The method of claim 37 further comprising replacing a video representation of the participant with a still image responsive to the bandwidth allocated to the participant.

52. The apparatus of claim 47 wherein the activity monitor determines the local participant'"'"'s absolute volume level during the videoconference.

53. The apparatus of claim 47 wherein the activity monitor determines the local participant'"'"'s volume level during the videoconference relative to other participants.

54. The apparatus of claim 47 wherein the activity monitor determines the local participant'"'"'s volubility during the videoconference.

55. The apparatus of claim 47 wherein the activity monitor determines the local participant'"'"'s level of animation during the videoconference.

56. The apparatus of claim 47 wherein the activity monitor determines the local participant'"'"'s level of animation during the videoconference relative to other participants.

57. The apparatus of claim 47 further comprising a display engine in communication with the network engine, the display engine changing the size of the transmitted graphical representation of the participant responsive to the amount of bandwidth allocated to the local participant.

58. The apparatus of claim 47 further comprising a display engine in communication with the network engine, the display engine changing the color bit depth of the transmitted graphical representation of the participant responsive to the amount of bandwidth allocated to the local participant.

59. The apparatus of claim 47 further comprising a display engine in communication with the network engine, the display engine replacing a color graphical representation of the participant with a grayscale representation of the participant responsive to the amount of bandwidth allocated to the local participant.

60. The apparatus of claim 47 further comprising a display engine in communication with the network engine, the display engine replacing a color graphical representation of the participant with a black and white representation of the participant responsive to the amount of bandwidth allocated to the local participant.

61. The apparatus of claim 47 further comprising a display engine in communication with the network engine, the display engine replacing a video representation of the participant with a still image responsive to the amount of bandwidth allocated to the local participant.

51. An apparatus for allocating bandwidth to participants in a videoconference, the apparatus comprising:

a network engine transmitting data to a remote participant in a videoconference;

an activity monitor in communication with the network engine, the activity monitor determining a level of activity exhibited by a local participant during the videoconference,

wherein the network engine changes the available bandwidth responsive to the determined level of activity.