Multi-participant conference system with controllable content delivery using a client monitor back-channel

• US 20040008635A1
• Filed: 07/10/2002
• Published: 01/15/2004
• Est. Priority Date: 07/10/2002
• Status: Active Grant

• Current Assignee: Seiko Epson Corporation (Seiko Group)
• Original Assignee: Seiko Epson Corporation (Seiko Group)
• Inventors: Nelson, Steve, Ivashin, Victor, Miceli, Sean, Boskovic, Ronald
• Granted Patent: US 7,362,349 B2
• Time in Patent Office: Days
• US Class Current: 370/260
• CPC Class Codes: H04N 7/147 Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals selecting H04Q
• CPC Class Codes: H04N 7/152 Multipoint control units therefor

Abstract

A videoconferencing system configured to utilize peer-to-peer videoconferencing software to provide a multi-participant conference environment for a plurality of participants is provided. The system includes a client component defining a conference client enabled to execute peer-to-peer videoconferencing software. The client component includes a client monitor configured to monitor both, whether the conference channel is active and events within a video window displayed by the conference client, wherein the events within the video window are communicated across a back-channel connection. The back-channel connection is established when the conference channel is active. The system includes a server component having a back-channel controller in communication with the client monitor through the back-channel connection. The server component provides a client configurable audio/video stream for each of a plurality of participants. A graphical user interface and methods for providing a multi-participant conferencing environment are provided.

Claims

1. A videoconferencing system configured to utilize peer-to-peer videoconferencing software to provide a multi-participant conference environment for a plurality of participants, comprising:

a client component, the client component including,

a conference client enabled to execute peer-to-peer videoconferencing software, the conference client communicating video and audio data across a conference channel; and

a client monitor configured to monitor both, whether the conference channel is active and events within a video window displayed by the conference client, wherein the events within the video window are communicated across a back-channel connection, the back-channel connection established when the conference channel is active;

a server component, the server component having a back-channel controller in communication with the client monitor through the back-channel connection, the server component providing a client configurable audio/video stream for each of a plurality of participants.

2. The videoconferencing system of claim 1, wherein the client monitor defines a graphical user interface of which the video window displayed by the conference client is a component.

3. The videoconferencing system of claim 2, wherein the graphical user interface enables access to files of the conference client.

4. The videoconferencing system of claim 3, wherein the files of the conference client are available to each of the plurality of participants over the back-channel connection.

5. The videoconferencing system of claim 1, wherein the server component includes a media mixer configured to compose a composite audio/video signal for each of the plurality of participants from individual audio/video signal from each of the plurality of participants.

6. A videoconferencing system, comprising:

a client component including a client in communication with a client monitor;

a server component;

a conference channel defined between the client component and the server component, the conference channel providing a first path for real-time video/audio data to be exchanged between the client component and a conferencing endpoint of the server component for a videoconference; and

a back-channel defined between the client component and the server component providing a second path for system information to be exchanged between the client monitor and the server component.

7. The videoconferencing system of claim 6, wherein the client includes a peer-to-peer videoconferencing application.

8. The videoconferencing system of claim 7, wherein the client monitor is configured to detect an activity in a display window associated with the peer-to-peer videoconferencing application, in response to detecting the activity, the client monitor reports the activity to the server component over the back-channel.

9. The videoconferencing system of claim 8, wherein the activity is one of mouse movement, mouse clicks and keyboard state information.

10. The videoconferencing system of claim 6, wherein the client monitor is configured to provide a user interface, the user interface including a display window of a peer-to-peer videoconference application associated with the client.

11. The videoconferencing system of claim 6, wherein the server component is configured to enable access to a non-participant of the videoconference through a back-channel network associated with the back-channel.

12. The videoconferencing system of claim 6, wherein the server component includes,

a media mixer enabling distribution of a composite audio/video data stream to the client component, the media mixer in communication with a back-channel network to enable a private audio link between two clients.

13. The videoconferencing system of claim 6, wherein the system information includes a configuration of a video display window associated with the client.

14. The videoconferencing system of claim 13, wherein the system information is communicated to a media mixer of the server component, in response to receiving the system information, the media mixer modifies a video data stream for the client.

15. A conferencing system configured to provide a multi-user conference environment to deliver customizable information to a plurality of conference clients, comprising:

a client component, the client component including,

a conference client; and

a client monitor configured to monitor an activity of the conference client, the activity occurring over a video frame displayed by the conference client;

a server component, the server component including,

a media hub server component providing a conference connection, the media hub server component including,

a media mixer configured to assemble audio and video data to be supplied to the conference client from audio and video data received by the media mixer from a plurality of conference clients, the media mixer including,

a video layout processor configured to generate a composite video image for each of the plurality of conference clients, and

an audio distribution processor for providing an audio signal for each of the plurality of conference clients;

a connection manager allowing connections of several participants into logical rooms for shared conference communications, the connection manager including,

a back-channel controller enabling communication between the client monitor and the media hub server component, and

an event handler configured to insert interface data into an outbound video stream image through the video layout processor.

16. The conferencing system of claim 15, wherein the interface data enables the conference client to access local files to be shared with the plurality of conference clients, the local files associated with a computer included in the client component.

17. The conferencing system of claim 15, wherein the client component and the server component are in communication through a conference channel carrying real time audio/video data and a back-channel carrying system information;

18. The conferencing system of claim 15, wherein the conference client includes,

a peer-to-peer videoconference application in communication with the conference connection of the media hub server component.

19. A graphical user interface (GUI) for a videoconference rendered on a computer monitor, comprising:

a first region defining an integrated video component, the integrated video component associated with a client, the integrated video component having a plurality of participant video images, the integrated video component being monitored to detect user activity within a display window of the integrated video component; and

a second region providing access to files of a computer system;

the second region allowing a user to select one of the files for transmission to a server supporting the videoconference, wherein the server communicates the selected one of the files to participants of the videoconference.

20. The GUI of claim 19, wherein the user activity is one of mouse movement, mouse clicks and keyboard state information.

21. The GUI of claim 19, wherein the first region is associated with a peer-to-peer videoconferencing application.

22. The GUI of claim 19, wherein the second region enables a peripheral device to augment conference content viewable by the participants.

23. The GUI of claim 22, wherein the peripheral device is one of a scanner and a video projector.

24. The GUI of claim 19, wherein the integrated video component is provided over a first communication link with the server and information captured in the second region is provided to the server over a second communication link.

25. The GUI of claim 24 wherein the first communication link is a conference channel and the second communication link is a back-channel.

26. A method for providing a multi-user conference environment for multiple participants, comprising:

establishing a server component for enabling a conference channel connection between the server component and a conference client associated with a participant;

providing audio and video data from the participant to the server component over the conference channel connection;

communicating system preferences to the server component for each of the multiple clients over a back-channel connection;

distributing combined audio and video data to the participant over the conference channel connection, the combined audio and video data presented as defined by the system preferences;

monitoring an interaction of the participant with a video image presented on the conference client;

transmitting a signal indicating the interaction to the server component over the back-channel connection; and

in response to the signal indicating the interaction, modifying the combined audio and video data distributed to the conference client over the conference channel connection.

27. The method of claim 26, wherein the conference channel connection support one of H.323 protocol and session initiation protocol (SIP).

28. The method of claim 26, wherein the system preferences include one of a position of an image in a video layout for each of the multiple clients, a brightness of the video layout and a volume level associated with participants displayed in the video layout.

29. The method of claim 26, wherein the interaction is associated with one of a mouse movement and a keyboard signal.

30. A method for creating a multi-user conferencing environment between conference clients having peer-to-peer conferencing applications, comprising:

providing a server component configured to emulate a peer-to-peer connection for each of the conference clients;

defining a conference channel for communication between conference clients and the server component;

monitoring activities of a user in an active region of a video display associated with one of the conference clients;

reporting an active selection by a user in the active region to the server component, the reporting occurring outside of the conference channel; and

in response to the active selection reporting being received by the server component, modifying a configuration of an audio/video signal provided to the conference clients.

31. The method of claim 30, wherein the server component is a media hub server.

32. The method of claim 30, wherein the conference channel is configured to communicate real time audio and video data between the conference clients and the server component.

33. The method of claim 30, wherein the method operation of reporting an active selection by a user occurs over a back-channel.

34. The method of claim 33, wherein the back-channel defines a communication link between a client monitor configured to track activities in a video display window of one of the conference clients and a back-channel controller of the server component.

35. A computer readable media having program instructions for creating a multi-user conferencing environment between conference clients having peer-to-peer conferencing applications and a server component configured to emulate a peer-to-peer connection for each of the participants, comprising:

program instructions for defining a conference channel for communication between conference clients and the server component;

program instructions for monitoring activities of a user with one of the conference clients;

program instructions for reporting the monitored activities to the server component over a back-channel connection; and

program instructions for modifying a video and audio signal provided to the conference clients in response to the reported activities being received by the server component.

36. The computer readable media of claim 35, wherein the server component is a media hub server.

37. The computer readable media of claim 35, wherein the back-channel connection defines a communication link between a client monitor configured to track activities in a video display window of one of the conference clients and a back-channel controller of the server component.

38. The computer readable media of claim 35, further including:

providing program instructions for enabling a private audio link between two participants during a videoconference session.