Two monitor videoconferencing hardware

• US 5,867,654 A
• Filed: 06/07/1996
• Issued: 02/02/1999
• Est. Priority Date: 10/01/1993
• Status: Expired due to Term

• Current Assignee: Pragmatus AV LLC (Pragmatus, LLC)
• Original Assignee: Collaboration Properties Incorporated
• Inventors: Ludwig, Lester F., Lantz, Keith A., Lauwers, J. Chris, Burns, Emmett R., Burnett, Gerald J.
• Primary Examiner(s): Geckil, Mehmet B.
• Application Number:
  US08/650,123
• Time in Patent Office: 970 Days
• Field of Search: 395/200.03, 395/200.4, 395/200.34, 395/200.35, 395/200.47, 395/200.57, 395/200.66, 395/331-332, 395/340, 395/200.48, 345/330
• US Class Current: 709/204
• CPC Class Codes: G06Q 10/10 Office automation; Time management
• CPC Class Codes: H04L 12/1813 for computer conferences, e.g. chat rooms instant messaging H04L51/04; protocols for multimedia communication H04L65/1101; arrangements for multi-party communication H04L65/403; telephonic conference arrangements H04M3/56; television conference systems H04N7/15
• CPC Class Codes: H04L 12/1818 Conference organisation arrangements, e.g. handling schedules, setting up parameters needed by nodes to attend a conference, booking network resources, notifying involved parties
• CPC Class Codes: H04L 12/1822 Conducting the conference, e.g. admission, detection, selection or grouping of participants, correlating users to one or more conference sessions, prioritising transmission
• CPC Class Codes: H04L 12/1827 Network arrangements for conference optimisation or adaptation
• CPC Class Codes: H04L 12/1831 Tracking arrangements for later retrieval, e.g. recording contents, participants activities or behavior, network status
• CPC Class Codes: H04L 12/1836 with heterogeneous network architecture
• CPC Class Codes: H04L 12/185 with management of multicast group membership
• CPC Class Codes: H04L 51/00 User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
• CPC Class Codes: H04L 51/04 Real-time or near real-time messaging, e.g. instant messaging [IM]
• CPC Class Codes: H04L 51/10 Multimedia information
• CPC Class Codes: H04L 65/1101 Session protocols
• CPC Class Codes: H04L 65/4038 with floor control
• CPC Class Codes: H04L 65/80 Responding to QoS
• CPC Class Codes: H04L 67/14 Session management for real-time applications in data packet communications networks H04L65/1066
• CPC Class Codes: H04L 67/75 Indicating network or usage conditions on the user display
• CPC Class Codes: H04L 9/40 Network security protocols
• CPC Class Codes: H04M 2201/38 Displays
• CPC Class Codes: H04M 2203/5018 Initiating a conference during a two-party conversation, i.e. three-party-service or three-way-call computer conference organisation arrangements H04L12/1818
• CPC Class Codes: H04M 2203/5027 Dropping a party from a conference conducting a computer conference, e.g. admission detection H04L12/1822
• CPC Class Codes: H04M 3/42221 : Conversation recording systems at the subscriber's set H04M1/656
• CPC Class Codes: H04M 3/42323 : PBX's with CTI arrangements
• CPC Class Codes: H04M 3/4285 : Notifying, informing or entertaining a held party while on hold, e.g. Music On Hold
• CPC Class Codes: H04M 3/5307 : for recording messages comprising any combination of audio and non-audio components
• CPC Class Codes: H04M 3/562 : where the conference facilities are distributed
• CPC Class Codes: H04M 3/563 : User guidance or feature selection
• CPC Class Codes: H04M 3/564 : whereby the feature is a sub-conference
• CPC Class Codes: H04M 3/567 : Multimedia conference systems
• CPC Class Codes: H04M 7/006 : Networks other than PSTN/ISDN providing telephone service, e.g. Voice over Internet Protocol (VoIP) , including next generation networks with a packet-switched transport layer H04L65/00 takes precedence; aspects not specific to the type of network H04M3/00; special services in those networks H04M3/42
• CPC Class Codes: H04M 7/12 : for working between exchanges having different types of switching equipment, e.g. power-driven and step by step or decimal and non-decimal
• CPC Class Codes: H04N 7/147 : Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals selecting H04Q
• CPC Class Codes: H04N 7/148 : Interfacing a video terminal to a particular transmission medium, e.g. ISDN
• CPC Class Codes: H04N 7/15 : Conference systems
• CPC Class Codes: H04N 7/152 : Multipoint control units therefor
• CPC Class Codes: H04Q 2213/1305 : Software aspects
• CPC Class Codes: H04Q 2213/13093 : Personal computer, PC
• CPC Class Codes: H04Q 2213/13175 : Graphical user interface [GUI], WWW interface, visual indication
• CPC Class Codes: H04Q 2213/1319 : Amplifier, attenuation circuit, echo suppressor
• CPC Class Codes: H04Q 2213/1322 : PBX
• CPC Class Codes: H04Q 2213/1324 : Conference call
• CPC Class Codes: H04Q 2213/1326 : Consultation call, broker's call, call hold, toggling
• CPC Class Codes: H04Q 2213/1332 : Logic circuits
• CPC Class Codes: H04Q 2213/13337 : Picturephone, videotelephony
• CPC Class Codes: H04Q 2213/13389 : LAN, internet

Abstract

A multimedia collaboration system and method that integrates separate real-time and asynchronous networks--the former for real-time audio and video, and the latter for control signals and textual, graphical and other data. The system includes separate data and AV paths that interconnect a plurality of workstations. Each workstation includes two monitors--one for representing video images of the participants and the other for reproducing data interactively shared and manipulated by the participants.

Claims

1. A teleconferencing system for conducting a teleconference among a plurality of participants, comprising:

(a) a plurality of workstations, each workstation having first and second monitors and in communication with audio and video (AV) capture capabilities;

(b) a data path in communication with the plurality of workstations, over which data can be shared among the plurality of participants; and

(c) an AV path in communication with the plurality of workstations, along which AV signals, representing video images and spoken audio of the participants, can be carried;

wherein, the system is configured to reproduce images, based on data signals shared along the data path, on at least two first monitors so as to permit participants associated with the workstations having the two first monitors to interactively share the reproduced images and reproduce participant video images, based on AV signals carried along the second path, on at least two second monitors.

2. The teleconference system according to claim 1 further comprising:

(a) an echo canceller to reduce echo during the reproduction of the audio.

3. The teleconferencing system of claim 1, wherein the first and second monitors are arranged in a side-by-side relationship at approximately the eye-level of a participant using the workstation.

4. The teleconferencing system according to claim 1, wherein the plurality of participants includes a first participant and a remaining plurality of participants, and wherein the system further comprises:

(a) a video mosaic generator, in communication with the AV path, that combines the captured video images of the first participant and the remaining plurality of participants into a mosaic image that is displayed by the second monitor of at least the first participant.

5. The teleconferencing system of claim 4, further comprising:

(a) an audio summer, in communication with the AV path, that combines the captured audio of the first participant and the remaining plurality of participants and configured to combine the received audio of the remaining plurality of participants into an audio sum that can be reproduced by the second monitor of the first participant.

6. The teleconferencing system of claim 5, wherein each second monitor includes a plurality of speakers, the system further comprising:

(a) an audio control configured to control the audio reproduction of the audio sum at the first participant'"'"'s second monitor such that the audio originating from the remaining plurality of participants is reproduced at each speaker based on a position of the images of the remaining plurality of participants in the reproduced mosaic image.

7. The teleconferencing system of claim 6, wherein at least one workstation includes an echo canceler.

8. A workstation for use in a teleconferencing system for conducting a teleconference among a plurality of participants, the teleconferencing system including a first network providing a data path for carrying digital data signals among the workstations, and a second network providing an AV path for carrying AV signals among the workstations, the workstation comprising:

(a) a first monitor for displaying visual images representing the data signals;

(b) AV capture capabilities configured to capture video images and spoken audio of a participant associated with the workstation; and

(c) a second monitor configured to reproduce captured participant video images and spoken audio,

wherein the workstation is configured to control

(i) the reproduction of images, based on the data signals, on the first monitor so as to permit a participant associated with the workstation to interactively share reproduced images based on the data signal with a participant associated with another workstation

(ii) and the reproduction of participant video images, based on the AV signals, on the second monitor.

9. The workstation according to claim 8, further comprising an echo canceler.

10. The workstation according to claim 8, wherein the first and second monitors are arranged in a side-by-side relationship at approximately the eye-level of a participant using the workstation.

11. The workstation according to claim 8, further comprising an echo canceler.

12. The workstation of claim 8, wherein the plurality of participants includes a first participant and a remaining plurality of participants, and wherein the workstation further comprises:

(a) an audio summer, in communication with the AV path, that combines the captured audio of the first participant and the remaining plurality of participants, at respective workstations and configured to combine the received audio of the remaining plurality of participants into an audio sum that can be reproduced by the second monitor of the first participant.

13. The workstation of claim 12, wherein the AV reproduction capabilities associated with the workstation include a plurality of speakers and wherein the workstation is in communication with a video mosaic generator configured to combine captured video images, of the first participant and the remaining plurality of participants, into a mosaic image and to cause the mosaic image to be reproduced by the second monitor, the workstation further comprising:

(a) an audio control configured to control reproduction of the audio sum by the second monitor such that the composition of the audio originating from the remaining plurality of participants is reproduced at each speaker based on a position of the images of the remaining plurality of participants in the reproduced mosaic image.

14. The workstation of claim 13, further comprising an echo canceler.

15. A method of conducting a teleconference among a plurality of participants, comprising the steps of:

(a) initiating a video conference, from one of a plurality of workstations, using a video conferencing control included within each of the plurality of workstations, the video conferencing control establishing communication with a central control manager to set up AV paths along a first network over which the video conference can be conducted;

(b) capturing video images and spoken audio of the participants for transmission in the form of AV signals over the AV paths during the video conference;

(c) reproducing the video images and spoken audio on at least one first monitor, positioned near each workstation, from the AV signals received over the AV paths during the video conference;

(d) initiating a data conference, during the video conference, using a data conferencing control included within each of the plurality of workstations, the data conferencing control establishing communication with the central control manager to set up requested data paths along a second network over which the data conference can be conducted; and

(e) sharing data, among the plurality of participants, during the data conference, such that data received over the data paths is displayed on at least one second monitor included within each workstation.

16. The method as recited in claim 15, wherein the data conference can be conducted absent a video conference.

17. The method as recited in claim 16, including the step of recording the video conference on a first storage medium.

18. The method as recited in claim 15, wherein the video conference can be conducted absent a data conference.

19. The method as recited in claim 18, including the step of recording the data conference on a second storage medium.

20. The method as recited in claim 15, wherein the step of sharing data, further comprises the step of transmitting annotations by at least one participant, from a corresponding user interface configured at each workstation, for displaying on the first monitors of the plurality of workstations.

21. The method as recited in claim 20, wherein the step of sharing data includes sharing an application program.

22. The method as recited in claim 20, wherein the step of sharing data includes sharing a snapshot provided by one of the participants.