Infinitely expandable real-time video conferencing system

• US 5,737,011 A
• Filed: 05/03/1995
• Issued: 04/07/1998
• Est. Priority Date: 05/03/1995
• Status: Expired due to Term

• Current Assignee: Lifesize, Inc. (Enghouse Systems Limited)
• Original Assignee: Bell Communications Research, Inc. (Telefonaktiebolaget LM Ericsson)
• Inventors: Lukacs, Michael Edward
• Primary Examiner(s): Burgess, Glenton B.
• Application Number:
  US08/434,083
• Time in Patent Office: 1,070 Days
• Field of Search: 348/15, 348/14, 348/17, 348/584-587, 348/590-593, 348/596, 348/598, 348/599, 348/16
• US Class Current: 348/14.09
• CPC Class Codes: H04N 7/15 Conference systems

Abstract

A video conferencing system and method that uses a central multimedia bridge to combine multimedia signals from a plurality of conference participants into a single composite signal for each participant. The system gives each conference participant the ability to customize their individual display of other participants, including keying in and out selected portions of the display and overlapping displayed images, and the ability to identify individual images in a composed video stream by click and drag operations or the like. The system uses a chain of video composing modules that can be extended as necessary to combine video signal streams from any number of conference participants in real time. Multimedia association software is provided for associating different media types to enhance display and manipulation capabilities for multimedia uses. The system also allows each user to dynamically change who can receive the information they provide to the conference.

Claims

1. A video conferencing system comprising

a plurality of user stations, at least some of said user stations being equipped with a video camera and a video display device;

a video composing unit in electronic communication with said video cameras and said video display devices for combining a plurality of video signal streams from respective user stations into a combined signal stream and sending the combined signal stream to a respective user station;

said video composing unit comprising a plurality of switches, each receiving video signal streams from individual ones of said use stations and

a video composing chain associated with each of said switches, each video composing chain comprising a plurality of video composing modules each having a first and a second input and an output, the first and second inputs of the first video composing module in the chain receiving video signal streams from the associated switch, the first input of succeeding video composing modules in the chain being connected to the output of the preceding video composing module in the chain, the second input of the succeeding modules receiving video signal streams from the associated switch, and the output of the last video composing module in the chain providing the output video signal stream to a user stations; and

a control unit in electronic communication with said video composing unit and said user stations, said control unit providing control signals to said video composing unit responsive to command signals received from said user stations, and said video composing unit altering the combined signal streams responsive to said control signals; and

wherein each of said video signal streams includes a priority signal portion and a video signal portion, and each of said video composing modules includes a priority driven multiplexing unit for combining two of said video signal streams into a single combined video stream having portions of said two video signal streams with the highest priority.

2. A video conferencing system comprising

a plurality of users stations, at least some of said user stations being equipped with a video camera and a video display device;

a video composing unit in electronic communication with said video cameras and said video display devices for combining a plurality of video signal streams from respective user stations into a combined signal stream and sending the combined signal stream to a respective user station;

said video composing unit comprising a plurality of switches, each receiving video signal streams from individual ones of said user stations,

a video composing chain associated with each of said switches, each video composing chain comprising a plurality of video composing modules each having a first and a second input and an output, the first and second inputs of the first video composing module in the chain receiving video signal streams from the associated switch, the first input of succeeding video composing modules in the chain being connected to the output of the preceding video composing module in the chain, the second input of the succeeding modules receiving video signal streams from the associated switch, and the output of the last video composing module in the chain providing the output video signal stream to a user station, and

each of said video composing modules further comprising a priority driven multiplexer, the first input of the video composing module being directly electronically connected to said multiplexer and the second input of the video composing module being electronically connected to said multiplexer via a priority generator; and

a control unit in electronic communication with said video composing unit and said user stations, said control unit providing control signals to said video composing unit responsive to command signals received from said user stations, and said video composing unit altering the combined signal streams responsive to said control signals.

3. The video conferencing system of claim 2, wherein each of said video signal streams includes a video signal portion and a priority signal portion, said multiplexer of each of said video composing modules combining video signal streams from said first and second inputs and outputting a combined video signal stream having picture elements consisting of the highest priority picture elements input to the multiplexer.

4. The video conferencing system of claim 3, wherein said priority generator comprises a picture element value keyer for selectively assigning high and low priorities to the picture elements of the video signal stream based on a color or brightness of the picture element.

5. The video conferencing system of claim 3, wherein said priority generator comprises a window generator for selectively assigning high and low priorities to the picture elements of the video signal stream based on a coordinate position of the picture element on a video display.

6. A video composing unit for combining a plurality of video signal streams into a single combined video signal stream, comprising:

a chain of a plurality of video composing modules each having respective first and second inputs for receiving respective video streams, a multiplexer for combining said respective video streams into a single combined video stream, and an output; and

switch means for routing said video stream to said video composing modules;

the first and second inputs of a first one of said video composing modules being electronically connected to respective first and second video streams from said switch means, the first input of a second one of said video composing modules being electronically connected to the output of the first video composing module, and the second input of said second video composing module being electronically connected to a third video stream from said switch means.

7. The video composing module of claim 6, further comprising a third video composing module having its first input electronically connected to the output of the second video composing module and its second input electronically connected to a fourth video stream from said switch means.

8. The video composing module of claim 7, further comprising a fourth video composing module having its first input electronically connected to the output of the third video composing module and its second input electronically connected to a fifth video stream from said switch means.

9. The video composing unit of claim 6, further comprising means for selectively connecting a plurality of said video composing modules together in series to create the video composing chain for combining any desired number of video signal streams.