Method and system for multimedia communication control
First Claim
1. A multipoint control unit for facilitating communication between a plurality of endpoints, each respective endpoint sending a compressed video output signal and receiving a compressed video input signal, comprising:
- a plurality of video input modules, each video input module receiving a respective video output signal from a respective endpoint, each video input module comprising;
a generalized decoder for reading the respective video output signal and for generating a respective primary data stream comprising video information and a respective secondary data stream comprising side information; and
a video output module comprising;
a rate control unit operable to read each of the respective secondary data streams, pre-process the respective secondary data stream, and control a generalized encoder; and
the generalized encoder, in communication with the rate control unit and operable to receive each of the respective primary data streams from each respective video input module, and encode the respective primary data stream into a compressed video output stream for transmission to an endpoint.
7 Assignments
0 Petitions
Accused Products
Abstract
A multipoint control unit (MCU) for facilitating communication between a plurality of endpoints. Each endpoint sends a compressed video signal and receives a compressed video signal. The MCU has a plurality of video input modules and a video output module. Each of the video input modules receives a video signal from one of the endpoints and generally decodes the data into a primary data stream and a secondary data stream. The video output module includes a rate control unit and a generalized encoder that receive the primary and secondary data streams for generally encoding to a compressed output stream for transmission to an endpoint.
-
Citations
50 Claims
-
1. A multipoint control unit for facilitating communication between a plurality of endpoints, each respective endpoint sending a compressed video output signal and receiving a compressed video input signal, comprising:
-
a plurality of video input modules, each video input module receiving a respective video output signal from a respective endpoint, each video input module comprising;
a generalized decoder for reading the respective video output signal and for generating a respective primary data stream comprising video information and a respective secondary data stream comprising side information; and
a video output module comprising;
a rate control unit operable to read each of the respective secondary data streams, pre-process the respective secondary data stream, and control a generalized encoder; and
the generalized encoder, in communication with the rate control unit and operable to receive each of the respective primary data streams from each respective video input module, and encode the respective primary data stream into a compressed video output stream for transmission to an endpoint.
-
-
2. A multipoint control unit for facilitating communication between a plurality of endpoints, each of said plurality of endpoints including a video screen and a video camera, each of said plurality of endpoints being operative to send a compressed video input signal to said multipoint control unit and receive a compressed video output signal from said multipoint control unit, the multipoint control unit comprising:
-
at least one video input module, for receiving a compressed video input signal from at least one endpoint of said plurality of endpoints, the video input module comprising;
a generalized decoder operative to decode the compressed video input signal and generate a primary video data stream, the generalized decoder comprising;
a data processing unit operative to process said compressed video input signal and said primary video data stream to generate a secondary data stream, said secondary data stream being associated with said primary video stream; and
at least one video output module operative to receive at least one of said primary video data stream and said secondary data stream, the output module comprising;
a rate control unit; and
a generalized encoder, in communication with said rate control unit and operative to receive said primary data stream from said at least one input module and encode said primary data stream into a compressed video output stream for transmission to at least one endpoint of said plurality of endpoints;
means to route said primary data stream from at least one input module to at lest one output module; and
means to route said secondary data stream from at least one input module to the at lest one output module;
whereby the use of said secondary data stream by the output module improves the speed of encoding and the quality of the compressed video output signal. - View Dependent Claims (3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18)
means to read said secondary data stream;
means to process said secondary data stream; and
means to control a generalized encoder based upon said processed secondary data stream.
-
-
7. The multipoint control unit of claim 6, wherein said rate control unit comprises:
-
means to read feedback data from a generalized encoder;
means to process said secondary data stream with said feedback data; and
means to control said generalized encoder based upon said processed secondary data stream and said feedback.
-
-
8. The multipoint control unit of claim 2, wherein said means to route said primary data stream includes a common interface selected from a group consisting of:
- shared memory, ATM bus, TDM bus, switching and direct connection.
-
9. The multipoint control unit of claim 2, wherein said means to route the secondary data stream includes a common interface selected from a group consisting of:
- shared memory, ATM bus, TDM bus, switching and direct connection.
-
10. The multipoint control unit of claim 2, wherein said primary data stream includes information in the DCT domain.
-
11. The multipoint control unit of claim 2, wherein said primary data stream includes information in spatial domain.
-
12. The multipoint control unit of claim 2, wherein said video output module receives at least one of said primary video data streams and it'"'"'s associated said secondary data stream and control information from an external device.
-
13. The multipoint control unit of claim 12, wherein said rate control unit of said video output module comprises:
-
means to read said secondary data stream;
means to read said control information;
means to process said secondary data stream;
means to process the control information; and
means to control said generalized encoder based upon the processed secondary data stream and the processed control information.
-
-
14. The multipoint control unit of claim 13, wherein said rate control unit of said video output module comprises:
-
means to read feedback data from a generalized encoder; and
means to process said secondary data stream with said control information and said feedback; and
means to control said generalized encoder based upon the results.
-
-
15. The multipoint control unit of claim 12, wherein the control information includes at least one type of information selected from a group consisting of:
- region of interest indication, screen layout requirements, user quality preferences and special effects.
-
16. The multipoint control unit of claim 12 wherein the control information is bidirectional information.
-
17. The multipoint control unit of claim 2 wherein said video output module receives said primary video data stream and said secondary data stream, and said rate control unit of said video output module comprises:
-
means to read said secondary data stream;
means to read data on the actual amount of bits used after variable length coding;
means to process the respective secondary data stream with the variable length coding information; and
means to control said generalized encoder based on the said processed information, whereby the use of said variable length coding information and the secondary data stream by generalized encoder improves the speed of encoding and the quality of the compressed video output signal by improving the output bits allocation.
-
-
18. The multipoint control unit of claim 17 wherein said video output module receives said primary video data stream and said secondary data stream, and said rate control unit of said video output module comprises:
-
means to read feedback data from a generalized encoder;
means to process the respective secondary data stream with the variable length coding information and said feedback data; and
means to control said generalized encoder based on the said processed information.
-
-
19. A multipoint control unit for facilitating communication between a plurality of endpoints, each endpoint including a video screen and a video camera, each endpoint being operative to send a compressed video input signal to the multipoint control unit and receive a compressed video output signal from said multipoint control unit, said multipoint control unit comprising:
-
at least one video fat port, each video fat port receiving at least one compressed video input signal from at least one endpoint and sending a compressed video output signal to at least one endpoint of said plurality of endpoints, each video fat port comprising;
at least one video input module, each video input module receiving a compressed video input signal from one endpoint of said plurality of endpoints, each video input module comprising;
a generalized decoder for decoding the compressed video input signal from said endpoint for generating a primary video data stream; and
a video output module, the output module receiving at least one of said primary video data streams, the output module comprising;
a rate control unit;
a generalized encoder, in communication with said rate control unit and operative to receive each of said primary data stream from at least one of said input modules and encode said primary data streams into a compressed video output stream for transmission to at least one endpoint of said plurality of endpoints; and
means to route said primary data stream from at least one input module to the output module;
whereby the use of said fat port enables sharing video streams of a conference in the compressed domain on the BackPlane this increases the number of participants in a conference and eliminates fragmentation compared to a case where the video sharing is done in the spatial domain on an open video bus.
-
-
20. A multipoint control unit for facilitating communication between a plurality of endpoints, each endpoint including a video screen and a video camera, each endpoint being operative to send a compressed video input signal to the multipoint control unit and receive a compressed video output signal from said multipoint control unit, the multipoint control unit comprising:
-
at least one video fat port, each video fat port receiving at least one compressed video input signal from at least one endpoint and sending a compressed video output signal to at least one endpoint of said plurality of endpoints, each video fat port comprising;
at least one video input module, each video input module receiving a compressed video input signal from one endpoint of said plurality of endpoints, each video input module comprising;
a generalized decoder for decoding the compressed video input signal from said endpoint for generating a primary video data stream, the generalized decoder comprising;
a data processing unit for processing said compressed video input signal and said primary video data stream for generating a secondary data stream associated with said primary video data stream comprising side information; and
a video output module, the video output module receiving at least one of said primary video data streams and said secondary data streams, the output module comprising;
a rate control unit; and
a generalized encoder, in communication with said rate control unit and operative to receive each of said primary data stream from at least one of said input modules and encode said primary data streams into a compressed video output stream for transmission to at least one endpoint of said plurality of endpoints; and
means to route said primary data stream from at least one input module to the output module; and
means to route said secondary data stream from at least one input module to the output module, whereby the use of said fat port enables sharing video streams of a conference in the compressed domain on the BackPlane this increases the number of participants in a conference and eliminates fragmentation in compare to a case where the video sharing is done in the spatial domain on an open video bus. - View Dependent Claims (21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35)
means to read each of the respective secondary data streams;
means to process the respective secondary data streams; and
means to control said generalized encoder based upon said processed secondary data stream.
-
-
25. The multipoint control unit of claim 20, wherein said means to route said primary data stream includes a common interface selected from a group consisting of:
- shared memory, ATM bus, TDM bus, switching and direct connection.
-
26. The multipoint control unit of claim 20, wherein said means to route said secondary data stream includes a common interface selected from a group consisting of:
- shared memory, ATM bus, TDM bus, switching and direct connection.
-
27. The multipoint control unit of claim 20, wherein said primary data stream includes information in a DCT domain.
-
28. The multipoint control unit of claim 20, wherein said primary data stream includes information in spatial domain.
-
29. The multipoint control unit of claim 20, wherein said video output module receives said at least one primary video data stream and said secondary data stream and control information from an external device.
-
30. The multipoint control unit of claim 29, wherein said rate control unit of said video output module comprises:
-
means to read the respective secondary data stream;
means to read said control information;
means to process the respective secondary data stream;
means to process the control information; and
a means to control the generalized encoder based upon the processed information.
-
-
31. The multipoint control unit of claim 29, wherein said rate control unit of said video output module comprises:
-
means to read feedback data from a generalized encoder;
means to process said secondary data stream with said control information and said feedback; and
means to control said generalized encoder based upon the results.
-
-
32. The multipoint control unit of claim 29, wherein the control information includes at least one type of information selected from the group consisting of:
- region of interest indication, screen layout requirements, user quality preferences and special effects.
-
33. The multipoint control unit of claim 29, wherein the control information is bidirectional information.
-
34. The multipoint control unit of claim 20, wherein said video output module receives said primary video data stream and said secondary data stream, and said rate control unit of said video output module comprises:
-
means to read said respective secondary data stream;
means to read data on the actual amount of bits used after variable length coding;
means to process the respective secondary data stream with the variable length coding information; and
means to control a generalized encoder based on the said processed information, whereby process of said variable length coding information and said secondary data stream the generalized encoder improves the speed of encoding ant the quality of the compressed video output signal by improving the output bits allocation.
-
-
35. The multipoint control unit of claim 34 wherein said video output module receives said primary video data stream and said secondary data stream, and said rate control unit of said video output module comprises:
-
means to read feedback data from a generalized encoder;
means to process the respective secondary data stream with the variable length coding information and said feedback data; and
means to control said generalized encoder based on the said processed information.
-
-
36. A method of performing operations on a compressed video stream, the method comprising the steps of:
-
reading encoding parameters embedded within the compressed input video stream;
processing the compressed input video stream into two data stream, a primary data stream and a secondary data stream;
routing said primary data stream and secondary data stream to at least one output unit; and
encoding said primary data stream by using the information associated with said secondary data stream, whereby using said secondary data stream improves the speed of encoding and the quality of the compressed video output signal. - View Dependent Claims (37, 38, 39, 40, 41, 42, 43)
-
-
44. A system for performing operations on a compressed video stream, the system comprising:
-
at least one generalized decoder for decoding the compressed video stream into a primary data stream and for reading and analyzing encoding parameters embedded within the compressed video stream and for creating a secondary data stream; and
at least one editor that receives the primary streams and generates modified pseudo-decoded video stream; and
a generalized encoder for encoding said modified decoded video stream into a second compressed output video stream using the encoding parameters from the generalized decoders. - View Dependent Claims (45, 46, 47, 48, 49, 50)
-
Specification