System and method for videoconferencing using scalable video coding and compositing scalable video conferencing servers
First Claim
Patent Images
1. A multi-endpoint video signal conferencing system for videoconferencing between a plurality of endpoints over a communications network, the system comprising:
- at least one transmitting endpoint that transmits coded digital video using either a single-layer coding format or a scalable video coding format, andat least one receiving endpoint that is capable of decoding at least one digital video stream coded in a scalable video coding format,a conferencing bridge (“
Compositing Scalable Video Coding Server”
(CSVCS)) linked to at least one receiving and at least one transmitting endpoint by at least one communication channel each,wherein the CSVCS is configured to compose input video signals received from transmitting endpoints into a single composite coded digital video output signal, and to forward the single composite coded digital video output signal to the at least one receiving endpoint where the CSVCS is configured to compose an output signal picture for at least one of the receiving endpoints by;
assigning a portion of the composite output picture'"'"'s area to each transmitting endpoint intended to be included in the composite output picture;
discarding incoming video signal data received from the transmitting endpoints that correspond to one of;
resolutions higher than the one intended for the composed picture;
data not needed for decoding at the resolution intended for the composed picture; and
a transmitting endpoint that is not to be included in the composite picture;
modifying the remaining data of the incoming coded video signals by changing header information so that they form proper data of the composite output video signal;
generating, when necessary, artificial layer data for at least one of the transmitting endpoint video signals; and
transmitting the modified data and any generated lower layer data to the one or more receiving endpoints,such that no decoding or encoding of picture data takes place at the CSVCS.
9 Assignments
0 Petitions
Accused Products
Abstract
Systems and methods for videoconferencing are provided. The systems use scalable video coding techniques and a compositing scalable video coding server (CSVCS) to composite input video signals from transmitting conferencing participants into one single output video signal forwarded to a receiving participant. The server is configured to composite the input video signals pictures without decoding, rescaling, and re-encoding of the signals.
-
Citations
67 Claims
-
1. A multi-endpoint video signal conferencing system for videoconferencing between a plurality of endpoints over a communications network, the system comprising:
-
at least one transmitting endpoint that transmits coded digital video using either a single-layer coding format or a scalable video coding format, and at least one receiving endpoint that is capable of decoding at least one digital video stream coded in a scalable video coding format, a conferencing bridge (“
Compositing Scalable Video Coding Server”
(CSVCS)) linked to at least one receiving and at least one transmitting endpoint by at least one communication channel each,wherein the CSVCS is configured to compose input video signals received from transmitting endpoints into a single composite coded digital video output signal, and to forward the single composite coded digital video output signal to the at least one receiving endpoint where the CSVCS is configured to compose an output signal picture for at least one of the receiving endpoints by; assigning a portion of the composite output picture'"'"'s area to each transmitting endpoint intended to be included in the composite output picture; discarding incoming video signal data received from the transmitting endpoints that correspond to one of;
resolutions higher than the one intended for the composed picture;
data not needed for decoding at the resolution intended for the composed picture; and
a transmitting endpoint that is not to be included in the composite picture;modifying the remaining data of the incoming coded video signals by changing header information so that they form proper data of the composite output video signal; generating, when necessary, artificial layer data for at least one of the transmitting endpoint video signals; and transmitting the modified data and any generated lower layer data to the one or more receiving endpoints, such that no decoding or encoding of picture data takes place at the CSVCS. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 65)
-
-
32. A multi-endpoint video signal conferencing system for videoconferencing between a plurality of endpoints over a communications network, the system comprising:
-
at least one transmitting endpoint that transmits coded digital video using either a single-layer coding format or a scalable video coding format, and at least one receiving endpoint that is capable of decoding at least one digital video stream coded in a scalable video coding format, a plurality of conferencing bridges (“
Compositing Scalable Video Coding Server”
(CSVCS)) in a cascading arrangement linked to at least one receiving and at least one transmitting endpoint by at least one communication channel each,wherein at least one CSVCS, which is not the last one in the cascading arrangement, is configured to optionally; without processing, forward composite coded pictures received from CSVCS that are earlier in the cascading arrangement to other CSVCSs;
ordecompose the composite coded pictures received from CSVCS that are earlier in the cascading arrangement and recompose them using a different layout prior to forwarding them to other CSVCSs.
-
-
33. A multi-endpoint video signal conferencing system for videoconferencing between a plurality of endpoints over a communications network, the system comprising:
-
at least one transmitting endpoint that transmits coded digital video using either a single-layer coding format or a scalable video coding format, and at least one receiving endpoint that is capable of decoding at least one digital video stream coded in a scalable video coding format, a conferencing bridge (“
Compositing Scalable Video Coding Server”
(CSVCS)) linked to at least one receiving and at least one transmitting endpoint by at least one communication channel each,at least one SVCS and at least one CSVCSs in an cascading arrangement, wherein; the at least one SVCS is configured to only select some or all data of the video signals received from the transmitting endpoints or other SVCSs, and forward the selected data to other SVCSs or CSVCSs, and a CSVCS is the last server in the cascading arrangement, which creates the composite coded output picture for transmission to the one or more receiving endpoints.
-
-
34. A method for videoconferencing between a plurality of endpoints over a communications network, the method comprising:
-
using a conferencing bridge (“
Compositing Scalable Video Coding Server”
(CSVCS)) linked to at least one receiving and at least one transmitting endpoint by at least one communication channel each;transmitting coded digital video from at least one transmitting endpoint in either a single-layer coding format or a scalable video coding format; and at the CSVCS, composing input video signals received from transmitting endpoints into a single composite coded digital video output signal, and forwarding the single composite coded digital video output signal to at least one receiving endpoint which is capable of decoding at least one digital video stream coded in a scalable video coding format; wherein the at the CSVCS, composing input video signals received from transmitting endpoints into a single composite coded digital video output signal, comprises; assigning a specific portion of the composite output picture'"'"'s area to each specific transmitting endpoint intended to be included in the composite output picture; discarding incoming video signal data received from the transmitting endpoints that correspond to one of;
resolutions higher than the one intended for the composed picture;
data not needed for decoding at the resolution intended for the composed picture; and
a transmitting endpoint that is not to be included in the composite picture;modifying the remaining data of the incoming coded video signals by changing header information so that they form proper data of the composite output video signal; generating, when necessary, artificial layer data for at least one of the transmitting endpoint video signals; and transmitting the modified data and any generated lower layer data to the one or more receiving endpoints, such that no decoding or encoding of picture data takes place at the CSVCS. - View Dependent Claims (35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64)
-
-
66. A method for videoconferencing between a plurality of endpoints over a communications network, the method comprising:
-
using a conferencing bridge (“
Compositing Scalable Video Coding Server”
(CSVCS)) linked to at least one receiving and at least one transmitting endpoint by at least one communication channel eachtransmitting coded digital video from at least one transmitting endpoint in either a single-layer coding format or a scalable video coding format; and at the CSVCS, composing input video signals received from transmitting endpoints into a single composite coded digital video output signal, and forwarding the single composite coded digital video output signal to at least one receiving endpoint which is capable of decoding at least one digital video stream coded in a scalable video coding format; in the case where the communication network comprises a plurality of CSVCS in an cascading arrangement, further comprising; at least one CSVCS that is not the last one in the cascading arrangement, optionally forwarding without processing composite coded pictures received from CSVCS that are earlier in the cascading arrangement to other CSVCSs;
or decomposing the composite coded pictures received from CSVCS that are earlier in the cascading arrangement and recompose them using a different layout prior to forwarding them to other CSVCSs.
-
-
67. A method for videoconferencing between a plurality of endpoints over a communications network, the method comprising:
-
using a conferencing bridge (“
Compositing Scalable Video Coding Server”
(CSVCS)) linked to at least one receiving and at least one transmitting endpoint by at least one communication channel each;transmitting coded digital video from at least one transmitting endpoint in either a single-layer coding format or a scalable video coding format; and at the CSVCS, composing input video signals received from transmitting endpoints into a single composite coded digital video output signal and forwarding the single composite coded digital video output signal to at least one receiving endpoint which is capable of decoding at least one digital video stream coded in a scalable video coding format; in the case where the communication network comprises at least one SVCS and at least one CSVCS in an cascading arrangement, further comprising; at the at least one SVCS, selecting only some or all data of the video signals received from the transmitting endpoints or other SVCSs, and forwarding the selected data to other SVCSs or CSVCSs; and at a CSVCS, which is the last server in the cascading arrangement, creating the composite coded output picture for transmission to the one or more receiving endpoints.
-
Specification