Video multicast engine

• US 8,791,982 B1
• Filed: 06/27/2012
• Issued: 07/29/2014
• Est. Priority Date: 06/27/2012
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Ellner, Lars Henrik
• Primary Examiner(s): SMITH, CREIGHTON H
• Application Number:
  US13/534,400
• Time in Patent Office: 762 Days
• Field of Search: 348/14.1, 379/202.01, 370/260
• US Class Current: 348/14.1
• CPC Class Codes: H04L 12/1818 Conference organisation arrangements, e.g. handling schedules, setting up parameters needed by nodes to attend a conference, booking network resources, notifying involved parties
• CPC Class Codes: H04L 12/1827 Network arrangements for conference optimisation or adaptation
• CPC Class Codes: H04L 65/403 Arrangements for multi-party communication, e.g. for conferences data switching systems for conference H04L12/18; arrangements for connecting several subscribers to a common circuit, i.e. affording conference facilities H04M3/56; television conferencing systems H04N7/15
• CPC Class Codes: H04L 65/611 for multicast or broadcast systems for broadcast or conference H04L12/18; arrangements for broadcast or distribution combined with broadcast H04H20/00; arrangements for broadcast applications with a direct linkage to broadcast information or to broadcast space-time H04H60/00; selective distribution of broadcast services, e.g. multimedia broadcast multicast service [MBMS], H04W4/06
• CPC Class Codes: H04L 65/752 adapting media to network capabilities
• CPC Class Codes: H04L 65/765 intermediate
• CPC Class Codes: H04M 3/563 User guidance or feature selection
• CPC Class Codes: H04M 3/567 Multimedia conference systems
• CPC Class Codes: H04M 3/568 audio processing specific to telephonic conferencing, e.g. spatial distribution, mixing of participants echo suppression in two-way loud-speaking telephone systems H04M9/02; sound field processing per se H04S7/30
• CPC Class Codes: H04N 7/15 Conference systems

Abstract

Introduction of one or more multicast engines to a video conferencing system permits an improvement of overall network bandwidth used for a video conference. A video stream is received at a multicast engine connected to a participant of a plurality of participants in the conference where the video stream is supplied by the participant. The multicast engine selectively transmits the video stream to a server station based on determining whether the video stream is a candidate for a conference video stream to be transmitted to at least some of the plurality of participants. The conference video stream is received at the multicast engine from the server station, and the stream is transmitted from the multicast engine to any participants in the video conference that are connected to the multicast engine.

Claims

1. A method of conducting a video conference with reduced bandwidth usage, comprising:

receiving a video stream at a multicast engine connected to a participant of a plurality of participants in the video conference, the video stream being supplied by the participant, the multicast engine including a first memory and a first processor configured to execute instructions stored in the first memory;

selectively transmitting the video stream of the participant from the multicast engine to a server station based on a determination of whether the video stream is a candidate for a conference video stream to be transmitted to at least some of the plurality of participants from the server station, the server station including a second memory and a second processor configured to execute instructions stored in the second memory;

receiving the conference video stream at the multicast engine from the server station; and

transmitting the conference video stream to any participants in the video conference that are connected to the multicast engine.

2. The method of claim 1, further comprising:

determining whether the video stream is a candidate for the conference video stream to be transmitted to at least some of the plurality of participants using the first processor.

3. The method of claim 2 wherein selectively transmitting the video stream comprises:

performing a mixing algorithm that selects at least one video stream of a plurality of video streams that are provided to the multicast engine by respective participants connected to the multicast engine; and

transmitting the video stream of the participant to the server station when the video stream of the participant is selected by the mixing algorithm.

4. The method of claim 3 wherein the mixing algorithm is a same mixing algorithm used by the server station to determine which video streams of the plurality of participants to include in the conference video stream.

5. The method of claim 3 wherein the server station is a relay station and wherein the mixing algorithm is a same mixing algorithm used by the server station to determine which video streams of the plurality of participants to include in the conference video stream.

6. The method of claim 5 wherein the multicast engine mixes the conference video stream before transmitting the conference video stream.

7. The method of claim 1, further comprising:

receiving a signal at the multicast engine from the server station indicating that the video stream of the participant is included in the conference video stream; and

wherein the multicast engine transmits the video stream of the participant to the server station responsive to the signal.

8. The method of claim 1 wherein the video stream is one of at least two video streams supplied by a respective participant connected to the multicast engine and wherein selectively transmitting the video stream comprises transmitting fewer than the at least two video streams as a result of the determination.

9. The method of claim 1 wherein a distance between the participant and the multicast engine is less than a distance between the multicast engine and the server station.

10. The method of claim 1 wherein the multicast engine is one of a plurality of multicast engines, each of the plurality of multicast engines connected to the server station and to different ones of the plurality of participants to form respective clusters, wherein all but at least one of the plurality of multicast engines is less distant from its connected participants than it is from the server station.

11. The method of claim 1 wherein determining whether the video stream is a candidate for the conference video stream comprises:

performing a mixing algorithm, using the first processor, that selects at least one video stream of a plurality of video streams supplied by respective participants to the multicast engine; and

transmitting the video stream of the participant to the server station when the video stream of the participant is selected by the mixing algorithm performed using the first processor; and

the method further including;

performing the mixing algorithm using the second processor to select at least one video stream to include in the conference video stream from all video streams received by the server station; and

transmitting the conference video stream to the multicast engine.

12. The method of claim 1, further comprising:

transmitting the video stream from the participant to the multicast engine and from the multicast engine, upon the multicast engine establishing a connection to the server station, to the server station; and

wherein selectively transmitting the video stream includes;

ending transmission of the video stream to the server station when a result of the determination indicates that the video stream is not a candidate for the video conference stream.

13. An apparatus for conducting a video conference with reduced bandwidth usage, the apparatus comprising:

a multicast engine including a first memory and a first processor configured to execute instructions stored in the first memory to;

receive a video stream supplied from a participant of a plurality of participants in the video conference;

selectively transmit the video stream of the participant to a server station based on a determination of whether the video stream is a candidate for a conference video stream to be transmitted to at least some of the plurality of participants from the server station, the server station including a second memory and a second processor configured to execute instructions stored in the second memory;

receive the conference video stream from the server station; and

transmit the conference video stream to any participants in the video conference that are connected to the multicast engine.

14. The apparatus of claim 13, further comprising:

the server station and the second processor configured to execute instructions stored in the second memory to;

perform a mixing algorithm that determines which video streams of the plurality of participants to include in the conference video stream; and

transmit a signal to the multicast engine indicating those video streams included in the conference video stream.

15. The apparatus of claim 13 wherein an encoding format of the conference video stream received at the multicast engine corresponds to that of a highest quality video stream of those clients connected to the multicast engine;

and wherein the first processor is configured to transcode the conference video stream to an encoding format required by a respective connected client before transmitting the conference video stream to the respective connected clients connected to the multicast engine.

16. The apparatus of claim 13, further comprising:

the participant including a third memory and a third processor configured to execute instructions stored in the third memory to;

form a mixed video stream using the conference video stream received from the multicast engine.

17. The apparatus of claim 13, further comprising:

the server station and the second processor configured to;

perform a mixing algorithm that determines which video streams of the plurality of participants to include in the conference video stream for a plurality of mix cycles; and

transmit a signal to the multicast engine that the participant is to be included in the conference video stream in a new cycle based on the mixing algorithm when the participant was not mixed to form the conference video stream in a previous cycle.

18. The apparatus of claim 17 wherein the signal is a NACK signal.

19. The apparatus of claim 18 wherein the second processor is configured to transmit, to the multicast engine, identifiers of the video streams of those of the plurality of participants to be included in the conference video stream in a cycle after the new cycle based on the mixing algorithm;

and wherein the first processor is configured to end transmission of each video stream received from a connected participant that is not included in the identifiers.

20. The apparatus of claim 19 wherein the identifiers belong to a CSRC list;

and wherein the participant is in the CSRC list when a SSRC of the participant is included in the CSRC.

21. The apparatus of claim 13 wherein the first processor is configured to estimate an input into a mixing algorithm that determines which video streams of those participants connected to the multicast engine are candidates for the conference video stream, the estimated input associated with at least one participant other than the participant.