Real-time transport protocol (RTP) media conference server routing engine

• US 10,523,730 B2
• Filed: 03/12/2015
• Issued: 12/31/2019
• Est. Priority Date: 03/12/2014
• Status: Active Grant

• Current Assignee: Infinesse Corporation
• Original Assignee: Infinesse Corporation
• Inventors: Olson, Joseph Augustine, Kim, Michael Ern, Young, Christopher, Hew, Peter Raymond
• Primary Examiner(s): Nano, Sargon N
• Application Number:
  US14/656,202
• Publication Number:
  US 20150264103A1
• Time in Patent Office: 1,755 Days
• CPC Class Codes: H04L 65/1093 by adding participants; by removing participants
• CPC Class Codes: H04L 65/403 Arrangements for multi-party communication, e.g. for conferences data switching systems for conference H04L12/18; arrangements for connecting several subscribers to a common circuit, i.e. affording conference facilities H04M3/56; television conferencing systems H04N7/15
• CPC Class Codes: H04L 65/65 Network streaming protocols, e.g. real-time transport protocol [RTP] or real-time control protocol [RTCP]

Abstract

The RTP Media Conference Server Routing Engine (“MCSRE”) integrates into a standards based RTP Media Server to improve server data throughput of RTP conference routing by factors of tens to hundreds while simultaneously decreasing real-time media delivery delays and significantly decreasing server resource requirements. The RTP MCSRE maintains a conference routing database used to manage a large number of conferences with a list of associated RTP sessions and conference participants. The routing engine also includes a Conference Session Routing Filter (“CSRF”) and a Routing Logic Processor (“RLP”) that selectively route received media streams to each participant in a given RTP conference. The behavior of both the CSRF and the RLP can be modified by executable scripts. The RTP MCSRE imposes floor control rules and packet filtering with regard to both network bandwidth and hardware resources specific to conference participant endpoint devices.

Claims

1. A method for routing RTP (Real-time Transport Protocol) media streams in a standards based Routed RTP Media Conferencing System, the method comprising:

managing a list of conferences using an RTP Media Conference Routing Engine wherein each conference contains a Conference Profile, a list of participant RTP endpoints with associated participant profiles, and a list of RTP media sessions; and

managing routing of RTP media streams amongst the list of participant RTP endpoints within each conference RTP session according to routing logic algorithms based on data provided by the RTP packet header, the list of RTP session participant RTP endpoints, and a Conference Database within the Routed RTP Media Conferencing System,

wherein the RTP media streams can be multiple streams from the same media generator source where at least two streams of a particular media type during a single conference RTP session are encoded with a different format according to the media attributes with the associated conference RTP media session list element and such streams can be properly routed to participant RTP endpoints according to the routing logic and data,

wherein the data provided by the RTP packet header to the routing logic algorithms includes the SSRC (Synchronization Source) Identifier, the X (Extension) flag, and the Extension header; and

wherein the RTP media stream includes data in the RTP Extension header that signals the routing logic that the media stream contains composite streams from a participant RTP endpoint performing the services of a media mixing MCU and that the composite streams can be routed to participant devices that are only able to process single media streams.

2. The method of claim 1, wherein the routing of the RTP media streams is performed based on the data in the RTP packet header.

3. The method of claim 1, wherein Conference Profile data is provided by a Conference Database within the Routed RTP Media Conferencing System.

4. The method of claim 1, wherein participant profile data are provided by a Conference Database within the Routed RTP Media Conferencing System as well as the associated participant RTP endpoint.

5. The method of claim 1, wherein the data associated with each element in the RTP media session list is obtained from the Conference Database, the participant RTP endpoints that are members of the RTP media session, and the RTP Media Server.

6. The method of claim 1, wherein the RTP media streams can be multiple streams from the same media generator source where each stream can be encoded with a different network bit rate within the associated media attributes with the associated conference RTP media session list element and such streams can be properly routed to participant RTP endpoints according to the routing logic and data.

7. The method of claim 1, wherein the RTP media streams can be multiple streams of encoded layered media from a codec with SVC (Scalable Video Coding) according to the media attributes with the associated conference RTP media session list element and such streams can be properly routed to participant RTP endpoints according to the routing logic and data.

8. The method of claim 1, wherein the RTP media stream can include data in the RTP Extension header that can signal receiving participant RTP endpoints the availability of network accessible media files generated from the media stream, such as image files on an FTP server.

9. The method of claim 1, wherein the RTP media stream can include data in the RTP Extension header that can provide future signaling methods as needed to either the routing logic or receiving participant RTP endpoints.

10. The method of claim 1, wherein the routing logic behavior can be altered by both executable scripts loaded from the Conference Profile and the RTP Extension Header.

11. The method of claim 1, wherein the participant RTP endpoints within a given conference can be heterogeneous devices in terms of network connectivity, hardware characteristics, and system software;

such as a conference with a variety of smart phone, tablet, notebook, laptop, and desktop devices all with differing operating systems and browsers.

12. A method for managing a series of real time conferences, each compliant with the Real-time Transport Protocol (RTP), the method comprising:

maintaining a list of conferences, wherein each conference within the list contains a conference profile including a list of participant RTP endpoints including associated participant profiles, and associated RTP media sessions;

routing RTP media streams amongst the list of participant RTP endpoints within each conference based on data provided by the RTP packet header, the RTP Packet header including a synchronization source (SSRC) identifier, an extension (X) flag, and an extension header, the data further including the associated RTP media sessions for the list of participant RTP endpoints;

wherein the RTP media streams can be multiple streams from the same media generator source where a least two of the RTP media streams of a particular media type during a single conference RTP session are encoded using different encoding formats dependent upon attributes of a media type being transmitted in the RTP media streams and the participant profiles, the RTP media streams properly routed to appropriate participant RTP endpoints; and

wherein the RTP media streams include data in the RTP Extension header that signals the routing logic that the media stream contains composite streams from a participant RTP endpoint performing the services of a media mixing MCU and that the composite streams can be routed to participant devices that are only able to process single media streams.