Method and System for Switching Between Video Streams in a Continuous Presence Conference

• US 20140333715A1
• Filed: 05/13/2014
• Published: 11/13/2014
• Est. Priority Date: 01/30/2009
• Status: Active Grant

• Current Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Original Assignee: Polycom Incorporated (Plantronics, Inc.)
• Inventors: Halavy, Avishay, Be'ery, Efrat, Harel, Erez
• Granted Patent: US 9,215,416 B2
• Time in Patent Office: Days
• US Class Current: 348/14.09
• CPC Class Codes: H04N 7/152 Multipoint control units therefor

Abstract

A media relay conferencing system includes a media relay multipoint control unit and a media relay endpoint that handle needs for Intra frames in an efficient way, improves the conferees experience, and reduces the load on the resources associated with that media relay videoconference by reducing the number of Intra frames and lowering the impact of Intra frames when they are needed. In some embodiments, when a requiring media relay endpoint requests an Intra frame for a video stream received from a presenting media relay endpoint, a media relay multipoint control unit may respond by requesting the presenting media relay endpoint to synchronize a reference frame in an encoder of the presenting media relay endpoint, which encodes the relevant relay compressed video stream, with a reference frame in a decoder of the requiring media relay endpoint.

Claims

1. A method comprising:

selecting a video stream obtained from a first media relay endpoint of a plurality of media relay endpoints; and

responding to a need for an Intra frame to be sent to a second media relay endpoint of the plurality of media relay endpoints, wherein the Intra frame belongs to the selected video stream, comprising;

synchronizing a reference frame in an encoder of the first media relay endpoint that encodes the selected video stream with a reference frame in a decoder of the second media relay endpoint;

obtaining from the selected video stream an Inter frame that is compressed based on the synchronized reference frame;

converting the selected video stream carrying the Inter frame and further received frames into a relayed video stream; and

relaying the relayed video stream toward the second media relay endpoint.

2. The method of claim 1, wherein the first media relay endpoint sends a plurality of video streams, each having a different resolution.

3. The method of claim 1, further comprising:

obtaining a video stream from each of the plurality of media relay endpoints, each video stream having a different resolution.

4. The method of claim 1, wherein the selected video stream is compressed according to a compression standard that complies with H.264/AVC.

5. The method of claim 1, wherein synchronizing a reference frame in the encoder of the first media relay endpoint with a reference frame in the decoder of the second media relay endpoint comprises:

identifying a previous used reference frame that exists in the encoder of the first media relay endpoint and in the decoder of the second media relay endpoint and instructing the encoder of the first media relay endpoint to compress the next frame as the Inter frame based on the identified previous reference frame.

6. The method of claim 5, further comprising releasing all other previous used reference frames in the encoder of the first media relay endpoint.

7. The method of claim 1, wherein synchronizing a reference frame in the encoder of the first media relay endpoint with a reference frame in the decoder of the second media relay endpoint further comprising:

initiating a temporary video stream from the first media relay endpoint toward the second media relay endpoint, the temporary video stream having the same resolution as the selected video stream and comprising an Intra frame, followed by one or more Inter frames and terminates with a unique frame; and

creating a reference frame in the temporary video stream that is based on the unique frame and has the same values as a reference frame created at the encoder of the selected video stream after compressing a corresponding frame of the selected video stream.

8. The method of claim 7, wherein the unique frame is a secondary switching P frame.

9. The method of claim 8, wherein the corresponding frame is a switching P frame.

10. The method of claim 7, wherein the unique frame is a lossless compression of the differences between a reference frame that was created from a frame before the unique frame of the temporary video stream and a reference frame created at the encoder of the selected video stream after compressing the corresponding frame.

11. A media relay multipoint control unit communicatively connected to a plurality of endpoints through a network, the media relay multipoint control unit comprising:

a network interface;

a signaling and control module that selects two or more endpoints of the plurality of endpoints; and

a video processor, coupled to the signaling and control module and the network interface, configured to;

receive instructions from the signaling and control module that a presented endpoint of the selected two or more endpoints is sending a temporary stream of video data chunks toward a requiring endpoint of the selected two or more endpoints in parallel to a first stream of video data chunks;

parse the video data chunks of the temporary stream, responsive to the instructions;

organize the parsed video data chunks into a stream of relayed video data chunks; and

transfer the stream of relayed video data chunks toward the requiring endpoint via the network interface.

12. The media relay multipoint control unit of claim 11, wherein the video processor is further configured to:

respond to instructions received from the signaling and control module that the temporary stream has been terminated by relaying corresponding video data chunks of the first stream toward the requiring endpoint.

13. The media relay multipoint control unit of claim 11, wherein the video processor is further configured to:

parse video data chunks received via the network interface from the plurality of endpoints;

organize the parsed video data chunks into a group of two or more streams of video data chunks; and

transfer the group toward a first endpoint via the network interface.

14. A media relay endpoint, comprising:

a video processor configured to;

receive a group of streams of video data chunks, wherein each stream originates from a different transmitting-media-relay endpoint;

organize the received video data chunks into a plurality of groups, each group corresponding to a transmitting-media-relay endpoint;

decode each group of organized video data chunks into decoded video data;

assemble a continuous presence layout from the decoded video data; and

synchronize a reference frame in a decoder allocated to decode a first video stream of the received group of streams of video data chunks received from a first media relay endpoint with a reference frame in an encoder that is used to compress the first stream responsive to a request for an Intra frame for the first video stream.

15. The media relay endpoint of claim 14, wherein the video processor is configured to synchronize the reference frame by obtaining a temporary video stream originated by the first media relay endpoint, the temporary video stream having the same resolution as the first video stream and comprising an Intra frame, followed by one or more Inter frames, and terminated with a unique frame.

16. The media relay endpoint of claim 15, wherein the unique frame is a secondary switching P frame.

17. The media relay endpoint of claim 15, wherein the reference frame in the temporary stream has the same values as a reference frame in the decoder.

18. The media relay endpoint of claim 15, wherein the reference frame in the decoder corresponds to a switching P frame.

19. The media relay endpoint of claim 14, wherein the video processor is configured to synchronize the reference frame by identifying a previously used reference frame that exists in the decoder that was allocated to decode the first video stream and requesting the first media relay endpoint to encode the next frame as an Inter frame based on the identified previously used reference frame.