Minimizing fast video update requests in a video conferencing system

• US 8,208,003 B2
• Filed: 03/23/2007
• Issued: 06/26/2012
• Est. Priority Date: 03/23/2007
• Status: Active Grant

• Current Assignee: Cisco Technology, Inc. (Cisco Systems, Inc.)
• Original Assignee: Cisco Technology, Inc. (Cisco Systems, Inc.)
• Inventors: Baird, Randall B., Knotts, Ryan, Bangalore, Manjunath S., Sarkar, Shantanu, Ramalingam, Thiyagesan
• Primary Examiner(s): WOO, STELLA L
• Application Number:
  US11/728,130
• Publication Number:
  US 20080231687A1
• Time in Patent Office: 1,922 Days
• Field of Search: 348/14.09, 348/14.08, 348/14.01, 370/260
• US Class Current: 348/14.09
• CPC Class Codes: H04N 7/15 Conference systems

Abstract

In one embodiment, a method includes dropping an initial series of video frames received by a video conferencing system from a first endpoint that has entered a video conference session as a first participant. One or more fast video update (FVU) messages received by the video conferencing system from the first endpoint during an enabling time period are then discarded. A single FVU message is then to the first endpoint after the video conferencing system has become enabled with respect to the first endpoint. An I-frame received from the first endpoint in response to the single FVU message is then sent back to the first endpoint. It is emphasized that this abstract is provided to comply with the rules requiring an abstract that will allow a searcher or other reader to quickly ascertain the subject matter of the technical disclosure.

Claims

1. A method comprising:

dropping an initial series of video frames received by a video conferencing system from a first endpoint that has entered a video conference session as a first participant;

discarding one or more fast video update (FVU) messages received by the video conferencing system from the first endpoint during an enabling time period;

sending a single FVU message to the first endpoint after the video conferencing system has enabled to send and receive a video stream in the video conference session;

receiving an I-frame from the first endpoint in response to the single FVU message; and

sending, by the video conferencing system, the I-frame back to the first endpoint.

2. The method of claim 1 wherein the initial series of video frames contains at least a portion of a video image of a user captured by the first endpoint.

3. The method of claim 1 wherein the sending of the single FVU occurs after a video switch of the video conferencing system enables the first endpoint to send and receive a video stream in the conference.

4. A method comprising:

synchronizing a first endpoint to a video switch of a video conferencing system, the first endpoint having entered a video conference session hosted by the video conferencing system as a first participant;

receiving one or more fast video update (FVU) messages from a second endpoint that has entered the video conference session as a second participant;

suppressing all fast video update (FVU) messages received from the first and second endpoints during an enabling time period;

receiving, responsive to a single FVU message sent to the first and second endpoints, a first I-frame from the first endpoint and a second I-frame from the second endpoint; and

sending, by the video conferencing system, the first I-frame to the second endpoint and the second I-frame to the first endpoint.

5. The method of claim 4 wherein the first I-frame contains at least a portion of a video image of the first participant, and second I-frame contains at least a portion of a video image of the second participant.

6. The method of claim 4 further comprising waiting to send the single FVU message until after the video conferencing system has enabled the first and second endpoints to send and receive a video stream in the video conference session.

7. The method of claim 4 further comprising:

detecting that a new endpoint has entered the video conference session; and

suppressing the one or more fast video update FVU messages received from the new endpoint during an additional enabling time period.

8. The method of claim 7 further comprising:

detecting speech from a third endpoint such that the third endpoint becomes a current active speaker, the third endpoint being included among a plurality of endpoints previously entered in the video conference session, the plurality of endpoints including the first and second endpoints;

sending out a single FVU to the third endpoint;

receiving an I-frame from the third endpoint; and

sending the I-frame to the new endpoint.

9. The method of claim 8 wherein the new endpoint is associated with an additional participant to the video conference session.

10. The method of claim 8 wherein the I-frame sent to the new endpoint comprises an image of a user of the third endpoint.

11. A method comprising:

sending, in a video conference session among a plurality of endpoints which includes a first endpoint as a current active speaker and a second endpoint as a previous active speaker, a first video image received from the second endpoint to the first endpoint, while simultaneously sending a second video image received from the first endpoint to the second endpoint and also to a remaining set of the endpoints;

detecting speech from a third endpoint such that the third endpoint becomes the current active speaker;

determining whether an expected arrival time of an I-frame from the third endpoint is less than a first predetermined time interval;

if so, then

waiting to receive a next I-frame from the third endpoint without sending a fast video update (FVU) message;

otherwise

sending the FVU message to the third endpoint.

12. The method of claim 11 further comprising:

receiving, in response to sending the FVU message to the third endpoint, an I-frame from the third endpoint;

sending the I-frame to the second endpoint and to every one of the set of remaining endpoints, excluding the third endpoint.

13. A method comprising:

sending, in a video conference session among a plurality of endpoints which includes a first endpoint as a current active speaker and a second endpoint as a previous active speaker, a first video image received from the second endpoint to the first endpoint, while simultaneously sending a second video image received from the first endpoint to the second endpoint;

detecting speech from a third endpoint such that the third endpoint becomes the current active speaker;

setting a switch pending flag;

determining whether an expected arrival time of an I-frame from the third endpoint is less than a first predetermined time interval;

if so, then

waiting to receive a next I-frame from the third endpoint without sending a fast video update (FVU) message;

otherwise

sending the FVU message to the first endpoint;

determining whether the I-frame has yet to be received from the third endpoint for a time period greater than either the first predetermined time interval or a second predetermined time interval longer than the first predetermined time interval;

if so, then

sending the FVU message to the first endpoint; and

determining whether the I-frame has yet to be received from the third endpoint for a time period greater than a third predetermined time interval, the third predetermined time interval being longer than the first and second predetermined time intervals;

if so, then

sending a preconfigured I-frame indicative of an error condition to the first, second, and third endpoints; and

clearing the switch pending flag.

14. The method of claim 13 wherein the preconfigured I-frame comprises a blank image.

15. The method of claim 13 wherein the preconfigured I-frame comprises a single visual image.

16. The method of claim 13 wherein in the event that the I-frame is received from the third endpoint in a time period less than either the first, second, or third predetermined time intervals, and the switch pending flag is set, then further comprising:

clearing the switch pending flag; and

sending a third video image received from the third endpoint to the first and second endpoints, while simultaneously sending the second video image received from the first endpoint to the third endpoint.

17. A method comprising:

starting a timer responsive to a fast video update FVU message being sent to a source endpoint during a session hosted by a video conferencing system;

suppressing forwarding to the source endpoint FVU messages received by the video conferencing system during a predetermined time interval commencing with the starting of the timer; and

forwarding to the source endpoint FVU messages received by the video conferencing system after the predetermined time interval has elapsed.

18. The method of claim 17 further comprising sending an FVU in response to the dropping of a video packet on a destination stream.

19. Logic encoded in one or more non-transitory, computer-readable media for execution and when executed is operable to:

send, in a video conference session among a plurality of endpoints which includes a first endpoint as a current active speaker and a second endpoint as a previous active speaker, a first video image received from the second endpoint to the first endpoint, and also send a second video image received from the first endpoint to the second endpoint and also to a remaining set of the endpoints;

detect speech from a third endpoint such that the third endpoint becomes the current active speaker;

set a switch pending flag;

determine whether an expected arrival time of an I-frame from the third endpoint is less than a first predetermined time interval;

if so, then

wait to receive a next I-frame from the third endpoint without sending a fast video update (FVU) message;

otherwise

send the FVU message to the first endpoint;

determine whether the I-frame has yet to be received from the third endpoint for a time period greater than either the first predetermined time interval or a second predetermined time interval longer than the first predetermined time interval;

if so, then

send the FVU message to the first endpoint; and

determine whether the I-frame has yet to be received from the third endpoint for a time period greater than a third predetermined time interval, the third predetermined time interval being longer than the first and second predetermined time intervals;

if so, then

send a preconfigured I-frame indicative of an error condition to the first, second, and third endpoints; and

clear the switch pending flag.

20. The logic of claim 19 wherein the preconfigured I-frame comprises a blank image.

21. The logic of claim 19 wherein the preconfigured I-frame comprises a single visual image.

22. Logic encoded in one or more non-transitory, computer-readable media for execution and when executed is operable to:

synchronize a first endpoint to a video switch of a video conferencing system;

receive one or more fast video update (FVU) messages from a second endpoint that has entered the video conference session;

suppress all fast video update (FVU) messages received from the first and second endpoints during an enabling time period;

send FVU messages to the first and second endpoints;

receive, responsive to the FVU messages sent to the first and second endpoints, a first I-frame from the first endpoint and a second I-frame from the second endpoint; and

send the first I-frame to the second endpoint and the second I-frame to the first endpoint.

23. The logic of claim 22 wherein, when executed, is further operable to:

receive one or more fast video update FVU messages indicating a new endpoint has entered the video conference session; and

suppress the one or more fast video update FVU messages received from the new endpoint during an additional enabling time period.

24. The logic of claim 22 wherein, when executed, is further operable to:

detect speech from a third endpoint such that the third endpoint becomes a current active speaker, the third endpoint being included among a plurality of endpoints previously entered in the video conference session, the plurality of endpoints including the first and second endpoints;

send out a single FVU to the third endpoint;

receive an I-frame from the third endpoint; and

send the I-frame to the new endpoint.

25. Logic encoded in one or more non-transitory, computer-readable media for execution and when executed is operable to:

drop an initial series of video frames received from a first endpoint that has entered a video conference session as a first participant;

discard one or more fast video update (FVU) messages received from the first endpoint during an enabling time period;

send a single FVU message to the first endpoint following the enabling time period;

receive an I-frame from the first endpoint in response to the single FVU message; and

send the I-frame back to the first endpoint.

26. Logic encoded in one or more non-transitory, computer-readable media for execution and when executed is operable to:

start a timer responsive to a fast video update FVU message being sent to a source endpoint during a session hosted by a video conferencing system;

suppress forwarding to the source endpoint FVU messages received by the video conferencing system during a predetermined time interval commencing with the starting of the timer; and

forward to the source endpoint FVU messages received by the video conferencing system after the predetermined time interval has elapsed.