Efficient error response in a video conferencing system

• US 7,729,299 B2
• Filed: 04/20/2007
• Issued: 06/01/2010
• Est. Priority Date: 04/20/2007
• Status: Active Grant

• Current Assignee: Cisco Technology, Inc. (Cisco Systems, Inc.)
• Original Assignee: Cisco Technology, Inc. (Cisco Systems, Inc.)
• Inventors: Mackie, David J., Eisenberg, Blane A.
• Primary Examiner(s): Ryman; Daniel J
• Assistant Examiner(s): PHAM, TITO Q
• Application Number:
  US11/738,218
• Publication Number:
  US 20080259823A1
• Time in Patent Office: 1,138 Days
• Field of Search: None
• US Class Current: 370/260
• CPC Class Codes: H04Q 11/04 for time-division multiplexing H04Q11/0001 takes precedence
• CPC Class Codes: H04Q 2213/13162 Fault indication and localisation
• CPC Class Codes: H04Q 2213/13166 Fault prevention
• CPC Class Codes: H04Q 2213/1324 Conference call
• CPC Class Codes: H04Q 2213/13337 Picturephone, videotelephony

Abstract

Elements in a video conferencing system may respond to error message(s) by aggregating any related error messages and responding based on a severity of the error indicated by the related error messages. A multipoint control unit (MCU) may identify an active stream from a first endpoint and forward the active stream to a second endpoint. The active stream may include a plurality of packets and transmit a video image by sending a frame followed by sub-frame modifications. The MCU may receive an error message from the second endpoint and determine the error'"'"'s severity, which is related to an impact on an displayed image. Based on the severity, the MCU may identify and send a set of correction packets to the second endpoint. Also, a third endpoint may receive the active stream and respond to one or more error messages received from the second endpoint.

Claims

1. A method for responding to error messages received during a video conference comprising:

establishing a video conference between a plurality of endpoints;

identifying an active stream comprising a plurality of packets received from a first one of the endpoints, the active stream transmitting a video image by sending a frame followed by sub-frame modifications;

forwarding the active stream to a second one of the endpoints;

buffering the packets received from the first endpoint in a packet buffer;

receiving an error message from the second endpoint indicating that the second endpoint did not receive a set of lost packets out of the plurality of packets;

determining a severity of an error indicated by the error message, wherein the severity is related to an impact on an image displayed at the second endpoint and the severity is classified as minor, moderate, or severe;

based on the severity, identifying a set of correction packets to send to the second endpoint, wherein identifying the set of correction packets to send to the second endpoint comprises;

if the severity is minor, locating the set of lost packets in the packet buffer;

if the severity is moderate, determining whether a sub-frame is locally available and, if the sub-frame is not locally available, sending a query to the first endpoint requesting the sub-frame; and

if the severity is severe, determining whether a frame is locally available and, if the frame is not locally available, sending a query to the first endpoint requesting the frame; and

sending the set of correction packets to the second endpoint.

2. The method of claim 1, wherein the error message is a first error message, the method further comprising:

forwarding the active stream to a third one of the endpoints;

receiving a second error message from the third endpoint, the second error message related to the first error message;

aggregating the first error message and the second error message, wherein determining the severity includes determining the severity for the error indicated by the aggregated error messages; and

sending the set of correction packets to the third endpoint.

3. The method of claim 2, wherein the second error message indicates that the third endpoint did not receive the set of lost packets.

4. The method of claim 1, wherein:

a destination address of the error message indicates the first endpoint; and

receiving the error message comprises intercepting the error message before it reaches the destination address.

5. A method for responding to error messages received during a video conference comprising:

participating in a video conference between a plurality of endpoints;

receiving an active stream comprising a plurality of packets from a first one of the endpoints, the active stream transmitting a video image by sending a frame followed by sub-frame modifications;

receiving an error message from a second one of the endpoints indicating that the second endpoint did not receive a set of lost packets out of the plurality of packets;

determining a severity of an error indicated by the error message, wherein the severity is related to an impact on an image displayed at the second endpoint;

if the severity is less than a threshold;

based on the severity, identifying a set of correction packets to send to the second endpoint; and

sending the set of correction packets to the second endpoint; and

if the severity is not less than the threshold;

sending an error notification to the first endpoint, the error notification specifying the second endpoint and the set of lost packets.

6. The method of claim 5, wherein the error message is a first error message, further comprising:

receiving a second error message from a third endpoint, the second error message related to the first error message;

aggregating the first error message and the second error message, wherein determining the severity includes determining the severity for the error indicated by the aggregated error messages; and

if the severity is less than the threshold, sending the set of correction packets to the third endpoint;

wherein the error notification further specifies the third endpoint.

7. The method of claim 6, further comprising:

buffering the packets received from the first endpoint in a packet buffer;

wherein identifying the set of correction packets comprises locating the set of lost packets in the packet buffer.

8. A device for responding to error messages received during a video conference comprising:

a controller operable to establish a video conference between a plurality of endpoints;

a crosspoint switch operable to identify an active stream comprising a plurality of packets received from a first one of the endpoints and to forward the active stream to a second one of the endpoints, the active stream transmitting a video image by sending a frame followed by sub-frame modifications;

a packet buffer buffering the packets received from the first endpoint;

an error response module operable;

to receive an error message from the second endpoint indicating that the second endpoint did not receive a set of lost packets out of the plurality of packets;

to determine a severity of an error indicated by the error message, wherein the severity is related to an impact on an image displayed at the second endpoint and the severity is classified as minor, moderate, or severe;

based on the severity, to identify a set of correction packets to send to the second endpoint, wherein identifying the set of correction packets to send to the second endpoint comprises;

if the severity is minor, locating the set of lost packets in the packet buffer;

if the severity is moderate, determining whether a sub-frame is locally available and, if the sub-frame is not locally available, sending a query to the first endpoint requesting the sub-frame; and

if the severity is severe, determining whether a frame is locally available and, if the frame is not locally available, sending a query to the first endpoint requesting the frame; and

to send the set of correction packets to the second endpoint.

9. The device of claim 8, wherein:

the error message is a first error message;

the crosspoint switch is further operable to forward the active stream to a third one of the endpoints; and

the error response module is further operable to receive a second error message from the third endpoint, the second error message related to the first error message, to aggregate the first error message and the second error message, and to send the set of correction packets to the third endpoint, wherein determining the severity includes determining the severity for the error indicated by the aggregated error messages.

10. The device of claim 9, wherein the second error message indicates that the third endpoint did not receive the set of lost packets.

11. The device of claim 8, wherein:

a destination address of the error message indicates the first endpoint; and

receiving the error message comprises intercepting the error message before it reaches the destination address.

12. Logic for responding to error messages received during a video conference, the logic encoded in tangible computer readable media and operable when executed to:

establish a video conference between a plurality of endpoints;

identify an active stream comprising a plurality of packets received from a first one of the endpoints, the active stream transmitting a video image by sending a frame followed by sub-frame modifications;

forward the active stream to a second one of the endpoints;

buffer the packets received from the first endpoint in a packet buffer

receive an error message from the second endpoint indicating that the second endpoint did not receive a set of lost packets out of the plurality of packets;

determine a severity of an error indicated by the error message, wherein the severity is related to an impact on an image displayed at the second endpoint and the severity is classified as minor, moderate, or severe;

based on the severity, identify a set of correction packets to send to the second endpoint, wherein identifying the set of correction packets to send to the second endpoint comprises;

if the severity is minor, locating the set of lost packets in the packet buffer;

if the severity is moderate, determining whether a sub-frame is locally available and, if the sub-frame is not locally available, sending a query to the first endpoint requesting the sub-frame; and

if the severity is severe, determining whether a frame is locally available and, if the frame is not locally available, sending a query to the first endpoint requesting the frame; and

send the set of correction packets to the second endpoint.

13. The logic of claim 12, wherein the error message is a first error message, the logic further operable to:

forward the active stream to a third one of the endpoints;

receive a second error message from the third endpoint, the second error message related to the first error message;

aggregate the first error message and the second error message, wherein determining the severity includes determining the severity for the error indicated by the aggregated error messages; and

send the set of correction packets to the third endpoint.

14. The logic of claim 13, wherein the second error message indicates that the third endpoint did not receive the set of lost packets.

15. The logic of claim 12, wherein:

a destination address of the error message indicates the first endpoint; and

receiving the error message comprises intercepting the error message before it reaches the destination address.

16. A system for responding to error messages received during a video conference comprising:

means for establishing a video conference between a plurality of endpoints;

means for identifying an active stream comprising a plurality of packets received from a first one of the endpoints, the active stream transmitting a video image by sending a frame followed by sub-frame modifications;

means for forwarding the active stream to a second one of the endpoints;

means for buffering the packets received from the first endpoint in a packet buffer;

means for receiving an error message from the second endpoint indicating that the second endpoint did not receive a set of lost packets out of the plurality of packets;

means for determining a severity of an error indicated by the error message, wherein the severity is related to an impact on an image displayed at the second endpoint and the severity is classified as minor, moderate, or severe;

means for, based on the severity, identifying a set of correction packets to send to the second endpoint, wherein identifying the set of correction packets to send to the second endpoint comprises;

if the severity is minor, locating the set of lost packets in the packet buffer;

if the severity is moderate, determining whether a sub-frame is locally available and, if the sub-frame is not locally available, sending a query to the first endpoint requesting the sub-frame; and

if the severity is severe, determining whether a frame is locally available and, if the frame is not locally available, sending a query to the first endpoint requesting the frame; and

means for sending the set of correction packets to the second endpoint.