Reliable network streaming of a single data stream over multiple physical interfaces

• US 8,325,601 B2
• Filed: 05/08/2009
• Issued: 12/04/2012
• Est. Priority Date: 05/08/2009
• Status: Active Grant

• Current Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Original Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Inventors: Martinez, Martin, Riggert, Eric
• Primary Examiner(s): RIYAMI, ABDULLAH A
• Application Number:
  US12/463,372
• Publication Number:
  US 20100284275A1
• Time in Patent Office: 1,306 Days
• Field of Search: 370/252, 370/229, 370/230, 370/230.1, 370/232, 370/233, 370/234, 370/235, 370/236, 370/237, 370/254, 370/351, 370/392, 370/394, 370/428, 370/429, 370/468, 370/476, 370/477, 370/231, 709/231, 709/224, 709/227, 709/245, 455/67.11, 725/109
• US Class Current: 370/230
• CPC Class Codes: H04L 65/65 Network streaming protocols, e.g. real-time transport protocol [RTP] or real-time control protocol [RTCP]
• CPC Class Codes: H04L 65/762 at the source reformatting of additional data in video distribution servers H04N21/2355
• CPC Class Codes: H04L 65/764 at the destination reformatting of additional data in video clients H04N21/4355
• CPC Class Codes: H04L 65/80 Responding to QoS
• CPC Class Codes: H04L 67/303 Terminal profiles
• CPC Class Codes: H04L 69/14 Multichannel or multilink protocols
• CPC Class Codes: H04L 69/22 Parsing or analysis of headers

Abstract

Sending a single data stream from a sending endpoint to a receiving endpoint, wherein both of the sending endpoint and the receiving endpoint each have multiple physical interfaces connecting the sending and receiving endpoint to multiple networks, respectively, is provided. The single data stream is partitioned into multiple data packets. A physical interface is designated on the sending side and the receiving side in accordance with a data capacity throughput of each of the multiple physical interfaces. Different portions of the partitioned data packets are then sent over different ones of the multiple physical interfaces in accordance with the designation. The single data stream is then reconstructed by combining received partitioned data packets into the single data stream in accordance with header information. An acknowledgment is sent to the sending endpoint indicating an amount of data received on each multiple physical interface, including any changes in the data capacity throughput.

Claims

1. A method for sending a single data stream from a sending endpoint to a receiving endpoint, wherein both of the sending endpoint and the receiving endpoint each have multiple physical interfaces connecting the sending endpoint and the receiving endpoint to multiple networks, respectively, the method comprising:

determining a data capacity throughput for each of the multiple physical interfaces, wherein the data capacity throughput is an amount of data throughput which is currently possible of being sent over a respective physical interface;

partitioning the single data stream into multiple data packets, wherein each of the multiple data packets has header information which identifies a sequence identifier indicating an in-sequence position of the data packet in the single data stream;

designating on a sending side of the sending endpoint, for each said data packet, a send-side physical interface and a receive-side physical interface, wherein the designation depends at least partly on the data capacity throughput;

sending different portions of the partitioned data packets over different ones of the multiple physical interfaces in accordance with the designation;

receiving the different portions of the partitioned data packets at the receiving endpoint;

determining by the receiving endpoint an amount of data received on each of the multiple physical interfaces, and any changes in the data capacity throughput for each of the multiple physical interfaces on a recipient side of the receiving endpoint;

reconstructing the single data stream at the receiving endpoint by combining the received partitioned data packets into the single data stream in accordance with the header information of the multiple data packets; and

sending an acknowledgment over each of the multiple physical interfaces from the receiving endpoint to the sending endpoint indicating the determined amount of data received on each of the different ones of the multiple physical interfaces, wherein the acknowledgment includes an indication of the determined changes in the data capacity throughput for each of the multiple physical interfaces on the recipient side,

wherein, when the acknowledgment indicates that an amount of a portion of data packets was not received over one of the multiple physical interfaces, then, depending on the data capacity throughput of the multiple physical interfaces, the sending endpoint repartitions the portion of the data stream corresponding to the not received data packets, and sends the repartitioned data packets over one or more of available ones of the multiple physical interfaces, and

wherein at least some of the repartitioned data packets are sent over physical interfaces which are different than the physical interfaces on which the data packets of the data stream, corresponding to the repartitioned data packets, were originally sent.

2. The method according to claim 1, wherein in the step of determining the data capacity throughput for each of the multiple physical interfaces, the indication of the determined changes in the data capacity throughput for each of the multiple physical interfaces on the recipient side, included in the sent acknowledgment, is used in making the determination.

3. The method according to claim 1, wherein the receiving endpoint sends another acknowledgment over each of the multiple physical interfaces to the sending endpoint indicating an amount of data received on each of the different ones of the multiple physical interfaces, and wherein, when the other acknowledgment indicates that a portion of the re-sent data packets was not received, the sending endpoint continues to resend any portion of the not received data packets, and the receiving endpoint continues to send acknowledgments indicating an amount of data received, until the portion of partitioned data packets is entirely received by the receiving endpoint.

4. The method according to claim 3, wherein when the other acknowledgment indicates that the portion of the re-sent data packets was not received, then the re-sent portion of data packets not received is repartitioned and sent over one or more available ones of the multiple physical interfaces.

5. The method according to claim 1, wherein the sending endpoint and the receiving endpoint each have a single physical interface connected to each of the multiple networks, and wherein, for each said data packet, the designated receive-side physical interface is a physical interface connected to a same network as the designated send-side physical interface.

6. The method according to claim 1, wherein the sending endpoint and the receiving endpoint each have the multiple physical interfaces connected to each of the multiple networks, and wherein, for each said data packet, when designating the send-side physical interface, one of the multiple physical interfaces of the sending endpoint connected to one of the multiple networks is designated as the send-side physical interface, and when designating the receive-side physical interface, one of the multiple physical interfaces of the receiving endpoint connected to a same network as the designated send-side physical interface is designated.

7. The method according to claim 5, wherein the designated receive-side physical interface is automatically selected according to the designation of the send-side physical interface.

8. The method according to claim 5, wherein the designated receive-side physical interface is designated based on the data capacity throughputs of the multiple physical interfaces of the receiving endpoint connected to the same network as the designated send-side physical interface, and the data capacity throughput of the designated send-side physical interface.

9. The method according to claim 1, wherein the data capacity throughput of each of the multiple physical interfaces is determined using a TCP/IP window size of each of the multiple physical interfaces.

10. The method according to claim 1, wherein, for ones of the multiple physical interfaces using a UDP connection, TCP/IP is used as a control channel, and the data capacity throughput of the ones of the multiple physical interfaces is determined using a TCP/IP window size provided by the TCP/IP control channel.

11. The method according to claim 1, wherein the amount of data received on each of the multiple physical interfaces is indicated by identifying a byte index that is expected to be received on each of the multiple physical interfaces.

12. The method according to claim 1, wherein, for ones of the multiple physical interfaces using a non-TCP connection, in a case where the acknowledgment is not received by the sending endpoint, or the acknowledgment is a negative acknowledgment, the different portions of the partitioned data packets sent over different ones of the multiple physical interfaces are re-sent in their entirety over different ones of the multiple physical interfaces.

13. A method for sending a single data stream from a sending endpoint to a receiving endpoint, wherein both of the sending endpoint and the receiving endpoint each have multiple physical interfaces connecting the sending endpoint and the receiving endpoint to multiple networks, respectively, and wherein in said method the sending endpoint performs the steps of:

determining a data capacity throughput for each of the multiple physical interfaces, wherein the data capacity throughput is an amount of data throughput which is currently possible of being sent over a respective physical interface;

partitioning the single data stream into multiple data packets, wherein each of the multiple data packets has header information which identifies a sequence identifier indicating an in-sequence position of the data packet in the single data stream;

designating for each said data packet, a send-side physical interface and a receive-side physical interface, wherein the designation depends at least partly on the data capacity throughput;

sending different portions of the partitioned data packets over different ones of the multiple physical interfaces in accordance with the designation; and

receiving an acknowledgment over each of the multiple physical interfaces sent from the receiving endpoint,

wherein the receiving endpoint determines an amount of data received on each of the multiple physical interfaces, and determines any changes in the data capacity throughput for each of the multiple physical interfaces on a recipient side of the receiving endpoint,

wherein the acknowledgment indicates the determined amount of data received by the receiving endpoint on each of the different ones of the multiple physical interfaces, and wherein the acknowledgment includes an indication of the determined changes in the data capacity throughput for each of the multiple physical interfaces on the recipient side,

wherein, when the acknowledgment indicates that an amount of a portion of data packets was not received over one of the multiple physical interfaces, then, depending on the data capacity throughput of the multiple physical interfaces, the sending endpoint repartitions the portion of the data stream corresponding to the not received data packets, and sends the repartitioned data packets over one or more of available ones of the multiple physical interfaces, and

wherein at least some of the repartitioned data packets are sent over physical interfaces which are different than the physical interfaces on which the data packets of the data stream, corresponding to the repartitioned data packets, were originally sent.

14. The method according to claim 13, wherein in the step of determining the data capacity throughput for each of the multiple physical interfaces, the indication of the determined changes in the data capacity throughput for each of the multiple physical interfaces on the recipient side, included in the sent acknowledgment, is used in making the determination.

15. A method for sending a single data stream from a sending endpoint to a receiving endpoint, wherein both of the sending endpoint and the receiving endpoint each have multiple physical interfaces connecting the sending endpoint and the receiving endpoint to multiple networks, respectively, and wherein in said method the receiving endpoint performs the steps of:

receiving different portions of partitioned data packets, wherein the single data stream is partitioned into multiple data packets, and different portions of the partitioned data packets are sent over different ones of the multiple physical interfaces in accordance with a designated send-side physical interface and a designated receive side physical interface, depending at least partly on a data capacity throughput for each of the multiple physical interfaces, wherein the data capacity throughput is an amount of data throughput which is currently possible of being sent over a respective physical interface;

reconstructing the single data stream by combining the received partitioned data packets into the single data stream, wherein each of the multiple data packets has header information which identifies a sequence identifier indicating an in-sequence position of the data packet in the single data stream, and the single data stream is combined in accordance with the header information of the multiple data packets;

determining an amount of data received on each of the multiple physical interfaces, and any changes in the data capacity throughput for each of the multiple physical interfaces on a recipient side of the receiving endpoint; and

sending an acknowledgment over each of the multiple physical interfaces to the sending endpoint indicating the determined amount of data received on each of the different ones of the multiple physical interfaces, wherein the acknowledgment includes an indication of the determined changes in the data capacity throughput for each of the multiple physical interfaces on the recipient side,

wherein, when the acknowledgment indicates that an amount of a portion of data packets was not received over one of the multiple physical interfaces, then, depending on the data capacity throughput of the multiple physical interfaces, the sending endpoint repartitions the portion of the data stream corresponding to the not received data packets, and sends the repartitioned data packets over one or more of available ones of the multiple physical interfaces, and

wherein at least some of the repartitioned data packets are sent over physical interfaces which are different than the physical interfaces on which the data packets of the data stream, corresponding to the repartitioned data packets, were originally sent.

16. A sending endpoint comprising:

a computer-readable memory constructed to store computer-executable process steps; and

a processor constructed to execute the computer-executable process steps stored in the memory;

wherein the process steps stored in the memory cause the processor to send a single data stream from the sending endpoint to a receiving endpoint, wherein both of the sending endpoint and the receiving endpoint each have multiple physical interfaces connecting the sending endpoint and the receiving endpoint to multiple networks, respectively, and wherein the process steps stored in the memory include computer-executable process steps to;

determine a data capacity throughput for each of the multiple physical interfaces, wherein the data capacity throughput is an amount of data throughput which is currently possible of being sent over a respective physical interface;

partition the single data stream into multiple data packets, wherein each of the multiple data packets has header information which identifies a sequence identifier indicating an in-sequence position of the data packet in the single data stream;

designate for each said data packet, a send-side physical interface and a receive-side physical interface, wherein the designation depends at least partly on the data capacity throughput;

send different portions of the partitioned data packets over different ones of the multiple physical interfaces in accordance with the designation; and

receive an acknowledgment over each of the multiple physical interfaces sent from the receiving endpoint,

wherein the receiving endpoint determines an amount of data received on each of the multiple physical interfaces, and determines any changes in the data capacity throughput for each of the multiple physical interfaces on a recipient side of the receiving endpoint,

wherein the acknowledgment indicates the determined amount of data received by the receiving endpoint on each of the different ones of the multiple physical interfaces, and wherein the acknowledgment includes an indication of the determined changes in the data capacity throughput for each of the multiple physical interfaces on the recipient side,

wherein, when the acknowledgment indicates that an amount of a portion of data packets was not received over one of the multiple physical interfaces, then, depending on the data capacity throughput of the multiple physical interfaces, the sending endpoint repartitions the portion of the data stream corresponding to the not received data packets, and sends the repartitioned data packets over one or more of available ones of the multiple physical interfaces, and

wherein at least some of the repartitioned data packets are sent over physical interfaces which are different than the physical interfaces on which the data packets of the data stream, corresponding to the repartitioned data packets, were originally sent.

17. A receiving endpoint comprising:

a computer-readable memory constructed to store computer-executable process steps; and

a processor constructed to execute the computer-executable process steps stored in the memory;

wherein the process steps stored in the memory cause the processor to receive a single data stream sent from a sending endpoint to the receiving endpoint, wherein both of the sending endpoint and the receiving endpoint each have multiple physical interfaces connecting the sending endpoint and the receiving endpoint to multiple networks, respectively, and wherein the process steps store in the memory include computer-executable process steps to;

receive different portions of partitioned data packets, wherein the single data stream is partitioned into multiple data packets, and different portions of the partitioned data packets are received over different ones of the multiple physical interfaces in accordance with a designated send-side physical interface and a designated receive side physical interface, depending at least partly on a data capacity throughput for each of the multiple physical interfaces, wherein the data capacity throughput is an amount of data throughput which is currently possible of being sent over a respective physical interface;

reconstruct the single data stream by combining the received partitioned data packets into the single data stream, wherein each of the multiple data packets has header information which identifies a sequence identifier indicating an in-sequence position of the data packet in the single data stream, and the single data stream is combined in accordance with the header information of the multiple data packets;

determine an amount of data received on each of the multiple physical interfaces, and any changes in the data capacity throughput for each of the multiple physical interfaces on a recipient side of the receiving endpoint; and

send an acknowledgment over each of the multiple physical interfaces to the sending endpoint indicating the determined amount of data received on each of the different ones of the multiple physical interfaces, wherein the acknowledgment includes an indication of the determined changes in the data capacity throughput for each of the multiple physical interfaces on the recipient side,

wherein, when the acknowledgment indicates that an amount of a portion of data packets was not received over one of the multiple physical interfaces, then, depending on the data capacity throughput of the multiple physical interfaces, the sending endpoint repartitions the portion of the data stream corresponding to the not received data packets, and sends the repartitioned data packets over one or more of available ones of the multiple physical interfaces, and

wherein at least some of the repartitioned data packets are sent over physical interfaces which are different than the physical interfaces on which the data packets of the data stream, corresponding to the repartitioned data packets, were originally sent.

18. A non-transitory computer-readable memory medium on which is stored computer-executable process steps for causing a processor to send a single data stream from a sending endpoint to a receiving endpoint, wherein both of the sending endpoint and the receiving endpoint each have multiple physical interfaces connecting the sending endpoint and the receiving endpoint to multiple networks, respectively, said process steps comprising:

determining a data capacity throughput for each of the multiple physical interfaces, wherein the data capacity throughput is an amount of data throughput which is currently possible of being sent over a respective physical interface;

partitioning the single data stream into multiple data packets, wherein each of the multiple data packets has header information which identifies a sequence identifier indicating an in-sequence position of the data packet in the single data stream;

designating for each data packet, a send-side physical interface and a receive-side physical interface, wherein the designation depends at least partly on the data capacity throughput;

sending different portions of the partitioned data packets over different ones of the multiple physical interfaces in accordance with the designation; and

receiving an acknowledgment over each of the multiple physical interfaces sent from the receiving endpoint,

wherein the receiving endpoint determines an amount of data received on each of the multiple physical interfaces, and determines any changes in the data capacity throughput for each of the multiple physical interfaces on a recipient side of the receiving endpoint,

wherein the acknowledgment indicates the determined amount of data received by the receiving endpoint on each of the different ones of the multiple physical interfaces, and wherein the acknowledgment includes an indication of the determined changes in the data capacity throughput for each of the multiple physical interfaces on the recipient side,

wherein, when the acknowledgment indicates that an amount of a portion of data packets was not received over one of the multiple physical interfaces, then, depending on the data capacity throughput of the multiple physical interfaces, the sending endpoint repartitions the portion of the data stream corresponding to the not received data packets, and sends the repartitioned data packets over one or more of available ones of the multiple physical interfaces, and

wherein at least some of the repartitioned data packets are sent over physical interfaces which are different than the physical interfaces on which the data packets of the data stream, corresponding to the repartitioned data packets, were originally sent.

19. A non-transitory computer-readable memory medium on which is stored computer-executable process steps for causing a processor to receive a single data stream sent from a sending endpoint to a receiving endpoint, wherein both of the sending endpoint and the receiving endpoint each have multiple physical interfaces connecting the sending endpoint and the receiving endpoint to multiple networks, respectively, said process steps comprising:

receiving different portions of partitioned data packets, wherein the single data stream is partitioned into multiple data packets, and different portions of the partitioned data packets are sent over different ones of the multiple physical interfaces in accordance with a designated send-side physical interface and a designated receive side physical interface, depending at least partly on a data capacity throughput for each of the multiple physical interfaces, wherein the data capacity throughput is an amount of data throughput which is currently possible of being sent over a respective physical interface;

reconstructing the single data stream by combining the received partitioned data packets into the single data stream, wherein each of the multiple data packets has header information which identifies a sequence identifier indicating an in-sequence position of the data packet in the single data stream, and the single data stream is combined in accordance with the header information of the multiple data packets;

determining an amount of data received on each of the multiple physical interfaces, and any changes in the data capacity throughput for each of the multiple physical interfaces on a recipient side of the receiving endpoint; and

sending an acknowledgment over each of the multiple physical interfaces to the sending endpoint indicating the determined amount of data received on each of the different ones of the multiple physical interfaces, wherein the acknowledgment includes an indication of the determined changes in the data capacity throughput for each of the multiple physical interfaces on the recipient side,

wherein, when the acknowledgment indicates that an amount of a portion of data packets was not received over one of the multiple physical interfaces, then, depending on the data capacity throughput of the multiple physical interfaces, the sending endpoint repartitions the portion of the data stream corresponding to the not received data packets, and sends the repartitioned data packets over one or more of available ones of the multiple physical interfaces, and

wherein at least some of the repartitioned data packets are sent over physical interfaces which are different than the physical interfaces on which the data packets of the data stream, corresponding to the repartitioned data packets, were originally sent.