Network streaming of a single data stream simultaneously over multiple physical interfaces

• US 8,880,716 B2
• Filed: 05/08/2009
• Issued: 11/04/2014
• Est. Priority Date: 05/08/2009
• Status: Active Grant

• Current Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Original Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Inventors: Riggert, Eric, Martinez, Martin
• Primary Examiner(s): Nguyen, Thuong
• Application Number:
  US12/463,367
• Publication Number:
  US 20100287296A1
• Time in Patent Office: 2,006 Days
• Field of Search: 709/231, 709/224, 370/537, 370/428, 370/232, 370/254, 455/456.1
• US Class Current: 709/231
• CPC Class Codes: H04L 65/61 for supporting one-way streaming services, e.g. Internet radio
• CPC Class Codes: H04L 65/65 Network streaming protocols, e.g. real-time transport protocol [RTP] or real-time control protocol [RTCP]
• CPC Class Codes: H04L 65/80 Responding to QoS
• CPC Class Codes: H04L 69/14 Multichannel or multilink protocols

Abstract

Sending a data stream from a sending endpoint to a receiving endpoint, wherein both of the sending endpoint and the receiving endpoint each have multiple physical interfaces connecting the sending endpoint and the receiving endpoint to multiple networks, respectively, is provided. The data stream is split into a series of data packets and sent over the multiple physical interfaces. A next available data packet of the series is sent over a fastest one of the multiple physical interfaces. A data packet from further back in the series is extracted in accordance with a determined expected difference in arrival time, and sent on a corresponding slower one of the multiple physical interfaces. The next available data packet is sent from the sending endpoint nearly simultaneously as the extracted data packet is sent from the sending endpoint.

Claims

1. A method for sending a data stream from a sending endpoint to a receiving endpoint, wherein the data stream is split into a series of data packets having an order and sent over multiple physical interfaces, the method comprising:

determining an expected difference in arrival time at the receiving endpoint between respective arrival times at the receiving endpoint of data packets sent concurrently by the sending endpoint to the receiving endpoint via different ones of the multiple physical interfaces, wherein each of the multiple physical interfaces connects the sending endpoint and the receiving endpoint over a respective path;

sending a next available data packet in the order of the series of data packets to the receiving endpoint over a fastest one of the multiple physical interfaces, wherein the fastest one of the multiple physical interfaces is determined based on the determined expected difference in arrival time at the receiving endpoint;

repositioning, within the sending endpoint, a data packet which is further back in the order of the series of data packets than the next available data packet, to the front of the order of the series of data packets in accordance with the determined expected difference in arrival time at the receiving endpoint; and

sending the repositioned data packet on one of the multiple physical interfaces which is slower than the fastest one of the multiple physical interfaces before sending the next available data packet over the fastest one of the multiple physical interfaces,

wherein the receiving endpoint maintains a history of the multiple physical interfaces on which ones of the extracted data packets continue to be delayed, and ones of the extracted data packets which arrive early, and creates a predictability model to more accurately predict future expected differences in arrival times.

2. The method according to claim 1, wherein the data packets are received at the receiving endpoint in an approximate order of appearance as in the original data stream.

3. The method according to claim 1, wherein the sending endpoint and the receiving endpoint each have a single physical interface connected to each of the multiple networks, wherein when sending the next available data packet of the series over a fastest one of the multiple physical interfaces, a send-side physical interface is selected from one of the single physical interfaces connected to one of the multiple networks, the selected send-side physical interface being the fastest single physical interface of the sending endpoint in accordance with the determined expected difference in arrival time, and a receive-side physical interface is selected, the selected receive-side physical interface being the physical interface of the receiving endpoint connected to a same network as the selected send-side physical interface.

4. The method according to claim 1, wherein the sending endpoint and the receiving endpoint each have a single physical interface connected to each of the multiple networks, and wherein when sending the extracted data packet of the series over a corresponding slower one of the multiple physical interfaces, a send-side physical interface is selected from one of the single physical interfaces connected to one of the multiple networks, the selected send-side physical interface being a slower corresponding single physical interface of the sending endpoint in accordance with the determined expected difference in arrival time, and a receive-side physical interface is selected, the selected receive-side physical interface being the physical interface of the receiving endpoint connected to a same network as the selected send-side physical interface.

5. The method according to claim 1, wherein the sending endpoint and the receiving endpoint each have multiple physical interfaces connected to each of the multiple networks, and when sending the next available data packet of the series over a fastest one of the multiple physical interfaces, a fastest send-side physical interface is selected from the multiple physical interfaces of the sending endpoint in accordance with the determined expected difference in arrival time, and a receive-side physical interface is selected from the multiple physical interfaces of the receiving endpoint connected to a same network as the selected send-side physical interface.

6. The method according to claim 5, wherein a receive-side physical interface corresponding to the fastest send-side physical interface when determining the expected difference in arrival time is the selected receive-side physical interface for the next available data packet.

7. The method according to claim 1, wherein the sending endpoint and the receiving endpoint each have multiple physical interfaces connected to each of the multiple networks, and when sending the extracted data packet of the series over a corresponding slower one of the multiple physical interfaces, a corresponding slower send-side physical interface is selected from the multiple physical interfaces of the sending endpoint in accordance with the determined expected difference in arrival time, and a receive-side physical interface is selected from the multiple physical interfaces of the receiving endpoint connected to a same network as the selected send-side physical interface.

8. The method according to claim 7, wherein a receive-side physical interface corresponding to a slower send-side physical interface when determining the expected difference in arrival time is the selected receive-side physical interface for the extracted data packet.

9. The method according to claim 1, wherein when determining the expected difference in arrival time, the expected difference is initially assumed to be zero, the receiving endpoint starts a timer when a first one of the sent data packets is received at the receiving endpoint, and the receiving endpoint stops the timer when a second one of the sent data packets is received at the receiving endpoint, wherein the receiving endpoint communicates the difference in arrival time to the sending endpoint, and wherein the determination of the expected difference in arrival time is made in accordance with the timed difference in arrival time.

10. The method according to claim 1, wherein when determining the expected difference in arrival time, the expected difference is initially assumed to be zero, the receiving endpoint notes a first time when a first one of the sent data packets is received at the receiving endpoint, and the receiving endpoint notes a second time when a second one of the sent data packets is received at the receiving endpoint, and wherein the receiving endpoint calculates a difference between the first time and the second time, wherein the receiving endpoint communicates the calculated difference in arrival time to the sending endpoint, and wherein the determination of the expected difference in arrival time is made in accordance with the calculated difference in arrival time.

11. The method according to claim 9 or 10, wherein the receiving endpoint communicates the difference in arrival time to the sending endpoint via a custom feedback message.

12. The method according to claim 9 or 10, wherein the receiving endpoint communicates the difference in arrival time to the sending endpoint by incorporating the communication into an existing receiver message.

13. The method according to claim 12, wherein the existing receiver message is a receiver message defined in Real-Time Transport Protocol.

14. The method according to claim 1, wherein when determining the expected difference in arrival time, the expected difference is assumed to be a same difference in arrival time as observed in a previous sending of data packets.

15. The method according to claim 1, wherein when determining the expected difference in arrival time, the expected difference is looked up in a table which stores various constant values to be used as an initial expected difference in arrival time for specific ones of the multiple physical interfaces.

16. The method according to claim 1, wherein when extracting a data packet from further back in the series of data packets in accordance with the determined expected difference in arrival time, the extracted data packet represents a unit of time in the future equal to the determined expected difference in arrival time.

17. The method according to claim 16, wherein the extracted data packet is identified by its protocol header timestamp.

18. The method according to claim 1, wherein the data stream is a multimedia data stream, and wherein when extracting a data packet from further back in the series of data packets in accordance with the determined expected difference in arrival time, the extracted data packet represents a unit of time in the future equal to the determined expected difference in arrival time, and the extracted data packet is identified using a known average bit rate of the multimedia.

19. The method according to claim 1, wherein the data stream is a non-media stream, and wherein when extracting a data packet further back in the series of data packets in accordance with the determined expected difference in arrival time, the extracted data packet represents a unit of time in the future equal to the determined expected difference in arrival time, and the extracted data packet is identified using a known aggregate available bandwidth of the multiple physical interfaces.

20. The method according to claim 18 or 19, wherein a format of the data stream is known based upon a transport protocol.

21. The method according to claim 1, wherein, if ones of the extracted data packets sent over corresponding slower ones of the multiple physical interfaces continue to be delayed, then the receiving endpoint communicates an added expected difference in arrival time to the sending endpoint for the delayed ones of the extracted data packets, and if ones of the extracted data packets sent over corresponding slower ones of the multiple physical interfaces are received at the receiving endpoint earlier than the next available data packets sent over the fastest one of the multiple physical interfaces, then the receiving endpoint communicates a reduced expected difference in arrival time to the sending endpoint for the early ones of the extracted data packets.

22. A method for sending a data stream from a sending endpoint to a receiving endpoint, wherein the data stream is split into a series of data packets having an order and sent over multiple physical interfaces, and wherein in said method the sending endpoint performs the steps of:

sending a next available data packet in the order of the series of data packets to the receiving endpoint over a fastest one of the multiple physical interfaces, wherein a determination is made of an expected difference in arrival time between respective arrival times at the receiving endpoint of data packets sent concurrently by the sending endpoint to the receiving endpoint via different ones of the multiple physical interfaces, wherein each of the multiple physical interfaces connects the sending endpoint and the receiving endpoint over a respective path, and wherein the fastest one of the multiple physical interfaces is determined based on the determined expected difference in arrival time at the receiving endpoint;

repositioning, within the sending endpoint, a data packet which is further back in the order of the series of data packets than the next available data packet, to the front of the order of the series of data packets in accordance with the determined expected difference in arrival time at the receiving endpoint; and

sending the repositioned data packet on one of the multiple physical interfaces which is slower than the fastest one of the multiple physical interfaces before sending the next available data packet over the fastest one of the multiple physical interfaces,

wherein the receiving endpoint maintains a history of the multiple physical interfaces on which ones of the extracted data packets continue to be delayed, and ones of the extracted data packets which arrive early, and creates a predictability model to more accurately predict future expected differences in arrival times.

23. The method according to claim 22, wherein the data packets are received at the receiving endpoint in an approximate order of appearance as in the original data stream.

24. A method for sending a data stream from a sending endpoint to a receiving endpoint, wherein the data stream is split into a series of data packets having an order and sent over multiple physical interfaces, and wherein in said method the receiving endpoint performs the steps of:

communicating a difference in arrival time between each of the sent data packets to the sending endpoint,

wherein a determination is made, based on the communication, of an expected difference in arrival time at the receiving endpoint between respective arrival times at the receiving endpoint of data packets sent concurrently by the sending endpoint to the receiving endpoint via different ones of the multiple physical interfaces, and

wherein each of the multiple physical interfaces connects the sending endpoint and the receiving endpoint over a respective path, and the sending endpoint sends a next available data packet in the order of the series of data packets to the receiving endpoint over a fastest one of the multiple physical interfaces, the fastest one of the multiple physical interfaces being determined based on the determined expected difference in arrival time at the receiving endpoint, repositions, within the sending endpoint, a data packet which is further back in the order of the series of data packets than the next available data packet, to the front of the order of the series of data packets in accordance with the determined difference in arrival time at the receiving endpoint, and sends the repositioned data packet on one of the multiple physical interfaces which is slower than the fastest one of the multiple physical interfaces before sending the next available data packet over the fastest one of the multiple physical interfaces,

wherein the receiving endpoint maintains a history of the multiple physical interfaces on which ones of the extracted data packets continue to be delayed, and ones of the extracted data packets which arrive early, and creates a predictability model to more accurately predict future expected differences in arrival times.

25. A sending endpoint comprising:

a computer-readable memory constructed to store computer-executable process steps; and

a processor constructed to execute the computer-executable process steps stored in the memory;

wherein the process steps stored in the memory cause the processor to send a data stream from the sending endpoint to a receiving endpoint, wherein the data stream is split into a series of data packets having an order and sent over multiple physical interfaces, and wherein the process steps stored in the memory include computer-executable process steps to;

send a next available data packet in the order of the series of data packets to the receiving endpoint over a fastest one of the multiple physical interfaces, wherein a determination is made of an expected difference in arrival time at the receiving endpoint between respective arrival times at the receiving endpoint of data packets sent concurrently by the sending endpoint to the receiving endpoint via different ones of the multiple physical interfaces, wherein each of the multiple physical interfaces connects the sending endpoint and the receiving endpoint over a respective path, and wherein the fastest one of the multiple physical interfaces is determined based on the determined expected difference in arrival time at the receiving endpoint;

reposition, within the sending endpoint, a data packet which is further back in the order of the series of data packets than the next available data packet, to the front of the order of the series of data packets in accordance with the determined expected difference in arrival time at the receiving endpoint; and

send the repositioned data packet on one of the multiple physical interfaces which is slower than the fastest one of the multiple physical interfaces before sending the next available data packet over the fastest one of the multiple physical interfaces,

wherein the receiving endpoint maintains a history of the multiple physical interfaces on which ones of the extracted data packets continue to be delayed, and ones of the extracted data packets which arrive early, and creates a predictability model to more accurately predict future expected differences in arrival times.

26. A receiving endpoint comprising:

a computer-readable memory constructed to store computer-executable process steps; and

a processor constructed to execute the computer-executable process steps stored in the memory;

wherein the process steps stored in the memory cause the processor to receive a data stream sent from a sending endpoint to the receiving endpoint, the data stream is split into a series of data packets having an order and sent over multiple physical interfaces, and wherein the process steps stored in the memory include computer-executable process steps to;

communicate a difference in arrival time between each of the sent data packets to the sending endpoint,

wherein a determination is made, based on the communication, of an expected difference in arrival time at the receiving endpoint between respective arrival times at the receiving endpoint of data packets sent concurrently by the sending endpoint to the receiving endpoint via different ones of the multiple physical interfaces, and

wherein each of the multiple physical interfaces connects the sending endpoint and the receiving endpoint over a respective path, and the sending endpoint sends a next available data packet in the order of the series of data packets to the receiving endpoint over a fastest one of the multiple physical interfaces, the fastest one of the multiple physical interfaces being determined based on the determined expected difference in arrival time at the receiving endpoint, repositions, within the sending endpoint, a data packet which is further back in the order of the series of data packets than the next available data packet, to the front of the order of the series of data packets in accordance with the determined difference in arrival time at the receiving endpoint, and sends the repositioned data packet on one of the multiple physical interfaces which is slower than the fastest one of the multiple physical interfaces before sending the next available data packet over the fastest one of the multiple physical interfaces,

wherein the receiving endpoint maintains a history of the multiple physical interfaces on which ones of the extracted data packets continue to be delayed, and ones of the extracted data packets which arrive early, and creates a predictability model to more accurately predict future expected differences in arrival times.

27. A non-transitory computer-readable memory medium on which is stored computer-executable process steps for causing a processor to send a data stream from a sending endpoint to a receiving endpoint, wherein the data stream is split into a series of data packets having an order and sent over multiple physical interfaces to said process steps comprising:

sending a next available data packet in the order of the series of data packets to the receiving endpoint over a fastest one of the multiple physical interfaces, wherein a determination is made of an expected difference in arrival time between respective arrival times at the receiving endpoint of data packets sent concurrently by the sending endpoint to the receiving endpoint via different ones of the multiple physical interfaces, wherein each of the multiple physical interfaces connects the sending endpoint and the receiving endpoint over a respective path, and wherein the fastest one of the multiple physical interfaces is determined based on the determined expected difference in arrival time at the receiving endpoint;

repositioning, within the sending endpoint, a data packet which is further back in the order of the series of data packets than the next available data packet, to the front of the order of the series of data packets in accordance with the determined expected difference in arrival time at the receiving endpoint; and

sending the repositioned data packet on one of the multiple physical interfaces which is slower than the fastest one of the multiple physical interfaces before sending the next available data packet over the fastest one of the multiple physical interfaces,

wherein the receiving endpoint maintains a history of the multiple physical interfaces on which ones of the extracted data packets continue to be delayed, and ones of the extracted data packets which arrive early, and creates a predictability model to more accurately predict future expected differences in arrival times.

28. A non-transitory computer-readable memory medium on which is stored computer-executable process steps for causing a processor to receive a data stream sent from a sending endpoint to the receiving endpoint, wherein the data stream is split into a series of data packets having an order and sent over multiple physical interfaces, said process steps comprising:

communicating a difference in arrival time between each of the sent data packets to the sending endpoint,

wherein a determination is made, based on the communication, of an expected difference in arrival time at the receiving endpoint between respective arrival times at the receiving endpoint of data packets sent concurrently by the sending endpoint to the receiving endpoint via different ones of the multiple physical interfaces, and

wherein each of the multiple physical interfaces connects the sending endpoint and the receiving endpoint over a respective path, and the sending endpoint sends a next available data packet in the order of the series of data packets to the receiving endpoint over a fastest one of the multiple physical interfaces, the fastest one of the multiple physical interfaces being determined based on the determined expected difference in arrival time at the receiving endpoint, repositions, within the sending endpoint, a data packet which is further back in the order of the series of data packets than the next available data packet, to the front of the order of the series of data packets in accordance with the determined difference in arrival time at the receiving endpoint, and sends the repositioned data packet on one of the multiple physical interfaces which is slower than the fastest one of the multiple physical interfaces before sending the next available data packet over the fastest one of the multiple physical interfaces,

wherein the receiving endpoint maintains a history of the multiple physical interfaces on which ones of the extracted data packets continue to be delayed, and ones of the extracted data packets which arrive early, and creates a predictability model to more accurately predict future expected differences in arrival times.