Low-latency hole punching

• US 9,154,426 B2
• Filed: 10/31/2011
• Issued: 10/06/2015
• Est. Priority Date: 10/31/2011
• Status: Expired due to Fees

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: McGuire, Rory L.
• Primary Examiner(s): SCOTT, RANDY A
• Application Number:
  US13/285,194
• Publication Number:
  US 20130111043A1
• Time in Patent Office: 1,436 Days
• Field of Search: 709/221, 709/223, 709/228, 709/230, 709/245, 709/246
• US Class Current: 1/1
• CPC Class Codes: H04L 47/18 End to end
• CPC Class Codes: H04L 61/2514 between local and global IP addresses
• CPC Class Codes: H04L 61/2557 Translation policies or rules
• CPC Class Codes: H04L 61/256 NAT traversal
• CPC Class Codes: H04L 61/2575 using address mapping retrieval, e.g. simple traversal of user datagram protocol through session traversal utilities for NAT [STUN]
• CPC Class Codes: H04L 61/2589 over a relay server, e.g. traversal using relay for network address translation [TURN]
• CPC Class Codes: H04L 67/104 Peer-to-peer [P2P] networks
• CPC Class Codes: H04W 28/02 Traffic management, e.g. flow control or congestion control
• CPC Class Codes: H04W 8/04 Registration at HLR or HSS [Home Subscriber Server]

Abstract

Described is a system for establishing a network connection between electronic devices in a network. In the described embodiments, a first electronic device is configured to determine that a relay server is being used to send packets to and receive packets from a second electronic device. In parallel with continuing to send packets to and receive packets from the second electronic device using the relay server, the first electronic device is configured to perform operations to establish a peer to peer network connection with the second electronic device. When the peer to peer network connection has been established, the first electronic device is configured to stop using the relay server to send packets to and receive packets from the second electronic device, and instead use the peer to peer network connection with the second electronic device to send packets to and receive packets from the second electronic device.

Claims

1. A method for establishing a network connection between electronic devices in a network, the method comprising:

at a first electronic device that includes a processing subsystem,

wherein the processing system is configured to execute an operating system for the first electronic device that comprises a kernel and an application space, and

wherein the processing subsystem is further configured to execute a virtual interface daemon in the application space in the operating system, wherein the virtual interface daemon appears as a network interface to the operating system,

the processing subsystem performing operations for the virtual interface daemon, the operations comprising;

determining that a relay server is being used to send packets to and receive packets from a second electronic device;

in parallel with continuing to send packets to and receive packets from the second electronic device using the relay server, performing operations to establish a peer to peer network connection with the second electronic device; and

when the peer to peer network connection has been established, stopping using the relay server to send packets to and receive packets from the second electronic device, and instead using the peer to peer network connection with the second electronic device to send packets to and receive packets from the second electronic device;

wherein sending packets using the relay server or the peer to peer network connection comprises, in the virtual interface daemon;

receiving the packets from the kernel of the operating system, adding corresponding information to the packets to configure the packets to be sent using either the relay server or the peer to peer network connection, and returning the updated packets to the kernel of the operating system to be sent therefrom.

2. The method of claim 1, further comprising, before sending packets to and receiving packets from the second electronic device using the relay server, registering the first electronic device with the relay server, wherein the registration comprises:

communicating an IP address and port of the first electronic device or an IP address and port of a NAT coupled between the first electronic device and the network to the relay server; and

negotiating with the relay server an identifier for the first electronic device to enable the first electronic device to use the relay server to send packets to and receive packets from the second electronic device.

3. The method of claim 1, wherein performing operations to establish the peer to peer network connection with the second electronic device comprises:

querying at least one of an address resolution server or the kernel of the operating system on the first electronic device to determine one or more candidate IP address and port pairs for communicating with the first electronic device using the peer to peer network connection;

sending to the second electronic device the one or more candidate IP address and port pairs for communicating with the first electronic device;

receiving from the second electronic device one or more candidate IP address and port pairs for communicating with the second electronic device using the peer to peer network connection; and

exchanging test messages using the candidate IP address and port pairs for the first and second electronic devices until an IP address and port pair is found for each electronic device that can be used for communicating with the electronic device using the peer to peer network connection.

4. The method of claim 3, wherein performing operations to establish the peer to peer network connection with the second electronic device further comprises:

using the IP address and port pair that is found for the second electronic device, performing operations to establish a UDP session and configure one or more aspects of the UDP session, wherein the one or more aspects optionally include security aspects of the UDP session.

5. The method of claim 1, wherein the method further comprises, when performing operations to establish the peer to peer network connection with the second electronic device are unsuccessful, or when the peer to peer network connection with the second electronic device is lost:

continuing to or commencing sending packets to and receiving packets from the second electronic device using the relay server; and

after a predetermined time, performing operations to establish the peer to peer network connection with the second electronic device.

6. The method of claim 1, wherein using the peer to peer network connection with the second electronic device to send packets to and receive packets from the second electronic device comprises:

determining one or more session identifiers that were being used when sending packets to and receiving packets from the second electronic device using the relay server; and

using the session identifiers within the packets when sending packets to and receiving packets from the second electronic device using the peer to peer network connection.

7. The method of claim 1, wherein sending packets to the second electronic device using the relay server or the peer to peer network connection comprises:

receiving the packets in the kernel of the operating system in the first electronic device, wherein the packets comprise an indication that they are to be sent to the second electronic device;

based on the indication in the packets that the packets are to be sent to the second electronic device, forwarding the received packets from the kernel of the operating system to the virtual interface daemon;

in the virtual interface daemon, determining whether the relay server or the peer to peer network connection is being used to send packets to the second electronic device;

based on the determination, adding corresponding information to the packets to configure the packets to be transmitted to the second electronic device using either the relay server or the peer to peer network connection; and

forwarding the packets to the kernel of the operating system to be sent to the second electronic device using a corresponding interface in a networking subsystem.

8. The method of claim 7, wherein adding corresponding information to the packets to configure the packets to be transmitted to the second electronic device using the peer to peer network connection comprises:

adding one of UDP information, TCP information, or IP-in-IP information when the peer to peer network connection is being used.

9. The method of claim 7, wherein adding corresponding information to the packets to configure the packets to be transmitted to the second electronic device using the relay server comprises:

adding one of UDP information, TCP information, or IP-in-IP information when the relay server is being used.

10. The method of claim 1, wherein the packets are sent or received for at least one application that is being executed by the first electronic device.

11. A non-transitory computer-readable storage medium containing instructions that, when executed by a processing subsystem in a first electronic device, cause the first electronic device to perform a method for establishing a network connection between the first electronic device and a second electronic device in a network, the method comprising:

in the processing subsystem in the first electronic device,

wherein the processing system is configured to execute an operating system for the first electronic device that comprises a kernel and an application space, and

wherein the processing subsystem is further configured to execute a virtual interface daemon in the application space in the operating system, wherein the virtual interface daemon appears as a network interface to the operating system,

performing operations for the virtual interface daemon, the operations comprising;

determining that a relay server is being used to send packets to and receive packets from a second electronic device;

in parallel with continuing to send packets to and receive packets from the second electronic device using the relay server, performing operations to establish a peer to peer network connection with the second electronic device; and

when the peer to peer network connection has been established, stopping using the relay server to send packets to and receive packets from the second electronic device, and instead using the peer to peer network connection with the second electronic device to send packets to and receive packets from the second electronic device;

wherein sending packets using the relay server or the peer to peer network connection comprises, in the virtual interface daemon;

receiving the packets from the kernel of the operating system, adding corresponding information to the packets to configure the packets to be sent using either the relay server or the peer to peer network connection, and returning the updated packets to the kernel of the operating system to be sent therefrom.

12. The computer-readable storage medium of claim 11, further comprising, before sending packets to and receiving packets from the second electronic device using the relay server, registering the first electronic device with the relay server, wherein the registration comprises:

communicating an IP address and port of the first electronic device or an IP address and port of a NAT coupled between the first electronic device and the network to the relay server; and

negotiating with the relay server an identifier for the first electronic device to enable the first electronic device to use the relay server to send packets to and receive packets from the second electronic device.

13. The computer-readable storage medium of claim 11, wherein performing operations to establish the peer to peer network connection with the second electronic device comprises:

querying at least one of an address resolution server or the kernel of the operating system on the first electronic device to determine one or more candidate IP address and port pairs for communicating with the first electronic device using the peer to peer network connection;

sending to the second electronic device the one or more candidate IP address and port pairs for communicating with the first electronic device;

receiving from the second electronic device one or more candidate IP address and port pairs for communicating with the second electronic device using the peer to peer network connection; and

exchanging test messages using the candidate IP address and port pairs for the first and second electronic devices until an IP address and port pair is found for each electronic device that can be used for communicating with the electronic device using the peer to peer network connection.

14. The computer-readable storage medium of claim 13, wherein performing operations to establish the peer to peer network connection with the second electronic device further comprises:

using the IP address and port pair that is found for the second electronic device, performing operations to establish a UDP session and configure one or more aspects of the UDP session, wherein the one or more aspects optionally include security aspects of the UDP session.

15. The computer-readable storage medium of claim 11, wherein the method further comprises, when performing operations to establish the peer to peer network connection with the second electronic device are unsuccessful, or when the peer to peer network connection with the second electronic device is lost:

continuing to or commencing sending packets to and receiving packets from the second electronic device using the relay server; and

after a predetermined time, performing operations to establish the peer to peer network connection with the second electronic device.

16. The computer-readable storage medium of claim 11, wherein using the peer to peer network connection with the second electronic device to send packets to and receive packets from the second electronic device comprises:

determining one or more session identifiers that were being used when sending packets to and receiving packets from the second electronic device using the relay server; and

using the session identifiers within the packets when sending packets to and receiving packets from the second electronic device using the peer to peer network connection.

17. The computer-readable storage medium of claim 11, wherein sending packets to the second electronic device using the relay server or the peer to peer network connection comprises:

receiving the packets in the kernel of the operating system in the first electronic device, wherein the packets comprise an indication that they are to be sent to the second electronic device;

based on the indication in the packets that the packets are to be sent to the second electronic device, forwarding the received packets from the kernel of the operating system to the virtual interface daemon;

in the virtual interface daemon, determining whether the relay server or the peer to peer network connection is being used to send packets to the second electronic device;

based on the determination, adding corresponding information to the packets to configure the packets to be transmitted to the second electronic device using either the relay server or the peer to peer network connection; and

forwarding the packets to the kernel of the operating system to be sent to the second electronic device using a corresponding interface in a networking subsystem.

18. The computer-readable storage medium of claim 17, wherein adding corresponding information to the packets to configure the packets to be transmitted to the second electronic device using the peer to peer network connection comprises:

adding one of UDP information, TCP information, or IP-in-IP information when the peer to peer network connection is being used.

19. The computer-readable storage medium of claim 17, wherein adding corresponding information to the packets to configure the packets to be transmitted to the second electronic device using the relay server comprises:

adding one of UDP information, TCP information, or IP-in-IP information when the relay server is being used.

20. The computer-readable storage medium of claim 11, wherein the packets are sent or received for at least one application that is being executed by the first electronic device.

21. A first electronic device, comprising:

a processing subsystem, wherein the processing system is configured to execute an operating system for the first electronic device that comprises a kernel and an application space, and wherein the processing subsystem is further configured to execute a virtual interface daemon in the application space in the operating system, wherein the virtual interface daemon appears as a network interface to the operating system,

wherein the processing subsystem is further configured to perform operations for the virtual interface daemon, the operations comprising;

determining that a relay server is being used to send packets to and receive packets from a second electronic device;

in parallel with continuing to send packets to and receive packets from the second electronic device using the relay server, performing operations to establish a peer to peer network connection with the second electronic device; and

when the peer to peer network connection has been established, stopping using the relay server to send packets to and receive packets from the second electronic device, and instead using the peer to peer network connection with the second electronic device to send packets to and receive packets from the second electronic device;

wherein sending packets using the relay server or the peer to peer network connection comprises, in the virtual interface daemon;

receiving the packets from the kernel of the operating system, adding corresponding information to the packets to configure the packets to be sent using either the relay server or the peer to peer network connection, and returning the updated packets to the kernel of the operating system to be sent therefrom.

22. The apparatus of claim 21, wherein, before sending packets to and receiving packets from the second electronic device using the relay server, the first electronic device is configured to register the first electronic device with the relay server, wherein the registration comprises:

communicating an IP address and port of the first electronic device or an IP address and port of a NAT coupled between the first electronic device and the network to the relay server;

negotiating with the relay server an identifier for the first electronic device to enable the first electronic device to use the relay server to send packets to and receive packets from the second electronic device.

23. The apparatus of claim 21, wherein, when performing operations to establish the peer to peer network connection with the second electronic device, the first electronic device is configured to:

query at least one of an address resolution server or the kernel of the operating system on the first electronic device to determine one or more candidate IP address and port pairs for communicating with the first electronic device using the peer to peer network connection;

send to the second electronic device the one or more candidate IP address and port pairs for communicating with the first electronic device;

receive from the second electronic device one or more candidate IP address and port pairs for communicating with the second electronic device using the peer to peer network connection; and

exchange test messages using the candidate IP address and port pairs for the first and second electronic devices until an IP address and port pair is found for each electronic device that can be used for communicating with the electronic device using the peer to peer network connection.

24. The apparatus of claim 23, wherein, when performing operations to establish the peer to peer network connection with the second electronic device, using the IP address and port pair that is found for the second electronic device, the first electronic device is configured to:

perform operations to establish a UDP session and configure one or more aspects of the UDP session, wherein the one or more aspects optionally include security aspects of the UDP session.

25. The apparatus of claim 21, wherein, when performing operations to establish the peer to peer network connection with the second electronic device are unsuccessful, or when the peer to peer network connection with the second electronic device is lost, the first electronic device is configured to:

continue to or commence sending packets to and receiving packets from the second electronic device using the relay server; and

after a predetermined time, perform operations to establish the peer to peer network connection with the second electronic device.

26. The apparatus of claim 21, wherein, when using the peer to peer network connection with the second electronic device to send packets to and receive packets from the second electronic device, the first electronic device is configured to:

determine one or more session identifiers that were being used when sending packets to and receiving packets from the second electronic device using the relay server; and

use the session identifiers within the packets when sending packets to and receiving packets from the second electronic device using the peer to peer network connection.

27. The apparatus of claim 21, wherein, when sending packets to the second electronic device using the relay server or the peer to peer network connection, the first electronic device is configured to:

receive the packets in the kernel of the operating system in the first electronic device, wherein the packets comprise an indication that they are to be sent to the second electronic device;

based on the indication in the packets that the packets are to be sent to the second electronic device, forward the received packets from the kernel of the operating system to the virtual interface daemon;

in the virtual interface daemon, determine whether the relay server or the peer to peer network connection is being used to send packets to the second electronic device;

based on the determination, add corresponding information to the packets to configure the packets to be transmitted to the second electronic device using either the relay server or the peer to peer network connection; and

forward the packets to the kernel of the operating system to be sent to the second electronic device using a corresponding interface in a networking subsystem.

28. The apparatus of claim 27, wherein, when adding corresponding information to the packets to configure the packets to be transmitted to the second electronic device using the peer to peer network connection, the first electronic device is configured to:

add one of UDP information, TCP information, or IP-in-IP information when the peer to peer network connection is being used.

29. The apparatus of claim 27, wherein, when adding corresponding information to the packets to configure the packets to be transmitted to the second electronic device using the relay server, the first electronic device is configured to:

add one of UDP information, TCP information, or IP-in-IP information when the relay server is being used.

30. The apparatus of claim 21, wherein the packets are sent or received for at least one application that is being executed by the first electronic device.