System providing faster and more efficient data communication

• US 10,582,014 B2
• Filed: 03/28/2019
• Issued: 03/03/2020
• Est. Priority Date: 10/08/2009
• Status: Active Grant

• Current Assignee: Bright Data, Ltd. (f/k/a Luminati Networks)
• Original Assignee: Bright Data, Ltd. (f/k/a Luminati Networks)
• Inventors: Shribman, Derry, Vilenski, Ofer
• Primary Examiner(s): Nguyen, Minh Chau
• Application Number:
  US16/368,041
• Publication Number:
  US 20190222678A1
• Time in Patent Office: 341 Days
• Field of Search: 709202
• CPC Class Codes: H04L 41/046 comprising network management agents or mobile agents therefor
• CPC Class Codes: H04L 67/01 Protocols
• CPC Class Codes: H04L 67/02 based on web technology, e.g. hypertext transfer protocol [HTTP]
• CPC Class Codes: H04L 67/1001 for accessing one among a plurality of replicated servers
• CPC Class Codes: H04L 67/1023 based on a hash applied to IP addresses or costs
• CPC Class Codes: H04L 67/1063 Discovery through centralising entities
• CPC Class Codes: H04L 67/108 characterised by resources being split in blocks or fragments
• CPC Class Codes: H04L 67/142 Managing session states for stateless protocols; Signalling session states; State transitions; Keeping-state mechanisms
• CPC Class Codes: H04L 67/535 Tracking the activity of the user network monitoring arrangements H04L43/00; recording of computer activity G06F11/34
• CPC Class Codes: H04L 67/563 Data redirection of data network streams
• CPC Class Codes: H04L 67/564 Enhancement of application control based on intercepted application data

Abstract

A system designed for increasing network communication speed for users, while lowering network congestion for content owners and ISPs. The system employs network elements including an acceleration server, clients, agents, and peers, where communication requests generated by applications are intercepted by the client on the same machine. The IP address of the server in the communication request is transmitted to the acceleration server, which provides a list of agents to use for this IP address. The communication request is sent to the agents. One or more of the agents respond with a list of peers that have previously seen some or all of the content which is the response to this request (after checking whether this data is still valid). The client then downloads the data from these peers in parts and in parallel, thereby speeding up the Web transfer, releasing congestion from the Web by fetching the information from multiple sources, and relieving traffic from Web servers by offloading the data transfers from them to nearby peers.

Claims

1. A method for use with a group of clients for data communication between a web server storing a web-page that is identified by a Uniform Resource Locator (URL) and a requesting client via one or more clients selected from the group, for use with a first server, and where the web server, the requesting client, the first server, and the clients in the group are communicatively coupled via the Internet and each is identified in the Internet using a distinct identifier, the method comprising the steps of:

(a) communicating, by each of the clients in the group, with the first server;

(b) receiving and storing, by the first server, the identifiers of the clients in the group;

(c) sending, by the requesting client, its identifier and the URL to the first server;

(d) selecting, by the first server, one of the clients from the group based on associating the identifiers of the clients with the URL;

(e) sending, by the first server, the identifier of the selected client to the requesting client; and

(f) receiving, by the selected client, the web-page from the web server.

2. The method according to claim 1, further comprising the step of the requesting client sending its identifier to the first server, and the first server storing the requesting client identifier.

3. The method according to claim 2, further for data communication between a second web server storing a second web-page identified by a second URL and a one of the clients via the requesting client, the method further comprising the steps of:

(h) one of the clients sending the second URL to the first server;

(i) the first server sending the identifier of the requesting client to the one of the clients;

(j) the requesting client receiving the second web-page from the second web server; and

(k) the one of the clients receiving the second web-page from the requesting client.

4. The method according to claim 1, wherein in step (d) the first server selecting two or more of the clients based on associating the identifiers of the clients with the URL;

and in step (e) the first server sending the identifiers of the selected two or more clients to the requesting client.

5. The method according to claim 4, further comprising the step of the requesting client selecting one of the clients as the selected client.

6. The method according to claim 1, further comprising the step of the requesting client sending the URL to the selected client.

7. The method according to claim 6, further comprising the step of the selected client communicating with the web server.

8. The method according to claim 1, wherein the steps are sequentially executed.

9. The method according to claim 1, wherein the web server is Hypertext Transfer Protocol (HTTP) server and responds to HTTP requests from the selected client.

10. The method according to claim 1, wherein the first server is HTTP server and responds to HTTP requests from the requesting client or the.

11. The method according to claim 1, wherein the web server is Transmission Control Protocol/Internet Protocol (TCP/IP) server and communicates based on, or according to, using TCP/IP protocol or connection.

12. The method according to claim 1, wherein the first server is a TCP/IP server and communicates based on, or according to, using TCP/IP protocol or connection.

13. The method according to claim 1, wherein the web-page includes audio, or video content.

14. The method according to claim 1, wherein the first server selecting one of the clients is based on the web server IP address or the URL.

15. The method according to claim 1, wherein the first server selecting one of the clients is based on the selected client IP address.

16. The method according to claim 1, wherein the selected client further storing the web-page received from the web server.

17. The method according to claim 1, wherein the requesting client sending its identifier and the URL to the first server as part of browser or email application execution.

18. The method according to claim 1, wherein the communication with the web server or the requesting first server is based on, or according to, one out of UDP, DNS, TCP, FTP, POP#, SMTP, or SQL standards.

19. The method according to claim 1, wherein the communication with the requesting client or the selected client is based on, or according to, one out of UDP, DNS, TCP, FTP, POP#, SMTP, or SQL standards.

20. The method according to claim 1, wherein the first server identifier is using a Uniform Resource Locator (URL).

21. The method according to claim 1, wherein the URL, the first server identifier, the requesting client identifier, or any of the client'"'"'s identifier is using Internet Protocol (IP) address.

22. The method according to claim 1, further comprising the steps of the requesting client sending a communication port number to the selected client, followed by communication between the requesting client and the selected client using the communication port number.

23. The method according to claim 1, wherein step (d) the first server selecting one of the clients based on the geographical location of the clients.

24. The method according to claim 1, further comprising receiving, by the requesting client from the selected client, the web-page in response to the receiving, by the selected client, the web-page from the web server.

25. A method for use with a group of clients for data communication between a web server storing a web-page that is identified by a Uniform Resource Locator (URL) and a requesting client via one or more clients selected from the group, for use with a first server, and where the web server, the requesting client, the first server, and the clients in the group are communicatively coupled via the Internet and each is identified in the Internet using a distinct identifier, the method comprising the steps of:

(a) sending, by each of the clients in the group, its identifier to the first server;

(b) receiving and storing, by the first server, the identifiers of ring the identifiers of the clients in the group;

(c) sending, by the requesting client, its identifier and the web server identifier to the first server;

(d) selecting one of the clients from the group based on the geographical location of the clients;

(e) sending, by the first server, the identifier of the selected client to the requesting client; and

(f) receiving, by the selected client, the web-page from the web server.

26. The method according to claim 25, wherein in step (d) the first server is selecting one of the clients.

27. The method according to claim 25, wherein in step (d) the requesting client is selecting one of the clients.

28. The method according to claim 25, further for data communication between a second web server storing a second web-page that is identified by a second Uniform Resource Locator (URL) and a one of the clients via the requesting client, the method further comprising the steps of:

(h) one of the clients sending the second URL to the first server;

(i) the first server sending the identifier of the requesting client to the one of the clients;

(j) the requesting client receiving the second web-page from the second web server; and

(k) the one of the clients receiving the second web-page from the requesting client.

29. The method according to claim 25, further comprising receiving, by the requesting client from the selected client, the web-page in response to the receiving, by the selected client, the web-page from the web server.

30. A method for data communication between a requesting client and a web server storing a web-page that is identified by a Uniform Resource Locator (URL) via a second client, for use with a first server and a second client, and where the web server, the requesting client, the first server, and the second client are communicatively coupled via the Internet and each is identified in the Internet using a distinct identifier, the method comprising the steps of:

(a) sending its identifier and the URL to the first server;

(b) receiving from the first server the identifier of the second client; and

(c) sending the URL to the second client.

31. The method according to claim 30, wherein the steps are sequentially executed.

32. The method according to claim 30, wherein the first server is HTTP server and responds to HTTP requests.

33. The method according to claim 30, wherein the first server is a TCP/IP server and communicates based on, or according to, using TCP/IP protocol or connection.

34. The method according to claim 30, wherein the web page includes audio, or video content.

35. The method according to claim 30, wherein the steps are part of browser or email application execution.

36. The method according to claim 30, further for data communication with a second web server storing a second web-page and having an identifier in the Internet and the second clients via the requesting client, the method further comprising the steps of:

(e) receiving the second web-page from the second web server; and

(f) sending the second web-page to the second client.

37. The method according to claim 30, wherein the communication with the web server or the first server is based on, or according to, one out of UDP, DNS, TCP, FTP, POP#, SMTP, or SQL standards.

38. The method according to claim 30, wherein the communication with the second client is based on, or according to, one out of UDP, DNS, TCP, FTP, POP#, SMTP, or SQL standards.

39. The method according to claim 30, wherein the first server identifier is using a Uniform Resource Locator (URL).

40. The method according to claim 30, wherein the URL, the first server identifier, the requesting client identifier, or the second client identifier is using Internet Protocol (IP) address.

41. The method according to claim 30, wherein step (b) comprising the receiving from the first server the identifiers of two or more second clients, and further comprising the step of selecting one out of second clients based on associating the identifiers of the second clients with the URL.

42. The method according to claim 30, further comprising the steps of sending a communication port number to the second client, followed by communication with the second client using the communication port number.

43. The method according to claim 30, further comprising receiving, the web-page associated with the web server from the second client, in response to the sending of the URL to the second client.