System providing faster and more efficient data communication

• US 10,582,013 B2
• Filed: 03/28/2019
• Issued: 03/03/2020
• Est. Priority Date: 10/08/2009
• Status: Active Grant

• Current Assignee: Bright Data, Ltd. (f/k/a Luminati Networks)
• Original Assignee: Bright Data, Ltd. (f/k/a Luminati Networks)
• Inventors: Shribman, Derry, Vilenski, Ofer
• Primary Examiner(s): Nguyen, Minh Chau
• Application Number:
  US16/368,002
• Publication Number:
  US 20190222677A1
• Time in Patent Office: 341 Days
• Field of Search: 709202
• CPC Class Codes: H04L 41/046 comprising network management agents or mobile agents therefor
• CPC Class Codes: H04L 67/01 Protocols
• CPC Class Codes: H04L 67/02 based on web technology, e.g. hypertext transfer protocol [HTTP]
• CPC Class Codes: H04L 67/1001 for accessing one among a plurality of replicated servers
• CPC Class Codes: H04L 67/1023 based on a hash applied to IP addresses or costs
• CPC Class Codes: H04L 67/1063 Discovery through centralising entities
• CPC Class Codes: H04L 67/108 characterised by resources being split in blocks or fragments
• CPC Class Codes: H04L 67/142 Managing session states for stateless protocols; Signalling session states; State transitions; Keeping-state mechanisms
• CPC Class Codes: H04L 67/535 Tracking the activity of the user network monitoring arrangements H04L43/00; recording of computer activity G06F11/34
• CPC Class Codes: H04L 67/563 Data redirection of data network streams
• CPC Class Codes: H04L 67/564 Enhancement of application control based on intercepted application data

Abstract

A system designed for increasing network communication speed for users, while lowering network congestion for content owners and ISPs. The system employs network elements including an acceleration server, clients, agents, and peers, where communication requests generated by applications are intercepted by the client on the same machine. The IP address of the server in the communication request is transmitted to the acceleration server, which provides a list of agents to use for this IP address. The communication request is sent to the agents. One or more of the agents respond with a list of peers that have previously seen some or all of the content which is the response to this request (after checking whether this data is still valid). The client then downloads the data from these peers in parts and in parallel, thereby speeding up the Web transfer, releasing congestion from the Web by fetching the information from multiple sources, and relieving traffic from Web servers by offloading the data transfers from them to nearby peers.

Claims

1. A method for fetching by a requesting client via a first server a first content identified by a first content identifier and stored in a web server, the first server, the web server, and the requesting client are communicatively coupled over the Internet and each is identified in the Internet using a distinct identifier, for use with multiple Internet-related addresses, the method comprising:

selecting an address from the multiple Internet-related addresses;

sending, by the requesting client to the first server, a request for the first content, the request comprises the first content identifier;

receiving, by the first server from the requesting client, the request;

responsive to receiving the request sending, by the first server to the web server, the request using the selected address;

receiving, by the web server from the selected address, the request;

sending, by the web server to the selected address, the first content;

receiving, by the first server, the first content;

responsive to the receiving of the first content by the first server, sending, by the first server to the requesting client, the first content; and

responsive to the sending, by the first server to the requesting client, the first content, receiving, by the requesting client from the first server, the first content.

2. The method according to claim 1, for use with a group of client devices, wherein each one of the multiple Internet related addresses is associated with a respective client device from the group that is addressed in the Internet using the respective Internet address.

3. The method according to claim 2, further comprising communicating, by each of the client device in the group, with the first server, and storing, by the first server in response to the communication, the respective identifiers of the client device in the group.

4. The method according to claim 3, wherein the sending by the first server of the request using the selected address comprises:

sending, by the first server, the request to a first client device from the group that is addressed by the selected address;

sending, by the first client device to the web server, the request;

receiving, by the first client device from the web server, the first content; and

sending, by the first client device to the first server, the first content.

5. The method according to claim 1, further comprising sending, by the requesting client, a communication port number.

6. The method according to claim 5, wherein the communication by the first server is based on, or uses, the communication port number.

7. The method according to claim 1, wherein each of the Internet related addresses is an IP address.

8. The method according to claim 1, wherein the request is an Hypertext Transfer Protocol (HTTP) request.

9. The method according to claim 1, wherein the web server is Hypertext Transfer Protocol (HTTP) server that responds to HTTP requests.

10. The method according to claim 1, wherein the first server is HTTP server that responds to HTTP requests from the requesting client.

11. The method according to claim 1, wherein the web server is Transmission Control Protocol/Internet Protocol (TCP/IP) server that communicates based on, or according to, using TCP/IP protocol or connection.

12. The method according to claim 1, wherein the first server is a TCP/IP server that communicates based on, or according to, using TCP/IP protocol or connection.

13. The method according to claim 1, wherein the steps are sequentially executed.

14. The method according to claim 1, wherein the first content includes web-page, audio, or video content.

15. The method according to claim 1, wherein the first content identifier is a Uniform Resource Locator (URL).

16. The method according to claim 1, wherein the selecting is performed by the first server.

17. The method according to claim 1, wherein the selecting is performed by the requesting client.

18. The method according to claim 1, wherein the selecting is based on an IP address of the requesting client.

19. The method according to claim 1, wherein each one of the multiple Internet related addresses is associated with a respective geographical location, and wherein the selecting is based on the respective geographical location.

20. The method according to claim 1, further comprising storing, by the first server or the requesting client, the received first content.

21. The method according to claim 1, wherein the sending of the request by the first server comprises using the selected address a source address.

22. The method according to claim 1, further comprising executing, by the requesting client, a web browser or an email application, and wherein the sending by the requesting client device of the request is part of, or in response to, the execution of the web browser or of the email application.

23. The method according to claim 1, wherein the communication with the requesting client or with the first server is based on, or according to, one out of UDP, DNS, TCP, FTP, POP #, SMTP, or SQL standards.

24. The method according to claim 1, further for fetching by the requesting client via the first server a second content identified by a second content identifier and stored in the web server, the method further comprising:

sending, by the requesting client device to the first server, an additional request for the second content, the additional request comprises the second content identifier;

receiving, by the first server from the requesting client, the additional request;

responsive to receiving the additional request sending, by the first server, the additional request using the selected address;

receiving, by the first server, the second content;

responsive to the receiving of the second content by the first server, sending, by the first server to the requesting client, the second content; and

receiving, by the requesting client, the second content.

25. The method according to claim 1, further for fetching by the requesting client via the first server a second content identified by a second content identifier and stored in the web server, the method further comprising:

selecting an additional address from the multiple Internet related addresses;

sending, by the requesting client device to the first server, an additional request for the second content, the additional request comprises the second content identifier;

receiving, by the first server from the requesting client, the additional request;

responsive to receiving the additional request sending, by the first server, the additional request using the additional selected address;

receiving, by the first server, the second content;

responsive to the receiving of the second content by the first server, sending, by the first server to the requesting client, the second content; and

receiving, by the requesting client, the second content.

26. The method according to claim 1, further for fetching by an additional requesting client via the first server a second content identified by a second content identifier and stored in the web server, the method further comprising:

sending, by the additional requesting client to the first server, an additional request for the second content, the additional request comprises the second content identifier;

receiving, by the first server from the additional requesting client, the additional request;

responsive to receiving the additional request sending, by the first server, the additional request using the selected address;

receiving, by the first server, the second content;

responsive to the receiving of the second content by the first server, sending, by the first server to the additional requesting client, the second content; and

receiving, by the additional requesting client, the second content.

27. The method according to claim 1, further for fetching by an additional requesting client via the first server a second content identified by a second content identifier and stored in the web server, the method further comprising:

selecting an additional address from the multiple Internet related addresses;

sending, by the additional requesting client device to the first server, an additional request for the second content, the additional request comprises the second content identifier;

receiving, by the first server from the additional requesting client, the additional request;

responsive to receiving the additional request sending, by the first server, the additional request using the additional selected address;

receiving, by the first server, the second content;

responsive to the receiving of the second content by the first server, sending, by the first server to the additional requesting client, the second content; and

receiving, by the additional requesting client, the second content.