System providing faster and more efficient data communication

• US 10,484,511 B2
• Filed: 02/17/2019
• Issued: 11/19/2019
• Est. Priority Date: 10/08/2009
• Status: Active Grant

• Current Assignee: Bright Data, Ltd. (f/k/a Luminati Networks)
• Original Assignee: Web Spark Ltd.
• Inventors: Shribman, Derry, Vilenski, Ofer
• Primary Examiner(s): Nguyen, Minh Chau
• Application Number:
  US16/278,109
• Publication Number:
  US 20190182361A1
• Time in Patent Office: 275 Days
• Field of Search: 709202
• CPC Class Codes: H04L 41/046 comprising network management agents or mobile agents therefor
• CPC Class Codes: H04L 67/01 Protocols
• CPC Class Codes: H04L 67/02 based on web technology, e.g. hypertext transfer protocol [HTTP]
• CPC Class Codes: H04L 67/1001 for accessing one among a plurality of replicated servers
• CPC Class Codes: H04L 67/1023 based on a hash applied to IP addresses or costs
• CPC Class Codes: H04L 67/1063 Discovery through centralising entities
• CPC Class Codes: H04L 67/108 characterised by resources being split in blocks or fragments
• CPC Class Codes: H04L 67/142 Managing session states for stateless protocols; Signalling session states; State transitions; Keeping-state mechanisms
• CPC Class Codes: H04L 67/535 Tracking the activity of the user network monitoring arrangements H04L43/00; recording of computer activity G06F11/34
• CPC Class Codes: H04L 67/563 Data redirection of data network streams
• CPC Class Codes: H04L 67/564 Enhancement of application control based on intercepted application data

Abstract

A system designed for increasing network communication speed for users, while lowering network congestion for content owners and ISPs. The system employs network elements including an acceleration server, clients, agents, and peers, where communication requests generated by applications are intercepted by the client on the same machine. The IP address of the server in the communication request is transmitted to the acceleration server, which provides a list of agents to use for this IP address. The communication request is sent to the agents. One or more of the agents respond with a list of peers that have previously seen some or all of the content which is the response to this request (after checking whether this data is still valid). The client then downloads the data from these peers in parts and in parallel, thereby speeding up the Web transfer, releasing congestion from the Web by fetching the information from multiple sources, and relieving traffic from Web servers by offloading the data transfers from them to nearby peers.

Claims

1. A method for fetching, by a first client device, a first content identified by a first content identifier and stored in a web server, for use with a first server that stores a group of IP addresses, the method by the first server comprising:

receiving, from the first client device, the first content identifier;

selecting, in response to the receiving of the first content identifier from the first client device, an IP address from the group;

sending, in response to the selecting, the first content identifier to the web server using the selected IP address;

receiving, in response to the sending, the first content from the web server; and

sending the received first content to the first client device,

wherein the first content comprises a web-page, an audio, or a video content, and wherein the first content identifier comprises a Uniform Resource Locator (URL).

2. The method according to claim 1, wherein each of the IP addresses in the group is associated with a respective client device that is identified over the Internet using a respective IP address.

3. The method according to claim 2, wherein the sending of the first content identifier to the web server comprises sending, by the first server, the first content identifier to the client device addressed by the selected IP address.

4. The method according to claim 3, wherein the sending of the first content identifier to the web server further comprises sending, by the client device addressed by the selected IP address, the first content identifier to the web server, and receiving, from the web server, the first content.

5. The method according to claim 3, wherein the receiving of the first content from the web server comprises receiving the first content from the client device addressed by the selected IP address.

6. The method according to claim 2, further comprising communicating, by the first server, with each of the client devices that are identified over the Internet using by the stored IP addresses.

7. The method according to claim 6, further comprising storing, by the first server, the IP addresses of each of the client devices in response to the communicating.

8. The method according to claim 6, further comprising receiving a ‘

keep alive’

message, by the first server, from each of the client devices that are identified over the Internet using by the stored IP addresses.

9. The method according to claim 2, wherein each of the IP addresses in the group is associated with a respective client device that is identified over the Internet using a respective IP address and is currently online.

10. The method according to claim 2, further comprising establishing, by the first server, a Transmission Control Protocol (TCP) connection with each of the client devices that are identified over the Internet using the IP addresses in the group.

11. The method according to claim 1, further comprising by the first server:

sending, a ‘

keep alive’

message to each of the client devices that are identified over the Internet using by the stored IP addresses; and

waiting for a response to the ‘

keep alive’

message from each of the client devices.

12. The method according to claim 11, further comprising responsive to not receiving, by the first server, a response to the ‘

keep alive’

message from a client device, removing the IP address of the non-responsive third client device from group of IP addresses.

13. The method according to claim 11, wherein the sending of the ‘

keep alive’

message comprises periodically sending by the first server the ‘

keep alive’

message to at least part of the client devices.

14. The method according to claim 1, for use with a criterion stored in the first server, wherein the selecting is according to, or based on, the criterion.

15. The method according to claim 14, wherein the criterion is based on, or comprises, a numerical closeness to the web server IP address.

16. The method according to claim 14, wherein the criterion is based on, or comprises, a geographical location of the client device addressed by the selected IP address.

17. The method according to claim 14, wherein the criterion is based on, or comprises, a response time when communicating.

18. The method according to claim 1, for use with a software application stored in the first server and associated with a first version number, and wherein the method further comprising sending, by the first server to a client device, a message that comprises the first version number of the software application.

19. The method according to claim 18, further comprising sending, by the first server to the client device, the first software application.

20. The method according to claim 1, wherein the first client device is addressed over the Internet using a first Internet Protocol (IP) address, and the method further comprising storing, in the first server, the first IP address.

21. The method according to claim 1, wherein the first server is a Transmission Control Protocol/Internet Protocol (TCP/IP) server that communicates over the Internet with client devices based on, according to, or using, TCP/IP protocol or connection.

22. The method according to claim 1, wherein the first server communicates over the Internet based on, or according to, one out of UDP, DNS, TCP, FTP, POP#, SMTP, or SQL standards.

23. The method according to claim 1, further comprising responsive to the receiving of the first content identifier from the first client device, adding the IP address of the first client device to group of IP addresses.

24. The method according to claim 1, for use with a second client device, the method further comprising, by the first server:

receiving a message from the second client device; and

responsive to the receiving of the message from the second client device, adding the IP address of the second device to the group of IP addresses.

25. The method according to claim 1, wherein the sending of the first content identifier to the web server comprises using the selected IP address as a source address.

26. The method according to claim 1, further comprising sending, by the first server, the selected IP address in response to the selecting.

27. The method according to claim 1, wherein the first client device is identified by a first Internet Protocol (IP) address, Media Access Control (MAC) address, or a hostname.

28. The method according to claim 1, further comprising storing, operating, or using, by the first server, a server operating system.

29. The method according to claim 1, for use with a software application that includes computer instructions that, when executed by a computer processor, cause the processor to perform the steps of the claim 1.

30. The method according to claim 1, wherein the web server comprises a web server that is a Hypertext Transfer Protocol (HTTP) server responding to HTTP requests and addressed in the Internet using a web server Internet Protocol (IP) address.