System providing faster and more efficient data communication

• US 10,637,968 B2
• Filed: 04/28/2019
• Issued: 04/28/2020
• Est. Priority Date: 10/08/2009
• Status: Active Grant

• Current Assignee: Bright Data, Ltd. (f/k/a Luminati Networks)
• Original Assignee: Bright Data, Ltd. (f/k/a Luminati Networks)
• Inventors: Shribman, Derry, Vilenski, Ofer
• Primary Examiner(s): Nguyen, Minh Chau
• Application Number:
  US16/396,696
• Publication Number:
  US 20190253528A1
• Time in Patent Office: 366 Days
• Field of Search: 709202
• CPC Class Codes: H04L 41/046 comprising network management agents or mobile agents therefor
• CPC Class Codes: H04L 67/01 Protocols
• CPC Class Codes: H04L 67/02 based on web technology, e.g. hypertext transfer protocol [HTTP]
• CPC Class Codes: H04L 67/1001 for accessing one among a plurality of replicated servers
• CPC Class Codes: H04L 67/1023 based on a hash applied to IP addresses or costs
• CPC Class Codes: H04L 67/1063 Discovery through centralising entities
• CPC Class Codes: H04L 67/108 characterised by resources being split in blocks or fragments
• CPC Class Codes: H04L 67/142 Managing session states for stateless protocols; Signalling session states; State transitions; Keeping-state mechanisms
• CPC Class Codes: H04L 67/535 Tracking the activity of the user network monitoring arrangements H04L43/00; recording of computer activity G06F11/34
• CPC Class Codes: H04L 67/563 Data redirection of data network streams
• CPC Class Codes: H04L 67/564 Enhancement of application control based on intercepted application data

Abstract

A system designed for increasing network communication speed for users, while lowering network congestion for content owners and ISPs. The system employs network elements including an acceleration server, clients, agents, and peers, where communication requests generated by applications are intercepted by the client on the same machine. The IP address of the server in the communication request is transmitted to the acceleration server, which provides a list of agents to use for this IP address. The communication request is sent to the agents. One or more of the agents respond with a list of peers that have previously seen some or all of the content which is the response to this request (after checking whether this data is still valid). The client then downloads the data from these peers in parts and in parallel, thereby speeding up the Web transfer, releasing congestion from the Web by fetching the information from multiple sources, and relieving traffic from Web servers by offloading the data transfers from them to nearby peers.

Claims

1. A method for use with a requesting client device that comprises an Hypertext Transfer Protocol (HTTP) or Hypertext Transfer Protocol Secure (HTTPS) client, for use with a first web server that is a HTTP or HTTPS server that respectively responds to HTTP or HTTPS requests and stores a first content identified by a first content identifier, for use with a second server distinct from the first web server and identified in the Internet by a second IP address, and for use with a list of IP addresses, the method comprising:

identifying, by the requesting client device, an HTTP or HTTPS request for the first content;

selecting, by the requesting client device, an IP address from the list;

sending, by the requesting client device, to the second server using the second IP address over the Internet in response to the identifying and the selecting, the first content identifier and the selected IP address; and

receiving, by the requesting client device, over the Internet in response to the sending, from the second server using the selected IP address, the first content.

2. The method according to claim 1, wherein the selecting is further based on a response time when communicating with the requesting client device.

3. The method according to claim 2, wherein the selected IP address is associated with a first client device that is the quickest to respond to queries from the requesting client device.

4. The method according to claim 3, further comprising sending, by the requesting client device, a notification message to a device from a plurality of client devices that was not selected as part of the selecting.

5. The method according to claim 1, for use with a first application stored in the requesting client device and associated with a first version number, wherein the sending comprises sending the first version number.

6. The method according to claim 5, for use with a second application that is a version of the first application and is stored in the second server and associated with a second version number, wherein the method further comprising receiving, by the requesting client device from the second server, in response to the sending of the first version number, a message that comprises the second version number.

7. The method according to claim 6, wherein the method further comprising downloading over the Internet, by the requesting client device from the second server, in response to the receiving of the second version number, the second application from the second server, and installing the second application by the requesting client device as a replacement for the first application.

8. The method according to claim 1, further comprising determining, by the requesting client device, that the received part of, or the whole of, the first content, is valid.

9. The method according to claim 8, wherein the determining is based on a received HTTP header according to, or based on, IETF RFC 2616.

10. The method according to claim 9, further comprising:

sending, a message over the Internet in response to the determining that the received part of, or the whole of, the first content, is not valid; and

receiving, over the Internet in response to the sending of the message, from a second client device selected from the plurality of client devices, the part of, or the whole of, the first content.

11. The method according to claim 1, wherein each of the IP addresses in the list is associated with a geographical location.

12. The method according to claim 11, wherein the selecting is based on the geographical location.

13. The method according to claim 1, for use with a plurality of client devices each identified by a distinct IP address in the list, wherein the selected IP address is associated with a first client device is selected from the plurality of client devices.

14. The method according to claim 13, further comprising establishing, by the requesting client device, a Transmission Control Protocol (TCP) connection with the second server or with the first client device using TCP/IP protocol.

15. The method according to claim 1, further comprising periodically communicating between the second server and the requesting client device.

16. The method according to claim 15, wherein the periodically communicating comprises exchanging ‘

keep alive’

messages.

17. The method according to claim 1, further comprising executing, by the requesting client device, a web/Internet browser application or an email application.

18. The method according to claim 17, wherein the identifying comprises intercepting, by a driver in the requesting client device, the request for the first content respectively from the web browser application or the email application.

19. The method according to claim 1, further comprising storing, by the requesting client device, the part of, or the whole of, the received first content.

20. The method according to claim 19, further comprising:

receiving, by the requesting client device from a second device over the Internet, a request for the part of, or the whole of, the first content; and

sending, in response to the received request by the requesting client device to the second device over the Internet, the part of, or the whole of, the stored first content.

21. The method according to claim 1, wherein the requesting client device stores a second content identified by a second content identifier, the method further comprising sending, over the Internet by the requesting client device, a part of, or a whole of, the second content.

22. The method according to claim 21, wherein the sending is at least in part performed in parallel to the identifying, the sending, or the receiving by the requesting client device.

23. The method according to claim 1, wherein the method further comprising receiving and storing, by the requesting client device, the list.

24. The method according to claim 1, wherein the requesting client device comprises a wireless modem for Radio-Frequency (RF) communication, and wherein the sending and the receiving is using the RF communication.

25. The method according to claim 1, wherein the first content comprises distinct first and second parts, wherein the receiving comprises receiving, the first part over the Internet in response to the sending, using a first client device, and wherein the method further comprising receiving, by the requesting client device over the Internet in response to the sending, from a second client device distinct from the first client device, the second part.

26. The method according to claim 1, wherein the first content comprises web-page, audio, or video content, and wherein the first content identifier is using a Uniform Resource Locator (URL).

27. The method according to claim 1, wherein the requesting client device is identified by a Media Access Control (MAC) address or a hostname, and wherein the method further comprising sending, by the requesting client device, during, as part of, or in response to, a start-up of the requesting client device, a first message to the second server, and wherein the first messages comprises an IP address of the requesting client device, the MAC address, or the hostname.

28. The method according to claim 1, wherein the first or second server is a Transmission Control Protocol/Internet Protocol (TCP/IP) server and communicates over the Internet with the requesting client device based on, or according to, using TCP/IP protocol or connection.

29. The method according to claim 1, wherein the requesting client device communicates over the Internet based on, or according to, one out of UDP, DNS, FTP, POP #, SMTP, or SQL standards.