Method for prefetching of structured data between a client device and a server device

• US 20040215717A1
• Filed: 11/06/2003
• Published: 10/28/2004
• Est. Priority Date: 11/06/2002
• Status: Active Grant

• Current Assignee: Tellique Kommunikationstechnik GmbH
• Original Assignee: Tellique Kommunikationstechnik GmbH
• Inventors: Ott, Jorg, Seifert, Nils
• Granted Patent: US 8,078,759 B2
• Time in Patent Office: Days
• US Class Current: 709/203
• CPC Class Codes: G06F 16/957 Browsing optimisation, e.g. caching or content distillation
• CPC Class Codes: H04L 67/02 based on web technology, e.g. hypertext transfer protocol [HTTP]
• CPC Class Codes: H04L 67/1001 for accessing one among a plurality of replicated servers
• CPC Class Codes: H04L 67/1008 based on parameters of servers, e.g. available memory or workload monitoring of computer activity G06F11/30
• CPC Class Codes: H04L 67/101 based on network conditions
• CPC Class Codes: H04L 67/1012 based on compliance of requirements or conditions with available server resources
• CPC Class Codes: H04L 67/1023 based on a hash applied to IP addresses or costs
• CPC Class Codes: H04L 67/1027 Persistence of sessions during load balancing
• CPC Class Codes: H04L 67/2876 Pairs of inter-processing entities at each side of the network, e.g. split proxies
• CPC Class Codes: H04L 67/561 Adding application-functional data or data for application control, e.g. adding metadata
• CPC Class Codes: H04L 67/563 Data redirection of data network streams

Abstract

The invention relates to a method of more efficient data transmission, in particular transmission of structured data, such as web pages, in a system comprising a server means and a client means which are interconnected via a plurality of proxy means, including a server proxy means and a client proxy means.

Claims

1. A method of transmitting data in a system comprising a server means and a client means which are interconnected via a plurality of proxy means, including a server proxy means and a client proxy means, wherein

the client means generates a conditional request for a base file of a structured dataset adapted to be fetched via the server means in the system, and transmits the same to one of the plurality of proxy means, said conditional request comprising a condition;

a modified request for the base file is derived from the conditional request in the one proxy means by changing the condition;

the modified request for the base file is transmitted by the one proxy means to the server means;

the modified request for the base file is received and analyzed in the server means;

a reply dataset, including the base file, is transmitted from the server means to the one or another one of the plurality of proxy means;

the reply dataset is received and analyzed by the one or the other proxy means to find out information about a subfile of the base file; and

a request for the subfile of the base file is generated by the one or the other proxy means and transmitted to the server means if information about the at least one subfile is determined when analyzing the base file.

2. The method as claimed in claim 1, characterized in that a further reply dataset including the subfile is transmitted by the server means to the one or the other proxy means, and the further reply dataset is analyzed recursively by the one or the other proxy means for information about a further subfile.

3. The method as claimed in claim 1, characterized in that the condition for the request for the subfile is comprised by the request for the base file.

4. The method as claimed in claim 1, characterized in that when changing the condition from the modified request an unconditional request is derived from the conditional electronic question.

5. The method as claimed in claim 1, characterized in that status data are transmitted together with the reply dataset from the server means to the one or the other proxy means.

6. The method as claimed in claim 5, characterized in that the one or the other proxy means receiving the reply dataset from the server means evaluates the condition of the request for the base file and, depending on the result of this evaluation, forwards the reply dataset received and/or the status data to another one of the plurality of proxy means or the client means.

7. The method as claimed in claim 5, characterized in that the one or the other proxy means receiving the reply dataset from the server means evaluates the condition of the request for the base file and forwards the reply dataset received and/or the status data to another one of the plurality of proxy means or the client means if the evaluation of the condition shows that forwarding of the reply dataset is not necessary.

8. The method as claimed in claim 5, characterized in that the one or the other of the plurality of proxy means receiving the reply dataset from the server means evaluates the condition of the request for the base file and, depending on the result of this evaluation, forwards the reply dataset received and/or the status data to another one of the plurality of proxy means or the client means, and in that the one or the other of the plurality of proxy means annexes status data of its own to the reply dataset and/or the status data and/or replaces at least parts of the status data by status data of its own, when forwarding to the other one of the plurality of proxy means or the client means.

9. The method as claimed in claim 5, characterized in that the one or the other proxy means receiving the reply dataset from the server means evaluates the condition of the request for the base file and, depending on the result of this evaluation, forwards the reply dataset received and/or the status data to another one of the plurality of proxy means or the client means;

in that the one or the other proxy means annexes status data of its own to the reply dataset and/or the status data and/or replaces at least parts of the status data by status data of its own, when forwarding to the other one of the plurality of proxy means or the client means; and

in that the status data annexed or replaced by the one or the other proxy means of its own reveal to the other one of the plurality of proxy means or the client means how the one or the other of the plurality of proxy means evaluated the condition in the request.

10. The method as claimed in claim 5, characterized in that the one or the other proxy means receiving the reply dataset from the server means evaluates the condition of the request for the base file and, depending on the result of this evaluation, forwards the reply dataset received and/or the status data to another one of the plurality of proxy means or the client means;

in that the one or the other of the plurality of proxy means annexes status data of its own to the reply dataset and/or the status data and/or replaces at least parts of the status data by status data of its own, when forwarding to the other one of the purality of proxy means or the client means; and

in that the status data supplemented or replaced by the one or the other of the plurality of proxy means of its own are transmitted in the form of a header data record and/or as a component part of a cookie, an excerpt from a header data record and/or a cookie, or a hash total across a header data record and/or a cookie.

11. The method as claimed in claim 5, characterized in that the one or the other proxy means receiving the reply dataset from the server means evaluates the condition of the request for the base file and, depending on the result of this evaluation, forwards the reply dataset received and/or the status data to another one of the plurality of proxy means or the client means;

in that the one or the other of the plurality of proxy means annexes status data of its own to the reply dataset and/or the status data and/or replaces at least parts of the status data by status data of its own, when forwarding to the other one of the plurality of proxy means or the client means;

in that the status data supplemented or replaced by the one or the other of the plurality of proxy means of its own are transmitted in the form of a header data record and/or as a component part of a cookie, an excerpt from a header data record and/or a cookie, or a hash total across a header data record and/or a cookie; and

in that an examining one of the plurality of proxy means checks whether the client means expresses the request for the subfile with the same or a comparable condition as the one proxy means did.

12. The method as claimed in claim 5, characterized in that the one or the other proxy means forwards only the status data or only parts of the base file together with the status data if the one or the other proxy means, in checking a reply dataset size of the reply dataset, determines that the size of the reply dataset checked exceeds a threshold value size.

13. The method as claimed in claim 12, characterized in that the threshold value magnitude is user defined.

14. The method as claimed in claim 5, characterized in that the one or the other proxy means forwards only the status data or only parts of the base file together with the status data if the one or the other proxy means, in checking a transmission bandwidth available for transmitting the reply dataset, determines that the transmission bandwidth checked is below a threshold value bandwidth.

15. The method as claimed in claim 14, characterized in that the threshold value bandwidth is user defined.

16. The method as claimed in claim 1, characterized in that in addition to transmitting the base file or the subfile, the one or the other proxy means transmits modification information including date and/or version information for the base file/subfile.

17. The method as claimed in claim 16, characterized in that the modification information is transmitted as a header data record by the one or the other proxy means.

18. The method as claimed in claim 16, characterized in that the modification information is transmitted as electronic user information (“

cookie”

) by the one or the other proxy means.

19. The method as claimed in claim 1, characterized in that the one or the other of the plurality of proxy means annexes modification information generated by itself to the reply dataset.

20. The method as claimed in claim 1, characterized in that the one proxy means generates proxy status information in response to the conditional request for the base file and transmits the proxy status information to the client means.

21. The method as claimed in claim 1, characterized in that the server proxy means makes an assumption regarding the base file and/or the subfile as to whether the base file/subfile comprises another subfile, and the modified request is derived from the conditional request only if the assumption made is that the base file/subfile does comprise another subfile.

22. The method as claimed in claim 21, characterized in that the assumption is made on the basis of the type of file of the base file/subfile.

23. The method as claimed in claim 1, characterized in that the one or the other proxy means makes an evaluation of its own of the condition and answers the request for the base file itself by suitable status information.

24. The method as claimed in claim 1, characterized in that the one or the other proxy means evaluates script information in the base file and/or the subfile.

25. The method as claimed in claim 1, characterized in that the reply dataset comprises compressed data, and that the one or the other proxy means decompresses the compressed data.

26. The method as claimed in claim 1, characterized in that the request for the base file is modified, that the reply dataset cannot comprise any compressed data.

27. The method as claimed in claim 1, characterized in that the one or the other proxy means buffers data from the reply dataset which are not provided for buffering.

28. The method as claimed in claim 27, characterized in that the buffered reply dataset is used only for replying to a limited number of further requests by the same client means.

29. The method as claimed in claim 27, characterized in that the buffered reply dataset is used only for replying to a limited number of further requests by the same client means, and that the upper limit for the limited number of further requests is 1.

30. The method as claimed in claim 27, characterized in that the buffered reply dataset is buffered only as long as it is requested by the client means (for the first time or again) within a respective time interval each.

31. The method as claimed in claim 1, characterized in that the client proxy means transmits to the server proxy means storage information indicating which base file(s) and/or subfile(s) still is/are buffered, and that the server proxy means evaluates the storage information received in order to suppress electronic requests for the base file/subfile still buffered and/or prevent forwarding of the base file/subfile still buffered from the server proxy means.

32. The method as claimed in claim 1, characterized in that the request for subfiles of the base file is generated by the client proxy means and transmitted to the server means, and that the client proxy means aborts the request for the subfile when the client proxy means receives at least parts of the subfile.

33. The method as claimed in claim 1, characterized in that the server proxy means executes prioritization for the forwarding by forwarding the base file with preference.

34. The method as claimed in claim 33, characterized in that a transmission bandwidth portion used for the preferential forwarding of the base file is expanded for this purpose.

35. The method as claimed in claim 1, characterized in that the server means and the server proxy means are comprised by server-end means and the client means and the client proxy means are comprised by client-end means, and wherein furthermore:

the request for the base file is transmitted from the server proxy means to the server means together with address information identifying the inquiring client-end means;

the address information identifying the inquiring clientend means is received in the server means;

the request for the subfile is transmitted from the server proxy means to the server means together with said or some other address information identifying the inquiring client-end means;

the request for the subfile and said/the other address information identifying the inquiring client-end means are received in the server means.

36. The method as claimed in claim 1, characterized in that the transmission of the reply dataset and/or the status data between at least two of the plurality of proxy means takes place at least partly compressed.

37. The method as claimed in claim 1, characterized in that the transmission of the reply dataset and/or the status data between at least two of the plurality of proxy means takes place at least partly encrypted.

38. A method of transmitting data in a system comprising a server means and a client means which are interconnected via a plurality of proxy means, including a server proxy means and a client proxy means, wherein

the client means generates a request, including user data (“

cookie”

), for a base file of a structured dataset adapted to be fetched via the server means in the system, and transmits the same to one of the plurality of proxy means;

the request for the base file together with the user data is transmitted by the one proxy means to the server means;

the request is received and analyzed in the server means;

the base file and/or status information is/are transmitted from the server means to the one or another one of the plurality of proxy means;

the base file is analyzed by the one or the other proxy means to find out electronic information about a subfile of the base file;

another request for the subfile is generated by the one or the other proxy means and transmitted to the server means if electronic information about the subfile of the base file is determined when analyzing the base file, user data for the subfile being annexed to the other request;

the other request for the subfile is received and analyzed in the server means;

the subfile and/or other status information is transmitted from the server means to the one or the other proxy means; and

a reply dataset, including the base file and the subfile, is transmitted from the one or the other proxy means to the client proxy means.

39. The method as claimed in claim 38, characterized in that the user data for the subfile include the user data from the request for the base file of the client means.

40. The method as claimed in claim 38, characterized in that the server means transmits response information to the one or the other proxy means to communicate that missing user data were determined upon receipt of the request for the base file.

41. The method as claimed in claim 40, characterized in that the missing user data are annexed to the user data for the subfile.

42. The method as claimed in claim 38, characterized in that the one or the other proxy means generates electronic path/domain information for the user data.

43. The method as claimed in claim 38, characterized in that the one or the other proxy means stores electronic validity information in a memory means, disclosing a realm of validity of the user data in the system.

44. The method as claimed in claim 38, characterized in that the one or the other proxy means transmits a test request to the server means to find out the user data.

45. The method as claimed in claim 38, characterized in that the one or the other proxy means evaluates script information in the base file and/or the subfile.

46. The method as claimed in claim 38, characterized in that the reply dataset comprises compressed data, and that the one or the other proxy means decompresses the compressed data.

47. The method as claimed in claim 38, characterized in that the request for the base file is modified, so that the reply dataset cannot comprise any compressed data.

48. The method as claimed in claim 38, characterized in that the one or the other proxy means buffers data from the reply dataset which are not provided for buffering.

49. The method as claimed in claim 48, characterized in that the buffered reply dataset is used only for replying to a limited number of further requests by the same client means.

50. The method as claimed in claim 48, characterized in that the buffered reply dataset is used only for replying to a limited number of further requests by the same client means, and that the upper limit for the limited number of further requests is 1.

51. The method as claimed in claim 48, characterized in that the buffered reply dataset is buffered only as long as it is requested by the client means (for the first time or again) within a respective time interval each.

52. The method as claimed in claim 38, characterized in that the client proxy means transmits to the server proxy means storage information indicating which-base file(s) and/or subfile(s) still is/are buffered, and that the server proxy means evaluates the storage information received in order to suppress electronic requests for the base file/subfile still buffered and/or prevent forwarding of the base file/subfile still buffered from the server proxy means.

53. The method as claimed in claim 38, characterized in that the request for subfiles of the base file is generated by the client proxy means and transmitted to the server means, and that the client proxy means aborts the transmission of the request for one of the subfiles when the client proxy means receives at least parts of the one subfile.

54. The method as claimed in claim 38, characterized in that the server proxy means executes prioritization for the forwarding by forwarding the base file with preference.

55. The method as claimed in claim 54, characterized in that a transmission bandwidth portion used for the preferential forwarding of the base file is expanded for this purpose.

56. The method as claimed in claim 38, characterized in that the server means and the server proxy means are comprised by server-end means and the client means and the client proxy means are comprised by client-end means, and wherein furthermore:

the request for the base file is transmitted from the server proxy means to the server means together with address information identifying the inquiring client-end means;

the address information identifying the inquiring clientend means is received in the server means;

the request for the subfile is transmitted from the server proxy means to the server means together with said or some other address information identifying the inquiring client-end means;

the request for the subfile and said/the other address information identifying the inquiring client-end means are received in the server means.

57. The method as claimed in claim 38, characterized in that the transmisssion of the reply dataset and/or the status data between at least two of the plurality of proxy means takes place at least partly compressed.

58. The method as claimed in claim 38, characterized in that the transmisssion of the reply dataset and/or the status data between at least two of the plurality of proxy means takes place at least partly encrypted.

59. A method of transmitting data in a system comprising server-end means which include a server means and a server proxy means and further comprising client-end means which include a client means and a client proxy means, wherein

an inquiring one of the client-end means generates a request for a base file of a structured dataset adapted to be fetched via the server means in the system;

the request for the base file is transmitted from the inquiring or another one of the client-end means to the server proxy means;

the request for the base file together with address information identifying the inquiring client-end means is transmitted by the server proxy means to the server means;

the request for the base file as well as the address information identifying the inquiring client-end means are received in the server means and the request is analyzed;

the base file is transmitted from the server means to the server proxy means;

the base file is analyzed by the server proxy means to find out electronic information about a subfile of the base file;

a request for the subfile is transmitted from the server proxy means to the server means together with said or some other address information identifying the inquiring client-end means if electronic information about the subfile was determined when analyzing the base file;

the request for the subfile and said/the other address information identifying the inquiring client-end means are received in the server means;

the subfile is transmitted from the server means to the server proxy means; and

a reply dataset including the base file and the subfile are transmitted from the server proxy means to the client proxy means.

60. The method as claimed in claim 59, characterized in that the address information identifying the inquiring client-end means includes the network address of the client means and/or the network address of the client proxy means.

61. The method as claimed in claim 59, characterized in that the address information identifying the inquiring client-end means is generated and configured in the system, as required.

62. The method as claimed in claim 59, characterized in that the address information identifying the inquiring client-end means includes a port number.

63. The method as claimed in claim 59, characterized in that the address information identifying the inquiring client-end means includes a supplementary network address in the system.

64. The method as claimed in claim 59, characterized in that the address information identifying the inquiring client-end means is generated and configured in the means at the client end.

65. The method as claimed in claim 59, characterized in that the address information identifying the inquiring client-end means is generated and configured in the means at the server end.

66. The method as claimed in claim 59, characterized in that the one or the other proxy means evaluates script data in the base file and/or the subfile.

67. The method as claimed in claim 59, characterized in that the reply dataset comprises compressed data, and that the one or the other proxy means decompresses the compressed data.

68. The method as claimed in claim 59, characterized in that the request for the base file is modified, that the reply dataset cannot comprise any compressed data.

69. The method as claimed in claim 59, characterized in that the one or the other proxy means buffers data from the reply dataset which are not supposed to be buffered.

70. The method as claimed in claim 69, characterized in that the buffered reply dataset is used only for replying to a limited number of further requests by the same client means.

71. The method as claimed in claim 69, characterized in that the buffered reply dataset is used only for replying to a limited number of further requests by the same client means, and that the upper limit for the limited number of further requests is 1.

72. The method as claimed in claim 69, characterized in that the buffered reply dataset is buffered only as long as it is requested by the client means (for the first time or again) within a respective time interval each.

73. The method as claimed in claim 59, characterized in that the client proxy means transmits to the server proxy means storage information indicating which base file(s) and/or subfile(s) still is/are buffered, and that the server proxy means evaluates the storage information received in order to suppress electronic requests for the base file/subfile still buffered and/or prevent forwarding of the base file/subfile still buffered from the server proxy means.

74. The method as claimed in claim 59, characterized in that the request for subfiles of the base file is generated by the client proxy means and transmitted to the server means, and that the client proxy means aborts the transmission of the request for one of the subfiles when the client proxy means receives at least parts of the one subfile.

75. The method as claimed in claim 59, characterized in that the server proxy means executes prioritization for the forwarding by forwarding the base file with preference.

76. The method as claimed in claim 75, characterized in that a transmission bandwidth portion used for the preferential forwarding of the base file is expanded for this purpose.

77. A computer program product for transmitting data in a system comprising a server means and a client means which are interconnected via a plurality of proxy means, including a server proxy means and a client proxy means, the product comprising the following means:

means recorded on an electronic data storage medium for generating a conditional request by the client means for a base file of a structured dataset adapted to be fetched via the server means in the system and for transmitting the request to one of the plurality of proxy means, said conditional request comprising a condition;

means recorded on the electronic data storage medium for deriving a modified request for the base file from the conditional request in the one proxy means by changing the condition;

means recorded on an electronic data storage medium for transmitting the modified request for the base file from the one proxy means to the server means;

means recorded on the electronic data storage medium for receiving and analyzing the modified request for the base file in the server means;

means recorded on the electronic data storage medium for transmitting a reply dataset, including the base file, from the server means to the one or another one of the plurality of proxy means;

means recorded on the electronic data storage medium for receiving and analyzing the reply dataset by the one or the other proxy means to find out information about a subfile of the base file; and

means recorded on the electronic data storage medium for generating a request for the subfile of the base file by the one or the other proxy means and for transmitting the same to the server means if information about the at least one subfile is determined when analyzing the base file.

78. A computer program product for transmitting data in a system comprising a server means and a client means which are interconnected via a plurality of proxy means, including a server proxy means and a client proxy means, the product comprising the following means:

means recorded on an electronic data storage medium for generating a request, including user data (“

cookie”

), for a base file of a structured dataset by the client means, adapted to be fetched via the server means in the system, and for transmitting the request to one of the plurality of proxy means;

means recorded on the electronic data storage medium for transmitting the request for the base file together with the user data from the one proxy means to the server means;

means recorded on the electronic data storage medium for receiving and analyzing the request in the server means;

means recorded on the electronic data storage medium for transmitting the base file and/or status information from the server means to the one or another one of the plurality of proxy means;

means recorded on the electronic data storage medium for analyzing the base file by the one or the other proxy means to find out electronic information about a subfile of the base file;

means recorded on the electronic data storage medium for generating another request for the subfile by the one or the other proxy means and for transmitting the other request to the server means if electronic information about the subfile of the base file is determined when analyzing the base file, user data for the subfile being annexed to the other request;

means recorded on the electronic data storage medium for receiving and analyzing the other request for the subfile in the server means;

means recorded on the electronic data storage medium for transmitting the subfile and/or other status information from the server means to the one or the other proxy means; and

means recorded on the electronic data storage medium for transmitting a reply dataset, including the base file and the subfile, from the one or the other proxy means to the client proxy means.

79. A computer program product for transmitting data in a system comprising server-end means which include a server means and a server proxy means, and further comprising client-end means which include a client means and a client proxy means, the product comprising the following means:

means recorded on an electronic data storage medium for generating a request for a base file of a structured dataset adapted to be fetched via the server means in the system by an inquiring one of the client-end means;

means recorded on the electronic data storage medium for transmitting the request for the base file from the inquiring or another one of the client-end means to the server proxy means;

means recorded on the electronic data storage medium for transmitting the request for the base file together with address information identifying the inquiring client-end means from the server proxy means to the server means;

means recorded on the electronic data storage medium for receiving the request for the base file as well as the address information identifying the inquiring client-end means in the server means and for analyzing the request;

means recorded on the electronic data storage medium for transmitting the base file from the server means to the server proxy means;

means recorded on the electronic data storage medium for analyzing the base file by the server proxy means to find out electronic information about a subfile of the base file;

means recorded on the electronic data storage medium for transmitting a request for the subfile from the server proxy means to the server means together with said or some other address information identifying the inquiring client-end means if electronic information about the subfile is determined when analyzing the base file;

means recorded on the electronic data storage medium for receiving the request for the subfile and said/the other address information identifying the inquiring client-end means in the server means;

means recorded on the electronic data storage medium for transmitting the subfile from the server means to the server proxy means; and

means recorded on the electronic data storage medium for transmitting a reply dataset, including the base file and the subfile, from the server proxy means to the client proxy means.