Extensible, Asynchronous, Centralized Analysis And Optimization Of Server Responses To Client Requests

• US 20090276488A1
• Filed: 04/20/2009
• Published: 11/05/2009
• Est. Priority Date: 05/05/2008
• Status: Active Grant

• Current Assignee: Radware Limited
• Original Assignee: Strangeloop Networks, Inc. (Radware Limited)
• Inventors: Alstad, Kent
• Granted Patent: US 9,906,620 B2
• Time in Patent Office: Days
• US Class Current: 709/203
• CPC Class Codes: G06F 16/9574 of access to content, e.g. by caching
• CPC Class Codes: H04L 67/02 based on web technology, e.g. hypertext transfer protocol [HTTP]
• CPC Class Codes: H04L 67/303 Terminal profiles
• CPC Class Codes: H04L 67/5651 Reducing the amount or size of exchanged application data

Abstract

An optimizer for messaging systems learns the purpose and context of each message and combines that information with knowledge of the specific client that will be rendering the response, such as a specific HTML browser. Any of a number of optimization factors can be applied, singly or in any combination. Messages are analyzed offline until a configurable threshold is reached, indicating that enough data has been sampled to develop a valid instruction set, to be applied to the responses that a server generates for a particular request. Responses are parsed into tokens and instructions for each type of token are compiled into instruction sets that are stored. These instructions sets continue to be iteratively improved as more data is collected, until the configurable sampling threshold is reached.

Claims

1. A computer-implemented method for optimizing a messaging system for communicating between at least one server and at least one client, comprising:

in a computing device, establishing a threshold representing an amount of data collection;

in a computing device, performing offline analysis of a plurality of messages to collect data for optimization;

in a computing device, responsive to the offline analysis having collected sufficient data to reach the established threshold, generating an optimization instruction set;

storing the generated optimization instruction set in a storage device; and

in a computing device, applying the generated instruction set to optimize at least one subsequent message.

2. The method of claim 1, wherein performing offline analysis is performed concurrently with generating and transmitting messages.

3. The method of claim 1, wherein generating an optimization instruction set comprises:

identifying a plurality of resources to be consolidated; and

generating instructions for consolidating the identified plurality of resources;

and wherein the optimization instruction set comprises instructions for replacing the plurality of resources with the consolidated resources.

4. The method of claim 3, wherein identifying a plurality of resources to be consolidated comprises at least one selected from the group consisting of:

identifying a plurality of cascading style sheet resources to be consolidated;

identifying a plurality of images to be consolidated; and

identifying a plurality of JavaScript resources to be consolidated.

5. The method of claim 1, wherein applying the generated instruction set comprises at least one selecting from the group consisting of:

consolidating a plurality of cascading style sheets;

consolidating a plurality of images; and

consolidating a plurality of JavaScript resources.

6. The method of claim 1, wherein applying the generated instruction set comprises rewriting resource references to use a URI stem that increases the number of concurrent connections.

7. The method of claim 1, wherein applying the generated instruction set comprises aliasing references within the message.

8. The method of claim 1, wherein applying the generated instruction set comprises:

predicting resource usage; and

preloading at least one resource based on the prediction.

9. The method of claim 1, wherein applying the generated instruction set comprises:

identifying static links within the message; and

transmitting identified static links to the client prior to rendering of other portions of the message.

10. The method of claim 1, wherein applying the generated instruction set comprises:

identifying JavaScript code within the message; and

deferring at least one of loading and execution of identified JavaScript code.

11. The method of claim 1, wherein each message comprises at least one selected from the group consisting of:

a client request; and

a server response to a request.

12. The method of claim 1, wherein each message comprises at least one selected from the group consisting of:

an HTTP request; and

a response to an HTTP request.

13. The method of claim 1, wherein performing offline analysis and generating an optimization instruction set are performed at an appliance located in a data path between the server and the client.

14. The method of claim 1, wherein performing offline analysis comprises, for at least one message:

determining whether the message is treatable; and

responsive to the message being treatable;

parsing the message to derive a plurality of message tokens; and

classifying the tokens according to type;

and wherein generating an optimization instruction set comprises compiling instructions for at least one token type.

15. The method of claim 1, wherein:

performing offline analysis comprises, for at least one message, classifying the tokens according to type; and

generating an optimization instruction set comprises compiling instructions for at least one token type.

16. The method of claim 1, wherein performing offline analysis comprises, for at least one message, determining at least one portion of the message that is suitable for optimization.

17. The method of claim 1, further comprising:

performing additional offline analysis of a plurality of messages to collect additional data for optimization; and

modifying at least one previously stored optimization instruction set based on the additional offline analysis.

18. The method of claim 1, further comprising:

establishing a timeout condition for expiry of at least one stored instruction set; and

responsive to the timeout condition being met for a stored instruction set;

flagging the stored instruction set as expired;

initiating offline analysis of a plurality of messages to collect data for optimization to replace the expired instruction set;

responsive to the offline analysis having collected sufficient data to reach the established threshold, generating a replacement optimization instruction set; and

storing the generated replacement optimization instruction set in a storage device.

19. The method of claim 1, wherein generating an optimization instruction set comprises:

identifying at least one content element common to responses associated with at least a predefined number of entities; and

generating the optimization instruction set for the at least one identified content element.

20. The method of claim 19, wherein each entity comprises a user.

21. A system for optimizing a messaging system for communicating between at least one server and at least one client, comprising:

a compiler, for performing offline analysis of a plurality of messages to collect data for optimization, and for, responsive to the offline analysis having collected sufficient data to reach an established threshold, generating an optimization instruction set;

a storage device, coupled to the compiler, for storing the generated optimization instruction set; and

a rewriter, coupled to the storage device, for applying the generated instruction set to optimize at least one subsequent message.

22. The system of claim 21, wherein the compiler generates an optimization instruction set by:

identifying a plurality of resources to be consolidated; and

generating instructions for consolidating the identified plurality of resources;

and wherein the optimization instruction set comprises instructions for replacing the plurality of resources with the consolidated resources.

23. The system of claim 22, wherein the compiler identifies a plurality of resources to be consolidated by performing at least one selected from the group consisting of:

identifying a plurality of cascading style sheet resources to be consolidated;

identifying a plurality of images to be consolidated; and

identifying a plurality of JavaScript resources to be consolidated.

24. The system of claim 21, wherein the rewriter applies the generated instruction set by performing at least one selecting from the group consisting of:

consolidating a plurality of cascading style sheets;

consolidating a plurality of images; and

consolidating a plurality of JavaScript resources.

25. The system of claim 21, wherein the rewriter applies the generated instruction set by rewriting resource references to use a URI stem that increases the number of concurrent connections.

26. The system of claim 21, wherein the rewriter applies the generated instruction set by aliasing references within the message.

27. The system of claim 21, wherein the rewriter applies the generated instruction set by:

predicting resource usage; and

preloading at least one resource based on the prediction.

28. The system of claim 21, wherein the rewriter applies the generated instruction set by:

identifying static links within the message; and

transmitting identified static links to the client prior to rendering of other portions of the message.

29. The system of claim 21, wherein the rewriter applies the generated instruction set by:

identifying JavaScript code within the message; and

deferring at least one of loading and execution of identified JavaScript code.

30. The system of claim 21, wherein each message comprises at least one selected from the group consisting of:

a client request; and

a server response to a request.

31. The system of claim 21, wherein each message comprises at least one selected from the group consisting of:

an HTTP request; and

a response to an HTTP request.

32. The system of claim 21, wherein the compiler is a component of an appliance located in a data path between the server and the client.

33. The system of claim 21, wherein the compiler performs offline analysis by, for at least one message:

determining whether the message is treatable; and

responsive to the message being treatable;

parsing the message to derive a plurality of message tokens; and

classifying the tokens according to type;

and wherein the compiler generates an optimization instruction set by compiling instructions for at least one token type.

34. The system of claim 21, wherein:

the compiler performs offline analysis by, for at least one message, classifying the tokens according to type; and

the compiler generates an optimization instruction set by compiling instructions for at least one token type.

35. The system of claim 21, wherein the compiler performs offline analysis by, for at least one message, determining at least one portion of the message that is suitable for optimization.

36. The system of claim 21, wherein the compiler:

performs additional offline analysis of a plurality of messages to collect additional data for optimization; and

modifies at least one previously stored optimization instruction set based on the additional offline analysis.

37. The system of claim 21, wherein a timeout condition is established for expiry of at least one stored instruction set, and wherein, responsive to the timeout condition being met for a stored instruction set:

the compiler flags the stored instruction set as expired;

the compiler initiates offline analysis of a plurality of messages to collect data for optimization to replace the expired instruction set;

responsive to the offline analysis having collected sufficient data to reach the established threshold, the compiler generates a replacement optimization instruction set; and

the storage device stores the generated replacement optimization instruction set.

38. The system of claim 21, wherein the compiler generates an optimization instruction set by:

identifying at least one content element common to responses associated with at least a predefined number of entities; and

generating the optimization instruction set for the at least one identified content element.

39. The system of claim 38, wherein each entity comprises a user.

40. A computer program product for optimizing a messaging system for communicating between at least one server and at least one client, comprising:

a computer-readable storage medium; and

computer program code, encoded on the medium, for;

establishing a threshold representing an amount of data collection;

performing offline analysis of a plurality of messages to collect data for optimization;

responsive to the offline analysis having collected sufficient data to reach the established threshold, generating an optimization instruction set;

storing the generated optimization instruction set in a storage device; and

applying the generated instruction set to optimize at least one subsequent message.

41. The computer program product of claim 40, wherein the computer program code causes the performing offline analysis to be performed concurrently with generating and transmitting messages.

42. The computer program product of claim 40, wherein the computer program code for generating an optimization instruction set comprises computer program code for:

identifying a plurality of resources to be consolidated; and

generating instructions for consolidating the identified plurality of resources;

and wherein the optimization instruction set comprises instructions for replacing the plurality of resources with the consolidated resources.

43. The computer program product of claim 42, wherein the computer program code for identifying a plurality of resources to be consolidated comprises computer program code for performing at least one selected from the group consisting of:

identifying a plurality of cascading style sheet resources to be consolidated;

identifying a plurality of images to be consolidated; and

identifying a plurality of JavaScript resources to be consolidated.

44. The computer program product of claim 40, wherein the computer program code for applying the generated instruction set comprises computer program code for performing at least one selecting from the group consisting of:

consolidating a plurality of cascading style sheets;

consolidating a plurality of images; and

consolidating a plurality of JavaScript resources.

45. The computer program product of claim 40, wherein the computer program code for applying the generated instruction set comprises computer program code for rewriting resource references to use a URI stem that increases the number of concurrent connections.

46. The computer program product of claim 40, wherein the computer program code for applying the generated instruction set comprises computer program code for aliasing references within the message.

47. The computer program product of claim 40, wherein the computer program code for applying the generated instruction set comprises computer program code for:

predicting resource usage; and

preloading at least one resource based on the prediction.

48. The computer program product of claim 40, wherein the computer program code for applying the generated instruction set comprises computer program code for:

identifying static links within the message; and

transmitting identified static links to the client prior to rendering of other portions of the message.

49. The computer program product of claim 40, wherein the computer program code for applying the generated instruction set comprises computer program code for:

identifying JavaScript code within the message; and

deferring at least one of loading and execution of identified JavaScript code.

50. The computer program product of claim 40, wherein each message comprises at least one selected from the group consisting of:

a client request; and

a server response to a request.

51. The computer program product of claim 40, wherein each message comprises at least one selected from the group consisting of:

an HTTP request; and

a response to an HTTP request.

52. The computer program product of claim 40, wherein the computer program code for performing offline analysis comprises computer program code for, for at least one message:

determining whether the message is treatable; and

responsive to the message being treatable;

parsing the message to derive a plurality of message tokens; and

classifying the tokens according to type;

and wherein the computer program code for generating an optimization instruction set comprises computer program code for compiling instructions for at least one token type.

53. The computer program product of claim 40, wherein:

the computer program code for performing offline analysis comprises computer program code for, for at least one message, classifying the tokens according to type; and

the computer program code for generating an optimization instruction set comprises computer program code for compiling instructions for at least one token type.

54. The computer program product of claim 40, wherein the computer program code for performing offline analysis comprises computer program code for, for at least one message, determining at least one portion of the message that is suitable for optimization.

55. The computer program product of claim 40, further comprising computer program code for:

performing additional offline analysis of a plurality of messages to collect additional data for optimization; and

modifying at least one previously stored optimization instruction set based on the additional offline analysis.

56. The computer program product of claim 40, further comprising computer program code for:

establishing a timeout condition for expiry of at least one stored instruction set; and

responsive to the timeout condition being met for a stored instruction set;

flagging the stored instruction set as expired;

initiating offline analysis of a plurality of messages to collect data for optimization to replace the expired instruction set;

responsive to the offline analysis having collected sufficient data to reach the established threshold, generating a replacement optimization instruction set; and

storing the generated replacement optimization instruction set in a storage device.

57. The computer program product of claim 40, wherein the computer program code for generating an optimization instruction set comprises computer program code for:

identifying at least one content element common to responses associated with at least a predefined number of entities; and

generating the optimization instruction set for the at least one identified content element.

58. The computer program product of claim 57, wherein each entity comprises a user.