Method and system for automated analysis and transformation of web pages

• US 10,108,595 B2
• Filed: 06/06/2016
• Issued: 10/23/2018
• Est. Priority Date: 06/22/2010
• Status: Active Grant

• Current Assignee: Akamai Technologies, Inc.
• Original Assignee: Akamai Technologies, Inc.
• Inventors: Podjarny, Guy
• Primary Examiner(s): Ibrahim, Mohamed
• Application Number:
  US15/174,326
• Publication Number:
  US 20160283452A1
• Time in Patent Office: 869 Days
• Field of Search: None
• CPC Class Codes: G06F 16/25 Integrating or interfacing systems involving database management systems
• CPC Class Codes: G06F 16/9577 Optimising the visualization of content, e.g. distillation of HTML documents
• CPC Class Codes: G06F 40/143 Markup, e.g. Standard Generalized Markup Language [SGML] or Document Type Definition [DTD]
• CPC Class Codes: G06F 40/151 Transformation
• CPC Class Codes: H04L 43/04 Processing captured monitoring data, e.g. for logfile generation
• CPC Class Codes: H04L 43/08 Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
• CPC Class Codes: H04L 67/02 based on web technology, e.g. hypertext transfer protocol [HTTP]

Abstract

A method and system for modifying web pages, including dynamic web pages, based on automated analysis wherein web pages are transformed based on transformation instructions in nearly real-time, and wherein analysis is performed and transformation instructions based on the analysis are prepared prior to a request for the web page. The system has two primary components, an analyzer which asynchronously and repeatedly analyzes web pages creating and updating transformation instructions relating to the web pages, and a transformer which intercepts traffic to a web server in response to a request for the web page, receives the returned web pages, and transforms them based on stored transformation instructions.

Claims

1. Apparatus, comprising:

one or more hardware processors;

computer memory associated with the one or more hardware processors;

computer program instructions held in the computer memory and executed by the one or more hardware processors to change the content of an object, in response to a request for the document from a client, the computer program instructions comprising;

first program code operative asynchronous to, and prior to the request from the client, to analyze at least a portion of the object to identify at least a predetermined characteristic and, in response thereto, to create one or more transformation instructions corresponding to the characteristic;

second program code operative to store the one or more transformation instructions prior to the request from the client; and

third program code operative upon receipt of the request for the object to modify the object based on the one or more transformation instructions previously stored, and to return the modified object to the client in response to the request for the object;

wherein the third program code operates in a request and response processing flow between the client and an origin server that publishes the object, and the first program code operates externally to the request and response processing flow between the client and the origin server.

2. The apparatus as described in claim 1, wherein the transformation instructions are search and replace instructions.

3. The apparatus as defined in claim 1, wherein the first program code and the third program code utilize different ones of the one or more hardware processors.

4. The apparatus as defined in claim 1, wherein the first program code utilizes computer memory at a first location, and wherein the third program code utilizes local cache memory at a second location different from the first location.

5. The apparatus as described in claim 1, wherein a transformation instruction is created without knowledge of the object to be transformed.

6. The apparatus as described in claim 1, wherein the third program code operates in an edge server of a content delivery network.

7. The apparatus as described in claim 1, wherein the computer program instructions include fourth program code for storing the transformation instructions.

8. The apparatus as described in claim 1, wherein the transformation instructions are executed on hardware processors located at different locations.

9. The apparatus as described in claim 1, wherein the object is available for delivery from a content delivery network, and wherein a transformation instruction references the object.

10. The apparatus as described in claim 1, wherein the first program code monitors a repository to identify content objects from a set of content objects that include the object and that the first program code should analyze to identify the predetermined characteristic.