Method and system for differencing container files

• US 6,148,340 A
• Filed: 04/30/1998
• Issued: 11/14/2000
• Est. Priority Date: 04/30/1998
• Status: Expired due to Fees

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Wang, Steve, Bittinger, Reed, Brubaker, Nils C., Housel, Barron Cornelius III
• Primary Examiner(s): Matar, Ahmad F.
• Assistant Examiner(s): DINH, KHANH Q
• Application Number:
  US09/070,513
• Time in Patent Office: 929 Days
• Field of Search: 709/203, 709/224, 709/226, 709/225, 709/207, 709/208
• US Class Current: 709/224
• CPC Class Codes: H04L 67/06 specially adapted for file transfer, e.g. file transfer protocol [FTP]
• CPC Class Codes: H04L 67/34 involving the movement of software or configuration parameters network booting or remote initial program loading [RIPL] G06F9/4416
• CPC Class Codes: H04L 67/564 Enhancement of application control based on intercepted application data
• CPC Class Codes: H04L 67/5651 Reducing the amount or size of exchanged application data
• CPC Class Codes: H04L 67/568 Storing data temporarily at an intermediate stage, e.g. caching
• CPC Class Codes: H04L 69/22 Parsing or analysis of headers
• CPC Class Codes: H04L 69/329 in the application layer [OSI layer 7]

Abstract

A method and system for efficiently updating container objects on remote systems. The method and system involve a server extension which determines whether the files within the container object have changed since the last time they were sent to the client. If they have changed, the server extension sends only the changed files with instructions on how to reconstruct the container object to a client extension. The client extension receives the changes and the instructions and reconstitutes the container object and transmits the container object to the client browser.

Claims

1. In a computer system having a client connected to at least one server over a communications mechanism, said client having a client extension associated therewith and said at least one server having a server extension associated therewith, said client and said server utilizing containers for the transmission of information, each container having one or more objects, said objects having associated lengths and CRCs, said objects also having header and contents portions, a method for reducing the amount of information sent from said server to said client in said communications system, said method comprising:

requesting, by a browser at said client, a URL (Uniform Resource Locator), said URL comprising the name of a container file;

passing said request from said browser at said client to said client extension;

recognizing, by said client extension, said requested name of said container file as one that had been previously cached;

passing said request for said named container from said client to said server extension, said passed request including a unique identifier (such as a CRC) of the previously cached container having the requested name;

receiving, by the server extension, the request for said named container;

passing, by said server extension, said request for said named container to said web server indicated in said URL;

receiving a response, at said server extension, from said web server;

if said response indicates that a new version of the named container file exists then;

creating a catalog, at said server extension, from said new version of said named container file;

computing a unique identifier for said named container file;

adding said catalog and said unique identifiers for said catalog to a catalog list at said server;

searching said catalog list for a catalog whose unique identifier matches the unique identifier of said passed request received from said client;

creating a difference file between the matched catalog and the catalog of the new version of said named container file if a match is found and sending said difference file to said client extension; and

,

sending the new version of said named container file to said client if no match is found.

2. A method as claimed in claim 1 wherein said difference file is created by comparing, for each object within the container to be transmitted, the length and the CRC in the matched catalog with the length and CRC in the catalog of the new version of said named container, if either the length or the CRC are different or non-existent then the object is added to the difference file with an associated INSERT command, if neither the length nor the CRC are different then a COPY command is inserted into the difference file.

3. A method as claimed in either of claims 1 or 2 wherein said difference file is created by comparing, for each object within the container to be transmitted, first the length and the CRC of the object contents in the matched catalog with the length and CRC of the object contents in the catalog of the new version of said named container, if either the length or the CRC are different or non-existent then the object is added to the difference file with an associated INSERT command, if neither the length nor the CRC are different then the CRC of the object header in the matched catalog is compared with the CRC of the object header in the new version, if the CRCs are different then an INSERT command is inserted into the difference file for the object header and a COPY command is inserted into the difference file for the object contents, if the CRCs for the object header are not different, then a COPY command is inserted into the difference file.

4. A method as claimed in claim 1 or 2 wherein said container is discarded from the memory of said server after the difference file is sent to the client.

5. In a computer system having a client connected to at least one server over a communications mechanism, said client having a client extension associated therewith and said at least one server having a server extension associated therewith, said client and said server utilizing containers for the transmission of information, each container having one or more objects, said objects having associated lengths and CRCs, said objects also having associated header and contents portions, an apparatus for reducing the amount of information sent from said server to said client in said communications system, said apparatus comprising:

means for requesting, by a browser at said client, a URL, said URL having the name of a container file;

means for passing said request from said browser at said client to said client extension;

means for recognizing, by said client extension, said requested name of said container file as one that had been previously cached by said client;

means for passing said request for said named container from said client to said server extension, said passed request including a unique identifier (such as a CRC) of the previously cached container having the requested name;

means for receiving, by the server extension, the request for said named container;

means for passing, by said server extension, said request for said named container to said web server indicated in said URL;

means for receiving a response, at said server extension, from said web server;

if said response indicates that a new version of the named container file exists then;

means for creating a catalog, at said server extension, from said new version of said named container file;

means for computing a unique identifier for said named container file;

means for adding said catalog and said unique identifier to a catalog list at said server;

means for searching said catalog list for a catalog whose unique identifier matches the unique identifier of said passed request received from said client;

means for creating a difference file between the matched catalog and the catalog of the new version of said named container file if a match is found and means for sending said difference file to said client extension; and

,

means for sending the new version of said named container file to said client if no match is found.

6. An apparatus as claimed in claim 5 wherein said difference file is created by comparing, for each object within the container to be transmitted, the length and the CRC in the matched catalog with the length and CRC in the catalog of the new version of said named container, if either the length or the CRC are different or non-existent then the object is added to the difference file with an associated INSERT command, if neither the length nor the CRC are different then a COPY command is inserted into the difference file.

7. An apparatus as claimed in claim 5 or 6 wherein said difference file is created by comparing, for each object within the container to be transmitted, first the length and the CRC of the object contents in the matched catalog with the length and CRC of the object contents in the catalog of the new version of said named container, if either the length or the CRC are different or non-existent then the object is added to the difference file with an associated INSERT command, if neither the length nor the CRC are different then the CRC of the object header in the matched catalog is compared with the CRC of the object header in the new version, if the CRCs are different then an INSERT command is inserted into the difference file for the object header and a COPY command is inserted into the difference file for the object contents, if the CRCs for the object header are not different, then a COPY command is inserted into the difference file.

8. An apparatus as claimed in claim 5 or 6 wherein said container is discarded from the memory of said server after the difference file is sent to the client.

9. A computer program product for reducing the amount of information sent from a server extension to a client extension in a communications system, said client extension having at least one client associated therewith and said server extension having at least one server associated therewith, said client and said server utilizing containers for the transmission of information, each container having one or more objects, said objects having associated lengths and CRCs, said objects also having associated header and contents portions, the computer program product comprising:

a computer-readable program code means embodied in a computer-readable storage medium, said computer readable program code means comprising;

computer readable program code means for requesting, by a browser at said client, a URL, said URL comprising the name of a container file;

computer readable program code means for passing said request from said browser at said client to said client extension;

computer readable program code means for recognizing, by said client extension, said requested name of said container file as one that had been previously cached by said client;

computer readable program code means for passing said request for said named container from said client extension to said server extension, said passed request including a unique identifier (such as a CRC) of the previously cached container having the requested name;

computer readable program code means for receiving, by the server, the request for said named container;

computer readable program code means for passing, by said server extension, said request for said named container to said web server indicated in said URL;

computer readable program code means for receiving a response, at said server, from said web server;

if said response indicates that a new version of the named container file exists then;

computer readable program code means for creating a catalog, at said server, from said new version of said named container file;

computer readable program code means for computing a unique identifier for said named container file;

computer readable program code means for adding said catalog and said unique identifier to a catalog list at said server;

computer readable program code means for searching said catalog list for a catalog whose unique identifier matches the unique identifier of said passed request received from said client extension;

computer readable program code means for creating a difference file between the matched catalog and the catalog of the new version of said named container file if a match is found and sending said difference file to said client extension; and

,

computer readable program code means for sending the new version of said named container file to said client if no match is found.

10. A program product as claimed in claim 9 wherein said difference file is created by comparing, for each object within the container to be transmitted, the length and the CRC in the matched catalog with the length and CRC in the catalog of the new version of said named container, if either the length or the CRC are different or non-existent then the object is added to the difference file with an associated INSERT command, if neither the length nor the CRC are different then a COPY command is inserted into the difference file.

11. A program product as claimed in claim 9 or 10 wherein said difference file is created by comparing, for each object within the container to be transmitted, first the length and the CRC of the object contents in the matched catalog with the length and CRC of the object contents in the catalog of the new version of said named container, if either the length or the CRC are different or non-existent then the object is added to the difference file with an associated INSERT command, if neither the length nor the CRC are different then the CRC of the object header in the matched catalog is compared with the CRC of the object header in the new version, if the CRCs are different then an INSERT command is inserted into the difference file for the object header and a COPY command is inserted into the difference file for the object contents, if the CRCs for the object header are not different, then a COPY command is inserted into the difference file.

12. A program product as claimed in claim 9 or 10 wherein said container is discarded from the memory of said server after the difference file is sent to the client.