Method for reducing the delay between the time a data page is requested and the time the data page is displayed

• US 5,931,904 A
• Filed: 10/11/1996
• Issued: 08/03/1999
• Est. Priority Date: 10/11/1996
• Status: Expired due to Term

• Current Assignee: Rakuten, Inc. (Rakuten Group, Inc.)
• Original Assignee: AT&T Corporation (AT&T, Inc.)
• Inventors: Banga, Gaurav, Douglis, Frederick, Rabinovich, Michael, Vo, Kiem-Phong, Jagadish, Hosagrahar Visvesvaraya
• Primary Examiner(s): An, Meng-Ai T.
• Assistant Examiner(s): PATEL, GAUTAM
• Application Number:
  US08/729,105
• Time in Patent Office: 1,026 Days
• Field of Search: 375/240, 395/200.47, 395/500, 341/87, 341/55, 709/217, 709/235
• US Class Current: 709/217
• CPC Class Codes: G06F 16/957 Browsing optimisation, e.g. caching or content distillation
• CPC Class Codes: G06F 16/9574 of access to content, e.g. by caching
• CPC Class Codes: H04L 67/2876 Pairs of inter-processing entities at each side of the network, e.g. split proxies
• CPC Class Codes: H04L 67/568 Storing data temporarily at an intermediate stage, e.g. caching
• CPC Class Codes: H04L 69/329 in the application layer [OSI layer 7]
• CPC Class Codes: H04L 9/40 Network security protocols

Abstract

The apparent speed of a connection between a browser at a user station and a proxy or gateway on a network such as the Internet is increased by providing a local proxy at the user station which interacts with a remote proxy. While the remote proxy is retrieving a newly requested World Wide Web page, for example, from the appropriate content provider, it may also be sending to the local proxy a stale cached version of that page. When the new version of the page is finally retrieved, the remote proxy determines the differences between the new version and the stale version, and, assuming the differences do not exceed the new page in size, sends the differences to the local proxy which then reconstructs the new page from the differences and the stale version. The local proxy delivers the new page to the browser, which need not even be aware that a local proxy exists; it is aware only that it received the page it requested. Because computational speed and power are frequently higher and cheaper than transmission speed, the apparent speed of the connection between the user station and the network has been increased at modest cost.

Claims

1. A method for transferring and displaying data pages on a data network, said network being of a type on which data can be retrieved as pages, said network having at least one server on which said data pages are stored, a gateway connected to said at least one server, and a user station connected to said gateway by a data connection having a finite speed, said user station requesting one of said pages from said at least one server, said method comprising the steps of:

sending a request from said user station to said gateway for retrieval of said data page from one of said at least one server;

recalling a base version of said data page;

initiating, in response to a determination that said base version is not current, a retrieval of said data page from said one of said at least one server to said gateway for transfer to said user station;

determining, after receipt at said gateway of a response to said request, a difference between said requested data page and said base version of said page;

transmitting said difference to said user station;

calculating at said user station said data page as a function of said base version and said difference;

determining a measure of efficiency of said difference determining and difference transmitting step;

when said measure of efficiency indicates that sending said requested data page in its entirety from said gateway to said user station is efficient, sending said requested data page in its entirety from said gateway to said user station, and displaying said requested data page at said user station; and

when said measure of efficiency indicates that sending said requested data page in its entirety from said gateway to said user is inefficient,

displaying said calculated page at said user station;

comparing size of said difference to a minimum threshold, wherein said minimum threshold is represented by the equations;

space="preserve" listing-type="equation">T.sub.small <

D

and

space="preserve" listing-type="equation">D.sub.tot <

F(S,C,T.sub.large)

where D represents a total number of unsent bytes of said difference data, including said difference data that has been generated but not sent;

D_tot represents a total number of bytes of difference data that has been generated;

C represents a number of byte of said requested data page that has already been processed;

S represents the size of the base version of said data page;

T_small represents a minimum threshold;

T_large represent a maximum threshold; and

F is a function of S,C, and T_large ; and

if said size of said difference exceeds said minimum threshold;

aborting said recalling and transmitting steps and said step of displaying said calculated page,

sending said requested data page in its entirety from said gateway to said user station, and

displaying said requested data page at said user station.

2. The method of claim 1 wherein said gateway is said server.

3. The method of claim 1 wherein said base version of said data page is an earlier version of said data page.

4. The method of claim 1 wherein said base version of said data page share elements in common with said data page.

5. The method of claim 1 wherein said recalling step comprises:

recalling said base version of said page from storage at said gateway; and

transmitting said base version of said page from said gateway to said user station.

6. The method of claim 1 wherein said recalling step comprises:

recalling a first version of said page at said user station;

recalling a second version of said page at said gateway;

comparing said first version with said second version; and

transmitting said second version from said gateway to said user station when said second version differs from said first version.

7. The method of claim 1 wherein said step of determining a measure of efficiency comprises:

assessing, after determination of said difference, a composite transmission size representing a function of size of said difference and transmission size of any remaining amount of said base version yet to be transferred;

comparing said composite transmission size to transmission size of said requested data page; and

when said transmission size of said requested data page exceeds said composite transmission size, determining that sending said requested data page in its entirety from said gateway to said user station is inefficient, otherwise determining that sending said requested data page in its entirety from said gateway to said user station is efficient.

8. The method of claim 7 wherein each of said composite transmission size and said transmission size of said requested data page is determined based on compression prior to transmission.

9. The method of claim 7, wherein said step of determining that sending said requested data page in its entirety is inefficient includes having the requested data page be at least 120 percent of the difference data.

10. The method of claim 1 wherein said step of determining a measure of efficiency comprises:

determining, when said requested page is received at said gateway, what proportion of said base version has been transferred to said user station; and

determining, when said proportion of said base version that has been sent is above a threshold proportion, that sending said requested data page in its entirety from said gateway to said user station is inefficient, otherwise determining that sending said requested data page in its entirety from said gateway to said user station is efficient.

11. The method of claim 10 wherein said threshold proportion is dynamically determined.

12. The method of claim 11 wherein said threshold proportion is determined based on said finite speed.

13. The method of claim 10, wherein said threshold proportion of said base version that has been sent is at least 40 percent of said base version.

14. The method of claim 1 wherein said step of determining a measure of efficiency comprises:

determining, when said requested page is received at said gateway, what proportion of said base version has been transferred to said user station; and

determining, when said proportion of said base version that has been sent is above a threshold proportion, that sending said requested data page in its entirety from said gateway to said user station is inefficient, otherwise;

assessing, after determination of said difference, a composite transmission size representing a function of size of said difference and size of any remaining amount of said base version yet to be transferred;

comparing said composite transmission size to transmission size of said requested data page; and

when said transmission size of said requested data page exceeds said composite transmission size, determining that sending said requested data page in its entirety from said gateway to said user station is inefficient, otherwise determining that sending said requested data page in its entirety from said gateway to said user station is efficient.

15. The method of claim 14 wherein each of said composite transmission size and said transmission size of said requested data page is determined based on compression prior to transmission.

16. The method of claim 14 wherein said threshold proportion is dynamically determined.

17. The method of claim 16 wherein said threshold proportion is determined based on said finite speed.

18. The method of claim 1 wherein said threshold is dynamically determined.

19. The method of claim 18 wherein said threshold is determined based on said finite speed.

20. The method of claim 1 wherein said determining step comprises:

awaiting completion of said retrieval of said data page from said one of said at least one server; and

comparing said complete retrieved data page to said base version of said page.

21. The method according to claim 1 wherein said difference data will not be sent is represented by the equation:

space="preserve" listing-type="equation">D<

T.sub.small

and said difference data accumulated will be held until additional difference data has been calculated.

22. The method according to claim 1 wherein said difference data aborted is represented by the equation:

space="preserve" listing-type="equation">D.sub.tot ≧

F(S,C,T.sub.large).

23.

23. A method for transferring and displaying data pages on a data network, said network being of a type on which data can be retrieved as pages, said network having at least one server on which said data pages are stored, a gateway connected to said at least one server, and a user station connected to said gateway by a data connection having a finite speed, said user station requesting one of said pages from said at least one server, said method comprising the steps of:

sending a request from said user station to said gateway for retrieval of said data page from one of said at least one server;

recalling a base version of said data page;

initiating, in response to a determination that said base version is not current, a retrieval of said data page from said one of said at least one server to said gateway for transfer to said user station;

determining, after receipt at said gateway of a response to said request, a difference between said requested data page and said base version of said page, wherein said determining step further includes the steps of;

awaiting completion of retrieval of a predetermined portion of said data page from said one of said at least one server;

comparing said retrieved predetermined portion of said data page to said base version of said data page;

generating a partial difference between said data page and said base version of said data page, wherein said generating step includes the steps of;

comparing transmission size of said partial difference to a minimum threshold wherein said comparing step is represented by the equations;

space="preserve" listing-type="equation">T.sub.small <

D

and

space="preserve" listing-type="equation">D.sub.tot <

F(S,C,T.sub.large)

where D represents a total number of unsent bytes of said difference data, including said difference data that has been generated by not sent;

D_tot represents a total number of bytes of difference data that has been generated;

C represents a number of byte of said requested data page that has already been processed;

S represents the size of the base version of said data page;

T_small represents a minimum threshold;

T_large represent a maximum threshold; and

F is a function of S,C, and T_large ;

transmitting said partial difference to said user station when said transmission size of said partial difference exceeds said minimum threshold; and

when said transmission size of said partial difference is less than said minimum threshold;

comparing at least one additional retrieved predetermined portion of said data page to a base version of said data page to generate at least one additional partial difference between said data page and said base version of said data page;

adding transmission size of said at least one additional partial difference to transmission size of said held partial difference until a sum of said transmission sizes exceeds said minimum threshold; and

transmitting said held partial difference and said at least one additional partial difference to said user station; and

repeating said awaiting and comparing step for additional predetermined portions of said data page;

transmitting said difference to said user station;

calculating at said user station said data page as a function of said base version and said difference; and

displaying said calculated page at said user station.

24. The method of claim 23 further comprising, on generation of said partial difference:

comparing transmission size of said partial difference to a minimum threshold;

transmitting said partial difference to said user station when said transmission size of said partial difference exceeds said minimum threshold; and

when said transmission size of said partial difference is less than said minimum threshold;

holding said partial difference,

comparing at least one additional retrieved predetermined portion of said data page to a said base version of said data page to generate at least one additional partial difference between said data page and said base version of said data page,

adding transmission size of said at least one additional partial difference to transmission size of said held partial difference until a sum of said transmission sizes exceeds said minimum threshold, and

transmitting said held partial difference and said at least one additional partial difference to said user station.

25. The method of claim 24 wherein each of said transmission size of said partial difference and said transmission size of said at least one additional partial difference is determined based on compression prior to transmission.

26. The method of claim 23 further comprising:

determining a transmission size of each partial difference;

on transmission of each said partial difference to said user station, adding said transmission size of said partial difference to a cumulative transmission size of partial differences transmitted to said user station;

comparing said cumulative transmission size to a maximum threshold; and

when said cumulative transmission size exceeds said maximum threshold, aborting said determining step and relaying said data page to said user station.

27. The method of claim 26 wherein each of said transmission size of said partial difference and said transmission size of said at least one additional partial difference is determined based on compression prior to transmission.

28. The method of claim 23 further comprising:

determining a measure of efficiency of said difference determining and calculating step and said difference transmitting step; and

when said measure of efficiency indicates that sending said requested data page in its entirety from said gateway to said user station is efficient;

aborting said recalling and transmitting steps and said step of displaying said calculated page,

sending said requested data page in its entirety from said gateway to said user station, and

displaying said requested data page at said user station.

29. The method of claim 28 wherein said step of determining a measure of efficiency comprises:

assessing, after determination of said size of said partial difference, a composite transmission size representing a function of size of said partial difference and size of any remaining amount of said base version yet to be transferred;

comparing said composite transmission size to transmission size of said requested data page; and

when said transmission size of said requested data page exceeds said composite transmission size, determining that sending said requested data page in its entirety from said gateway to said user station is inefficient, otherwise determining that sending said requested data page in its entirety from said gateway to said user station is efficient.

30. The method of claim 29 wherein said assessing step comprises estimating from said size of said partial difference a total size for data representing a difference between said data page and said base version of said data page.

31. The method of claim 29 wherein each of said composite transmission size and said transmission size of said requested data page is determined based on compression prior to transmission.