Accelerating responses to requests made by users to an internet

• US 7,082,456 B2
• Filed: 03/04/2001
• Issued: 07/25/2006
• Est. Priority Date: 03/17/2000
• Status: Expired due to Fees

• Current Assignee: International Business Machines Corporation
• Original Assignee: Filesx Limited (International Business Machines Corporation)
• Inventors: Mani-Meitav, Irit, Sarfati, Assaf
• Primary Examiner(s): Maung, Zarni
• Assistant Examiner(s): MADAMBA, GLENFORD J
• Application Number:
  US10/221,882
• Publication Number:
  US 20030050974A1
• Time in Patent Office: 1,969 Days
• Field of Search: 709/203
• US Class Current: 709/203
• CPC Class Codes: G06F 16/9574 of access to content, e.g. by caching
• CPC Class Codes: H04L 67/01 Protocols
• CPC Class Codes: H04L 67/02 based on web technology, e.g. hypertext transfer protocol [HTTP]
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]

Abstract

Method and system are disclosed for accelerating a response to a request made by a user of an Internet (1) coupled to a server (2), which is coupled to a shared storage (5). Preferably, an object response accelerator (4), or ORA, is inserted between the Internet and the server, and the ORA is coupled by at least one direct access communication link (DACL) to the shared storage.

A request from a user to the server is forwarded to the ORA for detection of a condition, on the request. The request is processed locally by the ORA in presence of the condition, but returned to the server in absence thereof. Local processing calls for the ORA to access the shared storage via the DACL and to retrieve the response therefrom. A response to the user is returned via the ORA, both when processed locally or by the server.

Claims

1. An acceleration method for accelerating a response to a user request received from a user coupled by an Internet to a server, the server being coupled to a data storage facility for returning the response fetched therefrom to the user, the acceleration method comprising the steps of:

coupling an object response accelerator (ORA) to the Internet,

coupling at least one direct access communication link from the ORA to the data storage facility, and

bypassing the server through the at least one direct access communication link for accelerated access to the data storage facility and for accelerated return of the response to the user,

wherein the ORA relieves processing load from the server.

2. The acceleration method according to claim 1, further comprising the step of:

operating a mechanism on the user request for detecting a capacity for retrieval of the response from the data storage facility through the at least one direct access communication link.

3. The acceleration method according to claim 2, further comprising the steps of:

retrieving the response for return to the user from the data storage facility through the at least one direct access communication link, when the capacity is detected, and

retrieving the response for return to the user from the server, upon failure to detect the capacity.

4. The acceleration method according to claim 1, further comprising the steps of:

inserting the ORA between the Internet and the server,

coupling the ORA to the server,

receiving each request from each user for the purpose of making a response-routing decision, and

analyzing the request to determine whether the response to the request may be obtained via either the ORA and directly from the shared storage or must be processed by the server.

5. The acceleration method according to claim 4, wherein analyzing the request further comprising the steps of:

detecting presence, on the user request, of at least one condition for retrieval of a response object from the data storage facility through the at least one direct access communication link,

bypassing the server through the at least one direct access communication link in presence of the at least one condition, for accelerating access to the data storage facility and for accelerating return of the response object retrieved therefrom, and

forwarding the user request to the server, for the server to return the response object to the user in absence of the at least one condition.

6. The acceleration method according to claim 5, further comprising the steps of:

establishing an ORA bypass for linking of the Internet directly to the server, and

operating a software-sensor for detecting normal operation of the ORA, the software-sensor commanding bypass of the ORA through the ORA bypass upon detection of absence of normal operation of the ORA.

7. The acceleration method according to claim 5, wherein detecting presence of at least one condition comprises the steps of:

detecting adequacy of type of the user request, and

detecting representation of the response object in the ORA.

8. The acceleration method according to claim 5, wherein the ORA comprises:

a Network Communication Subsystem (NECS) coupled to the Internet, the NECS for receiving user requests and for returning responses to the user(s),

a Server Communication Subsystem (SCS) coupled to the server and to the NECS, the SCS for transmitting user requests to and for receiving responses from the server,

a Shared Storage Interface Subsystem (SSIS) linked to the NECS and coupled by the direct access communication link to the data storage facility, the SSIS for providing accelerated access to and accelerated retrieval from the data storage facility, and

a Request Router (RQR) coupled to the NECS, to the SCS and to the SSIS, the RQR for forwarding the user request for retrieval of the response,

i) from the data storage facility, through the SSIS and the direct access communication link, in presence of the at least one condition, and

ii) from the server through the SCS and the NECS, in absence of the at least one condition, for the ORA and the server to access the data storage facility concurrently.

9. The acceleration method according to claim 8, further comprising the steps of:

at the NECS;

fetching, parsing and analyzing an incoming user request, and

forwarding the parsed user request to the RQR, and at the RQR;

searching the parsed user request to detect presence of the at least one condition, further comprising the steps of;

detecting presence of the at least one condition and forwarding the user request for retrieval of the response thereto from the data storage facility through the direct access link and through the SSIS, and

detecting absence of the at least one condition and forwarding the user request to the server through the SCS.

10. The acceleration method according to claim 9, wherein forwarding the user request in absence of the at least one condition comprises the steps of:

at the SCS;

receiving the parsed user requests forwarded by the RQR, rebuilding the user requests, and sending user requests to the server, and

returning server responses through the SCS and the NECS to the user.

11. The acceleration method according to claim 8, wherein the SSIS comprises:

a metadata table coupled to the RQR, the metadata table for containing information representative of objects saved in the data storage facility,

an update engine coupled to the metadata table for building and for updating the metadata table,

a retrieval request generator for accessing objects in the data storage facility, the retrieval request generator being coupled to the metadata table,

a storage response receiver for receiving objects from the data storage facility, the storage response receiver being coupled to the NECS, and

a data storage interface for sending objects to and for receiving objects from the data storage facility, the data storage interface being coupled to the update engine, to the retrieval request generator, to the storage response receiver and to the data storage facility.

12. The acceleration method according to claim 9, wherein operation of the RQR further comprises the steps of:

extracting an object name from a parsed user request,

detecting adequacy of type of the object name,

searching the metadata table for the extracted object name, the search comprising;

accepting the at least one condition as present when the extracted object name is found in the metadata table, and

regarding the at least one condition as absent upon failure to find the extracted object name in the metadata table.

13. The acceleration method according to claim 8, wherein accelerated access to the data storage facility via the SSIS comprises the steps of:

building the metadata table by first translating the name of an object contained in a user request into a unique signature and relating the unique signature to a physical location of the object in the data storage facility,

deriving a signature from the object name in the user request, and

searching, the metadata table to find the unique signature listed therein to derive therefrom the related physical location of the requested object and gaining direct access thereto for responding to the user request.

14. The acceleration method according to claim 11, wherein operation of the metadata table comprises the steps of:

starting, on power-on of the ORA,

building the metadata table by running the update engine,

updating the metadata table by running the update engine in repeated update cycles, and

ending operation, on intentional or unintentional shut-down of the ORA.

15. The acceleration method according to claim 14, further comprising the steps of:

building the metadata table by running the update engine for an initial scanning of the contents of the data storage facility to retrieve metadata indicative of objects residing therein, and for saving retrieved metadata in the metadata table,

updating the metadata table by running an update scanning to detect and to retrieve metadata indicative of change in the contents of the data storage facility and for saving retrieved metadata in the metadata table, and

repeating the update scanning to update the metadata table at intervals.

16. The acceleration method according to claim 15, wherein building of the metadata table further comprises the step of:

accepting user requests during initial scanning,

accessing the metadata table concurrently with the initial scanning, and

detecting the at least one condition at rate of success correlative with progress of the initial scanning.

17. The method according to claim 8, wherein returning to the user(s) responses to requests further comprises the steps of:

receiving responses from the server and from the direct access communication link,

determining a dynamic threshold as a limit to memory resources allocated to store the responses received before sequential return thereof to the users, the dynamic threshold limit being determined in correspondence with total memory resources available, with the number of active connections and with the throughput capabilities thereof,

accepting user requests when the limit is respected, and

suspending acceptance of user requests when the limit is exceeded, acceptance being resumed upon return of the threshold to below the limit.

18. The acceleration method according to claim 15, further comprising the step of:

defining a predetermined group of data objects as a selected group, and

building and updating the metadata table in association restricted to metadata of the selected group, to further increase speed of response of the ORA.

19. The acceleration method according to claim 15, wherein updating of the metadata table further comprises the step of:

saving contents of the metadata table in non-volatile memory at the end of each update-scanning run.

20. The acceleration method according to claim 19, wherein operation of the metadata table further comprising the steps of:

building the metadata table initially by downloading last saved contents from the non-volatile memory to the metadata table, and

updating the metadata table by running an update scanning to detect and to retrieve metadata indicative of change in the contents of the data storage facility, and saving retrieved metadata in the metadata table.

21. The acceleration method according to claim 15, wherein repeating the update scanning further comprises the step of:

repeating the update scanning at intervals of predetermined duration.

22. The acceleration method according to claim 21, wherein repeating the update scanning further comprises the steps of:

sensing a load of user requests, and

repeating the update scanning at intervals correlated to the load sensed.

23. The acceleration method according to claim 22, wherein repeating the update scanning further comprises the steps of:

sensing a load of user requests on the RQR, and

repeating the update scanning at interval duration defined in operative association with the load sensed on the RQR.

24. The acceleration method according to claim 22, wherein repeating the update scanning further comprises the steps of:

running a first background computer program on the server for sensing a load of user requests,

sensing the load of user requests on the server and notifying the ORA thereof through the SCS, and

repeating the update scanning at interval duration defined in operative association with the load sensed on the server.

25. The acceleration method according to claim 22, further comprising the steps of:

running a second background computer program on the server to detect a server-initiated change to objects in the data storage facility, and when change is detected, sending a signal to the ORA through the SCS, and

repeating the update scanning in operative association with the signal from the second background computer program.

26. A system for accelerating a response to a user request received from a user coupled by an Internet to a server, the server being coupled to a data storage facility for returning the response fetched therefrom to the user, the system comprising:

an object response accelerator (ORA) coupled to the Internet,

at least one direct access communication link coupling the ORA to the data storage facility, the at least one direct access communication link bypassing the server for accelerated access to the data storage facility and for accelerated return of the response to the user,

wherein the ORA relieves processing load from the server.

27. The system according to claim 26, further comprising:

a mechanism operating on the user request for detection of a capacity to retrieve the response from the data storage facility through the at least one direct access communication link.

28. The system according to claim 27, wherein:

the response to the user request is returned to the user through the at least one direct access communication link, when the mechanism detects the capacity, and

the response to the user request is returned to the user through the server, upon failure of the mechanism to detect the capacity.

29. The system according to claim 26, wherein the analysis further comprises:

the ORA being inserted between the Internet and the server, and being coupled to the server, to receive each request from each user for the purpose of making a response-retrieval decision, and

the user request is analyzed to determine whether the response to the request may be obtained via the ORA and directly from the shared storage or must be processed by the server.

30. The system according to claim 29, the further comprising:

a mechanism for detecting presence on the user request of at least one condition necessary to retrieve the response object from the data storage facility through the at least one direct access communication link, the response to the user request being returned through the at least one communication link in bypass of the server when the at least one condition is detected present, and

the user request being forwarded to the server for return therefrom to the user, when the at least one condition is detected absent.

31. The system according to claim 30, further comprising:

an ORA bypass for direct linking of the Internet to the Server, and

a software-sensor for detecting normal operation of the ORA, the software- sensor commanding bypass of the ORA through the ORA-bypass upon detection of absence of normal operation of the ORA.

32. The system according to claim 30, wherein detecting presence of at one least one condition comprises:

a type decision filter applied to the user request for detecting presence of a first condition out of the at least one condition, the first condition being indicative of adequacy of type of the user request,

a presence decision filter applied to the user request for detecting presence of a second condition out of the at least one condition, the presence filter for detecting representation of the response object in the ORA.

33. The system according to claim 30, wherein the ORA comprises:

a Network Communication Subsystem (NECS) coupled to the Internet, the NECS for receiving user requests and for returning responses to the user(s),

a Server Communication Subsystem (SCS) coupled to the server and to the NECS, the SCS for transmitting user requests to and for receiving responses from the server,

a Shared Storage Interface Subsystem (SSIS) linked to the NECS and coupled by the direct access communication link to the data storage facility, the SSIS for providing accelerated access to and accelerated retrieval from the data storage facility, and

a Request Router (RQR) coupled to the NECS, to the SCS and to the SSIS, the RQR for forwarding the user request for retrieval of the response,

i) from the data storage facility, through the SSIS and the direct access communication link, in presence of the at least one condition, and

ii) from the server through the SCS and the NECS, in absence of the at least one condition, for the ORA and the server to access the data storage facility concurrently.

34. The system according to claim 33, wherein the NECS further comprises:

an analysis mechanism for fetching, parsing and analyzing an incoming user request, and for forwarding the parsed user request to the RQR, and

the RQR further comprises;

a query mechanism for searching the parsed user request to detect presence of the at least one condition, the query mechanism forwarding the user request to the data storage facility for retrieval of the response therefrom through the direct access link and through the SSIS when detecting presence of the at least one condition, and the query mechanism forwarding the user request to the server through the SCS when detecting absence of the at least one condition.

35. The system according to claim 33, wherein forwarding the user request further comprises:

at the SCS;

receiving the parsed user requests from the RQR in absence of the at least one condition, rebuilding the user requests, and sending the users requests to the server, and

returning server responses to the user through the SCS and the NECS.

36. The system according to claim 33, wherein the SSIS comprises:

a metadata table coupled to the RQR, the metadata table for containing information representative of objects saved in the data storage facility,

an update engine coupled to the metadata table, the update engine for building and for maintaining the metadata table updated,

a retrieval request generator for accessing objects in the data storage facility, the retrieval request generator being coupled to the metadata table,

a storage response receiver for receiving objects from the data storage facility, the storage response receiver being coupled to the NECS, and

a data storage interface for sending objects to and for receiving objects from the data storage facility, the data storage interface being coupled to the update engine, to the retrieval request generator, to the storage response receiver and to the data storage facility.

37. The system according to claim 34, wherein operation of the RQR further comprises:

an extraction mechanism for extracting an object name from the parsed user request,

a type-adequacy mechanism for detecting adequacy of type of the object name,

a search mechanism for searching the metadata table for the extracted object name, the search mechanism comprising;

an acceptance mechanism for accepting the condition as present when the extracted object name is found in the metadata table, and

a rejection mechanism for regarding the condition as absent upon failure to find the object name in the metadata table.

38. The system according to claim 33, wherein accelerated access to the data storage facility via the retrieval request generator comprises:

a first procedure operated by the update engine for building the metadata table, the first procedure for translation of the name of an object into a unique signature and for relating the signature to a physical location of the object in the data storage facility,

a derivation mechanism for deriving a signature from the object name in the user request, and

a second procedure operated by the RQR for responding to a user request, the second procedure for searching the unique signature listed in the metadata table to derive therefrom the related physical location of the requested object and gaining direct access thereto.

39. The system according to claim 36, wherein operation of the metadata table comprises:

a sequence for starting the ORA on power-on, for initializing building of the metadata table by help of the update engine, for updating the metadata table in repeated update cycles, and for ending operation, on intentional or unintentional shut-down of the ORA.

40. The system according to claim 39, further comprising:

an initial scanning for scanning the contents of the data storage facility to retrieve therefrom metadata indicative of objects residing therein, the metadata being used for building of the metadata table, and

an update scanning for scanning the contents of the data storage facility to detect therein and to retrieve therefrom metadata indicative of change in the contents of the data storage facility, the update scanning being repeated for updating the metadata table repetitively at intervals.

41. The system according to claim 40, wherein the initial scanning further comprises:

accepting user requests during initial scanning,

accessing the metadata table concurrently with the initial scanning, and

a hit/miss mechanism for detecting presence of the at least one condition, the hit/miss mechanism scoring increased success hits correlative with progress of the initial scanning.

42. The system according to claim 33, wherein returning to the user(s) responses to requests further comprises:

a dynamic threshold determining a limit to memory resources allocated to store responses received from the server and from the direct access communication link, responses being stored for sequential return thereof to the users, the dynamic threshold limit being determined in correspondence with total memory resources available, with the number of active connections and with the throughput capabilities thereof, wherein the user requests are accepted when the limit is respected, and wherein acceptance of user requests is suspended when the limit is exceeded, acceptance being resumed upon return of the threshold to below the limit.

43. The system according to claim 38, wherein

a predetermined group of data objects is defined as a selected group, and

the metadata table is built and updated in association restricted to metadata of the selected group, for further increase of response speed of the ORA.

44. The system according to claim 38, wherein

a non-volatile memory is used to store therein contents of the metadata table saved at the end of each update scanning.

45. The system according to claim 44, wherein

the metadata table is built by retrieving from the non-volatile memory contents of the metadata table last saved therein, and

the metadata table is updated by running the update scanning to detect and to retrieve metadata indicative of change in the contents of the data storage facility, and saving retrieved metadata in the metadata table.

46. The acceleration method according to claim 40, wherein

the update scanning is repeated at intervals of predetermined duration.

47. The system according to claim 46, wherein

a first sensor is configured to sense a load of user requests, and

the update scanning is repeated at intervals correlated to the load sensed.

48. The system according to claim 47, wherein

a second sensor is configured to sense a load of user requests on the RQR, and

the update scanning is repeated at interval duration defined in operative association with the load sensed on the RQR.

49. The system according to claim 47, wherein:

a first background computer program is run on the server for sensing a load of user requests thereon, and the ORA is notified through the SCS of the load of user requests sensed on the server, and

the update scanning is repeated at interval duration defined in operative association with the server.

50. The system according to claim 47, further comprising:

a second background computer program running on the server to detect a server-initiated change to objects residing in the data storage facility, and when change is detected, sending a signal to the ORA through the SCS, and the update scanning is repeated in operative association with the signal from the second background computer program.

51. The acceleration system according to claim 26, wherein the ORA comprises at least:

a processor, a memory, a plurality of communication adapters for internet and data storage facility access, and

a real time operating system and software application computer programs for execution of the operation of the ORA.