Method and system for coherently caching I/O devices across a network

• US 5,918,244 A
• Filed: 05/31/1996
• Issued: 06/29/1999
• Est. Priority Date: 05/06/1994
• Status: Expired due to Term

• Current Assignee: SuperSpeed LLC
• Original Assignee: EEC Systems Inc.
• Inventors: Percival, James I
• Primary Examiner(s): BRAGDON, REGINALD GLENWOOD
• Application Number:
  US08/657,777
• Time in Patent Office: 1,124 Days
• Field of Search: 395/440, 395/446, 395/456, 395/462, 395/473, 395/200.02, 395/200.07, 395/200.09, 395/200.1, 395/200.11, 395/200.12, 395/830, 395/838, 395/876 , 395/681, 395/200.47, 395/200.48, 395/200.34, 395/200.52, 395/200.51, 395/200.5
• US Class Current: 711/119
• CPC Class Codes: G06F 12/0813 with a network or matrix configuration
• CPC Class Codes: G06F 12/0815 Cache consistency protocols
• CPC Class Codes: G06F 12/0837 with software control, e.g. non-cacheable data
• CPC Class Codes: G06F 12/0866 for peripheral storage systems, e.g. disk cache
• CPC Class Codes: G06F 12/123 with age lists, e.g. queue, most recently used [MRU] list or least recently used [LRU] list
• CPC Class Codes: G06F 2212/311 In host system

Abstract

The cache keeps regularly accessed disk I/O data within RAM that forms part of a computer systems main memory. The cache operates across a network of computers systems, maintaining cache coherency for the disk I/O devices that are shared by the multiple computer systems within that network. Read access for disk I/O data that is contained within the RAM is returned much faster than would occur if the disk I/O device was accessed directly. The data is held in one of three areas of the RAM for the cache, dependent on the size of the I/O access. The total RAM containing the three areas for the cache does not occupy a fixed amount of a computers main memory. The RAM for the cache grows to contain more disk I/O data on demand and shrinks when more of the main memory is required by the computer system for other uses. The user of the cache is allowed to specify which size of I/O access is allocated to the three areas for the RAM, along with a limit for the total amount of main memory that will be used by the cache at any one time.

Claims

1. A caching system comprising:

a network;

a plurality of computers interacting as a VMScluster on said network, each computer having a memory;

a plurality of I/O devices connected to said network;

a plurality of cache drivers, each resident in one of said computers, for creating a cache in the memory of the computer in which the cache driver resides for caching data from selected ones of said I/O devices, each cache driver including executable remote messaging code that forms a computer communication channel with a cache driver on any of said computers for sending messages relating to caching and means for listening on said network for a request from a new computer to connect to said network, said executable remote messaging code further saving a remote connection address for each of the communication channels.

2. A caching system of claim 1 wherein said plurality of computers further includes a plurality of computers interacting as a VAXcluster.

3. The catching system of claim 1 wherein each of said cache drivers further comprises means for invalidating all data in the cache of the computer in which said cache driver resides when a new computer connects to said network.

4. The caching system of claim 1 wherein for each cache driver, said executable remote messaging code further includes means for allocating extra message buffers for newly created computer communication channels.

5. The caching system of claim 1 wherein each of said cache drivers further comprises means for initiating a timing delay after a new computer connects to said network and means for comparing a count of the number of computers on the network with a count of the number of computer communication channels that have been formed by said cache driver so that caching is only reinitiated when said counts are equal.

6. The caching system of claim 1 wherein each of said cache drivers further includes means for intercepting a write instruction to one of said plurality of I/O devices from the computer on which said cache driver resides and means for using said executable remote messaging code to invalidate data in the caches of any computer that is caching said one of said plurality of I/O devices.

7. The caching system of claim 1 wherein each of said cache drivers further includes means for intercepting a read instruction to one of said plurality of I/O devices from the computer on which said cache driver resides and for reading data from the cache when the read instruction relates to addresses corresponding to data in the cache.

8. The caching system of claim 7 wherein each of said cache drivers further includes means for writing data into the cache when the read instruction relates to addresses that do not correspond to any data in the cache.

9. The caching system of claim 1 wherein each of said cache drivers creates a plurality of caches in the memory of the computer in which said cache driver resides, each of said caches including a plurality of data buckets and data structures for identifying the data buckets.

10. The caching system of claim 9 wherein the plurality of caches created by each cache driver includes a first cache having data structures for first sized data buckets and a second cache having data structures for second sized data buckets larger in size than said first sized buckets.

11. The caching system of claim 9 wherein each cache includes a plurality of queues in which the data structures for identifying the data buckets are listed.

12. The caching system of claim 1 wherein each of said computers runs an operating system and each of said cache drivers allocate to the cache, space in the memory of the computer in which the cache driver resides, when creating the cache.

13. The caching system of claim 12 wherein each of said cache drivers further comprises a system memory check that checks on how much of the memory of the computer is available to the operating system.

14. The caching system of claim 13 wherein each of said cache drivers further comprises means for releasing space in the memory of the computer in which the cache driver resides from the cache back to the operating system in response to a determination by the system memory check of said cache driver that the operating system has insufficient memory available.

15. A caching system comprising:

a network;

a plurality of computers connected over said network, each computer having a memory;

a plurality of I/O devices connected to said network; and

a plurality of cache drivers, each resident in one of said computers, for creating a cache in the memory of the computer in which the cache driver resides for caching data from selected ones of said I/O devices, each cache driver including executable remote messaging code that forms a computer communication channel with any other of said computers on said network via which messages relating to caching may be communicated with cache drivers on any of said computers on said network, said executable remote messaging code further saving a remote connection address for each of the communication channels;

wherein at least one of said cache drivers further includes executable interception code for intercepting a write instruction to one of said plurality of I/O devices and executable invalidate code that sends a message to invalidate data through selected ones of the communication channels to the caches of any computer that is caching said one of said plurality of I/O devices.

16. The caching system of claim 15 wherein each of said cache drivers further comprises means for listening on said network for a request from a new computer to connect to said network.

17. The caching system of claim 16 wherein each of said cache drivers further comprises means for initiating a timing delay after a new computer connects to said network and means for comparing a count of the number of computers on the network with a count of the number of computer communication channels that have been formed by said cache driver so that caching is only reinitiated when said counts are equal.

18. The caching system of claim 16 wherein each of said cache drivers further comprises means for invalidating all data in the cache of the computer in which said cache driver resides when a new computer connects to said network.

19. The caching system of claim 15 wherein for each cache driver, said executable remote messaging code further includes means for allocating extra message buffers for newly created computer communication channels.

20. The caching system of claim 15 wherein each of said cache drivers further includes means for intercepting a read instruction to one of said plurality of I/O devices from the computer on which said cache driver resides and for reading data from the cache when the read instruction relates to addresses corresponding to data in the cache.

21. The caching system of claim 20 wherein each of said cache drivers further includes means for writing data into the cache when the read instruction relates to addresses that do not correspond to any data in the cache.

22. The caching system of claim 15 wherein each of said computers runs an operating system and each of said cache drivers allocate to the cache, space in the memory of the computer in which the cache driver resides, when creating the cache.

23. The caching system of claim 22 wherein each of said cache drivers further comprises a system memory check that checks on how much of the memory of the computer is available to the operating system.

24. The caching system of claim 23 wherein each of said cache drivers further comprises means for releasing space in the memory of the computer in which the cache driver resides from the cache back to the operating system in response to a determination by the system memory check of said cache driver that the operating system has insufficient memory available.

25. A caching system comprising:

a network;

a first computer using an n-bit architecture connected to said network, where n is an integer, said first computer having a memory;

a second computer using an m-bit architecture connected to said network, where m is an integer unequal to n, said second computer having a memory;

a plurality of I/O devices connected to said network; and

a plurality of cache drivers, each resident in one of said first and second computers, for creating a cache in the memory of the computer in which the cache driver resides for caching data from selected ones of said I/O devices, each cache driver including executable remote messaging code that forms a computer communication channel with a cache driver on any of the other computers on said network via which messages relating to caching may be communicated, said executable remote messaging code further saving a remote connection address for each of the computer communication channels.

26. The caching system of claim 25 wherein n equals 32 and m equals 64.

27. The caching system of claim 25 wherein each of said cache drivers further comprises means for listening on said network for a request from a new computer to connect to said network.

28. The caching system of claim 27 wherein each of said cache drivers further comprises means for initiating a timing delay after a new computer connects to said network and means for comparing a count of the number of computers on the network with a count of the number of computer communication channels that have been formed by said cache driver so that caching is only reinitiated when said counts are equal.

29. The caching system of claim 27 wherein each of said cache drivers further comprises means for invalidating all data in the cache of the computer in which said cache driver resides when a new computer connects to said network.

30. The caching system of claim 25 wherein each cache driver further includes means for allocating extra message buffers for newly created computer communications channels.

31. The caching system of claim 25 wherein at least one of said cache drivers further includes means for intercepting a write instruction to one of said plurality of I/O devices and means for using the computer communication channels to invalidate data in the caches of any computer that is caching said one of said plurality of I/O devices.

32. The caching system of claim 25 wherein each of said cache drivers further includes means for intercepting a read instruction to one of said plurality of I/O devices from the computer on which said cache driver resides and for reading data from the cache when the read instruction relates to addresses corresponding to data in the cache.

33. The caching system of claim 32 wherein each of said cache drivers further includes means for writing data into the cache when the read instruction relates to addresses that do not correspond to any data in the cache.

34. The caching system of claim 25 wherein each of said first and second computers runs an operating system and each of said cache drivers allocate to the cache, space in the memory of the computer in which said cache driver resides, when creating the cache.

35. The caching system of claim 34 wherein each of said cache drivers further comprises a system memory check that checks how much of the memory of the computer is available to the operating system.

36. The caching system of claim 35 wherein each of said cache drivers further comprises means for releasing space in the memory of the computer in which the cache driver resides from the cache back to the operating system in response to a determination by the system memory check of said cache driver that the operating system has insufficient memory available.

37. A caching system comprising:

a network;

a plurality of computers interacting as a VMScluster on said network, each computer having a memory;

a plurality of I/O devices connected to said network;

a plurality of cache drivers, each resident in one of said computers, for creating a plurality of caches in the memory of the computer in which the cache driver resides for caching data from selected ones of said I/O devices, wherein each of said caches includes a plurality of data buckets and data structures for identifying the data buckets and each cache includes a plurality of queues in which the data structures for identifying the data buckets are listed, each cache driver including remote message means for communicating with cache drivers on any of said computers and means for listening on said network for a request from a new computer to connect to said network.

38. The caching system of claim 37 wherein said plurality of queues include a least recently used queue, a free queue for available data buckets and an in-progress queue for data buckets that are in the midst of an instruction, such that a plurality of instructions may be in progress on one computer at one time with respect to different data buckets.