Method and apparatus for coupling data processing systems

• US 5,317,739 A
• Filed: 03/30/1992
• Issued: 05/31/1994
• Est. Priority Date: 03/30/1992
• Status: Expired due to Term

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Mick, Jeffery M., Elko, David A., Swanson, Michael D., Frey, Jeffrey A., Moore, Brian B., Strickland, Jimmy P., Isenberg, John F. Jr., Helffrich, Audrey A.
• Primary Examiner(s): Ray, Gopal C.
• Application Number:
  US07/860,803
• Time in Patent Office: 792 Days
• Field of Search: 395/200, 395/325, 395/650, 395/800, 395/275, 395/725, 371/11.3, 340/825.52, 340/825.5
• US Class Current: 709/216
• CPC Class Codes: G06F 9/542 Event management; Broadcasting; Multicasting; Notifications
• CPC Class Codes: G06F 9/546 Message passing systems or structures, e.g. queues

Abstract

A Structured External Storage (SES) device/processor is connected to two or more DP systems, thereby loosely coupling the systems. The SES is capable of holding data objects of two distinct types (List objects and Cache objects), and communicates commands and command responses with the systems using a message protocol. A support facility within a processor on which a system is executing receives status indications from the SES without interrupting mainline system execution. Within the SES, a serialization mechanism allows more than one command to execute in parallel without loss of data object integrity, or command consistency. A forward completion mechanism sends to systems early notification of completion of certain commands, without permitting results inconsistent with this notification to be obtained by the systems. And a restart mechanism permits interrupted commands to be restarted by the initiating system or, in certain cases, by another system.

Claims

1. An apparatus for sharing data among two or more processes executing in one or more Central Electronic Complexes (CEC'"'"'s), said apparatus comprising:

a) A structured External Storage (SES) processor connected to at least one of said CEC'"'"'s and comprising;

i) data structure means for storing said data, comprising a list structure and a cache structure;

ii) one or more message processor means for interacting with said data structure means and interacting with a Support Facility (SF) in said one of said CEC'"'"'s, one of said one or more message processor means comprising registration means for registration of interest in status relating to a data item in said data structure by one of said two or more processes;

b) Said SF in said one of said CEC'"'"'s comprising;

i) vector means for indicating said status relating to a data item in said item in said data structure;

ii) a first instruction means for defining said

iii) a second instruction means for polling said vector means; and

c) Communication means within said one of said one or more CEC'"'"'s for communicating messages between said SES and said one of said one or more CEC'"'"'s.

2. An apparatus for sharing data among two or more processes executing in one or more Central Electronic Complexes (CEC'"'"'s), said apparatus comprising:

a) A structured External Storage (SES) processor connected to at least one of said CEC'"'"'s and comprising;

i) data structure means for storing said data, comprising one or more data objects;

ii) two or more message processor means for interacting with said data structure means and interacting with a support facility in said one of said CEC'"'"'s, to perform a command;

iii) serialization means accessed by said two or more message processor means for serializing command processing between said two or more message processor means; and

b) Communication means within said one of said one or more CEC'"'"'s for communicating messages between said SES and said one of said one or more CEC'"'"'s.

3. The apparatus of claim 2 in which said support facility in said one of said CEC'"'"'s comprises means for receiving status notifications from said SES without interrupting processing in said one of said CEC'"'"'s.

4. The apparatus of claim 2 in which said serialization means comprises update reference interlock means for interlocking access to a single one of said one or more data objects between a fetch and a store reference to said single one of said one or more data objects.

5. The apparatus of claim 4 in which said serialization means further comprises first lock means for serializing access to each one of said one or more data objects among said two or more message processor means.

6. The apparatus of claim 5 in which said first lock means comprises an object lock linked to said each one of said one or more data objects.

7. The apparatus of claim 6 in which said second lock means comprises:

a) deadlock prevention means for preventing a deadlock condition between two of said two or more message processor means;

b) lock retention means for retaining the object lock linked to said two or more data objects until said multiple-object command completes.

8. The apparatus of claim 7 in which said deadlock prevention means comprises a lock hierarchy comprising two or more lock hierarchy levels, each of said two or more lock hierarchy levels comprising one or more of said object locks.

9. The apparatus of claim 5 in which said means for serializing further comprises second lock means for serializing access to two or more data objects of said one or more data objects when a multiple-object command, referencing said two or more data objects, is performed.

10. An apparatus for sharing data among two or more processes executing in one or more Central Electronic Complexes (CEC'"'"'s), said apparatus comprising:

a) A structure External Storage (SES) processor connected to at least one of said CEC'"'"'s and comprising;

i) data structure means for storing said data, comprising one or more data objects and a directory comprising one or more directory elements locating each of said one or more data objects, and a buffer means for receiving an input data object;

ii) one or more message processor means for interacting with said data structure means, and interacting with a support facility (SF) in said one of said CEC'"'"'s, to perform a command for one of said one or more processes;

b) Said SF in said one of said CEC'"'"'s comprising means for receiving status notifications from said SES without interrupting processing in said one of said CEC'"'"'s; and

c) Communications means within said one of said one or more CEC'"'"'s for communicating messages between said SES and said one of said one or more CEC'"'"'s.

11. An apparatus for sharing data among two or more processes executing in one or more Central Electronic Complexes (CEC'"'"'s), said apparatus comprising:

a) A Structured External Storage (SES) processor connected to at least one of said CEC'"'"'s and comprising;

i) data structure means for storing said data, comprising one or more data objects,

ii) one or more message processor means for interacting with said data structure means, and interacting with a support facility (SF) in said one of said CEC'"'"'s, to perform a command on behalf of one of said one or more processes;

iii) forward completion means, operably connected to said one or more message processor means for returning a command completion indication to said one of said one or more processes before final processing of said command by said one or more message processor means, while ensuring that none of said two or more processes will subsequently detect a result inconsistent with said final processing;

b) Said SF in said one of said CEC'"'"'s comprising means for receiving status notifications from said SES without interrupting processing in said one of said CEC'"'"'s; and

c) Communications means within said one of said one or more CEC'"'"'s for communicating messages between said SES and said one of said one or more CEC'"'"'s.

12. The apparatus of claim 11 in which said forward completion means comprises power loss backup means for ensuring power continuity so that said final processing of said command will complete.

13. The apparatus of claim 11 in which said forward completion means comprises interrupt handler means for recovering interrupted command processes and reconstructing damaged data from checkpointed state information, and further comprises a damage indicator accessible by said one or more message processor means to prevent access to said damaged data when said recovering by said interrupt handler means is not successful.

14. The apparatus of claim 13 in which said damage indicator comprises a facility damage indicator and a structure damage indicator.

15. An apparatus for restarting commands in a system complex comprising one or more Central Electronic Complexes (CEC'"'"'s), each controlled by an operating system and attached to a Structured External Storage (SES) processor by a link, said apparatus comprising:

a) Command message means for transmitting a command request to said SES from a first program process in a first one of said one or more CEC'"'"'s, said command request initiating a command process in said SES;

b) Command message processing means in said SES, for performing said command process;

c) Timeout means in said SES for detecting expiration of a SES model-dependent timeout interval during executing of said command process, and suspending execution of said command process at a point of suspension; and

d) reinitiation means in said SES for restarting said command process at said point of suspension at request of a second program process in any of the one or more CEC'"'"'s.

16. The apparatus of claim 15 in which said timeout means comprises means for obtaining and passing to said first program process, a restart token, and in which said reinitiation means comprises means for receiving said restart token from said first program process.

17. The apparatus of claim 15 in which said SES comprises a directory object comprising more than one directory element, each of said more than one directory elements being sequentially ordered, and being linked to an associated data object;

in which said command process comprises a sequential scan of said sequentially ordered directory elements; and

in which said restart token comprises a directory element locator means for locating a first sequentially ordered directory element at which said command process was suspended by said timeout means.

18. A method for updating a data structure within a Structured External Storage (SES) processor by a process executing in a Central Electronic Complex (CEC) attached to said SES, said data structure having data entries each located by a directory entry in a directory, said method comprising the steps of:

a) formulating and initiating the transmission to the SES, by said process, of a command comprising a command object and a data object,

b) selecting a message processor to process said command, by a message processor selector within the SES,

c) allocating a new data area within the SES by said message processor;

d) copying said data object to said new data area by said message processor; and

e) placing an address of said new data area in an associated directory entry in said directory, by said message processor, after said step of copying.

19. A method for performing a command process within a Structured External Storage (SES) processor, said process being initiated by a command transmitted to the SES by a program in a Central Electronic Complex (CEC) attached to the SES, said method comprising the steps of:

a) selecting a message processor within the SES to perform said command process;

b) performing a portion of said command process by said message processor and returning a completion indication to said program, said portion being less than all of said command process; and

c) performing a remaining portion of said command process by said message processor and, if said remaining portion results in less than all of said command process being performed, setting a damage indicator in the SES to prevent further access to data within the SES.

20. The method of claim 19 in which said damage indicator is a "facility damage" indicator, and said data comprises all data within the SES.

21. The method of claim 19 in which said damage indicator is a "structure damage" indicator, and said data comprises a single data structure within said SES.

22. The method of claim 19 in which said step of performing a remaining portion of said command process further comprises the step of performing an error recovery process to recover from an error encountered during said performing.

23. A method for performing a command process within a Structured External Storage (SES) processor, said process being initiated by a command transmitted to the SES by a first program in a first Central Electronic Complex (CEC) attached to the SES, said method comprising the steps of:

a) selecting a message processor within the SES to perform said command process;

b) performing a portion of said command process by said message processor and storing checkpoint data for restarting said command at a point of suspension;

c) transmitting said command to said SES by a second program in a second CEC; and

d) accessing said checkpoint data by said message processor and continuing said command process from said point of suspension, in response to said command transmitted by said second program.

24. A method for performing a command process within a Structured External Storage (SES) processor, said process being initiated by a first command transmitted to the SES by a program in a Central Electronic Complex (CEC) attached to the SES, said method comprising the steps of:

a) selecting a message processor within the SES to perform said command process;

b) performing a portion of said command process by said message processor and returning to said program a restart token;

c) transmitting to said SES, by said program, a second command comprising said restart token; and

d) receiving said restart token by said message processor, and using said restart token as a start position indicator to continue said command process from said point of suspension, in response to said second command.