Simplifying automated software maintenance of data centers

• US 8,438,418 B2
• Filed: 06/30/2010
• Issued: 05/07/2013
• Est. Priority Date: 06/30/2010
• Status: Active Grant

• Current Assignee: Oracle International Corporation (Oracle Corporation)
• Original Assignee: Oracle International Corporation (Oracle Corporation)
• Inventors: Gopalswamy, Sriram, Ashraff, Mohammed H
• Primary Examiner(s): Baderman, Scott
• Assistant Examiner(s): BUTLER, SARAI E
• Application Number:
  US12/826,678
• Publication Number:
  US 20120005520A1
• Time in Patent Office: 1,042 Days
• Field of Search: 714/4.11, 714/25, 714/48
• US Class Current: 714/4.1
• CPC Class Codes: G06F 11/2028 eliminating a faulty processor or activating a spare
• CPC Class Codes: G06F 11/2038 with a single idle spare processing component
• CPC Class Codes: G06F 8/70 Software maintenance or management

Abstract

An aspect of the present invention simplifies software maintenance of nodes in a data center. In one embodiment, a management system receives data specifying a set of commands to be executed on a node in the data center, and then forms a maintenance script by programmatically incorporating instructions for executing the set of commands on the node and to perform a set of management actions. The management system then executes the maintenance script to cause execution of the set of commands on the nodes, thereby performing maintenance of the node. A user/administrator of the data center needs to specify only the commands, thereby simplifying the software maintenance of data centers. According to another aspect, the maintenance scripts (formed by incorporating the commands provided by a user) are executed as part of a disaster recovery process in the data center.

Claims

1. A non-transitory machine readable storage medium storing one or more sequences of instructions for causing a a digital processing system to generate maintenance scripts suitable for software maintenance of nodes in a data center, wherein execution of said one or more sequences of instructions by one or more processors contained in said digital processing system causes said digital processing system to perform the actions of:

receiving a data specifying a set of commands to be executed on a plurality of nodes contained in said data center, said plurality of nodes comprising a first node; and

forming a first maintenance script by programmatically incorporating a first set of instructions and a second set of instructions,

wherein said first set of instructions, when executed on a management system, is designed to cause said management system to perform a first set of management actions on said management system,

wherein said second set of instructions, when executed on said management system, is designed to cause said set of commands to be transmitted to and then executed on said first node,

wherein later execution of said first maintenance script on said management system causes execution of said first set of management actions on said management system and said set of commands to be remotely executed on said first node, thereby performing maintenance of said first node,

wherein said data is received from a user, and said data received from said user does not specify said first set of management actions, such that said user is relieved of the burden of specifying said management actions in generation of maintenance scripts.

2. The non-transitory machine readable storage medium of claim 1, wherein said plurality of nodes of said data center are of a plurality of node types, wherein said data received from said user comprises first data and second data,

wherein said first data specifies a corresponding one of said plurality of node types for each of said plurality of nodes,

wherein said second data specifies a corresponding subset of commands for each combination of a node type and a maintenance task, such that each subset of commands when executed on nodes of the corresponding node type in the combination causes the corresponding maintenance task to be performed on the nodes,

wherein said forming forms maintenance scripts for each of said plurality of nodes based on a node type of the node specified in said first data and the corresponding subset of commands for the node type specified in said second data.

3. The non-transitory machine readable storage medium of claim 2, wherein said plurality of nodes comprises a primary set of nodes and a standby set of nodes, wherein said primary set of nodes operate together to provide a set of services to users during normal operation, wherein said standby set of nodes are to be used if a disaster occurs at said primary set of nodes, wherein execution of said set of commands on said plurality of nodes in response to said disaster occurring at said primary set of nodes causes said standby set of nodes to operate together to provide said set of services to said users.

4. The non-transitory machine readable storage of claim 2, wherein said forming further forms a central script, a plurality of task-type scripts, a plurality of maintenance scripts including said first maintenance script, and a runner script,

wherein said central script is designed to invoke each of said plurality of task-type scripts to perform maintenance of said plurality of nodes,

wherein each of said plurality of task-type scripts corresponds to the combination of the node type and the maintenance task, wherein execution of a task-type script causes invocation of a corresponding subset of said plurality of maintenance scripts to cause the corresponding maintenance tasks to be performed on nodes of the corresponding node type,

wherein each of said plurality of maintenance scripts is designed to perform a single maintenance task on a single node by invoking said runner script with a node identifier of said single node and a command for performing said single maintenance task as parameters,

said runner script containing said first set of instructions and said second set of instructions such that execution of said runner script with a node identifier and one of said set of commands as parameters causes execution of said one of said set of commands on a node identified by said node identifier.

5. The non-transitory machine readable storage medium of claim 2, wherein each of said set of commands specifies the identifier of a corresponding one of a set of component scripts, wherein each component script upon execution on the corresponding node causes a corresponding maintenance task to be performed on said first node,

wherein said executing said first maintenance script causes a set of component scripts to be executed on said first node, thereby performing corresponding maintenance tasks on said first node.

6. The non-transitory machine readable storage medium of claim 5, wherein the maintenance task is one of installing, uninstalling, starting, stopping, checking a status of, and configuring a software component in said first node.

7. A data center comprising:

a plurality of nodes, wherein said plurality of nodes comprises a primary set of nodes and a standby set of nodes, wherein said primary set of nodes operate together to provide a set of services to users during normal operation and said standby set of nodes are to be used if a disaster occurs at said primary set of nodes; and

a management system containing a processor and a memory, said processor to retrieve and execute instructions stored in said memory causing said management system to;

receive a data specifying a set of commands to be executed on said plurality of nodes;

form a set of maintenance scripts by programmatically incorporating a first set of instructions and a second set of instructions,

wherein said first set of instructions, when executed on said management system, is designed to cause said management system to perform a first set of management actions on said management system,

wherein said second set of instructions, when executed on said management system, is designed to cause transmission and remote execution of said set of commands on said plurality of nodes;

receive an indication of declaration of a disaster at said primary set of nodes; and

in response to receiving said indication, execute said set of maintenance scripts to cause said standby set of nodes to operate together to provide said set of services to said users,

wherein said data is received from a user, and said data received from said user does not specify said first set of management actions, such that said user is relieved of the burden of specifying said management actions in generation of maintenance scripts.

8. The data center of claim 7, wherein to receive said set of commands, said management system is operable to:

store a corresponding set of component scripts for each of said plurality of nodes, wherein each component script upon execution on the corresponding node causes a corresponding maintenance task to be performed on the node, each component script being identified by a corresponding identifier; and

enable a user to specify the identifiers of a sequence of component scripts as corresponding commands to be remotely executed on said plurality of nodes.

9. The data center of claim 8, wherein said corresponding set of component scripts are stored on the corresponding one of said plurality of nodes.

10. The data center of claim 7, wherein said first set of instructions when executed on said management system causes logging and error handling in relation to execution of said commands.

11. The data center of claim 10, wherein to enable said user to specify said commands, said management system is operable to:

provide, to said user, a first user interface for specifying workflows for performing corresponding maintenance tasks on said plurality of nodes; and

receive, from said user using said first user interface, a workflow for performing a maintenance task, wherein first workflow specifies the identifiers of said sequence of component scripts.

12. The data center of claim 11, wherein the maintenance task is one of installing, uninstalling, starting, stopping, checking a status of, and configuring a software component in said plurality of nodes.

13. The data center of claim 8, wherein said management system is further operable to store said set of maintenance scripts in a scripts repository, said data center further comprising:

a second system operable to;

receive said indication of declaration of said disaster;

in response to receiving said indication, retrieve said set of maintenance scripts from said scripts repository; and

execute said set of maintenance scripts to cause said standby set of nodes to operate together to provide said set of services to said users,

wherein said second system is different from said management system.

14. The data center of claim 7, wherein said plurality of nodes are of a plurality of node types, wherein said data received from said user comprises first data and second data,

wherein said first data specifies a corresponding one of said plurality of node types for each of said plurality of nodes,

wherein said second data specifies a corresponding subset of commands for each combination of a node type and a maintenance task, such that each subset of commands when executed on nodes of the corresponding node type in the combination causes the corresponding maintenance task to be performed on the nodes,

wherein said management system forms maintenance scripts for each of said plurality of nodes based on a node type of the node specified in said first data and the corresponding subset of commands for the node type specified in said second data.

15. The data center of claim 14, wherein said management system further forms a central script, a plurality of task-type scripts, said set of maintenance scripts, and a runner script, wherein said central script is designed to invoke each of said plurality of task-type scripts to perform maintenance of said plurality of nodes, wherein each of said plurality of task-type scripts corresponds to the combination of the node type and the maintenance task, wherein execution of a task-type script causes invocation of a corresponding subset of said plurality of maintenance scripts to cause the corresponding maintenance tasks to be performed on nodes of the corresponding node type, wherein each of said set of maintenance scripts is designed to perform a single maintenance task on a single node by invoking said runner script with a node identifier of said single node and a command for performing said single maintenance task as parameters, said runner script containing said first set of instructions and said second set of instructions such that execution of said runner script with a node identifier and one of said set of commands as parameters causes execution of said one of said set of commands on a node identified by said node identifier.

16. A method generating maintenance scripts suitable for software maintenance of nodes in a data center, said method being performed in a digital processing system, said method comprising:

receiving a data specifying a set of commands to be executed on a plurality of nodes contained in said data center, said plurality of nodes comprising a first node; and

forming a first maintenance script by programmatically incorporating a first set of instructions and a second set of instructions,

wherein said first set of instructions, when executed on a management system, is designed to cause said management system to perform a first set of management actions on said management system,

wherein said second set of instructions, when executed on said management system, is designed to cause said set of commands to be transmitted to and then executed on said first node,

wherein later execution of said first maintenance script on said management system causes execution of said first set of management actions on said management system and said set of commands to be remotely executed on said first node, thereby performing maintenance of said first node,

wherein said data is received from a user, and said data received from said user does not specify said first set of management actions, such that said user is relieved of the burden of specifying said management actions in generation of maintenance scripts.