Installation and fault handling in a distributed system utilizing supervisor and dependency manager nodes

• US 9,348,573 B2
• Filed: 12/02/2014
• Issued: 05/24/2016
• Est. Priority Date: 12/02/2013
• Status: Active Grant

• Current Assignee: Finch Computing LLC (Qbase, LLC)
• Original Assignee: Qbase, LLC
• Inventors: Lightner, Scott, Weckesser, Franz
• Primary Examiner(s): Aguilera, Todd
• Application Number:
  US14/558,009
• Publication Number:
  US 20150154233A1
• Time in Patent Office: 539 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: G06F 11/1438 Restarting or rejuvenating
• CPC Class Codes: G06F 11/2025 using centralised failover control functionality
• CPC Class Codes: G06F 11/2028 eliminating a faulty processor or activating a spare
• CPC Class Codes: G06F 11/3006 where the computing system is distributed, e.g. networked systems, clusters, multiprocessor systems multiprogramming arrangements G06F9/46; allocation of resources G06F9/50
• CPC Class Codes: G06F 11/3055 Monitoring arrangements for monitoring the status of the computing system or of the computing system component, e.g. monitoring if the computing system is on, off, available, not available error or fault processing without redundancy G06F11/0703; error detection or correction by redundancy in data representation G06F11/08; error detection or correction by redundancy in operation G06F11/14; error detection or correction by redundancy in hardware G06F11/16
• CPC Class Codes: G06F 16/1734 Details of monitoring file system events, e.g. by the use of hooks, filter drivers, logs
• CPC Class Codes: G06F 16/21 Design, administration or maintenance of databases
• CPC Class Codes: G06F 16/28 Databases characterised by their database models, e.g. relational or object models
• CPC Class Codes: G06F 8/61 Installation
• CPC Class Codes: G06F 8/65 Updates security arrangements therefor G06F21/57
• CPC Class Codes: H04L 67/06 specially adapted for file transfer, e.g. file transfer protocol [FTP]
• CPC Class Codes: H04L 67/34 involving the movement of software or configuration parameters network booting or remote initial program loading [RIPL] G06F9/4416

Abstract

The present disclosure relates to in-memory databases or search engines using a dependency manager or configuration manager for maintaining configuration in the database system. The system may include a supervisor that may request and receive data from dependency manager, where the supervisor may be linked to other components in the system. The dependency manager may be used as a container for data metadata, and software components, which may be used in the system configuration. The configuration may be developed through a dependency system, where the dependency manager may keep an entire dependency tree for all software and data in the system. Similarly, dependency manager may create a deployable package to guarantee deployment integrity and to ensure a successful execution of any suitable software and data in the system.

Claims

1. A computer-implemented method comprising:

transmitting, by a computer of a distributed computing system, to a dependency manager node a request for a machine-readable deployable package file associated with a target node, wherein the dependency manager node comprises a non-transitory machine-readable storage medium storing one or more deployable package files associated with one or more nodes of the system according to a dependency tree before receiving the request, wherein the one or more nodes comprise the target node;

transmitting, by the computer, the deployable package file to the target node in response to receiving the deployable package file from the dependency manager node based on the request, wherein the deployable package file associated with the target node contains a set of one or more dependency files based on the dependency tree;

instructing, by the computer, the target node to install the set of dependencies in the deployable package file onto the target node;

receiving, by the computer, from each of the one or more nodes of the distributed computing system, a heartbeat signal indicating a status of the respective node at a predetermined interval;

determining, by the computer, the status of each respective node based on each respective heartbeat signal;

detecting, by the computer, a failure of one or more dependencies installed on the target node according to the heartbeat signal received from the target node, wherein the computer automatically requests the deployable package file from the dependency manager node responsive to detecting the failure;

transmitting, by the computer, based on the automatic request of the deployable package file responsive to detecting the failure, the deployable package file to a manager of a new node on which the failure occurred such that the manager of the new node attempts to restore the deployable package file to address the failure; and

determining, by the computer, if the manager of the new node successfully restored the one or more dependencies on the new node.

2. The method according to claim 1, wherein a dependency is selected from the group consisting of:

a partition, a module, a file, and data.

3. The method according to claim 1, wherein the dependency manager node fetches a dependency from one or more one dataframes and compiles the deployable package file.

4. The method according to claim 1, wherein each respective dependency file in the deployable package file is determined by the dependency manager node using at least one dependency tree associated with the target node.

5. The method according to claim 4, wherein each respective dependency file in the deployable package file is based on a comparative relationship of the dependency file with a corresponding dependency file installed on a subset of one or more nodes in a system.

6. The method according to claim 1, further comprising receiving, by the computer, from a vendor server associated with a dependency file installed on a node of the system, a prompt to update the node having the dependency file associated with the vendor server, wherein the one or more dependency files of the deployable package file contains the dependency file associated with the vendor server.

7. A database management system comprising:

one or more nodes comprising a non-transitory machine-readable storage memory storing one or more dependency files, and a processor monitoring a status of the one or more dependency files, wherein each respective dependency file is a component of a first node having a comparative relationship with a corresponding component installed on a second node, wherein the one or more nodes comprises the first node and the second node;

one or more supervisor nodes comprising a processor periodically monitoring a health status for each of the one or more nodes and configured to transmit a deployable package comprising a set of dependencies files to each of the one or more nodes based on the health status of each respective node of the one or more nodes; and

one or more dependency manager nodes comprising a non-transitory machine-readable storage medium storing one or more dependency tree files associated with the one or more nodes, and a processor configured to compile a deployable package file in accordance with a dependency tree associated with a node, wherein the deployable package file comprises a set of one or more dependencies files stored on at least one data frame, wherein the dependency manager node determines a dependency to include in the deployable package based on a dependency tree associated with a node targeted to receive the deployable package, wherein the processor of the one or more nodes is configured to transmit a heartbeat signal to the one or more supervisor nodes and monitor execution of one or more software modules installed on the one or more nodes, wherein the processor of the one or more supervisor nodes is configured to monitor one or more heartbeat signals received from the one or more nodes and determine a status of each respective node based on each respective heartbeat signal, wherein the processor of the one or more nodes is configured to attempt to restore a software module executed by the one or more nodes responsive to receiving a command to restore the software module from the one or more supervisor nodes, wherein the non-transitory machine-readable storage medium of the one or more dependency manager nodes stores one or more machine-readable configuration package files, wherein the processor of the one or more supervisor nodes is configured to determine a number of attempts to restore the software module by the one or more nodes, wherein the processor of the one or more supervisor nodes is configured to automatically retrieve from the one or more dependency manager nodes a configuration package file associated with the software module responsive to determining the number of attempts exceeds a threshold number of attempts to restore the software module.

8. The system according to claim 7, further comprising an external dataframe comprising a non-transitory machine-readable storage medium storing one or more machine-readable update files corresponding to one or more dependency files install updates for a dependency generated by a third-party dependency source;

and

a processor configured to transmit a request to a supervisor node to update a set of one or more nodes having the dependency of the third-party dependency source,

wherein a dependency manager node compiles an update deployment package comprising the one or more dependency files install updates received from the data frame of the third-party dependency source.

9. The system according to claim 7, further comprising a new node comprising a processor executing a node manager module that transmits a new node status to a supervisor node and receives one or more deployment packages according to a dependency tree associated with the new node.

10. The system according to claim 7, wherein the one or more dependency manager nodes updates a dependency tree associated with a node when a request to update the dependency tree is received from a supervisor node.

11. The system according to claim 7, wherein a dependency is selected from the group consisting of:

a partition, a module, a file, and data.