Distributed System

• US 20120078973A1
• Filed: 07/19/2011
• Published: 03/29/2012
• Est. Priority Date: 07/20/2010
• Status: Active Grant

• Current Assignee: Siemens AG
• Original Assignee: Siemens AG
• Inventors: GERDES, Christoph
• Granted Patent: US 8,892,567 B2
• Time in Patent Office: Days
• US Class Current: 707/802
• CPC Class Codes: G06F 16/22 Indexing; Data structures therefor; Storage structures
• CPC Class Codes: G06F 16/27 Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
• CPC Class Codes: G06F 16/278 Data partitioning, e.g. horizontal or vertical partitioning

Abstract

A distributed system having a plurality of nodes, wherein the system comprises a set of index nodes for providing a searchable index which comprises metadata for locating data in the system, the set of index nodes is divided into read zones comprising a group of index nodes containing the complete searchable index, and the read zones are subdivided in write zones, each write zone comprising at least one index node containing a partition of said searchable index; and includes a master index node maintaining an index structure of said searchable index by collecting from each index node measures of the current read and write throughput of the respective index node dependent on a current load of the respective index node, where the master index node re-configures the read zones and the corresponding write zones in response to the measured read and write throughputs and the measured loads of the index nodes.

Claims

1. A distributed system comprising a plurality of nodes, said system comprising:

a set of index nodes configured to provide a searchable index comprising metadata for locating data in the system, the set of index nodes being divided into read zones comprising a group of index nodes containing a complete searchable index, and the read zones being subdivided in write zones each comprising at least one index node containing a partition of the complete searchable index; and

a master index node configured to maintain an index structure of the complete searchable index by collecting from each index node measures of a current read and write throughput of a respective index node of the set of index nodes dependent on a current load of the respective index node;

wherein the master index node re-configures the read zones and corresponding write zones in response to measured read and write throughputs and measured loads of the set of index nodes.

2. The distributed system according to claim 1, wherein the master index node is configured to calculate an optimum number of read and write zones and to re-configure the read zones and the corresponding write zones automatically such that a predetermined target read and write throughput is achieved.

3. The distributed system according to claim 1, wherein the master index node is configured to maintain an index structure of said searchable index;

a plurality of index nodes are configured to provide the searchable index which indicates storage locations of metadata of the plurality of nodes; and

the plurality of nodes is formed by data generator nodes and data consumer nodes.

4. The distributed system according to claim 2, wherein the master index node is configured to maintain an index structure of said searchable index;

a plurality of index nodes are configured to provide the searchable index which indicates storage locations of metadata of the plurality of nodes; and

the plurality of nodes is formed by data generator nodes and data consumer nodes.

5. The distributed system according to claim 3, wherein each of the plurality of nodes include at least one of data sources for generating data and data sinks for consuming data.

6. The distributed system according to claim 5, wherein the data sources comprise at least one of sensors, counters and meters.

7. The distributed system according to claim 6, wherein each of the plurality of nodes are connected to each other by one of a wired and wireless network and exchange data and share resources to store data.

8. The distributed system according to claim 1, wherein the searchable index is provided for at least one of finding data sources and particular kinds of data in response to a query sent by a node of the plurality of nodes to an index node of the set of index nodes.

9. The distributed system according to claim 1, wherein all nodes of the network comprise node identifiers, and wherein all index nodes comprise node identifiers within a predetermined index identifier range.

10. The distributed system according to claim 9, wherein the master index node comprises a memory for storing an index node table indicating a current read and write throughput and a current load of each index node of the set of index nodes.

11. The distributed system according to claim 10, wherein an index node attribute indicates whether the respective index node of the set of index nodes is one of a read zone master index node assigned to a read zone, a write zone master index node assigned to a write zone, a read-and-write zone master index node assigned to a read-and-write zone and an index node unassigned to a zone.

12. The distributed system according to claim 1, wherein the measured load of a node comprises a current ratio between write operations and read operations performed by the respective node.

13. The distributed system according to claim 12, wherein the distributed system is an energy supply system comprising a plurality of metering devices as nodes for generating energy consumption data and energy supply data.

14. The distributed system according to claim 13, wherein the nodes are linked one of directly and indirectly by a data network to at least one index node of the set of index nodes providing said searchable index for finding at least one of data sources and particular kinds of data in the energy supply system.

15. The distributed system according to claim 14, wherein the metering devices each comprise metadata describing a characteristic of a respective metering device.

16. A method for performing a reconfiguration of a distributed system comprising a plurality of nodes, the method comprising:

providing a searchable index comprising metadata for locating data stored in the distributed system by a set of index nodes divided into read zones containing a complete searchable index, the read zones being subdivided into write zones comprising at least one index node containing a partition of the complete searchable index;

collecting, by a master index node from each index node of the set of index nodes, measures of a current read-and-write throughput of a respective index node dependent on a current load of the respective index node; and

re-configuring, by the master index node, the read zones and the corresponding write zones in response to measured read and write throughputs and measured loads of the index nodes.