System and method for distributed data collection and storage

• US 6,418,445 B1
• Filed: 04/30/1998
• Issued: 07/09/2002
• Est. Priority Date: 03/06/1998
• Status: Expired due to Term

• Current Assignee: NTT Data Services Corporation
• Original Assignee: Perot Systems Corporation (Dell Technologies Inc.)
• Inventors: Moerbeek, Otto
• Primary Examiner(s): Breene, John
• Assistant Examiner(s): LEWIS, CHERYL RENEA
• Application Number:
  US09/070,090
• Time in Patent Office: 1,531 Days
• Field of Search: 707/103, 707/10, 707/1, 707/9, 707/103.R, 707/103.Y, 707/103.Z, 709/201, 709/223
• US Class Current: 1/1
• CPC Class Codes: G06F 11/3006 where the computing system is distributed, e.g. networked systems, clusters, multiprocessor systems multiprogramming arrangements G06F9/46; allocation of resources G06F9/50
• CPC Class Codes: G06F 11/3055 Monitoring arrangements for monitoring the status of the computing system or of the computing system component, e.g. monitoring if the computing system is on, off, available, not available error or fault processing without redundancy G06F11/0703; error detection or correction by redundancy in data representation G06F11/08; error detection or correction by redundancy in operation G06F11/14; error detection or correction by redundancy in hardware G06F11/16
• CPC Class Codes: G06F 11/3072 where the reporting involves data filtering, e.g. pattern matching, time or event triggered, adaptive or policy-based reporting
• CPC Class Codes: G06F 11/3089 Monitoring arrangements determined by the means or processing involved in sensing the monitored data, e.g. interfaces, connectors, sensors, probes, agents software debugging using additional hardware using a specific debug interface G06F11/3656; performance evaluation by tracing or monitoring G06F11/3466
• CPC Class Codes: G06F 11/3495 for systems
• CPC Class Codes: H04L 43/00 Arrangements for monitoring or testing data switching networks
• CPC Class Codes: H04L 43/022 by sampling
• CPC Class Codes: H04L 43/0852 Delays
• CPC Class Codes: H04L 43/0888 Throughput
• CPC Class Codes: H04L 43/106 using time related information in packets, e.g. by adding timestamps
• CPC Class Codes: H04L 43/20 the monitoring system or the monitored elements being virtualised, abstracted or software-defined entities, e.g. SDN or NFV
• CPC Class Codes: Y10S 707/99933 Query processing, i.e. searching
• CPC Class Codes: Y10S 707/99944 Object-oriented database structure
• CPC Class Codes: Y10S 707/99946 Object-oriented database structure network

Abstract

A system and method for automatically and adaptively capturing, recording, and retrieving large amounts of complex Information Technology (IT) system component state data in a distributed, hierarchical manner. Monitored components include virtually any element in an IT system, including hardware, e.g., routers, hard drives, etc., and software, e.g., databases, operating system, kernels, etc. In a preferred embodiment, collection and storage elements, or objects, are logically arranged in a hierarchical manner such that data collected may be propagated up in the hierarchy. Similarly, querying of such data is performed in a hierarchial manner, e.g., queries are propagated down and results propagated up. Propagation of collected data through the storage system is performed in a manner to optimize system performance. Uniformity in the collection and storage scheme allows easy expansion of the collection and storage system, and thus the underlying IT system infrastructure.

Claims

1. A computer system for distributing system data across a multiplicity of interconnected system resources, said computer system comprising:

a multiplicity of interconnected collection objects corresponding to said multiplicity of interconnected system resources, each said collection object comprising;

retrieval means for retrieving system data from a multiplicity of discrete target system resources;

storage means for storing system data retrieved by said retrieval means; and

propagation means, within a respective one of said collection objects for propagating system data to at least one other of said collection objects, whereby said system data is distributed across said multiplicity of interconnected system resources.

2. The computer system according to claim 1, wherein said retrieval means within the respective collection objects comprises a plurality of collector objects, each said collector object retrieving respective system data from respective target system resources.

3. The computer system according to claim 1, wherein said storage means within the respective collection objects are respective saver objects, each said saver object storing respective system data retrieved by respective retrieval means from respective target system resources.

4. The computer system according to claim 3, wherein said propagation means, within a respective saver object, propagates respective system data from a respective target system resource to said at least one other collection object.

5. The computer system according to claim 1, wherein said retrieval means retrieves the system data from a given one of said target system resources periodically.

6. The computer system according to claim 1, wherein said retrieval means retrieves the system data from a given one of said target system resources upon the occurrence of a given system event.

7. The computer system according to claim 1, wherein said retrieval means retrieves the system data from a given one of said target system resources in a random manner.

8. The computer system according to claim 1, wherein said storage means is a memory component within said computer system.

9. The computer system according to claim 8, wherein the system data from at least one of said target system resources is stored within said memory component in a record structure.

10. The computer system according to claim 8, wherein the system data from at least one of said target system resources is stored within a relational database associated with said memory component.

11. The computer system according to claim 1, wherein one of said multiplicity of interconnected collection objects is a central query collection object, said propagation means within said central query collection object being deactivated.

12. The computer system according to claim 1, wherein said multiplicity of interconnected collection objects adaptively distributes the system data across said collection objects using said propagation means.

13. The computer system according to claim 12, wherein said system data is adaptively distributed across said collection objects via said propagation means after a plurality of said interconnected system resources become unavailable.

14. The computer system according to claim 1, wherein said propagation means within said respective collection object propagates system data pursuant to an adaptive methodology for said computer system, whereby system data stays resident within said respective collection object if said adaptive methodology warrants nonpropagation and propagates system data to another collection object if said adaptive methodology warrants propagation.

15. The computer system according to claim 1, wherein said multiplicity of interconnected collection objects are arranged in a hierarchical topology, a plurality of said collection objects at a first level collecting respective system data from a corresponding plurality of target system resources, the propagation means within each of said plurality of collection objects propagating the system data to a central query collection object connected to each of said plurality of collection objects.

16. The computer system according to claim 15, wherein said hierarchical topology is a tree structure, said first level of collection objects being leaf nodes and said central query collection object being a root node.

17. The computer system according to claim 15, wherein the respective propagation means within said plurality of said first level collection objects passes the respective system data to another plurality of said collection objects at least one intermediate level, the respective propagation means within said plurality of intermediate level collection objects passing the system data to said central query collection object.

18. The computer system according to claim 17, wherein said propagation means within a given one of said first level collection objects and within another one of said at least one intermediate level collection objects each comprise a filter means for modifying the respective system data retrieved by the respective retrieval means, the modified system data being propagated by the respective propagation means.

19. The computer system according to claim 18, wherein said filter means is an operator selected from the group consisting of an average, minimum, maximum, median, modal and other numerical derivatives.

20. The computer system according to claim 15, wherein said propagation means within a given one of said collection objects comprises a filter means for modifying the system data retrieved by said retrieval means from at least one of said target system resources, the modified system data being propagated to another of said collection objects at a higher level.

21. The computer system according to claim 20, wherein said filter means is an operator selected from the group consisting of an average, minimum, maximum, median, modal and other numerical derivatives.

22. The computer system according to claim 1, further comprising:

query means for querying about particular system data stored within said computer system, said query means searching through said interconnected collection objects for said particular system data.

23. The computer system according to claim 22, wherein said query means first queries a central query collection object to which all of the remaining collection objects are connected, said computer system returning the particular system data from said central query collection object if said particular system data is therein, said computer system otherwise initiating a search through said remaining collection objects for said particular system data, which upon being located is propagated to said central query collection object for retrieval by said query means.

24. A method for distributing system data across a multiplicity of interconnected system resources, said method comprising the steps of:

retrieving, by a given collection object, system data from at least one of a plurality of target system resources, a multiplicity of said collection objects being interconnected and corresponding to said multiplicity of interconnected system resources;

storing the system data retrieved by said given collection object; and

propagating the system data from said given collection object to at least one other of said collection objects.

25. The method according to claim 24, wherein, in said step of retrieving, the system data is retrieved from said at least one target system resource by a collector object within said given collection object.

26. The method according to claim 25, wherein each said collection object comprises a plurality of collector objects, each said collector object retrieving respective system data from respective target system resources.

27. The method according to claim 24, wherein, in said step of storing, the system data from said at least one target system resource is stored by a saver object within said given collection object.

28. The method according to claim 27, wherein each said collection object comprises at least one of said saver objects, each said collector object storing respective system data from respective target system resources.

29. The method according to claim 27, wherein in said step of propagating, said saver object within said given collection object propagates the system data from said at least one target system resource through said given collection object to at least one other collection object.

30. The method according to claim 29, wherein each said saver object propagates respective system data from respective target system resources to respective at least one other collection objects.

31. The method according to claim 24, wherein said step of retrieving is performed periodically.

32. The method according to claim 24, wherein said step of retrieving is performed upon the occurrence of a given system event.

33. The method according to claim 24, wherein said step of retrieving is performed randomly.

34. The method according to claim 24, wherein in said step of storing, the system data retrieved by the given collection object is stored in a memory component within said computer system.

35. The method according to claim 34, wherein the system data is stored within said memory component in a record structure.

36. The method according to claim 34, wherein the system data is stored within a relational database associated with said memory component.

37. The method according to claim 24, wherein one of said multiplicity of interconnected collection objects is a central query collection object, said step of propagating by said central query collection object being deactivated.

38. The method according to claim 24, wherein said steps of retrieving, storing and propagating are adaptive, adaptively distributing the system data across said collection objects.

39. The method according to claim 38, wherein the adaptive steps of retrieving, storing and propagating distribute the system data across said collection objects after a plurality of said interconnected system resources become unavailable.

40. The method according to claim 24, wherein said step of propagating propagates system data pursuant to an adaptive methodology for said computer system, whereby system data stays resident within said given collection object if said adaptive methodology warrants nonpropagation and propagates to another collection object if said adaptive methodology warrants propagation.

41. The method according to claim 24, wherein said multiplicity of interconnected collection objects are arranged in a hierarchical topology, said given collection object in said step of retrieving being one of a plurality of first level collection objects, said first level collection objects retrieving respective system data from a corresponding plurality of target system resources.

42. The method according to claim 41, wherein said plurality of said first level collection objects propagate the respective system data to a central query collection object.

43. The method according to claim 42, wherein said hierarchical topology is a tree structure, said first level collection objects are leaf nodes and said central query collection object being a root node.

44. The method according to claim 42, wherein said plurality of said first level collection objects passes the respective system data to another plurality of said collection objects at least one intermediate level, said step of propagating further comprising propagating the respective system data from said at least one intermediate level collection objects to said central query collection object.

45. The method according to claim 44, wherein said step of propagating further comprises a second filtering of the filtered system data retrieved by said at least one other collector object from said given collector object.

46. The method according to claim 24, wherein said step of propagating further comprises filtering the system data retrieved by said given collection object from said at least one target system resource, the filtered system data being propagated to said at least one other collector object.

47. The method according to claim 46, wherein said step of filtering modifies said system data, said filtration operation being selected from the group consisting of an average, minimum, maximum, median, modal and other numerical derivatives.

48. The method according to claim 24, further comprising the step of:

responding to a query about particular system data stored within said computer system, said query response searching through said interconnected collection objects for said particular system data.

49. The method according to claim 48, wherein said query queries a central query collection object to which all of the remaining collection objects are connected, said computer system returning the particular system data from said central query collection object if said particular system data is therein, said computer system otherwise initiating a search through said remaining collection objects for said particular system data, which upon being located is propagated to said central query collection object for retrieval.

50. A system for monitoring components operating on a network, said system comprising:

a plurality of collection objects being associated with at least one component, said collection object operating to gather data indicative of operational information of the associated at least one component;

at least one saver object in communication with at least one of said collection objects, the at least one saver object receiving and storing the data from the at least one of said collection objects; and

an internal collection object in communication with said at least one saver object, said internal collection object operating to gather the data stored by said at least one saver object.

51. The system according to claim 50, further comprising at least one second saver object in communication with said internal collection object, the gathered data being stored by the at least one second saver object.

52. A method for monitoring components operating on a network, said method comprising:

collecting a plurality of data elements indicative of operational information from a plurality of components operating on a first level on the network;

storing the plurality of data elements collected from the plurality of components operating on the first level on the network;

gathering the stored plurality of data elements; and

storing the plurality of data elements on a second level on the network.

53. The method according to claim 52, wherein the levels are organized hierarchically.

54. The method according to claim 52, further comprising querying the components for particular data elements.