DATA VERIFICATION BASED UPGRADES IN TIME SERIES SYSTEM

• US 20160036665A1
• Filed: 01/30/2015
• Published: 02/04/2016
• Est. Priority Date: 07/31/2014
• Status: Active Grant

• Current Assignee: Cisco Technology, Inc. (Cisco Systems, Inc.)
• Original Assignee: AppDynamics, Inc. (Cisco Systems, Inc.)
• Inventors: Borah, Gautam, Gupta, Pankaj
• Granted Patent: US 10,944,655 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 11/3006 where the computing system is distributed, e.g. networked systems, clusters, multiprocessor systems multiprogramming arrangements G06F9/46; allocation of resources G06F9/50
• CPC Class Codes: G06F 11/302 where the computing system component is a software system
• CPC Class Codes: G06F 11/3082 the data filtering being achieved by aggregating or compressing the monitored data
• CPC Class Codes: G06F 11/3409 for performance assessment
• CPC Class Codes: G06F 11/3495 for systems
• CPC Class Codes: G06F 2201/875 Monitoring of systems including the internet
• CPC Class Codes: H04L 41/046 comprising network management agents or mobile agents therefor
• CPC Class Codes: H04L 43/04 Processing captured monitoring data, e.g. for logfile generation
• CPC Class Codes: H04L 43/065 related to network devices

Abstract

A time series system is updated using a data-verification system. The aggregation system may include one or more aggregators. When an upgrade is appropriate, a shadow aggregator may be added to the set of active aggregators. Metrics are provided from one or more collectors to an active aggregator. The shadow aggregator may receive the metrics intended for a particular aggregator, process the metric, and then pass the metric to the intended aggregator for processing. After a period of time, the shadow aggregator data is verified against the intended aggregator data. If the shadow aggregator data is verified, the shadow aggregator becomes an active aggregator and processes data as normal.

Claims

1. A method for performing verification for an aggregator, comprising:

processing and storing time series payload data by a new aggregator and a group of aggregators, wherein a selected aggregator of the group of aggregators processes each payload that is processed by the new aggregator;

performing a verification of the data stored by the new aggregator and the data stored by the selected aggregator; and

modifying a processing state of the new aggregator based on the verification.

2. The method of claim 1, wherein the new aggregator forwards payload data to the selected aggregator until the verification is successful.

3. The method of claim 1, wherein the verification determines if the data stored by the new aggregator and the data stored by the selected aggregator are the same.

4. The method of claim 1, wherein the modified processing state enables the new aggregator to process and store payload data without forwarding the payload data to the selected aggregator.

5. The method of claim 1, wherein the new aggregator is an updated version of one or more aggregators of the group of aggregators.

6. The method of claim 1, wherein each metric is intended for a particular aggregator of the group of aggregators which has been verified.

7. The method of claim 1, wherein each metric is routed to an aggregator based on a hash of the metric.

8. The method of claim 1, further comprising receiving time series data metrics by the group of aggregators from one or more collectors, the one or more collectors transmitting time series metrics to the new aggregator after the verification is successful.

9. The method of claim 1, further comprising processing and storing time series payload data by two or more new aggregators, wherein each of the two or more new aggregators pass the received time series payload data towards the selected aggregator.

10. A non-transitory computer readable storage medium having embodied thereon a program, the program being executable by a processor to perform a method for performing verification for an aggregator, the method comprising:

processing and storing time series payload data by a new aggregator and a group of aggregators, wherein a selected aggregator of the group of aggregators processes each payload that is processed by the new aggregator;

performing a verification of the data stored by the new aggregator and the data stored by the selected aggregator; and

modifying a processing state of the new aggregator based on the verification.

11. The non-transitory computer readable storage medium of claim 10, wherein the new aggregator forwards payload data to the selected aggregator until the verification is successful.

12. The non-transitory computer readable storage medium of claim 10, wherein the verification determines if the data stored by the new aggregator and the data stored by the selected aggregator are the same.

13. The non-transitory computer readable storage medium of claim 10, wherein the modified processing state enables the new aggregator to process and store payload data without forwarding the payload data to the selected aggregator.

14. The non-transitory computer readable storage medium of claim 10, wherein the new aggregator is an updated version of one or more aggregators of the group of aggregators.

15. The non-transitory computer readable storage medium of claim 10, wherein each metric is intended for a particular aggregator of the group of aggregators which has been verified.

16. The non-transitory computer readable storage medium of claim 10, wherein each metric is routed to an aggregator based on a hash of the metric.

17. The non-transitory computer readable storage medium of claim 10, the method further comprising receiving time series data metrics by the group of aggregators from one or more collectors, the one or more collectors transmitting time series metrics to the new aggregator after the verification is successful.

18. The non-transitory computer readable storage medium of claim 10, the method further comprising processing and storing time series payload data by two or more new aggregators, wherein each of the two or more new aggregators pass the received time series payload data towards the selected aggregator.

19. A system for performing verification for an aggregator, comprising:

a processor;

a memory; and

one or more modules stored in memory and executable by a processor to process and store time series payload data by a new aggregator and a group of aggregators, wherein a selected aggregator of the group of aggregators process each payload that is processed by the new aggregator, perform a verification of the data stored by the new aggregator and the data stored by the selected aggregator, and modify a processing state of the new aggregator based on the verification.

20. The system of claim 19, wherein the new aggregator forwards payload data to the selected aggregator until the verification is successful.

21. The system of claim 19, wherein the verification determines if the data stored by the new aggregator and the data stored by the selected aggregator are the same.

22. The system of claim 19, wherein the modified processing state enables the new aggregator to process and store payload data without forwarding the payload data to the selected aggregator.

23. The system of claim 19, wherein the new aggregator is an updated version of one or more aggregators of the group of aggregators.

24. The system of claim 19, wherein each metric is intended for a particular aggregator of the group of aggregators which has been verified.

25. The system of claim 19, wherein each metric is routed to an aggregator based on a hash of the metric.

26. The system of claim 19, wherein the modules further executable to receive time series data metrics by the group of aggregators from one or more collectors, the one or more collectors transmitting time series metrics to the new aggregator after the verification is successful.

27. The system of claim 19, wherein the modules further executable to process and store time series payload data by two or more new aggregators, wherein each of the two or more new aggregators pass the received time series payload data towards the selected aggregator.