Monitoring service

• US 10,009,246 B1
• Filed: 03/28/2014
• Issued: 06/26/2018
• Est. Priority Date: 03/28/2014
• Status: Expired due to Fees

• Current Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Original Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Inventors: Benattar, Gary Ange
• Primary Examiner(s): Bates, Kevin
• Assistant Examiner(s): Kim, Dae
• Application Number:
  US14/228,916
• Time in Patent Office: 1,551 Days
• CPC Class Codes: G06Q 30/0201 Market modelling; Market analysis; Collecting market data
• CPC Class Codes: G06Q 50/01 Social networking
• CPC Class Codes: H04L 43/04 Processing captured monitoring data, e.g. for logfile generation
• CPC Class Codes: H04L 43/0876 Network utilisation, e.g. volume of load or congestion level

Abstract

Described herein are techniques for detecting abnormal volume of high cardinality metrics within a system in substantially real time. For example, a device may be configured to model a system as a tree-structure capable of monitoring the volume of data points or contact between users of the system with various nodes of the tree structure. The value of each counter may be normalized based on the value of the counter associated with one or more parent node. The normalized time series may then be compared to one or more thresholds to detect abnormal volumes associated with the node.

Claims

1. A method comprising:

under control of one or more computer systems configured with executable instructions,

generating a tree structure modeling volume of end-user interactions associated with a domain representative of an application, the tree structure including data stored in a plurality of nodes, each of the plurality of nodes representative of an individual page associated with the application;

receiving a first indication of at least a first end-user interaction with a node of the plurality of nodes during a period of time, the node including a counter representative of a number of end-user interactions with a page associated with the application and the node having a parent node, wherein the node and parent node are arranged along a same division-path of the tree structure;

incrementing a value of the counter based at least partly on receiving the first indication;

receiving a second indication of at least a second end-user interaction with the node outside of the period of time;

incrementing the value of the counter based at least partly on receiving the second indication;

decrementing the value of the counter based at least partly on the second end-user interaction being outside of the period of time and generating a decremented value;

normalizing the decremented value of the counter based at least in part on a value of an additional counter associated with the parent node to produce a normalized decremented value;

determining that the particular node is experiencing abnormal volume based at least in part on the normalized decremented value and at least one threshold corresponding to a volume of end-user interactions; and

re-allocating at least one of a server or a processing resource of the one or more computer systems based at least partly on determining that the node is experiencing abnormal volume.

2. The method as recited in claim 1, further comprising:

starting a timer in response to incrementing the additional counter associated with the parent node; and

decrementing the counter associated with the node and the additional counter associated with the parent node based at least partly on expiration of the timer.

3. The method as recited in claim 1, wherein the parent node is a root node.

4. The method as recited in claim 1, further comprising sending a link to a client device based at least in part on determining that the node is experiencing abnormal volume, the link being selectable to access a user interface indicating metrics related to end-user interactions with the page associated with node.

5. The method as recited in claim 1, wherein the at least one threshold corresponds to a fraction of the volume of end-user interactions.

6. A device comprising:

one or more processors; and

non-transitory computer-readable storage media storing computer-executable instructions, which when executed by the one or more processors cause the one or more processors to;

generate a tree-structure modeling a domain associated with an application, the tree-structure including a plurality of nodes arranged in one or more division-paths;

decrement a counter of a node of the plurality of nodes, based at least partly on a number of end-user interactions with the application that are related to the node and that take place outside of a period of time, to generate a decremented value;

normalize the decremented value of the counter based on a value of an additional counter associated with a parent node of the node within the tree structure to produce a normalized decremented value, wherein the node and parent node are arranged along a same division-path of the one or more division-paths;

determine that the node is experiencing abnormal volume based at least in part on the normalized decremented value and a threshold value corresponding to a volume of end-user interactions; and

re-allocate at least one of a server or a processing resource of the device based at least partly on determining that the node is experiencing abnormal volume.

7. The device as recited in claim 6, wherein the computer-readable storage media further stores computer-executable instructions, which when executed by the one or more processors cause the one or more processors to receive volume metrics from the application.

8. The device as recited in claim 7, wherein the volume metrics include at least a number of end-user interactions corresponding to the node.

9. The device as recited in claim 6, wherein the computer-readable storage media further stores computer-executable instructions, which when executed by the one or more processors cause the one or more processors to collect volume metrics from the application.

10. The device as recited in claim 9, wherein the node is associated with the division-path that includes at least a portion of the plurality of nodes, and the computer-readable storage media further stores computer-executable instructions, which when executed by the one or more processors cause the one or more processors to increment the value of the counter and a value of individual counters associated with individual nodes along the division-path at least partly based on the volume metrics including a contact with the node.

11. The device as recited in claim 10, wherein the computer-readable storage media further stores computer-executable instructions, which when executed by the one or more processors cause the one or more processors to:

start a timer in response to incrementing the value of the counter and the value of the individual counters associated with the individual nodes along the division-path; and

decrement the value of the counter and the value of the individual counters associated with the individual nodes along the division-path based at least partly on expiration of the timer.

12. The device as recited in claim 6, wherein the computer-readable storage media further stores computer-executable instructions, which when executed by the one or more processors cause the one or more processors to alert a client based at least partly on determining that the node is experiencing abnormal volume.

13. The device as recited in claim 6, wherein the domain is related to at least one of:

a customer service application;

an online sales application;

a social network;

a subscription service or application;

or

an inventory application.

14. The device as recited in claim 6, wherein determining that the node is experiencing abnormal volume includes comparing the normalized decremented value to the threshold value.

15. The device as recited in claim 14, wherein the threshold value is particular to the node.

16. One or more non-transitory computer-readable media having computer-executable instructions that, when executed by one or more processors, cause the one or more processors to perform operations comprising:

generating a tree structure modeling a domain associated with an application, the tree-structure including a root node and a first leaf node, the root node including a first counter and the first leaf node including a second counter, a first value of the first counter and a second value of the second counter based at least in part on volume metrics received from the application;

decrementing, based at least partly on an end-user interaction with the application taking place outside of a window of time, the first value of the first counter to generate a decremented first value and the second value of the second counter to generate a decremented second value;

determining a normalized value of the decremented second value based at least partly on the decremented first value;

determining that the first leaf node is experiencing abnormal volume based at least in part on the normalized value of the decremented second value and a predefined first threshold, wherein the predefined first threshold is determined based on at least one of historical data associated with the volume metrics or a mean of the normalized value of the decremented second value; and

re-allocating at least one of a server or a processing resource associated with hosting the application based at least partly on determining that the first leaf node is experiencing abnormal volume.

17. The one or more computer-readable media as recited in claim 16, wherein:

the tree-structure includes a second leaf node, the second leaf node including a third counter having a third value based at least in part on the volume metrics received from the application; and

the one or more computer-readable media store instruction which when executed by the one or more processors cause the one or more processors to perform the following actions;

determining a second normalized value of the third value based at least partly on the first value of the first counter; and

determining that the leaf node is experiencing abnormal volume based at least in part on the second normalized value and a second threshold.

18. The one or more computer-readable media as recited in claim 17, wherein the first threshold differs from the second threshold.

19. The one or more computer-readable media as recited in claim 16, having computer-executable instructions that, when executed by the one or more processors, cause the one or more processors to perform operations comprising receiving a client subscription related to the first leaf node.

20. The one or more computer-readable media as recited in claim 16, having computer-executable instructions that, when executed by the one or more processors, cause the one or more processors to perform operations comprising, alerting a client based at least partly on determining that the first leaf node is experiencing abnormal volume.