Centralized resource usage visualization service for large-scale network topologies

• US 10,505,814 B2
• Filed: 06/05/2017
• Issued: 12/10/2019
• Est. Priority Date: 11/25/2013
• Status: Active Grant

• Current Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Original Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Inventors: Lissack, Avichai Mendle
• Primary Examiner(s): Mejia, Anthony
• Application Number:
  US15/613,582
• Publication Number:
  US 20170272331A1
• Time in Patent Office: 918 Days
• Field of Search: 709224
• CPC Class Codes: G06F 2009/45591 Monitoring or debugging support
• CPC Class Codes: G06F 2009/45595 Network integration; Enabling network access in virtual machine instances
• CPC Class Codes: G06F 9/45558 Hypervisor-specific management and integration aspects
• CPC Class Codes: G06F 9/5083 Techniques for rebalancing the load in a distributed system
• CPC Class Codes: H04L 41/0893 Assignment of logical groups to network elements
• CPC Class Codes: H04L 41/0894 Policy-based network configuration management
• CPC Class Codes: H04L 41/0896 Bandwidth or capacity management, i.e. automatically increasing or decreasing capacities flow or congestion control using dynamic resource allocation, e.g. in-call renegotiation, H04L47/76
• CPC Class Codes: H04L 41/12 Discovery or management of network topologies
• CPC Class Codes: H04L 41/22 comprising specially adapted graphical user interfaces [GUI]
• CPC Class Codes: H04L 41/40 using virtualisation of network functions or resources, e.g. SDN or NFV entities
• CPC Class Codes: H04L 41/5096 wherein the managed service relates to distributed or central networked applications
• CPC Class Codes: H04L 43/0817 by checking functioning
• CPC Class Codes: H04L 43/16 Threshold monitoring
• CPC Class Codes: H04L 43/20 the monitoring system or the monitored elements being virtualised, abstracted or software-defined entities, e.g. SDN or NFV
• CPC Class Codes: H04L 63/00 Network architectures or network communication protocols for network security cryptographic mechanisms or cryptographic arrangements for secret or secure communication H04L9/00; network architectures or network communication protocols for wireless network security H04W12/00; security arrangements for protecting computers or computer systems against unauthorised activity G06F21/00

Abstract

Methods and apparatus for centralized resource utilization visualization in distributed systems are disclosed. Metrics are collected from a plurality of sources in a distributed system, including network traffic metrics collected from nodes implementing a network-accessible service. A topology representing at least one of (a) a relationship between respective client accounts to which a first and second node are assigned, or (b) one or more network links between the first and second nodes is generated. Respective networking performance indicators of the first node and the second node are provided for inclusion in a resource heat map corresponding to the topology.

Claims

1. A system, comprising:

one or more computing devices configured to;

obtain metrics of a provider network, including network traffic metrics collected from a set of nodes implementing at least one network-accessible service on behalf of client accounts of the provider network;

generate a network topology representing one or more relationships between a node of the set of nodes that is assigned to a client account and another node of the set of nodes that is assigned to another client account; and

provide, based on the obtained metrics, performance indicators corresponding to the network topology.

2. The system as recited in claim 1, wherein to provide the performance indicators, the one or more computing devices are further configured to:

provide the respective networking performance indicators for network traffic of the node assigned to the client account and network traffic of the other node assigned to the other client account.

3. The system as recited in claim 2, wherein the networking performance indicator of the node assigned to the client account comprises an indication of a ratio between a measured network latency and an upper bound on network latency for traffic associated with the node.

4. The system as recited in claim 2, wherein the networking performance indicator of the node assigned to the client account comprises an indication of a ratio between a measured network traffic rate at the node and a bandwidth limit for the node.

5. The system as recited in claim 2, wherein the one or more computing devices are further configured to:

display a resource heat map that includes the respective performance indicators for network traffic of the node and the other node.

6. The system as recited in claim 5, wherein the resource heat map comprises one of:

(a) a processor performance indicator of the node, or (b) a storage performance indicator of the node, or (c) a memory performance indicator of the node.

7. The system as recited in claim 1, wherein the one or more relationships between the node assigned to the client account and the other node assigned to the other client account comprise one or more network links between the node and the other node.

8. A method, comprising:

performing, by one or more computing devices;

obtaining metrics of a provider network, including network traffic metrics collected from a set of nodes implementing at least one network-accessible service on behalf of client accounts of the provider network;

generating a network topology representing one or more relationships between a node of the set of nodes that is assigned to a client account and another node of the set of nodes that is assigned to another client account; and

providing, based on the obtained metrics, performance indicators corresponding to the network topology.

9. The method as recited in claim 8, further comprising:

providing the respective networking performance indicators for network traffic of the node assigned to the client account and network traffic of the other node assigned to the other client account.

10. The method as recited in claim 9, wherein the networking performance indicator of the node assigned to the client account comprises an indication of a ratio between a measured network latency and an upper bound on network latency for traffic associated with the node.

11. The method as recited in claim 9, wherein the networking performance indicator of the node assigned to the client account comprises:

an indication of a ratio between a measured network traffic rate at the node and a bandwidth limit for the node.

12. The method as recited in claim 9, further comprising:

displaying a resource heat map that includes the respective performance indicators for network traffic of the node and the other node.

13. The method as recited in claim 12, wherein the resource heat map comprises one of:

(a) a processor performance indicator of the node, or (b) a storage performance indicator of the node, or (c) a memory performance indicator of the node.

14. The method as recited in claim 8, wherein the one or more relationships between the node assigned to the client account and the other node assigned to the other client account comprise one or more network links between the node and the other node.

15. A non-transitory computer-accessible storage medium storing program instructions that when executed on one or more processors:

obtain metrics of a provider network, including network traffic metrics collected from a set of nodes implementing at least one network-accessible service on behalf of client accounts of the provider network;

generate a network topology representing one or more relationships between a node of the set of nodes that is assigned to a client account and another node of the set of nodes that is assigned to another client account; and

provide, based on the obtained metrics, performance indicators corresponding to the network topology.

16. The non-transitory computer-accessible storage medium as recited in claim 15, wherein the instructions when executed on the one or more processors:

provide the respective performance indicators for network traffic of the node assigned to the client account and network traffic of the other node assigned to the other client account.

17. The non-transitory computer-accessible storage medium as recited in claim 16, wherein the networking performance indicator of the node assigned to the client account comprises an indication of a ratio between peak latency at the node and a target maximum latency.

18. The non-transitory computer-accessible storage medium as recited in claim 16, wherein the networking performance indicator of the node assigned to the client account comprises an indication of a ratio between a measured network traffic rate at the node and a bandwidth limit for the node.

19. The non-transitory computer-accessible storage medium as recited in claim 16, wherein the instructions when executed on the one or more processors:

display a resource heat map that includes the respective performance indicators for network traffic of the node and the other node.

20. The non-transitory computer-accessible storage medium as recited in claim 15, wherein the one or more relationships between the node assigned to the client account and the other node assigned to the other client account comprise one or more network links between the node and the other node.