Efficient resource status reporting apparatuses

• US 10,218,589 B1
• Filed: 12/17/2015
• Issued: 02/26/2019
• Est. Priority Date: 12/17/2015
• Status: Active Grant

• Current Assignee: Innovium, Inc. (Marvell Technology Group Limited)
• Original Assignee: Innovium, Inc. (Marvell Technology Group Limited)
• Inventors: Matthews, William Brad, Agarwal, Puneet
• Primary Examiner(s): Nguyen, Thu Ha T
• Application Number:
  US14/973,541
• Time in Patent Office: 1,167 Days
• Field of Search: 709223, 709224, 709202
• CPC Class Codes: H04L 41/0681 Configuration of triggering conditions
• CPC Class Codes: H04L 43/045 for graphical visualisation of monitoring data
• CPC Class Codes: H04L 43/06 Generation of reports
• CPC Class Codes: H04L 43/0817 by checking functioning
• CPC Class Codes: H04L 43/0876 Network utilisation, e.g. volume of load or congestion level
• CPC Class Codes: H04L 43/16 Threshold monitoring
• CPC Class Codes: H04L 47/70 Admission control; Resource allocation

Abstract

Described techniques enable the tracking and reporting of resource utilization at multiple levels of granularity, the highest of which involves tracking resource usage by a particular object in aggregate. When aggregate usage for the particular object is within certain parameters, actual resource usage is not reported at the lower level of granularity, but is replaced by placeholder values. When aggregate usage for the particular object exceeds a threshold, the particular object is considered to be a “hot spot.” Resource usage for the particular object can then be reported (and tracked, if not already) at the lower level of granularity until the particular object is no longer a “hot spot.” The efficiency of the tracking may be further enhanced by leveraging a bifurcated counting mechanism in which a full count is updated only at selected sample times, with intermediate counters used to store changes in between sample times.

Claims

1. A networking apparatus comprising:

communication hardware interfaces coupled to one or more networks, the communication hardware interfaces configured to receive and send messages;

a switching subsystem configured to process routable messages received over the communication hardware interfaces;

a tracking subsystem configured to track resources used by the apparatus while processing the routable messages, at least by tracking an aggregate count of resources assigned for each object in a first set of objects, each object in the first set corresponding to one of;

an ingress port, egress port, processing queue, or group of ports;

a status update system configured to update resource status information for each object in the first set by comparing a current aggregate count of resource assignments for the object to one or more thresholds for the object, the resource status information including a priority indicator indicating whether the object has a priority status;

a reporting subsystem configured to send, to a receiver, granular measures of resource assignments for priority objects within the first set, the priority objects being objects that currently have the priority status, each of the granular measures for a particular object reflecting how many resources have been assigned to a different combination of the particular object with another object in a second set of objects;

wherein the reporting subsystem is further configured to send the granular measures of resource assignments for the priority objects more frequently than granular measures of resource assignments for other objects in the first set that do not have the priority status.

2. The networking apparatus of claim 1, wherein the networking apparatus is configured to not send the granular measures of resource assignments for the other objects in the first set that do not have the priority status.

3. The networking apparatus of claim 1, wherein the receiver is configured to generate a heat map of granular measures of resource assignments, a first axis of the heat map corresponding to the first set of objects and a second axis of the heat map corresponding to the second set of objects, the receiver further configured to display placeholder values for granular measures depicted in the heat map but not received from the networking apparatus.

4. The networking apparatus of claim 1, further comprising a granular tracking subsystem configured to maintain and update the granular measures for the priority objects within the first set, without maintaining and updating the granular measures for the other objects within the first set that do not currently have the priority status.

5. The networking apparatus of claim 1,

wherein the granular measures are granular status indicators that indicate congestion levels, the granular status indicators further serving as the priority indicators;

wherein the status update system is further configured to determine the granular status indicators by comparing associated granular thresholds with granular counts of pairings of objects from the first set with objects in the second set;

wherein the resources are memory buffers used to store the messages, or portions thereof.

6. The networking apparatus of claim 1, wherein the granular measures are counts of amounts of resources.

7. The networking apparatus of claim 1, further comprising:

a resource assignment subsystem configured to determine whether to assign resources to certain objects based on current resource status information for the certain objects.

8. The networking apparatus of claim 1, wherein the switching subsystem is further configured to use current resource status information to determine one or more of:

whether to buffer or to drop a message that has been routed to or through a given object in the first set, whether to apply flow control to a message that has been routed to or through a given object in the first set, or whether to mark a message that has been routed to or through a given object in the first set with a particular flag.

9. The networking apparatus of claim 1,

wherein each aggregate count is stored in a delayed counter that reflects resource assignments for a corresponding object in the first set as of a last sample time for the corresponding object;

wherein the tracking subsystem is further configured to maintain an intermediate counter for each aggregate count that reflects changes in resource assignments for the corresponding object since the last sample time for the corresponding object, and to update the aggregate count using the intermediate counter at each of a plurality of sample times for the corresponding object;

wherein the apparatus further comprises a scheduling subsystem configured to determine the sample times for each object in the first set based at least partially upon the resource status information.

10. The networking apparatus of claim 1, further comprising:

one or more first memories configured to store full status counters, the full status counters including each aggregate count;

one or more second memories configured to store intermediate counters, the one or more second memories being different than the one or more first memories, each of the intermediate counters corresponding to a different one of the full status counters;

wherein the tracking subsystem is further configured to increment the intermediate counters responsive to the communication hardware interfaces receiving the routable messages, to decrement the intermediate counters responsive to the communication hardware interfaces sending the routable messages and/or the routing subsystem disposing of the routable messages, and to update the full status counters at sample times based on the intermediate counters.

11. A method comprising:

tracking an aggregate count of resources assigned for each object in a first set of objects, the objects in the first set corresponding to components of a network device, the components including at least one of;

an ingress port, an egress port, a processing queue, or a group of ports;

updating resource status information for each object in the first set by comparing a current aggregate count of resource assignments for the object to one or more aggregate thresholds for the object, the resource status information including a priority indicator indicating whether the object has a priority status;

identifying priority objects within the first set that currently have the priority status;

tracking granular counts of resource assignments for each particular object of at least the priority objects, each of the granular counts for the particular object counting resources assigned to a different combination of the particular object with another object in a second set of objects;

based on the tracked granular counts, generating a report of granular measures of resource assignments for objects in the first set of objects, each of the granular measures for a particular object reflecting how many resources have been assigned to a different combination of the particular object with another object in the second set of objects;

selecting specific objects in the first set for which to track the granular counts and/or whose granular measures are to be included in the report based on which objects in the first set are identified as priority objects.

12. The method of claim 11, further comprising:

selecting the specific objects in the first set whose granular measures are to be included in the report, the specific objects being only those objects in the first set that are currently priority objects;

sending the report as a set of one or more messages to a receiver;

wherein the receiver is configured to generate a presentation of granular measures for the first set in which granular measures for objects other than the specific objects are presented using placeholder values.

13. The method of claim 11, further comprising selecting the specific objects in the first set for which to track the granular counts, wherein the granular counts are only tracked for objects in the first set that are currently priority objects.

14. The method of claim 11, further comprising generating a multi-dimensional presentation of the granular measures, a first dimension of the presentation corresponding to the first set of objects and a second dimension of the presentation corresponding to the second set of objects, the presentation including placeholder values for granular measures corresponding to combinations of objects that do not include the priority objects.

15. The method of claim 11, wherein the granular measures are granular status indicators, the method further comprising determining the granular status indicators by comparing associated granular thresholds with the granular counts.

16. The method of claim 11, wherein the granular measures are the granular counts.

17. The method of claim 11, further comprising using the resource status information to determine at least one of:

whether to buffer or to drop a message that has been routed to or through a given object in the first set, whether to apply flow control to a message that has been routed to or through a given object in the first set, or whether to mark a message that has been routed to or through a given object in the first set with a particular flag.

18. The method of claim 11, further comprising:

storing each aggregate count in a delayed counter that reflects resource assignments for a corresponding object in the first set as of a last sample time for the corresponding object;

maintaining an intermediate counter for each aggregate count that reflects changes in resource assignments for the corresponding object since the last sample time for the corresponding object;

updating the aggregate count using the intermediate counter at each of a plurality of sample times for the corresponding object;

determining the sample times for each object in the first set based at least partially upon the resource status information.

19. The method of claim 11, further comprising:

storing full status counters in one or more first memories, the full status counters including each aggregate count;

storing intermediate counters in one or more second memories, the one or more second memories being different than the one or more first memories, each of the intermediate counters corresponding to a different one of the full status counters;

incrementing the intermediate counters responsive to resource assignments for corresponding objects in the first set;

decrementing the intermediate counters responsive to unassigning resources for corresponding objects in the first set;

updating the full status counters at sample times based on the intermediate counters.

20. One or more non-transitory computer-readable storage media storing instructions that, when executed by one or more computing devices, cause performance of:

tracking an aggregate count of resources assigned for each object in a first set of objects, the objects in the first set corresponding to components of a network device, the components including at least one of;

an ingress port, an egress port, a processing queue, or a group of ports;

updating resource status information for each object in the first set by comparing a current aggregate count of resource assignments for the object to one or more aggregate thresholds for the object, the resource status information including a priority indicator indicating whether the object has a priority status;

identifying priority objects within the first set that currently have the priority status;

tracking granular counts of resource assignments for each particular object of at least the priority objects, each of the granular counts for the particular object counting resources assigned to a different combination of the particular object with another object in a second set of objects;

based on the tracked granular counts, generating a report of granular measures of resource assignments for objects in the first set of objects, each of the granular measures for a particular object reflecting how many resources have been assigned to a different combination of the particular object with another object in the second set of objects;

selecting specific objects in the first set for which to track the granular counts and/or whose granular measures are to be included in the report based on which objects in the first set are identified as priority objects.

21. The one or more non-transitory computer-readable storage media of claim 20, wherein the instructions, when executed by the one or more computing devices, further cause performance of:

selecting the specific objects in the first set whose granular measures are to be included in the report, the specific objects being only those objects in the first set that are currently priority objects;

sending the report as a set of one or more messages to a receiver;

wherein the receiver is configured to generate a presentation of granular measures for the first set in which granular measures for objects other than the specific objects are presented using placeholder values.

22. The one or more non-transitory computer-readable storage media of claim 20, wherein the instructions, when executed by the one or more computing devices, further cause performance of:

selecting the specific objects in the first set for which to track the granular counts, wherein granular counts are only tracked for objects in the first set that are currently priority objects.

23. The one or more non-transitory computer-readable storage media of claim 20, wherein the instructions, when executed by the one or more computing devices, further cause performance of:

generating a multi-dimensional presentation of the granular measures, a first dimension of the presentation corresponding to the first set of objects and a second dimension of the presentation corresponding to the second set of objects, the presentation including placeholder values for granular measures corresponding to combinations of objects that do not include the priority objects.

24. The one or more non-transitory computer-readable storage media of claim 20, wherein the instructions, when executed by the one or more computing devices, further cause performance of using the resource status information to determine at least one of:

whether to buffer or to drop a message that has been routed to or through a given object in the first set, whether to apply flow control to a message that has been routed to or through a given object in the first set, or whether to mark a message that has been routed to or through a given object in the first set with a particular flag.

25. The one or more non-transitory computer-readable storage media of claim 20, wherein the instructions, when executed by the one or more computing devices, further cause performance of:

storing each aggregate count in a delayed counter that reflects resource assignments for a corresponding object in the first set as of a last sample time for the corresponding object;

maintaining an intermediate counter for each aggregate count that reflects changes in resource assignments for the corresponding object since the last sample time for the corresponding object;

updating the aggregate count using the intermediate counter at each of a plurality of sample times for the corresponding object;

determining the sample times for each object in the first set based at least partially upon the resource status information.

26. The one or more non-transitory computer-readable storage media of claim 20, wherein the instructions, when executed by the one or more computing devices, further cause performance of:

storing full status counters in one or more first memories, the full status counters including each aggregate count;

storing intermediate counters in one or more second memories, the one or more second memories being different than the one or more first memories, each of the intermediate counters corresponding to a different one of the full status counters;

incrementing the intermediate counters responsive to resource assignments for corresponding objects in the first set;

decrementing the intermediate counters responsive to unas signing resources for corresponding objects in the first set;

updating the full status counters at sample times based on the intermediate counters.