Techniques for managing telemetry data for content delivery and/or data transfer networks

• US 10,601,698 B2
• Filed: 02/08/2016
• Issued: 03/24/2020
• Est. Priority Date: 02/06/2015
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Nyerges, Gabor, Ecsedi, Jozsef Tamas
• Primary Examiner(s): Vostal, Ondrej C
• Application Number:
  US15/018,134
• Publication Number:
  US 20160234087A1
• Time in Patent Office: 1,506 Days
• Field of Search: 709203
• CPC Class Codes: H04L 43/12 Network monitoring probes
• CPC Class Codes: H04L 45/02 Topology update or discovery
• CPC Class Codes: H04Q 2209/826 where the data is sent periodically
• CPC Class Codes: H04Q 9/00 Arrangements in telecontrol or telemetry systems for selectively calling a substation from a main station, in which substation desired apparatus is selected for applying a control signal thereto or for obtaining measured values therefrom

Abstract

An application server associated with a content and/or data transfer network executes telemetry framework(s) to monitor telemetry data for client devices over communication networks. The application server instructs one or more client devices associated with the application server to generate telemetry data according to one or more parameters, monitors the telemetry data generated by the one or more client devices when the one or more client devices requests content from a content delivery network associated with the application server, determines a change in a value for the telemetry data, and stores the change in the value for the telemetry data keyed to the one or more parameters in a database.

Claims

1. A method for monitoring, and efficiently storing, real-time telemetry data over a communication network, said method comprising:

instructing, by an application server executing a telemetry framework, one or more client devices to generate real-time telemetry data according to a distribution tree that includes one or more parameters;

monitoring, by the application server in accordance with the distribution tree, the real-time telemetry data generated by the one or more client devices when the one or more client devices requests content from a content delivery network associated with the application server, said monitoring comprising collecting in accordance with the distribution tree the real-time telemetry data generated by the one or more client devices;

determining, by the application server, a change in a value of the telemetry data generated by the one or more client devices;

storing, in a database by the application server, the change in the value of the telemetry data keyed to the one or more parameters;

transforming, by the application server, the collected real-time data into transformed data comprising key-value pairs, said transformed data configured to be efficiently stored using minimal storage space to provide high availability, scalability and low response time for the collected real-time data, which supports efficient real-time data collection;

storing, by the application server, the transformed data in the minimal storage space;

using a key component of a key-value pair of the transformed data to modify the distribution tree;

directing, by the application server, real-time delivery of data content via one or more routes over the communication network to the one or more client devices that request the data content from the content delivery network associated with the application server, said data content based on (i) modified telemetry data generated in accordance with the modified distribution tree and (ii) a cost metric; and

repeating, in accordance with the modified distribution tree, said monitoring, said determining a change, said storing the change, said transforming, said storing the transformed data, said using a key component, and said directing real-time delivery of data content.

2. The method of claim 1, wherein the telemetry framework includes a distribution tree indicating the one or more telemetry parameters.

3. The method of claim 1, further comprising:

establishing a bi-directional communication channel between the application server executing the telemetry framework and each client device that requests content from the content delivery network associated with the application server.

4. The method of claim 1, further comprising:

identifying, by the application server, a sub-group of client devices from the one or more client devices; and

transmitting, by the application server, a group notification to the sub-group of client devices to cause the sub-group of client devices to modify the real-time telemetry data generated when the sub-group of client devices request content from the content delivery network associated with the application server.

5. The method of claim 1, wherein monitoring the real-time telemetry data further comprises:

receiving, by the application server, an application programming interface call that indicates a time interval to collect real-time telemetry data; and

monitoring the real-time telemetry data according to the time interval.

6. A telemetry monitoring device, comprising:

one or more network interfaces adapted to communicate in a communication network;

a processor adapted to execute one or more processes; and

a memory configured to store a process executable by the processor, the process when executed operable to;

instruct one or more client devices associated with telemetry monitoring device to generate real-time telemetry data according to a distribution tree that includes one or more parameters;

monitor in accordance with the distribution tree the real-time telemetry data generated by the one or more client devices when the one or more client devices requests content from a content delivery network associated with the telemetry monitoring device, wherein to monitor the real-time telemetry data comprises to collect in accordance with the distribution tree the real-time telemetry data generated by the one or more client devices;

determine a change in a value of the telemetry data generated by the one or more client devices;

store, in the memory, the change in the value of the telemetry data keyed to the one or more parameters;

transform the collected real-time data into transformed data comprising key-value pairs, said transformed data configured to be efficiently stored using minimal storage space to provide high availability, scalability and low response time for the collected real-time data, which supports efficient real-time data collection;

store, the transformed data in the minimal storage space;

use a key component of a key-value pair of the transformed data to modify the distribution tree;

direct real-time delivery of data content via one or more routes over the communication network to the one or more client devices that request the data content from the content delivery network associated with the application server, said data content based on (i) modified telemetry data generated in accordance with the modified distribution tree and (ii) a cost metric; and

repeat, in accordance with the modified distribution tree, said to monitor, said to determine a change, said to store the change, said to transform, said to store the transformed data, said to use a key component, and said to direct real-time delivery of data content.

7. The telemetry monitoring device of claim 6, wherein the process, when executed by the processor, further causes the processor to:

receive an application programming interface call that includes a distribution tree, the distribution tree indicates the one or more telemetry parameters.

8. The telemetry monitoring device of claim 6, wherein the process, when executed by the processor, further causes the processor to:

instruct the one or more client devices to generate the real-time telemetry data over a bi-directional communication channel; and

receive the real-time telemetry data generated by the one or more client devices over the bi-directional communication channel.

9. The telemetry monitoring device of claim 6, wherein the process, when executed by the processor, further causes the processor to:

identify a sub-group of client devices from the one or more client devices; and

transmit, by the application server, a group notification to the sub-group of client devices to cause the sub-group of client devices to modify the telemetry data generated when the sub-group of client devices request content from the content delivery network associated with the telemetry monitoring device.

10. The telemetry monitoring device of claim 6, wherein the telemetry monitoring device is an application server.

11. The telemetry monitoring device of claim 6, wherein the process, when executed by the processor, further causes the processor to:

receive an application programming interface call that indicates a time interval to collect real-time telemetry data; and

monitor the real-time telemetry data according to the time interval.

12. A tangible, non-transitory, computer-readable media having a telemetry framework encoded thereon, the telemetry framework, when executed by a processor of an application server in a content delivery network, causes the application server to:

instruct one or more client devices associated with the application server to generate real-time telemetry data according to a distribution tree that includes one or more parameters;

monitor in accordance with the distribution tree the real-time telemetry data generated by the one or more client devices when the one or more client devices requests content from the content delivery network, wherein to monitor the real-time telemetry data comprises to collect in accordance with the distribution tree the real-time telemetry data generated by the one or more client devices;

determine a change in a value of the telemetry data generated by the one or more client devices;

store, in a database, the change in the value of the telemetry data keyed to the one or more parameters;

transform the collected real-time data into transformed data comprising key-value pairs, said transformed data configured to be efficiently stored using minimal storage space to provide high availability, scalability and low response time for the collected real-time data, which supports efficient real-time data collection;

store the transformed data in the minimal storage space;

using a key component of a key-value pair of the transformed data to modify the distribution tree;

direct real-time delivery of data content via one or more routes over the communication network to the one or more client devices that request the data content from the content delivery network associated with the application server, said data content based on (i) modified telemetry data generated in accordance with the modified distribution tree and (ii) a cost metric; and

repeat, in accordance with the modified distribution tree, said to monitor, said to determine a change, said to store the change, said to transform, said to store the transformed data, said to use a key component, and said to direct real-time delivery of data content.

13. The tangible, non-transitory, computer-readable media of claim 12, wherein the telemetry framework, when executed by the processor of the application server, further causes the application server to:

receive an application programming interface call that includes a distribution tree, the distribution tree indicates the one or more telemetry parameters.

14. The tangible, non-transitory, computer-readable media of claim 12, wherein the telemetry framework, when executed by the processor of the application server, further causes the application server to:

instruct the one or more client devices to generate the real-time telemetry data over a bi-directional communication channel; and

receive the real-time telemetry data generated by the one or more client devices over the bi-directional communication channel.

15. The tangible, non-transitory, computer-readable media of claim 12, wherein the telemetry framework, when executed by the processor of the application server, further causes the application server to:

identify a sub-group of client devices from the one or more client devices; and

transmit, by the application server, a group notification to the sub-group of client devices to cause the sub-group of client devices to modify the telemetry data generated when the sub-group of client devices request content from the content delivery network associated with the telemetry monitoring device.