Deterministic control loop scheduling

• US 9,866,431 B2
• Filed: 06/02/2017
• Issued: 01/09/2018
• Est. Priority Date: 07/21/2014
• Status: Expired due to Fees

• Current Assignee: Cisco Technology, Inc. (Cisco Systems, Inc.)
• Original Assignee: Cisco Technology, Inc. (Cisco Systems, Inc.)
• Inventors: Wetterwald, Patrick, Thubert, Pascal, Vasseur, Jean-Philippe
• Primary Examiner(s): Cheng, Peter
• Application Number:
  US15/611,836
• Publication Number:
  US 20170272315A1
• Time in Patent Office: 221 Days
• Field of Search: 370252
• CPC Class Codes: H04L 41/04 Network management architectures or arrangements
• CPC Class Codes: H04L 41/0803 Configuration setting
• CPC Class Codes: H04L 41/0895 Configuration of virtualised networks or elements, e.g. virtualised network function or OpenFlow elements
• CPC Class Codes: H04L 41/34 Signalling channels for network management communication
• CPC Class Codes: H04L 41/40 using virtualisation of network functions or resources, e.g. SDN or NFV entities

Abstract

In one embodiment, a scheduling device in a network receives routing metrics regarding a network path between a device controller and a networked device. The scheduling device also receives controller metrics for the device controller. The scheduling device determines time costs associated with the network path and one or more control operations performed by the device controller, based on the routing and controller metrics. The scheduling device generates a communication schedule based on the time costs and instructs the device controller and the networked device to use the communication schedule.

Claims

1. A method, comprising:

receiving, at a scheduling device in a network, routing metrics regarding a network path between a device controller and a networked device in a control loop running in the network, wherein the routing metrics are indicative of a time associated with transferring data along various links of the network path, wherein the device controller executes a control process within a virtual machine to control the networked device;

receiving, at the scheduling device, controller metrics from the device controller, wherein the controller metrics indicate a delay associated with the device controller executing a control application;

determining, by the scheduling device based on the routing metrics and the controller metrics, a time cost associated with the network path and one or more control operations of the control application performed by the device controller, wherein the time cost is a sum of the time associated with transferring data along the various links of the network path and the delay associated with the device controller executing the one or more control operations of the control application;

generating, by the scheduling device, a communication schedule based on the time cost; and

sending, by the scheduling device, instructions to the device controller and the networked device that instruct the device controller and the networked device to use the communication schedule for performing the one or more control operations in the control loop at specific times.

2. The method as in claim 1, wherein the controller metrics include at least one of:

a delay associated with loading the control application or virtual machine, a delay associated with scheduling the control application to execute, or an execution time associated with the control application performing a particular operation.

3. The method as in claim 1, wherein the networked device comprises a sensor, and wherein the communication schedule indicates a time slot at which the sensor is to provide a measurement to the device controller.

4. The method as in claim 1, wherein the networked device is an actuator and the device controller is a programmable logic controller.

5. The method as in claim 1, wherein the routing metrics indicate a latency for the network path.

6. The method as in claim 1, further comprising:

determining that the device controller has limited resources available;

identifying a second device controller that has available resources;

determining a time associated with transferring control to the second device controller; and

generating a new communication schedule based on the time cost associated with transferring control to the second device controller.

7. The method as in claim 6, wherein the new communication schedule is based on a time associated with a new path from the second device controller to the networked device.

8. The method as in claim 1, further comprising:

selecting the network path based on the routing metrics.

9. An apparatus operating as a path computation element, comprising:

one or more network interfaces to communicate with a network;

a processor coupled to the network interfaces and configured to execute computer instructions; and

a memory configured to store the computer instructions executable by the processor, the computer instructions when executed configured to;

receive routing metrics regarding a network path between a device controller and a networked device in a control loop running in the network, wherein the routing metrics are data indicative of a time associated with transferring data along various links of the network path, wherein the device controller executes a control process within a virtual machine to control the networked device;

receive controller metrics from the device controller, wherein the controller metrics indicate a delay associated with the device controller executing a control application;

determine, based on the routing metrics and the controller metrics, a time cost associated with the network path and one or more operations of the control application performed by the device controller, wherein the time cost is a sum of the time associated with transferring data along the various links of the network path and the delay associated with the device controller executing the one or more control operations of the control application;

generate a communication schedule based on the time cost; and

send instructions to the device controller and the networked device that instruct the device controller and the networked device to use the communication schedule for performing the one or more control operations in the control loop at specific times.

10. The apparatus as in claim 9, wherein the controller metrics include at least one of:

a delay associated with loading the control application or virtual machine, a delay associated with scheduling the control application to execute, or an execution time associated with the control application performing a particular operation.

11. The apparatus as in claim 9, wherein the networked device comprises a sensor, and wherein the communication schedule indicates a time slot at which the sensor is to provide a measurement to the device controller.

12. The apparatus as in claim 9, wherein the networked device is an actuator and the device controller is a programmable logic controller.

13. The apparatus as in claim 9, wherein the routing metrics indicate a latency for the network path.

14. The apparatus as in claim 9, wherein the process when executed is further configured to:

determine that the device controller has limited resources available;

identify a second device controller that has available resources;

determine a time associated with transferring control to the second device controller; and

generate a new communication schedule based on the time associated with transferring control to the second device controller.

15. The apparatus as in claim 14, wherein the new communication schedule is based on a time associated with a new path from the second device controller to the networked device.

16. The apparatus as in claim 9, wherein the process when executed is further configured to:

select the network path based on the routing metrics.

17. A tangible, non-transitory, computer-readable media having software encoded thereon, the software when executed by a processor of a path computation element configured to:

receive routing metrics regarding a network path between a device controller and a networked device in a control loop running in the network, wherein the routing metrics are data indicative of a time associated with transferring data along various links of the network path, wherein the device controller executes a control process within a virtual machine to control the networked device;

receive controller metrics from the device controller, wherein the controller metrics indicate a delay associated with the device controller executing a control application;

determine, based on the routing metrics and the controller metrics, a time cost associated with the network path and one or more operations of the control application performed by the device controller, wherein the time cost is a sum of the time associated with transferring data along the various links of the network path and the delay associated with the device controller executing the one or more control operations of the control application;

generate a communication schedule based on the time cost; and

send instructions to the device controller and the networked device to instruct the device controller and the networked device to use the communication schedule for performing the one or more control operations in the control loop at specific times.

18. The computer-readable media as in claim 17, wherein the controller metrics include at least one of:

a delay associated with loading the control application or virtual machine, a delay associated with scheduling the control application to execute, or an execution time associated with the control application performing a particular operation.