Deterministic control loop scheduling

• US 9,705,737 B2
• Filed: 07/21/2014
• Issued: 07/11/2017
• Est. Priority Date: 07/21/2014
• Status: Expired due to Fees

• Current Assignee: Cisco Technology, Inc. (Cisco Systems, Inc.)
• Original Assignee: Cisco Technology, Inc. (Cisco Systems, Inc.)
• Inventors: Wetterwald, Patrick, Vasseur, Jean-Philippe, Thubert, Pascal
• Primary Examiner(s): Cheng, Peter
• Application Number:
  US14/336,051
• Publication Number:
  US 20160020987A1
• Time in Patent Office: 1,086 Days
• Field of Search: 370252
• CPC Class Codes: H04L 41/04 Network management architectures or arrangements
• CPC Class Codes: H04L 41/0803 Configuration setting
• CPC Class Codes: H04L 41/0895 Configuration of virtualised networks or elements, e.g. virtualised network function or OpenFlow elements
• CPC Class Codes: H04L 41/34 Signalling channels for network management communication
• CPC Class Codes: H04L 41/40 using virtualisation of network functions or resources, e.g. SDN or NFV entities

Abstract

In one embodiment, a scheduling device in a network receives routing metrics regarding a network path between a device controller and a networked device. The scheduling device also receives controller metrics for the device controller. The scheduling device determines time costs associated with the network path and one or more control operations performed by the device controller, based on the routing and controller metrics. The scheduling device generates a communication schedule based on the time costs and instructs the device controller and the networked device to use the communication schedule.

Claims

1. A method, comprising:

receiving, at a scheduling device in a network, routing metrics regarding a network path between a device controller and a networked device in a control loop running in the network, wherein the scheduling device is a path computation element, wherein routing metrics are indicative of time costs associated with transferring data along various links of the network path, wherein the networked device is a sensor or actuator and the device controller is a programmable logic controller;

receiving, at the scheduling device, controller metrics from the device controller, wherein the controller metrics indicate at least one of;

a delay associated with loading a control application that communicates with the networked device or a delay associated with scheduling the control application to execute;

determining, by the scheduling device, time costs associated with the network path and one or more control operations performed by the device controller, wherein the time costs are based on the routing and controller metrics;

generating, by the scheduling device, a communication schedule based on the time costs; and

sending, by the scheduling device, instructions to the device controller and the networked device that instruct the device controller and the networked device to use the communication schedule for performing the one or more control operations in the control loop at specific times.

2. The method as in claim 1, wherein the controller metrics also include an execution time associated with the control application performing a particular operation.

3. The method as in claim 1, wherein when the networked device is a sensor, the communication schedule indicates a time slot at which the sensor is to provide a measurement to the device controller.

4. The method as in claim 1, wherein the routing metrics indicate a latency for the network path.

5. The method as in claim 1, wherein the device controller executes a control process within a virtual machine to control the networked device.

6. The method as in claim 5, further comprising:

determining that the device controller has limited resources available;

identifying a second device controller that has available resources;

determining a time cost associated with transferring control to the second device controller; and

generating a new communication schedule based on the time cost associated with transferring control to the second device controller.

7. The method as in claim 6, wherein the new communication schedule is based on a time cost associated with a new path from the second device controller to the networked device.

8. The method as in claim 1, further comprising:

selecting the network path based on the routing metrics.

9. An apparatus operating as a path computation element, comprising:

one or more network interfaces to communicate with a network;

a processor coupled to the network interfaces and configured to execute computer instructions; and

a memory configured to store the computer instructions executable by the processor, the computer instructions when executed configured to;

receive routing metrics regarding a network path between a device controller and a networked device in a control loop running in the network, wherein routing metrics are data indicative of time costs associated with transferring data along various links the network path, wherein the networked device is a sensor or actuator and the device controller is a programmable logic controller;

receive controller metrics from the device controller, wherein the controller metrics indicate at least one of;

a delay associated with loading a control application that communicates with the networked device or a delay associated with scheduling the control application to execute;

determine time costs associated with the network path and one or more operations performed by the device controller based on the routing and controller metrics;

generate a communication schedule based on the time costs; and

send instructions to the device controller and the networked device that instruct the device controller and the networked device to use the communication schedule for performing the one or more control operations in the control loop at specific times.

10. The apparatus as in claim 9, wherein the controller metrics also include an execution time associated with the control application performing a particular operation.

11. The apparatus as in claim 9, wherein when the networked device is a sensor, the communication schedule indicates a time slot at which the sensor is to provide a measurement to the device controller.

12. The apparatus as in claim 9, wherein the routing metrics indicate a latency for the network path.

13. The apparatus as in claim 9, wherein the device controller executes a control process within a virtual machine to control the networked device.

14. The apparatus as in claim 13, wherein the process when executed is further configured to:

determine that the device controller has limited resources available;

identify a second device controller that has available resources;

determine a time cost associated with transferring control to the second device controller; and

generate a new communication schedule based on the time cost associated with transferring control to the second device controller.

15. The method as in claim 14, wherein the new communication schedule is based on a time cost associated with a new path from the second device controller to the networked device.

16. The method as in claim 9, wherein the process when executed is further configured to:

select the network path based on the routing metrics.

17. A tangible, non-transitory, computer-readable media having software encoded thereon, the software when executed by a processor of a path computation element configured to:

receive routing metrics regarding a network path between a device controller and a networked device in a control loop running in the network, wherein routing metrics are data indicative of time costs associated with transferring data along various links of the network path, wherein the networked device is a sensor or actuator and the device controller is a programmable logic controller;

receive controller metrics from the device controller, wherein the controller metrics indicate at least one of;

a delay associated with loading a control application that communicates with the networked device or a delay associated with scheduling the control application to execute;

determine time costs associated with the network path and one or more operations performed by the device controller based on the routing and controller metrics;

generate a communication schedule based on the time costs; and

send instructions to the device controller and the networked device to instruct the device controller and the networked device to use the communication schedule for performing the one or more control operations in the control loop at specific times.

18. The computer-readable media as in claim 17, wherein the controller metrics also include an execution time associated with the control application performing a particular operation.