METHOD FOR THE COMPUTER-AIDED CONTROL OF A TECHNICAL SYSTEM

• US 20130013543A1
• Filed: 02/15/2011
• Published: 01/10/2013
• Est. Priority Date: 03/12/2010
• Status: Abandoned Application

• Current Assignee: Siemens AG
• Original Assignee: Siemens AG
• Inventors: Sterzing, Volkmar, Udluft, Steffen, Dll, Siegmund
• Application Number:
  US13/583,057
• Publication Number:
  US 20130013543A1
• Time in Patent Office: Days
• US Class Current: 706/25
• CPC Class Codes: G05B 13/027 using neural networks only

Abstract

A method for the computer-aided control of a technical system is provided. A recurrent neuronal network is used for modeling the dynamic behaviour of the technical system, the input layer of which contains states of the technical system and actions carried out on the technical system, which are supplied to a recurrent hidden layer. The output layer of the recurrent neuronal network is represented by an evaluation signal which reproduces the dynamics of technical system. The hidden states generated using the recurrent neural network are used to control the technical system on the basis of a learning and/or optimization method.

Claims

1-15. -15. (canceled)

16. A method for computer-aided control and/or regulation of a technical system, wherein:

providing the technical system, which for a plurality of time points, includes for each time point, a state with a number of state variables and an action carried out on the technical system with a number of action variables and an evaluation signal for the state and the action;

modeling the dynamic behavior of the technical system with a recurrent neural network comprising an input layer, a recurrent hidden layer and an output layer based on training data comprising known states, actions, and evaluation signals, wherein;

the input layer is formed by a first state space with a first dimension which comprises the states of the technical system and actions performed on the technical system,

the recurrent hidden layer is formed by a second state space with a second dimension and comprises a plurality of hidden states with a plurality of hidden state variables,

the output layer is formed by a third state space with a third dimension which is defined such that the states thereof represent the evaluation signals or exclusively those state and/or action variables which influence the evaluation signals; and

performing a learning and/or optimization process on the plurality of hidden states in the second state space for controlling and/or regulating the technical system by carrying out actions on the technical system.

17. The method as claimed in claim 16, wherein in the modeling of the dynamic behavior of the technical system, the recurrent neural network is trained using the training data such that the states of the output layer are predicted for a future time point from a past time point.

18. The method as claimed in claim 17, the plurality of hidden states are linked in the hidden layer via a plurality of weights such that a first plurality of weights for a plurality of future time points differ from a second plurality of weights for a plurality of past time points.

19. The method as claimed in claim 16, wherein the technical system includes a non-linear dynamic behavior.

20. The method as claimed in claim 16, wherein in the modeling, the recurrent neural network uses a non-linear activation function.

21. The method as claimed in claim 16, the learning and/or optimization process is an automated learning process.

22. The method as claimed in claim 21, wherein the learning and/or optimization process is a reinforcement learning process.

23. The method as claimed in claim 22, wherein the learning and/or optimization process includes programming, prioritized sweeping and Q-learning.

24. The method as claimed in claim 22, wherein the learning and/or optimization process includes programming or prioritized sweeping or Q-learning.

25. The method as claimed in claim 16, wherein in the modeling, the second dimension of the second state space is varied until a second dimension is found which fulfils a pre-determined criteria.

26. The method as claimed in claim 25, wherein in the modeling, the second dimension of the second state space is reduced step by step for as long as the deviation between the states of the output layer, determined with the recurrent neural network, and the known states according to the training data, is smaller than a pre-determined threshold value.

27. The method as claimed in claim 16, wherein the evaluation signal is represented by an evaluation function which partially depends on the state variables and/or action variables.

28. The method as claimed in claim 16, wherein the learning and/or optimization process uses the evaluation signals in order to carry out the actions with respect to an optimum evaluation signal.

29. The method as claimed in claim 16, wherein the technical system is a turbine.

30. The method as claimed in claim 29, wherein the turbine is a gas turbine or a wind turbine.

31. The method as claimed in claim 30,

wherein the technical system is a gas turbine, and

wherein the evaluation signal is determined at least by the efficiency, pollutant emissions of the gas turbine, the alternating pressures, and the mechanical loading on the combustion chambers of the gas turbine.

32. The method as claimed in claim 30,

wherein the technical system is a gas turbine, and

wherein the evaluation signal is determined at least by the efficiency or pollutant emissions of the gas turbine or the alternating pressures or the mechanical loading on the combustion chambers of the gas turbine.

33. The method as claimed in claim 30,

wherein the technical system is a wind turbine, and

wherein the evaluation signal is determined at least by the force loading and alternating loading on a rotor blade of the wind turbine.

34. The method as claimed in claim 30,

wherein the technical system is a wind turbine, and

wherein the evaluation signal is determined at least by the force loading or alternating loading on a rotor blade of the wind turbine.

35. A computer program product having a program code stored on a machine-readable carrier for carrying out the method as claimed in claim 16, when the program runs on a computer.