Information processing apparatus having a neural network and an expert system

• US 5,701,394 A
• Filed: 04/18/1995
• Issued: 12/23/1997
• Est. Priority Date: 12/18/1989
• Status: Expired due to Term

• Current Assignee: Hitachi, Ltd.
• Original Assignee: Hitachi, Ltd.
• Inventors: Nishizawa, Yasuo, Miyake, Masao, Ujita, Hiroshi, Arita, Setsuo, Ito, Tetsuo, Ohga, Yukiharu, Murata, Fumio
• Primary Examiner(s): Davis, George B.
• Application Number:
  US08/425,334
• Time in Patent Office: 980 Days
• Field of Search: 395/11, 395/22, 395/906, 395/907, 395/914, 395/21
• US Class Current: 706/10
• CPC Class Codes: G05B 13/029 using neural networks and expert systems
• CPC Class Codes: G06N 3/042 Knowledge-based neural networks; Logical representations of neural networks
• CPC Class Codes: Y10S 706/906 Process plant
• CPC Class Codes: Y10S 706/907 Power plant
• CPC Class Codes: Y10S 706/914 Process plant

Abstract

Disclosed is an information processing system having a neural processing unit, an expert system for executing an inference using a rule, and an information selection unit. The neural processing unit and the expert system being arranged in parallel to each other. The information selection unit selects and outputs necessary information from the information outputted from the neural processing unit and the expert system. Since necessary information is selected and outputted from the information obtained from the neural processing unit and the expert system as a result of processing executed by the neural processing unit and the expert system in the parallelly different points of view, the certainty of the information to be selected is improved.

Claims

1. An information processing system comprising:

neural processing means for inputting a plurality of pieces of first information and outputting second information by processing said first information;

first knowledge processing means for outputting third information through inference by use of said second information from said neural processing means and first knowledge information;

first means for inputting said pieces of first information, and generating fourth information showing a singular state of each of said pieces of first information every time each of said pieces of first information is supplied thereto;

second knowledge processing means for outputting fifth information through inference by use of said fourth information from said first means and second knowledge information; and

second means for receiving said third information and said fifth information and producing sixth information to be outputted by compensating one information of said third and fifth information with the other of said third and fifth information in a manner that said sixth information to be outputted at an arbitrary time point is produced by using both said third and fifth information together, simultaneously.

2. An information processing system comprising:

information processing means for inputting a plurality of pieces of first information and outputting second information by processing said pieces of first information;

first knowledge processing means for outputting third information through inference by use of said second information from said information processing means and knowledge information;

first means for inputting said pieces of first information and generating fourth information showing a singular state of each of said pieces of first information every time each of said pieces of first information is supplied thereto;

second knowledge processing means for outputting fifth information through inference by use of said fourth information from said first means and said knowledge information; and

second means for receiving said third information and said fifth information and producing sixth information to be outputted by compensating one information of said third and fifth information with the other of said third and fifth information in a manner that said sixth information to be outputted at an arbitrary time point is produced by using both said third and fifth information together, simultaneously.

3. An information processing system comprising:

neural processing means for outputting a plurality of pieces of information as a result of neural processing of input information; and

an expert system for executing inference using a rule so as to specify information corresponding to said rule from said pieces of information output by said neural processing means to thereby output said specified information in such a manner that said specified information to be outputted at an arbitrary time point is produced by using both said pieces of information and said rule together simultaneously.

4. An information processing system comprising:

neural processing means for outputting a plurality of pieces of information as a result of processing input information;

a first expert systems connected in said system to be parallel with said neural processing means, for outputting information through inference by use of said input information; and

a second expert system for specifying information corresponding to a rule from said pieces of information output by said neural processing means to thereby output the specified information, when said pieces of information output by said neural processing means does not accord with said output information of said first expert system said, specified information to be outputted at an arbitrary time point is produced by using both said pieces of information from said neural processing means and said output information from said first expert system together, simultaneously.

5. An information processing system comprising:

neural processing means for inputting a plurality of pieces of process information and for outputting an abnormal event by processing said process information;

a first knowledge processing means for outputting first display alarm information through inference by use of said abnormal event outputted by said neural processing means and knowledge information;

abnormality monitor means for inputting said process information and outputting alarm information when said process information becomes abnormal;

second knowledge processing means for outputting second display alarm information through inference by use of said alarm information from said abnormality monitor means and said knowledge information;

display alarm output means for inputting said first and second display alarm information from said first and second knowledge processing means and outputting display alarm information by compensating one display alarm information of said first and second display alarm information with the other of said first and second display alarm information in such a manner that said display alarm information to be outputted at an arbitrary time point is produced by using both said first and second display alarm information together, simultaneously; and

means for selecting alarm information corresponding to said display alarm information to be finally displayed as an output by said display alarm output means.

6. An information processing system according to claim 5, further comprising:

alarm information storage means for storing alarm information which is not selected by said means for selecting alarm information; and

alarm information search means for searching for alarm information in said alarm information storage means in response to a search request signal and for supplying said alarm information resulting from a search to display means.

7. An information processing system according to claim 5, further comprising:

confirmation information storage means for storing confirmation information with respect to an abnormal event; and

means for searching for confirmation information corresponding to an abnormal event supplied thereto in said conformation information storage means and for supplying said confirmation information resulting from said search to display means.

8. An information processing system comprising:

neural processing means for inputting a plurality of pieces of process information and for outputting an abnormal event by processing said process information;

first knowledge processing means for outputting first non-display alarm information through inference by use of said abnormal event output by said neural processing means and first knowledge information;

abnormality monitor means for inputting said pieces of process information and outputting alarm information when said process information becomes abnormal;

second knowledge processing means for outputting second non-display alarm information through inference by use of said alarm information from said abnormality monitor means and second knowledge information;

display alarm output means for inputting said first and second non-display alarm information from said first and second knowledge processing means and outputting display non-display alarm information indicating information not to be displayed by compensating one non-display alarm information of said first and second non-display alarm information with the other of said first and second non-display alarm information in such a manner that said non-display alarm information to be outputted at an arbitrary time point is produced by using both said first and second non-display alarm information together, simultaneously; and

means for selecting alarm information which does not correspond to said non-display alarm information output by said display alarm output means.

9. An information processing system according to claim 8, further comprising:

alarm information storage means for storing alarm information which is not selected by said means for selecting alarm information; and

alarm information search means for searching for alarm information in said alarm information storage means in response to a search request signal and for supplying said alarm information resulting from a search to display means.

10. An information processing system comprising:

first information processing means including a neural network for receiving a plurality of pieces of process information, outputting an abnormal event based on said plurality of pieces of process information and producing first display alarm information based on said abnormal event;

second information processing means including a knowledge processing means for processing one of said first display alarm information and said plurality of pieces of process information and producing second display alarm information, said second information processing means being an information processing means different from said first information processing means and including no neural network; and

display alarm information outputting means for inputting said first display alarm information which is an output of said first information processing means and inputting said second display alarm information which is an output of said second information processing means, and for producing display alarm information to be outputted by complementing one display alarm information of said first display alarm information and said second display alarm information with the other display alarm information of said first display alarm information and said second display alarm information in a manner that said display alarm information to be outputted at an arbitrary time point is produced by using both said first and second display alarm information together simultaneously.

11. An information processing system comprising:

first information processing means including a neural network for inputting a plurality of pieces of process information, outputting an abnormal event based on said plurality of pieces of process information and producing first non-display alarm information based on said abnormal event;

second information processing means including knowledge processing means for processing one of said first non-display alarm information and said plurality of pieces of process information and producing second non-display alarm information, said second information processing means being an information processing means different from said first information processing means and including no neural network; and

non-display alarm information outputting means for inputting said first non-display alarm information which is an output of said first information processing means and inputting said second non-display alarm information which is an output of said second information processing means, and for producing non-display alarm information to be outputted by complementing one display alarm information of said first non-display alarm information and said second non-display alarm information with the other display alarm information of said first non-display alarm information and said second non-display alarm information in a manner that said non-display alarm information to be outputted at an arbitrary time point is produced by using both said first and second non-display alarm information together, simultaneously.

12. An information processing system according to claim 11, further comprising:

a display device, and

means for selecting, from plural pieces of input alarm information, alarm information corresponding to display alarm information outputted from display alarm information outputting means, and for outputting the selected alarm information to said display device.

13. An information processing system according to claim 12, further comprising

an alarm information storage means for storing said alarm information which is not selected by said means for selecting alarm information, and

an alarm information search means for searching for alarm information from said alarm information storage means in response to a search request signal, and for outputting the searched alarm information to said display device.

14. An information processing system according to claim 11, further comprising:

a display device, and

means for selecting, from plural pieces of input information, alarm information which does not correspond to said non-display alarm information outputted from said non-display alarm information outputting means, and for outputting the selected alarm information to said display device.

15. An information processing system according to claim 14, further comprising:

an alarm information storage means for storing said alarm information which is not selected by said means for selecting alarm information, and

an alarm information search means for searching for alarm information from said alarm information storage means in response to a search request signal, and for outputting the searched alarm information to said display device.

16. An information processing system comprising:

a neural network for inputting a plurality of pieces of information and producing first information by processing said plurality of pieces of information;

an expert system for processing said plurality of pieces of information by inference using a rule and producing second information, said expert system being an information processing system different from said neural network; and

means for inputting said first information said neural network and said second information output by said expert system, and for producing third information to be outputted by using both of said first information and said second information;

wherein said means for inputting and producing produces said third information to be outputted by compensating one information of said first information and said second information with the other information of said first information and said second information in a manner that said third information to be outputted at an arbitrary time point is produced by using both said first and second information together, simultaneously.

17. An information processing system according to claim 16, wherein

said means for receiving and producing produces said third information to be outputted by compensating said first information with said second information.

18. An information processing system comprising:

neural network for inputting a plurality of pieces of information and producing first information by processing said plurality of pieces of information;

an expert system for processing said plurality of pieces and information by inference using a knowledge information and producing second information, said expert system being an information processing means different from said neural network; and

means for inputting said first information produced by said neural network and said second information produced by said expert system, for determining whether said first information produced by said neural network is accurate or not by using said knowledge information of said expert system, for producing said first information as an output of said information processing system when it is determined that said first information produced by said neural network is accurate, and for preparing new information by complementing said first information with said second information so that said first information becomes accurate and producing said new information as an output of said information processing system when it is determined that said first information obtained by said neural network is not accurate in a manner that said new information to be outputted at an arbitrary time point is produced by using both said first and second information together, simultaneously.

19. An information processing system comprising:

a neural network for inputting a plurality of pieces of information and producing first information by processing said plurality of pieces of information; and

an expert system for processing said first information by inference using knowledge information such that said first information is compensated by said knowledge information and producing second information as said first information thus, compensated in a manner that said second information at an arbitrary time point is produced by using both said first information and said knowledge information together, simultaneously.

20. An information processing system comprising:

a neural network for inputting first plurality of pieces of information and producing first information by processing said first plurality of pieces of information; and

an expert system for inputting second plurality of pieces of information and processing said second plurality of pieces of information by inference using knowledge information and said first information and producing second information in a manner that said second information at an arbitrary time point is produced by using both said first information and said knowledge information together simultaneously, said expert system being an information processing means different from said neural network.

21. An information processing system according to claim 20, wherein

said neural network includes means for outputting an abnormal event based on said plurality of pieces of first information and for producing said abnormal event as said first information, and

wherein said expert system includes means for inputting a plurality of pieces of alarm information as said second plurality of pieces of information, for processing said plurality of pieces of alarm information by said inference using said knowledge information and said abnormal event to select at least one piece of alarm information to be displayed from said plurality of pieces of alarm information, and for producing said selected at least one piece of alarm information as display alarm information which is said second information.

22. An information processing system comprising:

a neural network for inputting a plurality of pieces of information and producing first information by processing said plurality of pieces of information;

an expert system for processing said plurality of pieces of information by inference using knowledge information and producing second information, said expert system being an information processing means different from said neural network; and

means for inputting said first information produced by said neural network and said second information produced by said expert system, and for producing third information to be outputted by compensating one information of said first information and said second information with the other information of said first information and said second information in a manner that said third information to be outputted at an arbitrary time point is produced by using both said first and second information together, simultaneously.

23. An information processing system according to claim 22, wherein said neural network includes means for inputting a plurality of pieces of alarm information as said plurality of pieces of information, and for outputting an abnormal event based on said plurality of pieces of alarm information and producing said abnormal event as said first information, and

wherein said expert system includes means for inputting said plurality of pieces of alarm information as said plurality of pieces of information, for processing said plurality of pieces of alarm information by inference using said knowledge information to select at least one piece of alarm information to be displayed from said plurality of pieces of alarm information, and for producing said selected at least one piece of alarm information as first display alarm information which is said second information, and

wherein said means for inputting includes means for selecting at least one first display alarm information based on said selected at least one piece of alarm information, and for producing said selected at least one first display alarm information as second display alarm information which is said third information to be outputted.

24. An information processing system according to claim 23, wherein

said means for receiving includes said knowledge information and also includes means for, when said neural network can not obtain any abnormal event, selecting at least one first display alarm information by using said knowledge information.

25. An information processing system comprising:

information processing means having a neural network for inputting pregiven input information, and outputting output information in response to said pregiven input information and teacher information related to said output information, said neural network being arranged to correlate said pregiven input information, said output information and said teacher information so that said output information becomes equal to said teacher information, said information processing means outputs first information using said neural network in response to an inputted group of plural pieces of information; and

an expert system for processing said first information by inference using knowledge information such that said first information is compensated by said knowledge information and producing second information as said first information thus compensated in a manner that said second information at an arbitrary time point is produced by using both said first information and said knowledge information together simultaneously, said expert system being an information processing means different from said information processing means.

26. An information processing system comprising:

an information processing means having a neural network for inputting pregiven input information, and outputting output information in response to said pregiven input information and teacher information related to said output information, said neural network being arranged to correlate said pregiven input information, said output information and said teacher information so that said output information becomes equal to said teacher information, said information processing means outputs first information using said neural network in response to an inputted first plural pieces of information; and

an expert system for inputting a second plural pieces of information and processing said second plural pieces of information by inference using knowledge information and said first plural pieces of information and producing second information in a manner that said second information at an arbitrary time point is produced by using both said first plural pieces of information and said knowledge information together simultaneously, said expert system being an information processing means different from said information processing means.

27. An information processing system according to claim 26, wherein said neural network includes means for outputting an abnormal event based on said first plural pieces of information and for producing said abnormal event as said first information, and

wherein said expert system includes means for inputting a plurality of pieces of alarm information as said second plural pieces of information, for processing said plurality of pieces of alarm information by inference using said knowledge information and said abnormal event to select at least one piece of alarm information to be displayed from said plurality of pieces of alarm information, and for producing said selected at least one piece of alarm information as display alarm information which is said second information.

28. An information processing system comprising:

information processing means having a neural network for inputting pregiven input information, and outputting output information in response to said pregiven input information and teacher information related to said output information, said neural network being arranged to correlate said pregiven input information, said output information and said teacher information so that said output information becomes equal to said teacher information, said information processing means outputs first information using said neural network in response to an inputted first plural pieces of information; and

an expert system for inputting second plural pieces of information, processing said second plural pieces of information by inference using knowledge information and producing second information, said expert system being an information processing means different from said information processing means having said neural network; and

means for inputting said first information output by said information processing means and said second information output by said expert system, and for producing third information to be outputted by compensating one information of said first information and said second information with the other information of said first information and said second information in a manner that said third information to be outputted at an arbitrary time point is produced by using both said first and second information together, simultaneously.

29. An information processing system according to claim 28, wherein said neural network includes means for inputting a plurality of pieces of alarm information as said first plural pieces of information, and for outputting an abnormal event based on said plurality of pieces of alarm information and producing said abnormal event as said first information, and

wherein said expert system includes means for inputting said plurality of pieces of alarm information as said second plural pieces of information, for processing said plurality of pieces of alarm information by inference using said knowledge information to select at least one piece of alarm information to be displayed from said plurality of pieces of alarm information, and for producing said selected at least one piece of alarm information as first display alarm information which is said second information, and

wherein said means for inputting includes means for selecting at least one first display alarm information based on said selected at least one piece of alarm information, and for producing said selected at least one first display alarm information as second display alarm information which is said third information to be outputted.

30. An information processing system according to claim 29, wherein

said means for receiving includes said knowledge information and also includes means for, when said neural network can not output any abnormal event, selecting at least one first display alarm information by using said knowledge information.

31. An information processing system comprising:

first information processing means including a neural network for inputting a plurality of pieces of information and producing first information by processing said plurality of pieces of information; and

second information processing means including an expert system for processing said first information by inference using knowledge information such that said first information is compensated by said knowledge information and producing second information as said first information thus compensated in a manner that said second information at an arbitrary time point is produced by using both said first information and said knowledge information together simultaneously, said second information processing means being an information processing means different from said first information processing means.

32. An information processing system comprising:

first information processing means including a neural network for inputting first plurality of pieces of information and producing first information by processing said first plurality of pieces of information; and

second information processing means including an expert system for inputting second plurality of pieces of information and processing said second plurality of pieces of information by inference using knowledge information and said first information and producing second information in a manner that said second information at an arbitrary time point is produced by using both said first pieces of information and said knowledge information together simultaneously, said second information processing means being an information processing means different from said first information processing means.

33. An information processing system according to claim 32, wherein said neural network includes means for outputting an abnormal event based on said first plurality of pieces of information and for producing said abnormal event as said first information, and

wherein said expert system includes means for inputting a plurality of pieces of alarm information as said second plurality of pieces of information, for processing said plurality of pieces of alarm information by inference using said knowledge information and said abnormal event to select at least one piece of alarm information to be displayed from said plurality of pieces of alarm information, and for producing said selected at least one piece of alarm information as display alarm information which is said second information.

34. An information processing system comprising:

first information processing means including a neural network for inputting a plurality of pieces of information and producing first information by processing said plurality of pieces of information;

second information processing means including an expert system for processing said plurality of pieces of information by inference using knowledge information and producing second information, said second information processing means being an information processing means different from said first information processing means; and

means for inputting said first information which is an output of said first information processing means, and inputting said second information which is an output of said second information processing means, and for producing third information to be outputted by compensating one information of said first information and said second information with the other information of said first information and said second information in a manner that said third information to be outputted at an arbitrary time point is produced by using both said first and second information together, simultaneously.

35. An information processing system according to claim 34, wherein said neural network includes means for inputting a plurality of pieces of alarm information as said plurality of pieces of information, for detecting an abnormal event based on said plurality of pieces of alarm information and producing said abnormal event as said first information, and

wherein said expert system includes means for inputting said plurality of pieces of alarm information as said plurality of pieces of information, for processing said plurality of pieces of alarm information by inference using said knowledge information to select at least one piece of alarm information to be displayed from said plurality of pieces of alarm information, and for producing said selected at least one piece of alarm information as first display alarm information which is said second information, and

wherein said means for inputting includes means for selecting at least one first display alarm information based on said selected at least one piece of alarm information, and for producing said selected at least one first display alarm information as second display alarm information which is said third information to be outputted.

36. An information processing system according to claim 35, wherein

said means for receiving includes said knowledge information and also includes means for, when said neural network can not output any abnormal event, selecting at least one first display alarm information by using said knowledge information.

37. An information processing system comprising:

a neural network for inputting a plurality of pieces of information and producing first information by processing said plurality of pieces of information; and

an expert system for processing said first information by inference using knowledge information such that said first information is compensated by said knowledge information and producing second information as said first information thus compensated in a manner that said second information at an arbitrary time point is produced by using both said first information and said knowledge information together simultaneously, said expert system being an information processing means different from said neural network.

38. An information processing system comprising:

a neural network for inputting first plurality of pieces of information and producing first information by processing said first plurality of pieces of information; and

an expert system for inputting second plurality of pieces of information and processing said second plurality of pieces of information by inference using knowledge information and said first information output by said neural network such that said first information is compensated by said knowledge information and producing second information in a manner that said second information at an arbitrary time point is produced by using both said first information and said knowledge information together simultaneously, said expert system being an information processing means different from said neural network.

39. An information processing system according to claim 38, wherein said neural network includes means for detecting an abnormal event based on said first plurality of pieces of information and for producing said abnormal event as said first information, and

wherein said expert system includes means for inputting a plurality of pieces of alarm information as said second plurality of pieces of information, for processing said plurality of pieces of alarm information by inference using said knowledge information and said abnormal event to select at least one piece of alarm information to be displayed from said plurality of pieces of alarm information, and for producing said selected at least one piece of alarm information as display alarm information which is said second information.

40. An information processing system comprising:

a neural network for inputting a plurality of pieces of information and producing first information by processing said first plurality of pieces of information;

an expert system for processing said plurality of pieces of information by inference using knowledge information and producing second information, said expert system being an information processing means different from said neural network; and

means for inputting said first information produced by said neural network and said second information produced by said expert system, and for producing third information to be outputted by using both of said first information and said second information in a manner that said third information to be outputted at an arbitrary time point is produced by using both said first and second information together, simultaneously.

41. An information processing system according to claim 40, wherein said neural network includes means for inputting a plurality of pieces of alarm information as said plurality of pieces of information, for detecting an abnormal event based on said plurality of pieces of alarm information and producing said abnormal event as said first information,

wherein said expert system includes means for inputting said plurality of pieces of alarm information as said plurality of pieces of information, for processing said plurality of pieces of alarm information by said inference using said knowledge information to select at least one piece of alarm information to be displayed from said plurality of pieces of alarm information, and for producing said selected at least one piece of alarm information as first display alarm information which is said second information, and

wherein said means for inputting includes means for selecting at least one first display alarm information based on said selected at least one piece of alarm information, and for producing said selected at least one first display alarm information as second display alarm information which is said information to be outputted.

42. An information processing system according to claim 41, wherein

said means for receiving includes said knowledge information and also includes means for, when said neural network can not output any abnormal event, selecting at least one first display alarm information by using said knowledge information.

43. An information processing system comprising:

a neural network for inputting first plural pieces of information and producing first information by processing said first plural pieces of information;

an expert system for inputting said first information produced by said neural network, for determining whether said first information produced by said neural network has insufficient information or not by inference using said first information and knowledge information of said expert system, for outputting information based on said first information as an output of said information processing system when it is determined that said first information output by said neural network has sufficient information, and for preparing new information by compensating said first information with said knowledge information of said expert system in a manner that said new information at an arbitrary time point is prepared by using both said first information and said knowledge information of said expert system together so that said first information becomes accurate and for outputting said new information as an output of said information processing system when it is determined that said first information obtained by said neural network has insufficient information.

44. An information processing system comprising:

a neural network for inputting first plural pieces of information and producing first information by processing said first plural pieces of information;

an expert system for inputting said first information produced by said neural network and second plural information, for determining whether said first information produced by said neural network has insufficient information or not by inference using said first information and said second plural information and knowledge information of said expert system, for outputting information based on said first information as an output of said information processing system when it is determined that said first information output by said neural network has sufficient information, and for preparing a new information by compensating said first information with said knowledge information of said expert system in a manner that said new information at an arbitrary time point is prepared by using both said first information and said knowledge information of said expert system together, simultaneously so that said first information becomes accurate and for outputting said new information as an output of said information processing system when it is determined that said first information obtained by said neural network has insufficient information.

45. An information processing system comprising:

a neural network for inputting first plural pieces of information and producing first information by processing said first plural pieces of information;

a first expert system for inputting second plural pieces of information and processing second plural pieces of information by inference using knowledge information and producing second information, said first expert system being an information processing system different from said neural network; and

a second expert system for inputting said first information produced by said neural network and said second information produced by said first expert system, for determining whether said first information produced by said neural network has insufficient information or not by inference using said first and second information and knowledge information of said second expert system, for outputting information based on said first information as an output of said information processing system when it is determined that said first information produced by said neural network has sufficient information, and for preparing new information by compensating said first information with said knowledge information of said second expert system in a manner that said new information at an arbitrary time point is prepared by using both said first information and said knowledge information of said second expert system together, so that said first information becomes accurate and for outputting said new information as an output of said information processing system when it is determined that said first information output by said neural network has insufficient information.

46. An information processing system comprising:

a neural network for inputting first plural pieces of information and producing first information by processing said first plural pieces of information;

a first expert system for inputting second plural pieces of input information, processing said second plural pieces of information by inference using knowledge information and producing second information, said first expert system being an information processing means different from said neural network; and

a second expert system for receiving said first information produced by said neural network and said second information produced by said first expert system, for determining whether said first information produced by said neural network has insufficient information or not by inference using said first and second information and knowledge information of said second expert system and for outputting a result of the determination.

47. An information processing system comprising:

a neural network for inputting a plurality of pieces of information and producing first information by processing said plurality of pieces of information;

an expert system for processing one of said first information and said plurality of pieces of information by inference using knowledge information and producing second information, said expert system being an information processing system different from said neural network; and

means for inputting said first information produced by said neural network and said second information produced by said expert system, and for producing third information to be outputted by compensating one information of said first information and said second information with the other information of said first information and said second information in a manner that said third information to be outputted at an arbitrary time point is produced by using both said first and second information together, simultaneously.