Information processing apparatus, information processing method, and program

• US 20070265841A1
• Filed: 05/14/2007
• Published: 11/15/2007
• Est. Priority Date: 05/15/2006
• Status: Active Grant

• Current Assignee: Riken, Sony Corporation (Sony Group Corp.)
• Original Assignee: Riken, Sony Corporation (Sony Group Corp.)
• Inventors: Tani, Jun, Nishimoto, Ryunosuke, Ito, Masato
• Granted Patent: US 7,877,338 B2
• Time in Patent Office: Days
• US Class Current: 704/211
• CPC Class Codes: G06N 3/044 Recurrent networks, e.g. Hopfield networks
• CPC Class Codes: G06N 3/045 Combinations of networks
• CPC Class Codes: G06N 3/049 Temporal neural networks, e.g. delay elements, oscillating neurons or pulsed inputs

Abstract

An information processing apparatus, comprises: a lower time series data generation unit having a plurality of recurrent neural networks which learn predetermined time series data, and generate prediction time series data according to the learning result; an upper time series data generation unit having recurrent neural networks which learn error time series data that is time series data of errors raised at the time of the learning by the respective plural recurrent neural networks of the lower time series data generation unit, and generate prediction error time series data that is time series data of prediction errors according to the learning result; and a conversion unit that performs nonlinear conversion for the prediction errors generated by the upper time series data generation unit, wherein the lower time series data generation unit outputs the prediction time series data generated by the respective plural recurrent neural networks according to the prediction errors which have undergone the nonlinear conversion by the conversion unit.

Claims

1. An information processing apparatus, including:

lower time series data generation means having a plurality of recurrent neural networks which learn predetermined time series data, and generate prediction time series data according to the learning result;

upper time series data generation means having recurrent neural networks which learn error time series data that is time series data of errors raised at the time of the learning by the respective plural recurrent neural networks of the lower time series data generation means, and generate prediction error time series data that is time series data of prediction errors according to the learning result; and

conversion means for performing nonlinear conversion for the prediction errors generated by the upper time series data generation means,

wherein the lower time series data generation means outputs the prediction time series data generated by the respective plural recurrent neural networks according to the prediction errors which have undergone the nonlinear conversion by the conversion means.

2. The information processing apparatus according to claim 1, wherein

the lower time series data generation means further comprises

a plurality of gate means for opening and closing the outputs of the prediction time series data at the subsequent stages of the respective plural recurrent neural networks, and

the plural gate means open and close the outputs of the prediction time series data according to the prediction errors which have undergone the nonlinear conversion by the conversion means.

3. The information processing apparatus according to claim 2, wherein the lower time series data generation means further comprises composition means for compositing and outputting the prediction time series data output from the plural gate means.

4. The information processing apparatus according to claim 1, wherein the recurrent neural networks of the upper time series data generation means are recurrent neural networks of the continuous time type.

5. The information processing apparatus according to claim 1, wherein the conversion means performs the nonlinear conversion for the prediction errors generated by the upper time series data generation means using the softmax function.

6. The information processing apparatus according to claim 1, further comprising

temporal filter means for performing the temporal filter processing for the errors output by the lower time series data generation means.

7. The information processing apparatus according to claim 1, further comprising

nonlinear filter means for nonlinearly converting the errors output by the lower time series data generation means.

8. The information processing apparatus according to claim 1, wherein, at the time of the learning, the lower time series data generation means updates the weight of learning of the respective plural recurrent neural networks according to errors raised at the time of the learning by the respective plural recurrent neural networks.

9. The information processing apparatus according to claim 1, wherein, at the time of the learning, of errors raised at the time of the learning by the respective plural recurrent neural networks, the lower time series data generation means sets a recurrent neural network that has raised a minimum error to the winner, and updates the weight of learning of the respective plural recurrent neural networks according to the distance from the winner.

10. An information processing method, comprising the steps of:

learning predetermined time series data, and generating prediction time series data according to the learning result;

learning error time series data that is time series data of errors raised at the time of learning the predetermined time series data; and

generating prediction error time series data that is time series data of prediction errors according to the learning result;

performing nonlinear conversion for the generated prediction errors; and

outputting the generated prediction time series data according to the prediction errors which have undergone the nonlinear conversion.

11. A program that makes a computer execute a processing, the processing comprising the steps of:

learning predetermined time series data, and generating prediction time series data according to the learning result;

learning error time series data that is time series data of errors raised at the time of learning the predetermined time series data, and generating prediction error time series data that is time series data of prediction errors according to the learning