SYSTEM AND METHOD FOR LEARNING

• US 20090327176A1
• Filed: 06/18/2009
• Published: 12/31/2009
• Est. Priority Date: 06/25/2008
• Status: Abandoned Application

• Current Assignee: NEC Corporation
• Original Assignee: NEC Corporation
• Inventors: Teramoto, Reiji
• Application Number:
  US12/487,178
• Publication Number:
  US 20090327176A1
• Time in Patent Office: Days
• US Class Current: 706/12
• CPC Class Codes: G06F 18/214 Generating training patterns; Bootstrap methods, e.g. bagging or boosting
• CPC Class Codes: G06F 18/2415 based on parametric or probabilistic models, e.g. based on likelihood ratio or false acceptance rate versus a false rejection rate
• CPC Class Codes: G06N 20/00 Machine learning

Abstract

A method of learning discriminant function for predicting label information by using computer includes: receiving training data including attribute data and label information, to create an initial prediction model based on the attribute data and the label information; calculating, based on the initial prediction model used as a discriminant function, a gradient of a loss function, which is differentiable with respect to the discriminant function and satisfies a monotonous convex function, from the discriminant function and the label information; creating a prediction model from the attribute data and the gradient while assuming that the gradient is label information of each sample of the training data; and updating the discriminant function based on the created prediction model.

Claims

1. A method used in a computer, comprising:

receiving training data including attribute data and label information, to create an initial prediction model based on said attribute data and said label information;

calculating, based on said initial prediction model used as a discriminant function, a gradient of a loss function, which is differentiable with respect to said discriminant function and satisfies a monotonous convex function, from said discriminant function and said label information;

creating a prediction model from said attribute data and said gradient while assuming that said gradient is label information of each sample of said training data; and

updating said discriminant function based on said created prediction model.

2. The method according to claim 1, wherein said loss function is an approximation of an area under curve (AUC) of receiver operating characteristic (ROC), and includes a variable as a function that is differentiable with respect to said discriminant function.

3. The method according to claim 2, wherein said loss function is an indicator function including an index as said function that is differentiable with respect to said discriminant function.

4. The method according to claim 1, wherein said updating uses the following formula:

F_m=F_m-1+ν

T_m

wherein T_m, F_m, F_m-1 and ν

are said prediction model created from said attribute data and said gradient, discriminant function after updating, discriminant function before updating, and normalizing term satisfying 0<

ν

≦

1.

5. The method according to claim 1, wherein said calculating, creating and updating are consecutively conducted and iterated for a plurality of repetition times.

6. The method according to claim 1, wherein said creating of prediction model and creating of initial prediction model use a supervised learning.

7. The method according to claim 6, wherein said creating of prediction model uses a decision tree, a support vector machine, or a neural network.

8. The method according to claim 1, further comprising:

receiving test data including attribute data, to predict label information of said test data based on said attribute data of said test data and said discriminant function.

12. The system according to claim 1, wherein said update section uses the following formula:

F_m=F_m-1+ν

T_m

wherein T_m, F_m, F_m-1 and ν

are said prediction model created from said attribute data and said gradient, discriminant function after updating, discriminant function before updating, and normalizing term satisfying 0<

ν

≦

1.

9. A system using a computer, comprising:

initial-prediction-model creation section that receives training data including attribute data and label information, to create an initial prediction model based on said attribute data and said label information;

a gradient calculation section that calculates, based on said initial prediction model used as a discriminant function, a gradient of a loss function, which is differentiable with respect to said discriminant function and satisfies a monotonous convex function, from said discriminant function and said label information;

a prediction-model creation section that creates a prediction model from said attribute data and said gradient while assuming that said gradient is label information of each sample of said training data; and

an update section that updates said discriminant function based on said created prediction model.

10. The system according to claim 9, wherein said loss function is an approximation of an area under curve (AUC) of receiver operating characteristic (ROC), and includes a variable as a function that is differentiable with respect to said discriminant function.

11. The system according to claim 10, wherein said loss function is an indicator function including an index as said function that is differentiable with respect to said discriminant function.

13. The system according to claim 9, wherein said gradient calculation section, said prediction-model creation section and said update section consecutively operate and iterate for a plurality of repetition times.

14. The system according to claim 9, wherein said prediction-model creation section and said initial-prediction-model creation section use a supervised learning.

15. The system according to claim 14, wherein said prediction-model creation section uses a decision tree, a support vector machine, or a neural network.

16. The system according to claim 9, further comprising:

a judgment section that receives test data including attribute data, to predict label information of said test data based on said attribute data of said test data and said discriminant function.

17. A computer-readable medium encoded with a computer program running on a computer, said computer program causes said computer to:

receive training data including attribute data and label information, to create an initial prediction model based on said attribute data and said label information;

calculate, based on said initial prediction model used as a discriminant function, a gradient of a loss function, which is differentiable with respect to said discriminant function and satisfies a monotonous convex function, from said discriminant function and said label information;

create a prediction model from said attribute data and said gradient while assuming that said gradient is label information of each sample of said training data; and

update said discriminant function based on said created prediction model.

18. The computer-readable medium according to claim 17, wherein said loss function is an approximation of an area under curve (AUC) of receiver operating characteristic (ROC), and includes a variable as a function that is differentiable with respect to said discriminant function.

19. The computer-readable medium according to claim 18, wherein said loss function is an indicator function including an index as said function that is differentiable with respect to said discriminant function.

20. The computer-readable medium according to claim 17, wherein said program further causes said computer to receive test data including attribute data, and predict label information of said test data based on said attribute data of said test data and said discriminant function.