EVALUATION RESULT DISPLAY METHOD, EVALUATION RESULT DISPLAY APPARATUS, AND NON-TRANSITORY COMPUTER-READABLE RECORDING MEDIUM STORING EVALUATION RESULT DISPLAY PROGRAM

• US 20150286692A1
• Filed: 03/27/2015
• Published: 10/08/2015
• Est. Priority Date: 04/04/2014
• Status: Active Grant

• Current Assignee: Panasonic Intellectual Property Corporation of America (Panasonic Holdings Corporation)
• Original Assignee: Panasonic Intellectual Property Corporation of America (Panasonic Holdings Corporation)
• Inventors: UMETANI, HIDEO, FUJIMURA, RYOTA, OHAMA, IKU
• Granted Patent: US 11,093,517 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/248 Presentation of query results
• CPC Class Codes: G06N 20/00 Machine learning
• CPC Class Codes: G06Q 10/04 Forecasting or optimisation specially adapted for administrative or management purposes, e.g. linear programming or "cutting stock problem" market predictions or forecasting for commercial activities G06Q30/0202
• CPC Class Codes: G06Q 30/02 Marketing; Price estimation or determination; Fundraising

Abstract

An acquisition section acquires a plurality of records which is a collection of records each of which includes a prediction value predicted by a prediction model and group information, a sorting section sorts the records based on the prediction values, a calculation section selects records from the sorted records in order, calculates the number of selections indicating the number of selected records and the number of correct decisions indicating the number of decisions in which the group information included in the selected record is decided to belong to a group classified as a correct decision, and outputs both the numbers in association with each other, an image drawing section generates a graph created by plotting both the numbers in a coordinate system with the horizontal axis representing the number of selections and the vertical axis representing the number of correct decisions, and a display section displays the generated graph.

Claims

1. A method, comprising:

acquiring a plurality of records which are a collection of records each of which includes a prediction value predicted by the prediction model which predicts which group, among a plurality of groups, each of a plurality of objects belongs to, and group information indicating a group to which each of the plurality of objects actually belongs;

sorting the plurality of records based on the prediction values;

selecting with respect to the plurality of records sorted in the sorting, records sequentially in sorted order;

calculating the number of selections which indicates the number of the selected records and the number of correct decisions which indicates the number of decisions in which the group information included in the selected record is decided to belong to a group classified as a correct decision among the plurality of groups;

outputting the number of selections and the number of correct decisions in association with each other;

generating a graph which is created by plotting the number of selections and the number of correct decisions output in the outputting in a coordinate system with the horizontal axis representing the number of selections and the vertical axis representing the number of correct decisions; and

displaying the graph generated in the generation step.

2. The method according to claim 1, wherein

the prediction value includes a prediction probability which indicates a probability of belonging to a group classified as the correct decision among the plurality of groups, and

the sorting sorts the plurality of records in descending order of the prediction probability or in ascending order of the prediction probability.

3. The method according to claim 1,

wherein the generating plots a line which links a point at which the number of selections takes 0 and the number of correct decisions takes 0 with a point at which the number of selections takes a maximum value and the number of correct decisions takes a maximum value in the coordinate system.

4. The method according to claim 1,

wherein the selecting selects a predetermined number of the records at a time and the calculating calculates the number of selections of the predetermined number of the selected records and the number of correct decisions of the predetermined number of the selected records.

5. The method according to claim 1,

wherein the selecting selects, among the plurality of records sorted in the sorting, all the records that have the same prediction value in sorted order and the calculating calculates the number of selections of the selected records having the same prediction value and the number of correct decisions of the selected records having the same prediction value.

6. The method according to claim 1, further comprising:

calculating an area ratio of an area on a lower side of the graph which is generated in the generation step to a total area calculated by multiplying a maximum value of the number of selections by a maximum value of the number of correct decisions; and

outputting the calculated value of the area ratio.

7. The method according to claim 1, further comprising:

calculating the number of selections of a point on the graph at which a slope of a line that links a point at which the number of selections takes 0 and the number of correct decisions takes 0 with a point at which the number of selections takes a maximum value and the number of correct decisions takes a maximum value coincides with a slope of the generated graph as an optimum value by using the number of selections and the number of correct decisions output in the outputting, and

outputting the calculated optimum value.

8. An apparatus, comprising:

an acquirer that acquires a plurality of records which are a collection of records each of which includes a prediction value predicted by the prediction model which predicts which group, among a plurality of groups, each of a plurality of objects belongs to, and group information indicating a group to which each of the plurality of objects actually belongs;

a storage that stores the plurality of records acquired by the acquirer;

a sorter that reads out the plurality of records stored in the storage and sorts the read-out plurality of records based on the prediction values;

a calculator that, with respect to the plurality of records sorted by the sorter, selects records sequentially in sorted order, calculates the number of selections which indicates the number of the selected records and the number of correct decisions which indicates the number of decisions in which the group information included in the selected record is decided to belong to a group classified as a correct decision among the plurality of groups, and outputs the number of selections and the number of correct decisions in association with each other;

a generator that generates a graph which is created by plotting the number of selections and the number of correct decisions output by the calculator in a coordinate system with the horizontal axis representing the number of selections and the vertical axis representing the number of correct decisions; and

an outputter that outputs the graph generated by the generator.

9. A non-transitory computer-readable recording medium storing a program, the program causing a computer to function as:

an acquirer that acquires a plurality of records which are a collection of records each of which includes a prediction value predicted by the prediction model which predicts which group, among a plurality of groups, each of a plurality of objects belongs to, and group information indicating a group to which each of the plurality of objects actually belongs;

a storage that stores the plurality of records acquired by the acquirer;

a sorter that reads out the plurality of records stored in the storage and sorts the read-out plurality of records based on the prediction values;

a calculator that, with respect to the plurality of records sorted by the sorter, selects records sequentially in sorted order, calculates the number of selections which indicates the number of the selected records and the number of correct decisions which indicates the number of decisions in which the group information included in the selected record is decided to belong to a group classified as a correct decision among the plurality of groups, and outputs the number of selections and the number of correct decisions in association with each other;

a generator that generates a graph which is created by plotting the number of selections and the number of correct decisions output by the calculator in a coordinate system with the horizontal axis representing the number of selections and the vertical axis representing the number of correct decisions; and

an outputter that outputs the graph generated by the generator.