ASSESSMENT SYSTEM AND ASSESSMENT METHOD

• US 20190325775A1
• Filed: 07/03/2019
• Published: 10/24/2019
• Est. Priority Date: 01/04/2017
• Status: Active Grant

• Current Assignee: Johan Ritser Kuipers
• Original Assignee: Johan Ritser Kuipers
• Inventors: KUIPERS, Johan Ritser
• Granted Patent: US 11,580,871 B2
• Time in Patent Office: Days
• CPC Class Codes: A61B 5/18 for vehicle drivers or machine operators
• CPC Class Codes: A61B 5/7264 Classification of physiological signals or data, e.g. using neural networks, statistical classifiers, expert systems or fuzzy systems neural networks per se G06N3/00; expert systems per se G06N5/00
• CPC Class Codes: G09B 9/052 characterised by provision for recording or measuring trainee's performance devices for psychotechnics, e.g. for vehicle drivers A61B5/16, A61B5/18

Abstract

An assessment system is provided for assessing a performance of at least one autonomous actor in a dynamic environment. The system includes a computer program which, when operating on a data processing system, retrieves input selected from digital information, sensor data and a combination thereof, for detecting and classifying the at least one autonomous actor present in the dynamic environment; sets up a virtual reality simulation of the environment, and synchronizes the simulation with the environment. The program evaluates behavior of the actor in the environment, including measuring, analyzing and classifying actions and reactions of the actor in the simulation while the actor performs at least one predefined procedure in the environment; compares the behavior of the actor with a curriculum including at least one documented procedure and at least one documented performance value of the at least one predefined procedure; and outputs a qualification for the performance.

Claims

1. An assessment system for assessing a performance of at least one autonomous actor in a dynamic environment, said assessment system comprising a computer program which, when operating on a data processing system:

retrieves input selected from digital information, sensor data and a combination thereof, for detecting and classifying said at least one autonomous actor that is present in said dynamic environment

set up a virtual reality simulation of said dynamic environment, and synchronizing said virtual reality simulation with said dynamic environment;

evaluate behavior of said at least one autonomous actor in said dynamic environment, said evaluating comprising measuring, analyzing and classifying actions and reactions of said at least one autonomous actor in said synchronized virtual reality simulation while said autonomous actor performs at least one predefined procedures in said dynamic environment;

compares said behavior of said at least one autonomous actor with a curriculum, said curriculum comprising at least one documented procedure and at least one documented performance value of said at least one predefined procedure;

output a qualification for said performance.

2. The assessment system of claim 1, wherein said performance value is selected from an absolute performance value and a relative performance value and a combination thereof, in particular said absolute performance value being based on predefined parameters that are part of the curriculum, and said relative performance value being calculated based on at least one reference performance values of a peer group.

3. The assessment system of claim 2, wherein said absolute performance value is mathematically calculated and said relative performance value is derived from a statistical evaluation, wherein in particular said at least one performance value is applied to at least one selected from individual actions, reactions, on groups of actions, on groups of reactions and combinations thereof.

4. The assessment system of claim 1, wherein said groups of actions and reactions are selected from one type of behavior, different kind of behaviors that are statistically correlated with each other, and combinations thereof.

5. The assessment system of claim 1, wherein said assessment system uses performance data of a peer group related to said at least one predefined procedure to determine specific actions of the driver that correlates with faults related to accident involvement in said at least one predefined procedure.

6. The assessment system of claim 1, wherein said dynamic environment is a traffic environment, said at least one autonomous actor is a driver, and said behaviour comprises behaviour of said driver while driving a vehicle, wherein said computer program furthermore retrieves data of said driver collected from previous attempts on said behaviour, wherein in particular said predefined procedure comprises a specific driving task, and said computer program furthermore retrieves data of said driver collected from previous attempts on said specific driving task.

7. The assessment system of claim 6, wherein in case there is enough proof the driver is capable and there is no indication for increased risk the autonomous assessment system will not change its status of observation and low resource consumption.

8. The assessment system of claim 1, wherein said qualification enables issuing a certificate if said qualification results in a pass, which certificate enables said autonomous actor to continue operating in said dynamic environment.

9. An assessment method for assessment of a performance of at least one autonomous actor in a dynamic environment, said assessment method comprising:

retrieving input selected from digital information, sensor data and a combination thereof, for detecting and classifying said at least one autonomous actor that is present in said dynamic environment;

set up a virtual reality simulation of said dynamic environment, and synchronizing said virtual reality simulation with said dynamic environment;

evaluating behavior of said at least one autonomous actor in said dynamic environment, said evaluating comprising measuring, analyzing and classifying actions and reactions of said at least one autonomous actor in said synchronized virtual reality simulation while said autonomous actor performs at least one predefined procedures in said dynamic environment;

comparing said behaviour of said at least one autonomous actor with a curriculum, said curriculum comprising at least one documented procedure and at least one documented performance value of said at least one predefined procedure;

outputting a qualification for said performance.

10. The assessment method of claim 9, wherein said qualification a certificate is issued if said qualification results in a pass, which certificate enables said autonomous actor to continue operating in said dynamic environment.

11. A computer program product for assessment of a performance of at least one autonomous actor in a dynamic environment for the purpose of certification, said computer program, when operating on a data processing system:

retrieves input selected from digital information, sensor data and a combination thereof, for detecting and classifying said at least one autonomous actor that is present in said dynamic environment;

set up a virtual reality simulation of said dynamic environment, and synchronizing said virtual reality simulation with said dynamic environment;

evaluate behavior of said at least one autonomous actor in said dynamic environment, said evaluating comprising measuring, analyzing and classifying actions and reactions of said at least one autonomous actor in said synchronized virtual reality simulation while said autonomous actor performs at least one predefined procedures in said dynamic environment;

compares said behaviour of said at least one autonomous actor with a curriculum, said curriculum comprising at least one documented procedure and at least one documented performance value of said at least one predefined procedure;

output a qualification for said performance.

12. The computer program product of claim 11, wherein computer program issues a digital certificate if said qualification results in a pass, which digital certificate enables said autonomous actor to continue operating in said dynamic environment.