Method and device for assessing, training and improving perceptual-cognitive abilities of individuals

• US 9,566,029 B2
• Filed: 09/29/2009
• Issued: 02/14/2017
• Est. Priority Date: 09/30/2008
• Status: Active Grant

• Current Assignee: Cognisens Inc.
• Original Assignee: Cognisens Inc.
• Inventors: Faubert, Jocelyn, Tinjust, David
• Primary Examiner(s): HULL, JAMES B
• Application Number:
  US13/121,623
• Publication Number:
  US 20110300522A1
• Time in Patent Office: 2,695 Days
• Field of Search: 434/236
• US Class Current: 1/1
• CPC Class Codes: A61B 5/16 Devices for psychotechnics using teaching or educational appliances G09B1/00 - G09B7/00; Testing reaction times ; Devices for evaluating the psychological state
• CPC Class Codes: A61B 5/7445 Display arrangements, e.g. multiple display units
• CPC Class Codes: G09B 5/02 with visual presentation of the material to be studied, e.g. using film strip
• CPC Class Codes: G09B 9/00 Simulators for teaching or training purposes for the use of weapons F41; computing aspects G06; protocols for games, networked simulations or virtual reality H04L67/131
• CPC Class Codes: G09G 2320/0261 in the context of movement of objects on the screen or movement of the observer relative to the screen
• CPC Class Codes: H04N 13/341 using temporal multiplexing
• CPC Class Codes: H04N 13/363 using image projection screens volumetric display H04N13/388
• CPC Class Codes: H04N 13/366 using viewer tracking

Abstract

A device and method for evaluating or improving perceptual-cognitive abilities of a subject, comprising displaying virtual objects moving in a given three-dimensional environment during successive tests. The subject is in visual contact with the virtual objects moving in the three-dimensional environment, and the speed of movement of the virtual objects in the three-dimensional environment during the successive tests is changed.

Claims

1. A device for evaluating or improving perceptual-cognitive abilities of a subject, comprising:

at least one sensor adapted to detect a movement and a position of the subject within a real, physical three-dimensional environment;

a display apparatus comprising an augmented reality helmet configured to display stereoscopic images of moving virtual objects superimposed on the real, physical three-dimensional environment, the virtual objects being displayed during a sequence of successive tests in a manner allowing the subject to be in visual contact with the virtual objects while the subject is moving within the real, physical three-dimensional environment, the display apparatus being adapted to detect an orientation of the augmented reality helmet; and

a controller adapted to;

control the display apparatus to correct in real-time a subject'"'"'s visual perspective based on the detected orientation of the augmented reality helmet;

evaluate, according to an evaluation protocol, the perceptual-cognitive abilities of the subject as a function of the movement and of the position of the subject within the real, physical three-dimensional environment in response to the moving virtual objects superimposed on the real, physical three-dimensional environment; and

change, during the sequence of the successive tests, a speed of movement of the virtual objects displayed by the display apparatus using a staircase variation to increase or decrease the speed of the virtual objects, based on the evaluation of the perceptual-cognitive abilities of the subject from at least one preceding successive test in the sequence of successive tests.

2. A device as defined in claim 1, further comprising a collector of responses configured to receive from the subject responses to the successive tests for use in evaluating, according to the evaluation protocol, the perceptual-cognitive abilities of the subject.

3. A device as defined in claim 2, wherein the collector of responses comprises one of the following devices:

a computer in which verbal responses from the subject are entered for each of the successive tests for evaluating, according to the evaluation protocol, the perceptual-cognitive abilities of the subject;

a keyboard operable by the subject to enter the responses to the successive tests in a computer for evaluating, according to the evaluation protocol, the perceptual-cognitive abilities of the subject; and

a voice recognition system adapted to enter the responses from the subject to the successive tests in a computer for evaluating, according to the evaluation protocol, the perceptual-cognitive abilities of the subject.

4. A device as defined in claim 2, further comprising, following a response phase in which the collector of responses receives the responses from the subject, a feedback phase in which target objects are identified to give a feedback to the subject.

5. A device as defined in claim 2, wherein the controller is configured to control the display apparatus to execute, during each test, the following sequence of phases:

a presentation phase in which the virtual objects are displayed in random positions on the display apparatus;

an indexation phase in which a portion of the virtual objects displayed in the presentation phase are identified as target objects; and

a tracking phase in which the virtual objects move; and

a response phase in which tracking responses related to the target objects are received on the collector of responses.

6. A device as defined in claim 1, wherein:

the augmented reality helmet comprises a shutter visual implement.

7. A device as defined in claim 1, wherein:

the real, physical three-dimensional environment is a sport playground visible through the augmented reality helmet,

the virtual objects are selected from the group consisting of players and a ball, and

the controller is configured to control the display apparatus to change a speed of a play from one play to the other.

8. A device as defined in claim 1, further comprising:

a collector of responses configured to receive from the subject responses to the successive tests for use in the evaluation of the perceptual-cognitive abilities of the subject,

wherein the real, physical three-dimensional environment is a real sport playground, wherein the moving virtual objects are three-dimensional virtual objects selected from the group consisting of players and a ball, wherein the augmented reality helmet is structured to present to the subject the real sport playground and the three-dimensional virtual objects superimposed to the real sport playground, wherein the collector of responses comprises sensors mounted on the subject and connected to a computer, and wherein the sensors detect movements and position of the subject on the real sport playground for use by the computer for the evaluation of the perceptual-cognitive abilities of the subject.

9. A device as defined in claim 1, wherein, to produce the staircase variation of the speed of movement of the virtual objects, the controller:

increases the speed of movement of the virtual objects by a factor of 0.2 log unit following a correct identification of the moving virtual objects by the subject after a given one of the successive tests; and

decreases the speed of movement of the virtual objects by a factor of 0.2 log unit following an incorrect identification of the moving virtual objects by the subject after the given one of the successive tests.

10. A method of evaluating or improving perceptual-cognitive abilities of a subject, comprising:

detecting a movement and a position of the subject within a real, physical three-dimensional environment;

displaying, on a display apparatus, moving virtual objects superimposed on the real, physical three-dimensional environment during a sequence of successive tests, the display apparatus comprising an augmented reality helmet configured to display stereoscopic images of the virtual objects in a manner allowing the subject to be in visual contact with the virtual objects while the subject is moving within the real, physical three-dimensional environment, the display apparatus being adapted to detect an orientation of the augmented reality helmet;

controlling the display apparatus to correct in real-time a visual perspective based on the detected orientation of the augmented reality helmet;

evaluating, according to an evaluation protocol, the perceptual-cognitive abilities of the subject as a function of the movement and of the position of the subject within the real, physical three-dimensional environment in response to the moving virtual objects superimposed on the real, physical three-dimensional environment; and

changing, during the sequence of the successive tests, a speed of movement of the virtual objects displayed by the display apparatus using a staircase variation to increase or decrease the speed of the virtual objects, based on the evaluation of the perceptual-cognitive abilities of the subject from at least one preceding successive test in the sequence of successive tests.

11. A method as defined in claim 10, further comprising collecting responses from the subject to the successive tests for use in the evaluation of the perceptual-cognitive abilities of the subject.

12. A method as defined in claim 11, further comprising, following a response phase in which the responses from the subject are collected, a feedback phase in which the target objects are identified to give a feedback to the subject.

13. A method as defined in claim 10, wherein changing the speed of movement of the virtual objects comprises moving the virtual objects at a constant speed during each test, and changing the speed of movement of the virtual objects from one of the successive tests to the other.

14. A method as defined in claim 10, wherein changing the speed of movement of the virtual objects comprises adjusting the speed of movement of the virtual objects in relation to responses from the subject to the successive tests.

15. A method as defined in claim 10, wherein the evaluation protocol evaluates responses from the subject to the successive tests as a function of the speed of movement of the virtual objects in the real, physical three-dimensional environment.

16. A method as defined in claim 10, wherein displaying the moving virtual objects comprises executing, during each test, the following sequence of phases:

a presentation phase in which the virtual objects are presented in random positions to the subject;

an indexation phase in which a portion of the virtual objects presented in the presentation phase are identified as target objects; and

a tracking phase in which the virtual objects move and the target objects are tracked by the subject for a predetermined duration; and

a response phase in which the subject identifies, as response to the test, the target objects.