Three-dimensional visual target acquisition systems

• US 10,712,830 B2
• Filed: 02/12/2019
• Issued: 07/14/2020
• Est. Priority Date: 02/14/2018
• Status: Active Grant

• Current Assignee: Aaron Joseph Derouin
• Original Assignee: Aaron Derouin
• Inventors: Derouin, Aaron, Fischer, Steven, Terai, Burhanuddin
• Primary Examiner(s): Titcomb, William D
• Application Number:
  US16/273,311
• Publication Number:
  US 20190250715A1
• Time in Patent Office: 518 Days
• Field of Search: 715863
• CPC Class Codes: G02B 27/0093 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
• CPC Class Codes: G02B 27/0172 characterised by optical features
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/015 Input arrangements based on nervous system activity detection, e.g. brain waves [EEG] detection, electromyograms [EMG] detection, electrodermal response detection
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06N 7/00 Computing arrangements based on specific mathematical models
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00

Abstract

Fitts'"'"'s law is a predictive model of human movement primarily used in human-computer interaction, ergonomics, and medical assessments. A cervical orientated assessment allows assessments of aspects of users such as injuries, concussions, impacts of equipment as well as ergonomic assessments etc. Accordingly, a three-dimensional visual target acquisition system (3D-VTAS) provides measurements based upon a cervical oriented Fitts'"'"' Law paradigm in a manner which provides for ease of use, high between-day reliability and validity based upon healthy subject'"'"'s performance. The 3D-VTAS also provides increased data allowing determination/verification if there are movement trajectory or target size confounds between the measurements of a subject'"'"'s performance and hence assessments of both healthy and non-healthy individuals as well as assessments of ergonomic factors etc. Accordingly, subject and ergonomic effects of movement trajectory and target size can be established in either portable or fixed systems with rapid establishment and configuration.

Claims

1. A method comprising:

providing to a user a plurality of targets, each target comprising a target zone and an indicator capable of presenting a plurality of indications to the user;

determining timing data relating to acquisition of a subset of the plurality of targets;

establishing data relating to the user in dependence upon the timing data;

wherein

the subset of the plurality of targets established in a particular sequence, the sequence comprising;

a first pair of targets within the transverse plane (yaw) relative to the user;

a second pair of targets within the sagittal plane (pitch) relative to the user;

a third pair of targets diagonally upper left to center relative to the user; and

a fourth pair of targets diagonally upper right to center relative to the user.

2. The method according to claim 1, wherein

the data relating to the user established in dependence upon the timing data comprises at least one of:

a mean dwell time (DT) calculated as the duration of a first indication of the plurality of indications to the user prior to a successful target acquisition;

a mean target acquisition time (TAT), calculated as difference in time between the rising edge of a second indication of the plurality of indications of a start target of the plurality of targets indicating acquisition of the start target of the plurality of targets and the rising edge of the second indication of the plurality of indications of a goal target of the plurality of targets;

a mean time to move off target (TMOT), calculated as the duration of the second indication of the plurality of second indications indicating duration the user acquires the target of the plurality of targets; and

a mean error index (EI), calculated as the ratio of the number of rising edges of first indications of the plurality of indications to the number of rising edges of the second indication of the plurality of indications.

3. The method according to claim 1, wherein

each indication of the plurality of indications is a different colour LED signal.

4. The method according to claim 1, wherein

each target comprises an optical photodetector;

and

the timing data relating to acquisition of a target of the plurality of targets comprises illumination of the optical photodetector by an optical source worn by the user.

5. The method according to claim 1, wherein

the user wears a virtual reality headset;

and

the plurality of targets are virtually presented to the user within a virtual reality environment.

6. A system comprising:

a device comprising a microprocessor coupled to a memory which stores computer executable instructions which when executed by the microprocessor configure the device to;

generate user specific data relating to movement of a predetermined element of a user'"'"'s anatomy in dependence upon established timing information with respect to the movement of the predetermined element of the user'"'"'s anatomy as the user establishes acquisition of a plurality of targets;

wherein

at least one of;

the user specific data relates to a determination of an impact on the user of the wearing an item of equipment upon the predetermined element of the user'"'"'s anatomy; and

the impact relating to the user'"'"'s movement of the predetermined element of the user'"'"'s anatomy is established at multiple predetermined points in time after they initially don the item of equipment;

and

the device is configured to provide indications to the user of a sequential subsets of the plurality of targets such that the user acquires a first target within each sequential subset of the plurality of targets and then acquires a second target within each sequential subset of the plurality of targets; and

the sequential subsets of the plurality of targets are established in a sequence comprising;

a first sequential subset of the plurality of targets are disposed within the transverse plane (yaw) relative to the user;

a second sequential subset of the plurality of targets are disposed within the sagittal plane (pitch) relative to the user;

a third sequential subset of the plurality of targets are disposed diagonally upper left to center relative to the user; and

a fourth sequential subset of the plurality of targets are disposed diagonally upper right to center relative to the user.

7. The system according to claim 6, further comprising:

the plurality of targets, each target comprising a target zone and an indicator capable of presenting a plurality of indications to the user;

wherein

the device is configured to;

determine timing data relating to acquisition of a subset of the plurality of targets; and

establishing data relating to the user in dependence upon the timing data.

8. The system according to claim 6, wherein

the data relating to the user established in dependence upon the timing data comprises at least one of:

a mean dwell time (DT) calculated as the duration of a first indication of the plurality of indications to the user prior to a successful target acquisition;

a mean target acquisition time (TAT), calculated as difference in time between the rising edge of a second indication of the plurality of indications of a start target of the plurality of targets indicating acquisition of the start target of the plurality of targets and the rising edge of the second indication of the plurality of indications of a goal target of the plurality of targets;

a mean time to move off target (TMOT), calculated as the duration of the second indication of the plurality of second indications indicating duration the user acquires the target of the plurality of targets; and

a mean error index (EI), calculated as the ratio of the number of rising edges of first indications of the plurality of indications to the number of rising edges of the second indication of the plurality of indications.

9. The system according to claim 8, wherein

each indication of the plurality of indications is a different colour LED signal.

10. The system according to claim 6, wherein

the user wears a virtual reality headset;

and

the plurality of targets are virtually presented to the user within a virtual reality environment upon the virtual reality headset.

11. A system comprising:

a device comprising a microprocessor coupled to a memory which stores computer executable instructions which when executed by the microprocessor configure the device to;

generate user specific data relating to movement of a predetermined element of a user'"'"'s anatomy in dependence upon established timing information with respect to the movement of the predetermined element of the user'"'"'s anatomy as the user establishes acquisition of a plurality of targets;

wherein

either;

each target comprises an optical photodetector;

the user wears another device upon the predetermined element of the user'"'"'s anatomy comprising an optical source aligned to an axis of the predetermined element of the user'"'"'s anatomy; and

the timing data relating to acquisition of a target of the plurality of targets comprises illumination of the optical photodetector by the optical source within the another device worn by the user;

or;

each target comprises a plurality of optical retroreflectors;

the user wears another device upon the predetermined element of the user'"'"'s anatomy comprising an optical source aligned to an axis of the predetermined element of the user'"'"'s anatomy and an optical photodetector in a predetermined position relative to the optical source; and

the timing data relating to acquisition of a target of the plurality of targets comprises illumination of the optical photodetector by the optical source.

12. A system comprising:

a device comprising a microprocessor coupled to a memory which stores computer executable instructions which when executed by the microprocessor configure the device to;

generate user specific data relating to movement of a predetermined element of a user'"'"'s anatomy in dependence upon established timing information with respect to the movement of the predetermined element of the user'"'"'s anatomy as the user establishes acquisition of a plurality of targets;

wherein

the system further comprises either;

the plurality of targets, wherein each target comprises a photodetector; and

an optical emitter worn by the user upon the predetermined element of the user'"'"'s anatomy and aligned with the predetermined element of the user'"'"'s anatomy;

wherein

the timing information is determined in dependence upon the user illuminating a first photodetector within a first target of the plurality of targets for a predetermined period after receiving an indication to illuminate the first target of the plurality of targets and illuminating a second photodetector within a second target of the plurality of targets after receiving an indication to illuminate the second target of the plurality of targets;

or;

the plurality of targets, wherein each target comprises one or more retroreflectors;

an optical emitter worn by the user upon the predetermined element of the user'"'"'s anatomy and aligned with the predetermined element of the user'"'"'s anatomy; and

an optical detector worn by the upon the predetermined element of the user'"'"'s anatomy in a predetermined position relative to the optical emitter;

wherein

the timing information is determined in dependence upon the user illuminating one or more retroreflectors within a first target of the plurality of targets for a predetermined period after receiving an indication to illuminate the first target of the plurality of targets and illuminating one or more retroreflectors within a second target of the plurality of targets after receiving an indication to illuminate the second target of the plurality of targets.