SYSTEMS AND METHODS USING VIRTUAL REALITY OR AUGMENTED REALITY ENVIRONMENTS FOR THE MEASUREMENT AND/OR IMPROVEMENT OF HUMAN VESTIBULO-OCULAR PERFORMANCE

• US 20160262608A1
• Filed: 05/23/2016
• Published: 09/15/2016
• Est. Priority Date: 07/08/2014
• Status: Active Grant

• Current Assignee: Novutz LLC
• Original Assignee: Armour Holdings, Inc.
• Inventors: Krueger, Wesley W.O.
• Granted Patent: US 9,788,714 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: A61B 3/0041 characterised by display arrangements
• CPC Class Codes: A61B 3/032 Devices for presenting test symbols or characters, e.g. test chart projectors A61B3/036 takes precedence
• CPC Class Codes: A61B 3/112 for measuring diameter of pupils
• CPC Class Codes: A61B 3/113 for determining or recording eye movement
• CPC Class Codes: A61B 3/18 Arrangement of plural eye-testing or -examining apparatus
• CPC Class Codes: A61B 5/11 Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb for measuring pulse A61B5/02 ;A61B5/1038 takes precedence; motion detection to correct for motion artifacts in physiological signals A61B5/721
• CPC Class Codes: A61B 5/1121 Determining geometric values, e.g. centre of rotation or angular range of movement
• CPC Class Codes: A61B 5/163 by tracking eye movement, gaze, or pupil change
• CPC Class Codes: A61B 5/4023 Evaluating sense of balance
• CPC Class Codes: A61B 5/4064 Evaluating the brain A61B5/031, A61B5/369, A61B5/14553 take precedence
• CPC Class Codes: A61B 5/6803 Head-worn items, e.g. helmets, masks, headphones or goggles
• CPC Class Codes: A61B 5/7257 using Fourier transforms
• CPC Class Codes: A61B 5/744 Displaying an avatar, e.g. an animated cartoon character
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G16H 40/63 for local operation
• CPC Class Codes: G16H 50/20 : for computer-aided diagnosis, e.g. based on medical expert systems
• CPC Class Codes: G16H 50/30 : for calculating health indices; for individual health risk assessment

Abstract

A system and method for using a virtual reality or an augmented reality environment for the measurement and/or improvement of human vestibulo-ocular performance can be implemented by combining a video camera based eye orientation sensor, a head orientation sensor, a display, and an electronic circuit that connects the eye sensor, head sensor, and display. The system and method can be operated in the range of frequencies between 0.01 Hertz and 15 Hertz. The system and method can use a Fourier transform to compute a gain and a phase. The system and method can be used for measuring vestibulo-ocular reflex, dynamic visual acuity, dynamic visual stability, kinetic visual acuity, retinal image stability, or foveal fixation stability in a non-clinical setting. The system and method can be completely portable, head-worn, and self-contained.

Claims

1. A vestibulo-ocular performance measuring device wherein:

the device is configured for measuring a human physiologic vestibulo-ocular performance characteristic selected from the group of;

vestibulo-ocular reflex;

dynamic visual acuity;

dynamic visual stability;

kinetic visual acuity;

retinal image stability; and

foveal fixation stability; and

the device comprises;

an eye orientation sensor wherein;

the eye orientation sensor is attachable to a person'"'"'s head;

the eye orientation sensor comprises a video camera; and

the eye orientation sensor senses vertical movement and horizontal movement of at least one eye;

a head orientation sensor wherein;

the head orientation sensor is attachable to the person'"'"'s head;

the head orientation sensor senses pitch and yaw of the person'"'"'s head wherein pitch represents a rotation about a first axis representing up and down movement of the person'"'"'s face when the rear of the person'"'"'s head moves in the opposite direction and yaw represents horizontal movement of the face when looked at from the front about a second axis substantially aligned with the spine and perpendicular to the first axis; and

the head orientation sensor senses pitch and yaw in a range of frequencies between 0.01 Hertz and 15 Hertz;

the head orientation sensor comprises a micro-electro-mechanical system integrated circuit comprising a module selected from the group consisting of an accelerometer, a magnetometer, and a gyroscope;

an electronic circuit wherein;

the electronic circuit comprises a battery, a central processing unit, and a memory unit;

the electronic circuit is responsive to horizontal and vertical eye movement information received from the eye orientation sensor;

the electronic circuit is responsive to pitch and yaw information received from the head orientation sensor;

the electronic circuit uses a Fourier transform to generate a vertical gain signal and a vertical phase signal in response to the vertical eye movement information and the pitch information; and

the electronic circuit uses a Fourier transform to generate a horizontal gain signal and a horizontal phase signal in response to the horizontal eye movement information and the yaw information; and

a display wherein;

the display is attachable to the person'"'"'s head.

2. The device of claim 1 wherein:

the device is a portable head-worn device configured for use outside of a medical facility;

the device is self-contained wherein self-contained comprises a configuration that measures the human physiologic vestibulo-ocular performance characteristic without the use of any external devices;

the video camera is responsive to motion of an eye feature selected from the group of the pupil, the cornea, the iris, the limbus, and the retina;

the eye orientation sensor senses movement of both the left eye and the right eye;

the electronic circuit is responsive to both left eye movement information and right eye movement information received from the eye orientation sensor;

the electronic circuit compares eye movement of one eye in one direction with eye movement of the same eye in the opposite direction to determine eye movement asymmetry;

the electronic circuit comprises an element that compares a gain signal and a phase signal with a reference value to determine if the measured eye response is normal.

3. The device of claim 2 wherein:

the eye orientation sensor comprises two separate video cameras, one video camera for sending movement of the left eye and one video camera for sensing movement of the right eye;

the video cameras are responsive to infrared light;

the eye orientation sensor senses rotational movement of at least one eye wherein the rotational movement represents a rotation of the eye as viewed by looking at the front of the eye;

the head orientation sensor comprises a 9-axis inertial measurement unit further comprising an accelerometer, a gyroscope, and a magnetometer;

the head orientation sensor senses roll of the person'"'"'s head wherein roll represents a rotation about a third axis substantially orthogonal to the first axis and the second axis representing rotation of the person'"'"'s face when viewed from the front;

the battery comprises a lithium ion battery;

the display comprises a 3-dimensional element;

the display is responsive to the video camera;

the electronic circuit is responsive to rotational eye movement information received from the eye orientation sensor;

the electronic circuit is responsive to roll information received from the head orientation sensor;

the electronic circuit uses a Fourier transform to generate a rotational gain signal and a rotational phase signal in response to the rotational eye movement information and the roll information;

the electronic circuit generates a multi-frequency composite score for a measurement selected from the group consisting of vestibulo-ocular reflex, dynamic visual acuity, dynamic visual stability, kinetic visual acuity, retinal image stability, and foveal fixation stability in response to a plurality of signals at a plurality of frequencies selected from the group comprising a plurality of phase signals, a plurality of gain signals, and signals from a plurality of eyes;

the memory unit comprises data logging functionality wherein the data logging functionality stores a plurality of multi-frequency composite scores;

the device comprises a Global Positioning System receiver;

the device comprises a calibration function;

the device comprises vestibulo-ocular performance improvement information for the user; and

the display is responsive to the head orientation sensor.

4. A portable eye response measuring system configured for measuring a human physiologic vestibulo-ocular performance characteristic selected from the group of:

vestibulo-ocular reflex;

dynamic visual acuity;

dynamic visual stability;

kinetic visual acuity;

retinal image stability; and

foveal fixation stability,

the system comprising;

an eye orientation sensor wherein;

the eye orientation sensor is attachable to a person'"'"'s head;

the eye orientation sensor comprises a video camera; and

the eye orientation sensor senses movement of at least one eye wherein the eye movement is selected from the group comprising vertical eye movement and horizontal eye movement;

a head orientation sensor wherein;

the head orientation sensor is attachable to a person'"'"'s head;

the head orientation sensor senses movement of the person'"'"'s head wherein the head movement is selected from the group comprising pitch movement and yaw movement wherein pitch represents a rotation about a first axis representing up and down movement of the person'"'"'s face when the rear of the person'"'"'s head moves in the opposite direction and yaw represents horizontal movement of the face when looked at from the front about a second axis substantially aligned with the spine and perpendicular to the first axis; and

the head orientation sensor senses movement in a range of frequencies that comprises at least one frequency between 0.01 Hertz and 15 Hertz;

the head orientation sensor comprises a micro-electro-mechanical system integrated circuit comprising a device selected from the group consisting of an accelerometer, a magnetometer, and a gyroscope; and

an electronic circuit wherein;

the electronic circuit comprises a central processing unit and a memory unit;

the electronic circuit is responsive to the movement information received from the eye orientation sensor;

the electronic circuit is responsive to the movement information received from the head orientation sensor; and

the electronic circuit generates a signal selected from the group comprising a phase signal and a gain signal in response to eye movement information received from the eye orientation sensor and head movement information received from the head orientation sensor; and

a display wherein;

the display is attachable to the person'"'"'s head.

5. The system of claim 4 wherein:

the system is configurable for use in an ambulatory environment outside of a medical facility;

the eye orientation sensor senses movement of both the left eye and the right eye;

the electronic circuit is responsive to both left eye movement information and right eye movement information received from the eye orientation sensor;

the electronic circuit uses a Fourier transform to generate both the gain signal and the phase signal;

the electronic circuit compares eye movement of one eye in one direction with eye movement of the same eye in the opposite direction to determine eye movement asymmetry;

the electronic circuit comprises an element that compares the gain signal and the phase signal with a reference value to determine if the measured eye response is normal.

6. The system of claim 4 wherein:

the electronic circuit generates a multi-frequency composite score for the human physiologic vestibulo-ocular performance characteristic in response to a plurality of signals at a plurality of frequencies selected from the group consisting of a plurality of phase signals, and a plurality of gain signals.

7. The system of claim 4 wherein:

the eye sensor comprises a mobile electronic device selected from the group comprising a smart phone, a smart watch, a hand-held electronic device, and a body-attached electronic device.

8. The system of claim 4 wherein:

the video camera is responsive to infrared light.

9. The system of claim 4 wherein:

the eye orientation sensor senses vertical movement and horizontal movement of at least one eye;

the head orientation sensor senses pitch and yaw of the person'"'"'s head;

the electronic circuit uses a Fourier transform to generate a vertical signal selected from the group consisting of a gain signal and a phase signal in response to the vertical eye movement information and the pitch information; and

the electronic circuit uses a Fourier transform to generate a horizontal signal selected from the group consisting of a gain signal and a phase signal in response to the horizontal eye movement information and the yaw information.

10. The system of claim 4 wherein:

the system is configured for detecting neurological damage selected from the group of a concussion and traumatic brain injury.

11. The system of claim 4 wherein:

the display comprises a stereoscopic display; and

the system comprises a virtual reality device.

12. The system of claim 4 wherein:

the system comprises an augmented reality device.

13. The system of claim 4 wherein:

the system is further configured for tests selected from the group of;

vestibulo-ocular performance calibration;

static active vestibulo-ocular performance;

static passive vestibulo-ocular performance;

positional testing;

benign positional paroxysmal vertigo testing;

smooth pursuit testing; and

optokinetic testing.

14. The system of claim 4 wherein:

the system comprises eyewear; and

the eyewear comprises a lens.

15. The system of claim 4 wherein:

the electronic circuit transmits a signal responsive to the eye orientation sensor to a remote device using a wireless communications interface.

16. The system of claim 4 wherein:

the display further comprises a target visual element and a background scene; and

the target visual element has been enhanced with a feature selected from the group comprising;

a recognizable character;

a recognizable optotype;

a feature that moves relative the rest of the target visual element;

a difference in contrast relative to the background scene;

a difference in intensity relative to the background scene;

a difference in focus relative to the background scene; and

a color that contrasts with the background scene.

17. The system of claim 4 wherein:

the display further comprises a target visual element and a background scene;

the background scene comprises a realistic natural scene; and

the target visual element comprises a moving familiar visual object further comprising a ball.

18. The system of claim 4 wherein:

the display further comprises a target visual element and a background scene;

the background scene is presented in three dimensions;

the target visual element is configured to move relative to the background scene along a scan path comprising variations in movements in three orthogonal axes.

19. The system of claim 4 wherein:

the electronic circuit generates a signal selected from the group comprising;

a saccade accuracy;

a saccade amplitude;

a saccade velocity;

a saccade latency;

a saccade duration;

a visual pursuit accuracy;

a visual pursuit acceleration;

a visual pursuit velocity; and

a visual pursuit latency;

in response to eye movement information received from the eye orientation sensor and head movement information received from the head orientation sensor.

20. A vestibulo-ocular performance measuring method, the method comprising the steps of:

electronically sensing changes in eye orientation wherein;

the eye orientation changes are sensed by a video camera in a portable device; and

the eye orientation changes are selected from the group comprising vertical eye movement and horizontal eye movement;

electronically sensing changes in head orientation wherein;

the head orientation changes are sensed by the portable device;

the head orientation changes are selected from the group consisting of pitch movement and yaw movement;

the head orientation changes are sensed in at least one frequency between 0.01 Hertz and 15 Hertz; and

head orientation sensing comprises the use of a device selected from the group consisting of an accelerometer, a magnetometer, and a gyroscope;

comparing the eye orientation and head orientation information using an electronic circuit wherein;

the electronic circuit comprises a central processing unit and a memory unit;

the electronic circuit uses a Fourier transform to generate a signal selected from the group consisting of a phase signal and a gain signal in response to the eye orientation changes and the head orientation changes;

displaying a computer-generated image wherein;

the image is presented on a display on the portable device; and

measuring a human physiologic vestibulo-ocular performance characteristic selected from the group of;

vestibulo-ocular reflex;

dynamic visual acuity;

dynamic visual stability;

kinetic visual acuity;

retinal image stability; and

foveal fixation stability.

21. The vestibulo-ocular performance measuring method of claim 20 wherein:

the Fourier transform generates the phase signal and the gain signal in response to the eye orientation changes and the head orientation changes;

the method further comprises the step of generating a multi-frequency composite score in response to the signal generated by the Fourier transform.

22. The vestibulo-ocular performance measuring method of claim 20 wherein:

sensing eye orientation changes comprises sensing vertical eye movement and horizontal eye movement;

sensing head orientation changes comprises sensing pitch movement and yaw movement;

the Fourier transform generates a horizontal signal and vertical signal in response to the eye orientation changes and the head orientation changes.

23. The vestibulo-ocular performance measuring method of claim 20 wherein the method is done on a device selected from the group of:

a virtual reality device; and

an augmented reality device.

24. The vestibulo-ocular performance measuring method of claim 20 wherein:

the method is used for improving vestibulo-ocular performance in a rehabilitation environment.