System and method of correlating virtual reality with biofeedback for enhancing attention

• US 20020128540A1
• Filed: 02/22/2002
• Published: 09/12/2002
• Est. Priority Date: 02/23/2001
• Status: Abandoned Application

• Current Assignee: Dong Joo Kang, Jang Han Lee, Sun-Il Kim
• Original Assignee: Dong Joo Kang, Jang Han Lee, Sun-Il Kim
• Inventors: Kim, In-Young, Kim, Jae-Seok, Kim, Sun-Il, Kang, Dong Joo, Cho, Back-Hwan, Ku, Jeong-Hun, Lee, Jan Han, Jang, Dong-Pyo
• Application Number:
  US10/080,837
• Publication Number:
  US 20020128540A1
• Time in Patent Office: Days
• US Class Current: 600/301
• CPC Class Codes: A61B 5/168 Evaluating attention deficit, hyperactivity
• CPC Class Codes: A61B 5/374 Detecting the frequency distribution of signals, e.g. detecting delta, theta, alpha, beta or gamma waves
• CPC Class Codes: A61B 5/377 using evoked responses
• CPC Class Codes: A61B 5/486 Bio-feedback A61B5/375 takes precedence
• CPC Class Codes: A63F 2300/1012 involving biosensors worn by the player, e.g. for measuring heart beat, limb activity
• CPC Class Codes: A63F 2300/8082 Virtual reality
• CPC Class Codes: G16H 10/20 for electronic clinical trials or questionnaires
• CPC Class Codes: G16H 15/00 ICT specially adapted for medical reports, e.g. generation or transmission thereof
• CPC Class Codes: G16H 40/63 for local operation

Abstract

The present invention discloses a system and method for the enhancement of attention and further the treatment of attention deficit disorder. The present invention also presents a virtual reality environment for enhancing attention shift, selective attention, and sustained attention by correlating a biofeedback device that estimates the current attention level of the patient.

Claims

1. A method of enhancing the attention of a trainee interacting with a computer-generated virtual reality, comprising steps of:

(a) extracting and normalizing brain waves from said trainee through a biofeedback sensor;

(b) estimating the attention level of the trainee by calculating the relative ratio of the strength level of each brain wave; and

(c) updating the visual and/or auditory elements in the VR contents in response to the estimated attention level of the trainee for improving the trainee'"'"'s attention.

2. The method as set forth in claim 1 wherein said step of (a) comprises a step of extracting and normalizing beta-wave of 13˜

20 Hz, theta-wave of 4˜

8 Hz, and SMR-wave of 12˜

16 Hz.

3. The method as set forth in claim 1 wherein said VR contents comprise either one or the combination from a group of visual comparison module, auditory comparison module, memory comparison module, and attention shifting module.

4. The method as set forth in claim 1 wherein said step of (c) comprises steps of:

(d) extracting beta-wave of 13˜

20 Hz;

(e) extracting theta-wave of 4˜

8 Hz;

(f) determining the current attention level of the trainee by calculating the relative ratio of the strength level between said beta-wave and theta-wave; and

(g) updating a VR content in response to the calculated attention level of the trainee.

5. The method as set forth in claim 1 wherein said step of (c) comprises steps of:

(d) displaying a couple of objects in the VR content in response to the trainee'"'"'s attention level;

(e) having the trainee to give an answer to a question asking the trainee to tell the difference of geometric feature between the two objects; and

(f) presenting an updated VR content with an altered visual element for changing the difficulty level in response to the evaluation about said trainee'"'"'s answer to the previous question.

6. The method as set forth in claim 1 wherein said step of (c) comprises steps of:

(d) displaying a vocabulary that is listed in a moving fashion on the screen while asking the trainee if he thinks said listed vocabulary has something to do with what he listens to in VR environment;

(e) having the trainee to respond to the inquiry of step (d) by clicking a mouse or typing a keyboard; and

(f) inducing the enhancement of the trainee'"'"'s attention by altering the moving speed of said listed vocabulary or changing the auditory elements of said VR content in accordance with the trainee'"'"'s response at step (e).

7. The method as set forth in claim 1 wherein said step of (c) comprises steps of:

(d) presenting the trainee with a first VR content in accordance with the estimated level of the trainee'"'"'s attention;

(e) having said first VR content faded gradually away and a second VR content faded gradually in;

(f) having the trainee to compare the first VR content and the second VR content and to find the object that has stealthily showed up in the second VR content; and

(g) inducing the enhancement of the trainee'"'"'s attention by presenting a new VR content that has been leveled up or down in accordance with the trainee'"'"'s response at step (f), respectively.

8. The method as set forth in claim 1 wherein said step of (c) comprises steps of:

(d) presenting a multiple of object models with a reference model to the trainee in accordance with the trainee'"'"'s current level of attention;

(e) having the trainee to designate one out of said multiple of object models which he thinks is to be the most similar to the reference object model; and

(f) inducing the enhancement of the trainee'"'"'s attention by presenting a new VR content that has been leveled up or down in accordance with the trainee'"'"'s response at step

(e), respectively.

9. The method as set forth in claim 1 wherein said step of (c) comprises steps of:

(d) extracting a first beta-wave of 13˜

20 Hz;

(e) extracting a second beta-wave of 20˜

40 Hz;

(f) extracting an alpha-wave of 8˜

13 Hz;

(g) extracting a theta-wave of 4˜

8 Hz;

(h) evaluating the current level of the trainee'"'"'s attention by calculating the ratio between the sum of the first beta-wave and the second beta-wave and the sum of the alpha-wave and the theta-wave; and

(i) presenting a new VR content that has been leveled up if the level of the trainee'"'"'s attention level drops and leveled down if the trainee'"'"'s attention level rises.

10. The method as set forth in claim 1 wherein said step of (c) comprises a step of:

presenting a new VR content where the moving speed of an object has been raised if the attention level of the trainee drops downward and vice versa.

11. The method as set forth in claim 1 where said step of (c) comprises a step of:

presenting an updated VR content with higher difficulty level if the attention level of the trainee drops downward and vice versa.

13. The system as set forth in claim 12 wherein said VR device comprises:

a head mounted device (HMD);

a head tracker;

a sound speaker; and

a variety of VR contents with different levels of difficulty.

14. The system as set forth in claim 12 wherein said processor comprises a unit that estimates the current attention level of the trainee and controls a command to present a VR content with updated level of difficulty in accordance with the estimated current attention level of the trainee.

15. The system as set forth in claim 12 wherein said biofeedback device extracts either one or the combination from the group of beta-wave of 13˜

20 Hz, theta-wave of 4˜

8 Hz, and alpha-wave of 8˜

13 Hz.

16. The system as set forth in claim 12 wherein said biofeedback device extracts either one or the combination from the group of a first beta-wave of 13˜

20 Hz, a second beta-wave of 20˜

40 Hz, a theta-wave of 4˜

8 Hz, and an alpha-wave of 8˜

13 Hz.

17. The system as set forth in claim 12 wherein said VR device comprises VR contents including one or the combination from the group of visual comparison module, auditory comparison module, memory comparison module, and attention shifting module.

18. The system as set forth in claim 12 wherein said VR device comprises VR contents for one or the combination from the group of attention shift, selective attention, attention, and sustained attention.

12. A system for enhancing attention or treating attention deficit disorder of a trainee, comprising:

a biofeedback device producing a multiple of signals from the extraction of the trainee'"'"'s brain waves of specific frequency ranges;

a processor that estimates the trainee'"'"'s attention level by calculating the strength ratio of each signal from the normalized brain waves for each frequency range; and

a virtual reality device having a variety of VR contents and presenting the trainee with an updated VR content for attention enhancement in accordance with the currently estimated attention level of the trainee.