Bimanual integrative virtual rehabilitation systems and methods

• US 9,724,598 B2
• Filed: 09/20/2013
• Issued: 08/08/2017
• Est. Priority Date: 09/21/2012
• Status: Active Grant

• Current Assignee: Bright Cloud International Corporation
• Original Assignee: Bright Cloud International Corporation
• Inventors: Burdea, Grigore Cristian
• Primary Examiner(s): Lewis, David L
• Assistant Examiner(s): Williams, Ross
• Application Number:
  US14/032,360
• Publication Number:
  US 20140121018A1
• Time in Patent Office: 1,418 Days
• Field of Search: 463 1- 6, 463 35, 463 37, 463 40- 42, 482 4
• CPC Class Codes: A63F 13/211 using inertial sensors, e.g. accelerometers or gyroscopes
• CPC Class Codes: G16H 20/30 relating to physical therapies or activities, e.g. physiotherapy, acupressure or exercising
• CPC Class Codes: G16H 20/70 relating to mental therapies, e.g. psychological therapy or autogenous training

Abstract

Virtual rehabilitation serious games have gained increasing clinical acceptance in the therapy of large patient populations (stroke and traumatic brain injury). This is due to their ability to motivate the patient, as well as intrinsic large number of movement repetitions they generate. These repetitions are key to inducing brain plasticity and facilitating patient recovery. Unfortunately, bi-manual therapy, while potentially more efficacious, is less developed at this time. We present a novel system and method, for bi-manual game-based integrative therapy that combines physical and cognitive training in integrative game play sessions. It is built around the new Razer Hydra Game interface that track'"'"'s the patient'"'"'s arms in 3D and detects trigger pressing. A series of custom games designed to improve focusing, decision making (executive function), short term and long term memory, are played with progressive difficulty.

Claims

1. A method of providing therapy to a patient having a first arm, a first hand, a second arm and a second hand, comprising:

executing a video game on a computer comprising a display and portraying action from the video game on the display, the action being viewable by the patient;

the patient holding a first component of a game controller in the first hand, manipulating an interface on the first component of the game controller with the first hand, and moving the first component of the game controller with the first hand and the first arm to control the video game;

the patient holding a second component of a game controller in the second hand, manipulating an interface on the second component of the game controller with the second hand, and moving the second component of the game controller with the second hand and the second arm to control the video game;

wherein the first component of the game controller is separate from the second component of the game controller and can be moved independently from the second component of the game controller;

the game controller sending one or more signals representative of a position of the interface on the first component, of a position of the interface on the second component, of a motion of the first component, and of a motion of the second component, wherein the signals are reported by the game controller to the computer; and

the computer analyzing the one or more signals and controlling the video game to control action portrayed on the display,

wherein the action portrayed on the display comprises an avatar representative of the patient'"'"'s first hand, holding the first component of the game controller, and an avatar representative of the patient'"'"'s second hand, holding the second component of the game controller,

wherein the patient'"'"'s first arm has a more limited range of movement than the patient'"'"'s second arm,

wherein vertical and horizontal movement of the respective hand avatars on the display is adjusted according to a baseline of the patient'"'"'s motor capabilities such that a range of movement of the patient'"'"'s first arm is exaggerated to be substantially equal to a range of movement of the patient'"'"'s second arm.

2. The method of claim 1, comprising the video game causing a displayed object to include one of two codes wherein a first code indicates that the displayed object can be moved with the first component of the controller and a second code indicates that the displayed object can be moved with the second component of the controller.

3. The method of claim 2 wherein the two codes are different colors.

4. The method of claim 1, comprising the video game causing a displayed object to include one of two codes wherein the computer only allows the displayed to be moved by either the first component or the second component of the controller in accordance with the two codes.

5. The method of claim 1, comprising the video game causing a displayed object to include a first code or a second code and the computer only allowing displayed objects that include the first code to be moved by the first component of the controller and the computer only allowing displayed objects that include the second code to be moved by the second component of the controller.

6. The method of claim 1, comprising the computer monitoring and storing a set of information from the first component and the second component of the controller, the set of information including:

activation of the interface on the first component of the controller;

movement of the first component of the controller;

activation of the interface on the second component of the controller;

movement of the second component of the controller; and

total number of repetitions of movement of the first arm over a video game and over a session of therapy and total number of repetitions of the second arm over a video game and over a session of therapy.

7. The method of claim 6, wherein the computer controls the video game and resulting action on the display in accordance with the set of information.

8. The method of claim 6, wherein the computer analyzes the set of information to determine progress of the patient.

9. The method of claim 1, wherein extra oxygen to help neural activity by improving brain oxygenation is fed to the patient from an oxygen tank while the patient manipulates the first component and the second component.

10. The method of claim 1, wherein cognition enhancing food supplements are fed to the patient a short time before commencing a therapy session.

11. The method of claim 10, wherein the cognition enhancing food supplements comprise one or more of dark chocolate, fatty fish, spinach, berries, walnuts, avocado, wheat germ, beets, or garlic.

12. The method of claim 1, wherein the patient wears wrist weights on the first arm, on the second arm or on both arms while the patient manipulates the first component and the second component.

13. The method of claim 1, wherein weights are added to either the first component of the game controller, to the second component of the game controller or to both.

14. The method of claim 1 wherein the interface on the first component and the interface on the second component includes a button and a trigger and the computer controls a videogame avatar object to respond to movement of the first component of the controller if the button or the trigger on the first component are pressed and the computer controls another video game avatar object to respond to movement of the second component of the controller if the button or the trigger on the second component are pressed.

15. A system of providing therapy to a patient having a first arm, a first hand, a second arm and a second hand, comprising:

a computer;

a video game executing on the computer;

a display portraying action from the video game, the action being viewable by the patient;

a game controller having a first hand-held component with a button and a trigger and a second hand-held component with a button and a trigger, wherein the first component is separate from the second component and can be moved independently from the second component;

the game controller sending one or more signals representative of a position of the button and the trigger on the first component, of a position of the button and a trigger on the second component, of a motion of the first component, and of a motion of the second component wherein the motions are reported by the game controller to the computer; and

the computer analyzing the one or more signals and controlling the video game to control action portrayed on the display,

wherein the action portrayed on the display comprises an avatar representative of the patient'"'"'s first hand, holding the first component of the game controller, and an avatar representative of the patient'"'"'s second hand, holding the second component of the game controller,

wherein the patient'"'"'s first arm has a more limited range of movement than the patient'"'"'s second arm,

wherein vertical and horizontal movement of the respective hand avatars on the display is adjusted according to a baseline of the patient'"'"'s motor capabilities such that a range of movement of the patient'"'"'s first arm is exaggerated to be substantially equal to a range of movement of the patient'"'"'s second arm.

16. The system of claim 15, wherein the video game causes a displayed object to include one of two codes wherein a first code indicates that the displayed object can be moved with the first component of the controller and a second code indicates that the displayed object can be moved with the second component of the controller.

17. The system of claim 15, wherein the video game causes a displayed object to include one of two codes wherein the computer only allows the displayed to be moved by either the first component or the second component of the controller in accordance with the two codes.

18. The system of claim 15, wherein the video game causes a displayed object to include a first code or a second code and the computer only allowing displayed objects that include the first code to be moved by the first component of the controller and the computer only allowing displayed objects that include the second code to be moved by the second component of the controller.

19. The system of claim 15, wherein the computer monitors and stores a set of information from the first component and the second component of the controller derived from successive uses of the system, the set of information including:

activation of the interface on the first component of the controller;

movement of the first component of the controller;

activation of the interface on the second component of the controller;

movement of the second component of the controller; and

total number of repetitions of movement of the first arm over a video game and over a session of therapy, and total number of repetitions of the second arm over a video game and over a session of therapy.

20. The system of claim 19, wherein the computer controls the video game and resulting action on the display in accordance the set of information and the computer analyzes the set of information to determine progress of the patient, wherein the computer controls a videogame avatar object to respond to first component movement if the interface on the first component trigger is manipulated and to respond to second component movement if the interface on the second component is manipulated.