Method and system for computerized drawing and writing during functional magnetic resonance imaging

• US 8,073,526 B2
• Filed: 02/16/2007
• Issued: 12/06/2011
• Est. Priority Date: 02/16/2007
• Status: Active Grant

• Current Assignee: Sunnybrook Health Sciences Centre
• Original Assignee: Sunnybrook Health Sciences Centre
• Inventors: Graham, Simon James, Mraz, Richard, Baker, Nicole, Clarkson, Ian, Tam, Fred
• Primary Examiner(s): Chen, Tse
• Assistant Examiner(s): REMALY, MARK DONALD
• Application Number:
  US11/707,266
• Publication Number:
  US 20080200796A1
• Time in Patent Office: 1,754 Days
• Field of Search: 600/407, 600/410, 600/411, 600/413, 600/415, 600/416, 600/418, 600/421, 600/422, 600425-429
• US Class Current: 600/411
• CPC Class Codes: G01R 33/28 Details of apparatus provided for in groups G01R33/44 - G01R33/64
• CPC Class Codes: G01R 33/283 Intercom or optical viewing arrangements, structurally associated with NMR apparatus
• CPC Class Codes: G01R 33/4806 Functional imaging of brain activation
• CPC Class Codes: G06F 3/03547 Touch pads, in which fingers can move on a surface
• CPC Class Codes: G06F 3/045 using resistive elements, e.g. a single continuous surface or two parallel surfaces put in contact

Abstract

The present invention provides a method and device to record and visualize drawing and writing movements during functional magnetic resonance imaging (fMRI) of brain activity. The system includes a touch-sensitive tablet, an elevated mounting platform, a stylus, and a controller box, as well as the necessary cabling and software. All equipment residing inside the magnet room is non-ferromagnetic and does not interfere with scanner operation and does not affect fMRI data quality. Individuals lying inside the scanner interact with device in a natural, intuitive way, similar to writing with pen and paper. Drawing motions captured by the tablet are displayed through a pair of fMRI-compatible goggles or by using a projector and screen. Other visual stimuli can be concurrently presented with the drawing motions for the purpose of assessing specific aspects of human behavior. The system allows for a plurality of experiments to be performed, all while brain activity is measured and recorded.

Claims

1. A system for computerized drawing and writing during functional magnetic resonance imaging (fMRI) of a user'"'"'s brain by an MRI scanner located in an electromagnetically shielded enclosure for mapping the user'"'"'s brain activity during a behavioral task, comprising:

a) an fMRI-compatible touch-sensitive tablet having a touch-sensitive surface configured to detect user input while the user is subject to functional magnetic resonance imaging (fMRI);

b) an fMRI-compatible tablet support mounted on a patient table, said touch-sensitive tablet being mounted on said tablet support, said tablet support including an adjustment means for ergonomically accessing the touch-sensitive tablet by the user;

c) an fMRI-compatible visual display mechanism for displaying to the user an input made by the user on the touch-sensitive tablet; and

d) a microprocessor controller connected to said visual display mechanism and said touch-sensitive tablet, said microprocessor controller being located outside the electromagnetically shielded enclosure, said microprocessor controller configured to convert the user'"'"'s input to said touch-sensitive tablet into visual stimuli displayed on said visual display mechanism, log the input into temporal and two dimensional spatial coordinates, and interpret the input associated with the behavioral behavior task under fMRI investigation.

2. The system according to claim 1 wherein said fMRI-compatible visual display mechanism comprises fMRI-compatible goggles mounted on the MRI system.

3. The system according to claim 1 wherein said visual display mechanism comprises a projector and projector screen and associated optics permitting the user to observe the projector screen.

4. The system according to claim 1 wherein said further comprising an fMRI-compatible stylus for interacting with the touch-sensitive surface for entering input thereto.

5. The system according to claim 4 wherein said fMRI-compatible stylus includes a hand held stylus having a contact surface which makes contact with said touch-sensitive surface.

6. The system according to claim 5 wherein said hand held stylus having a contact surface includes a micro switch located on said contact surface configured such that when in contact with said touch-sensitive surface of said touch-sensitive tablet the micro switch is activated indicative of contact being made between said stylus and said touch-sensitive surface, and wherein said hand held stylus is connected to said microprocessor controller.

7. The system according to claim 4 wherein said fMRI-compatible stylus includes wearable apparel having a localized interaction point for interacting with said touch-sensitive surface.

8. The system according to claim 1 wherein said microprocessor controller is further configured to replay responses of the user.

9. The system according to claim 1 wherein said fMRI-compatible touch-sensitive tablet is connected to an fMRI-compatible interface located in the electromagnetically shielded enclosure, said fMRI-compatible interface being connected to said microprocessor controller.

10. The system according to claim 9 wherein said fMRI-compatible interface converts electrical signals received from said fMRI-compatible touch-sensitive tablet into optical signals, including an optical fiber connecting said fMRI-compatible interface to an optoelectronic stage outside of the electromagnetically shielded enclosure incorporated within said microprocessor controller.

11. The system according to claim 9 wherein said fMRI-compatible interface converts signals received from said fMRI-compatible touch-sensitive tablet into wireless signals, said fMRI-compatible interface including transmitting means for transmitting the wireless signals to said microprocessor controller.

12. The system according to claim 1 wherein said adjusting means is configured to provide adjustment of orientation and placement of the touch sensitive said touch-sensitive tablet with respect to the user.

13. The system according to claim 1 wherein said table support includes an articulating frame for adjusting the orientation and placement of said touch-sensitive surface.

14. The system according to claim 1 wherein said microprocessor controller is further configured to be record, display, store, analyze, replay and timestamp all movements detected by said touch-sensitive tablet.

15. The system according to claim 1 including stimulating means for presenting sensory stimuli to the user according to task requirements during fMRI.

16. The system according to claim 15 wherein the sensory stimuli are any one or combination of visual, auditory, or tactile.

17. A method for computerized drawing and writing during functional magnetic resonance imaging (fMRI) of a user'"'"'s brain by an MRI scanner located in an electromagnetically shielded enclosure for mapping the user'"'"'s brain activity during a behavioral task, comprising:

a) placing a user on a patient table and inserting the user into a bore of the MRI scanner, the patient table including an fMRI-compatible touch-sensitive tablet configured to detect user input while the user is subject to functional magnetic resonance imaging (fMRI), the touch-sensitive tablet being mounted on a tablet support, the tablet support including adjusting means for ergonomically accessing the touch-sensitive tablet by the user;

b) during functional magnetic resonance imaging (fMRI) the user interacting with the touch-sensitive tablet for entering input thereto;

c) displaying to the user the input entered by the user on the touch-sensitive tablet;

d) converting responses of the user input to the touch-sensitive tablet into visual stimuli displayed on a visual display mechanism,

e) logging the input into temporal and two dimensional spatial coordinates, and

f) interpreting the input associated with the behavioral task under fMRI investigation.

18. The method according to claim 17 wherein said step c) of displaying to the user the input entered by the user on the touch-sensitive tablet is achieved using fMRI-compatible goggles mounted on the MRI system.

19. The method according to claim 17 wherein said step c) of displaying to the user the input entered by the user on the touch-sensitive tablet is achieved using a projector and projector screen and associated optics permitting the user to observe the projector screen.

20. The method according to claim 17 wherein said step b) of the user interacting with the touch-sensitive tablet involves the use of an fMRI-compatible stylus.

21. The method according to claim 20 wherein the fMRI-compatible stylus includes a hand held stylus having a contact surface which makes contact with the touch-sensitive tablet.

22. The method according to claim 21 wherein the hand held stylus having a contact surface includes a micro switch located on the contact surface configured such that when in contact with the touch-sensitive surface the micro switch is activated indicative of contact being made between the stylus and the touch-sensitive tablet, and wherein the hand held stylus is connected to the microprocessor controller.

23. The system according to claim 20 wherein the fMRI-compatible stylus includes wearable apparel having a localized interaction point for interacting with the touch-sensitive tablet.

24. The method according to claim 17 including replaying responses of the user.

25. The method according to claim 17 including recording, displaying, storing, analyzing, replaying and timestamping all movements detected by the touch-sensitive tablet.

26. The method according to claim 17 including presenting sensory stimuli to the user according to task requirements during fMRI.

27. The method according to claim 17 wherein the sensory stimuli are any one or combination of visual, auditory, or tactile.

28. The method according to claim 17 wherein the fMRI-compatible touch-sensitive tablet is connected to an fMRI-compatible interface located in the electromagnetically shielded enclosure.

29. The method according to claim 28 including the fMRI-compatible interface converting electrical signals received from the fMRI-compatible touch-sensitive tablet into optical signals, and transmitting optical signals to an optoelectronic stage incorporated within a microprocessor controller configured to perform step e) located outside of the electromagnetically shielded enclosure in which the MRI scanner is located.

30. The method according to claim 28 including the fMRI-compatible interface converting electrical signals received from the fMRI-compatible touch-sensitive tablet into wireless signals, the fMRI-compatible interface including transmitting means for transmitting said wireless signals to a microprocessor controller located outside of the electromagnetically shielded enclosure in which the MRI scanner is located, and said microprocessor configured to perform step e).