System and method for sensory defect simulation

• US 7,788,075 B2
• Filed: 08/15/2005
• Issued: 08/31/2010
• Est. Priority Date: 08/16/2004
• Status: Active Grant

• Current Assignee: MCW Research Foundation Inc (Medical College of Wisconsin Incorporated)
• Original Assignee: MCW Research Foundation Inc (Medical College of Wisconsin Incorporated)
• Inventors: Ulmer, John L., DeYoe, Edgar A., Kirchhoff, Rachael A.
• Primary Examiner(s): Brusca; John S
• Application Number:
  US11/203,754
• Publication Number:
  US 20060058619A1
• Time in Patent Office: 1,842 Days
• Field of Search: None
• US Class Current: 703/11
• CPC Class Codes: G06T 11/00 2D [Two Dimensional] image generation
• CPC Class Codes: G09B 23/28 for medicine

Abstract

A visual defect simulation system receives a functional field map produced by an MRI system that relates locations in a patient'"'"'s brain to locations in the patient'"'"'s field of view. Planned medical operations are indicated at locations in the patient'"'"'s brain and any resulting vision loss is simulated with a revised functional field map. A scene is displayed and an impairment overlay is produced from the revised functional field map that blocks the scene at locations corresponding to simulated vision loss. The overlay is translated over the scene in response to viewer eye movements detected by a vision-tracking system to present a real-time simulation of the resulting vision loss.

Claims

1. A method for simulating a visual defect produced by a planned operation on a patient'"'"'s brain, the method comprising the steps of:

a) producing a functional field map that relates locations in the patient'"'"'s field of view to regions in the patient'"'"'s brain;

b) designating regions in the patient'"'"'s brain that are affected by the planned operation;

c) producing a revised functional field map that indicates locations in the patient'"'"'s field of view that are affected by the regions designated in step b);

d) displaying a scene that substantially fills the field of view of a user; and

e) altering the displayed scene at locations therein determined by the locations indicated in step c).

2. The method of claim 1 wherein the functional field map is produced by acquiring data with a magnetic resonance imaging (MRI) system.

3. The method of claim 1 wherein step e) further includes producing an overlay displayed over the scene and having pixels corresponding to locations in the patient'"'"'s field of view in which at least one of a transparency and a color of the pixels are determined by the revised functional field map.

4. The method of claim 3 further comprising the steps of:

f) detecting eye movements of a user viewing the displayed scene; and

g) translating a position of the overlay relative to the displayed scene in response to the detected eye movements.

5. The method of claim 3 wherein step d) further includes forming the displayed scene to include a first colored text arranged on a second colored background and step e) includes forming the overlay to include opaque pixels in the second color to alter the displayed scene by obscuring portions of the first color text.

6. The method of claim 1 further comprising the steps of:

f) tracking eye movements of the user viewing the displayed scene; and

g) adjusting a position of the locations of the alterations to the displayed scene to provide a retinopically fixed simulation of a potential visual defect to the user.

7. The method of claim 6 wherein the user is the patient and the potential visual defect is a predicted result of the planned operation.

8. A visual defect simulation system comprising:

a functional field map of a patient'"'"'s brain;

a user input configured to receive parameters indicating a proposed process to be performed on the patient'"'"'s brain;

a processor for receiving the parameters from the user input and the functional field map and being operable to predict at least one visual defect that will result from the proposed process; and

a display coupled to the processor for displaying an image simulating the at least one visual defect.

9. The system of claim 8 wherein the display produces a background scene and a foreground impairment overlay, the impairment overlay including at least one opaque portion obscuring a portion of the background scene to simulate the at least one visual defect.

10. The system of claim 9 further comprising:

an eye-tracking system for monitoring a user viewing the display and producing feedback to the processor indicating movement of the user'"'"'s eyes; and

wherein upon receiving feedback from the eye-tracking system, the processor dynamically adjusts a position of the impairment overlay with respect to the background scene to retinopically fix the at least one visual defect in the user'"'"'s field of view.

11. The system of claim 8 wherein the at least one visual defect is a retinopically fixed scotoma.

12. The system of claim 8 wherein the proposed is a surgical process and wherein the at least one visual defect is a predicted result of the surgical process.

13. The system of claim 8 wherein the processor produces a revised functional field map that predicts the at least one visual defect.

14. The system of claim 13 wherein the revised functional field map indicates locations in the patient'"'"'s field of view that will be affected by the proposed process.

15. A visual defect simulation system comprising:

means for receiving a functional field map that relates locations in a patient'"'"'s field of view to regions in the patient'"'"'s brain;

means for designating regions in the patient'"'"'s brain that are to be affected by a planned operation;

means for producing a revised functional field map that indicates locations in the patient'"'"'s field of view that will be affected by the planned operation; and

means for simulating the patient'"'"'s field of view with visual defects at the locations in the patient'"'"'s field of view that will be affected by the planned operation.

16. The system of claim 15 wherein the means for simulating includes means for displaying a scene with the visual defects superimposed thereon.

17. The system of claim 16 further comprising:

means for tracking a gaze of a user viewing the means for displaying; and

means for adjusting a position of the visual defects superimposed on the scene based on feedback from the means for tracking to substantially fix the visual defects in a location within the user'"'"'s field of view corresponding to the locations in the patient'"'"'s field of view that will be affected by the planned operation.

18. The system of claim 17 further comprising means for generating a log of feedback generated by the means for tracking.

19. The system of claim 17 further comprising means for assigning coordinates to feedback generated by the means for tracking.

20. The system of claim 15 further comprising means for generating a representation of the patient'"'"'s brain from the functional field map.