Optical image-based position tracking for magnetic resonance imaging applications

• US 20050054910A1
• Filed: 07/13/2004
• Published: 03/10/2005
• Est. Priority Date: 07/14/2003
• Status: Abandoned Application

• Current Assignee: Sunnybrook and Women's College Health Sciences Centre
• Original Assignee: Sunnybrook and Women's College Health Sciences Centre
• Inventors: Marmurek, Jonathan, Tam, Fred, Tremblay, Marleine, Kucharczyk, John, Graham, Simon James
• Application Number:
  US10/889,667
• Publication Number:
  US 20050054910A1
• Time in Patent Office: Days
• US Class Current: 600/411
• CPC Class Codes: A61B 2034/2055 Optical tracking systems
• CPC Class Codes: A61B 2034/2057 Details of tracking cameras
• CPC Class Codes: A61B 2034/2065 Tracking using image or pattern recognition
• CPC Class Codes: A61B 2034/2072 Reference field transducer attached to an instrument or patient
• CPC Class Codes: A61B 2090/3937 Visible markers
• CPC Class Codes: A61B 2090/3954 magnetic, e.g. NMR or MRI
• CPC Class Codes: A61B 2090/3983 Reference marker arrangements for use with image guided surgery
• CPC Class Codes: A61B 34/20 Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
• CPC Class Codes: A61B 5/055 involving electronic [EMR] or nuclear [NMR] magnetic resonance, e.g. magnetic resonance imaging
• CPC Class Codes: A61B 5/70 Means for positioning the patient in relation to the detecting, measuring or recording means
• CPC Class Codes: A61B 5/7285 for synchronising or triggering a physiological measurement or image acquisition with a physiological event or waveform, e.g. an ECG signal A61B6/5205, A61B6/541, A61B8/5207, A61B8/543 take precedence
• CPC Class Codes: A61B 90/36 Image-producing devices or illumination devices not otherwise provided for
• CPC Class Codes: A61B 90/361 Image-producing devices, e.g. surgical cameras
• CPC Class Codes: A61B 90/39 Markers, e.g. radio-opaque or breast lesions markers
• CPC Class Codes: G01R 33/283 Intercom or optical viewing arrangements, structurally associated with NMR apparatus

Abstract

An optical image-based tracking system determines the position and orientation of objects such as biological materials or medical devices within or on the surface of a human body undergoing Magnetic Resonance Imaging (MRI). Three-dimensional coordinates of the object to be tracked are obtained initially using a plurality of MR-compatible cameras. A calibration procedure converts the motion information obtained with the optical tracking system coordinates into coordinates of an MR system. A motion information file is acquired for each MRI scan, and each file is then converted into coordinates of the MRI system using a registration transformation. Each converted motion information file can be used to realign, correct, or otherwise augment its corresponding single MR image or a time series of such MR images. In a preferred embodiment, the invention provides real-time computer control to track the position of an interventional treatment system, including surgical tools and tissue manipulators, devices for in vivo delivery of drugs, angioplasty devices, biopsy and sampling devices, devices for delivery of RF, thermal energy, microwaves, laser energy or ionizing radiation, and internal illumination and imaging devices, such as catheters, endoscopes, laparoscopes, and like instruments. In other embodiments, the invention is also useful for conventional clinical MRI events, functional MRI studies, and registration of image data acquired using multiple modalities.

Claims

1. An optical image-based motion tracking method for determining the location and orientation of at least one object moving through three-dimensional space within or on the surface of a human or non-human body undergoing magnetic resonance (MR) imaging, the method comprising

(a) obtaining 3D coordinates of the at least one object within a field-of-view of said MR imaging system using a plurality of MR-compatible cameras;

(b) obtaining motion information coordinates with the optical tracking system;

(c) converting motion information coordinates obtained with the optical tracking system into coordinates of said MR imaging system;

(d) acquiring a motion information file for each MR imaging scan of the body;

(e) converting said motion information file into coordinates of the MR imaging system using a registration transformation;

(f) applying each converted motion information file to realign its corresponding MR time series of images; and

applying each converted motion information file and corresponding MR time series of images to track movement of the at least one object in the field-of-view.

2. The method of claim 1, wherein the at least one object comprises biological materials in a human or non-human body.

3. The method of claim 1, wherein the at least one object comprises at least one medical device used in diagnostic and interventional medical and surgical procedures.

4. The method of claim 3 wherein the at least one medical device is selected from the group consisting of surgical tools and tissue manipulators, devices for in vivo delivery of drugs, angioplasty devices, biopsy and sampling devices, devices for delivery of energy or radiation, and internal illumination, imaging devices, tools, instruments, devices, and chemical agents used in conventional anatomic MR imaging or functional MRI studies.

5. The method of claim 1, wherein the camera system estimates motion with six degrees of freedom of a rigid tool containing multiple precisely located reflective objects, the camera system comprises an MR-compatible current charge-coupled-device camera.

6. The method of claim 5, wherein the camera system provides an image with high spatial resolution and wherein the camera system operates at video frame rates and/or the camera system provides measurement accuracy and precision below 100 microns.

7. The apparatus of claim 6, wherein the camera system uses a low-intensity pulsed or continuous light source.

8. The apparatus of claim 7 wherein the camera system is sensitive to at least one specific optical wavelengths outside the range of human vision.

9. The method of claim 1, wherein the optical tracking system transmits position data in MRI spatial coordinates to an MRI system computer to allow for retrospective image coregistration and optionally The optical tracking system transmits the position data in the MR imaging spatial coordinates for real-time display of head motion during real-time fMRI.

10. The method of claim 9, wherein the optical tracking system transmits the position data in the MR imaging spatial coordinates to adjust imaging gradients such that the imaging scan plane prospectively tracks with moving anatomy or the optical tracking system collects data from multiple different imaging modalities to be registered by measuring the patient'"'"'s orientation in each image with respect to a common coordinate system.

11. The method of claim 10, wherein the data from the optical tracking system flows to a behavioral task computer to record movement kinematics or motion parameters for use in sensorimotor fMRI performances.

12. The method of claim 10, wherein the position data flows to an additional registration computer for subsequent alignment of MR images with images from another imaging modality.

13. The method of claim 10, wherein the transmission of said position data between any or all said computers are made by high speed internet connections.

14. The method of claim 13, wherein the imaging scan plane and field-of-view offset is adjusted such that the start the acquisition of 3D anatomical data are initially registered spatially with respect to previous image acquisition.

15. The method of claim 14, wherein the real-time computer control tracks the position of the interventional treatment system, including at least one element selected from the group consisting of surgical tools and tissue manipulators, devices for in vivo delivery of drugs, angioplasty devices, biopsy and sampling devices, devices for delivery of energy or radiation, internal illumination devices and imaging devices.

16. The method of claim 15, wherein the tracking system is operated independently of MRI acquisition to track motions in between scans or during interventional procedures that do not require real-time guidance.

17. The method of claim 1, wherein the optical position tracking system is used in an interventional MRI application where images are used to guide and monitor minimally-invasive diagnostic and therapeutic procedures or the optical position tracking system is used in a medical application to provide registration of MRI data and with data obtained from imaging modalities other then MRI.

18. The method of claim 1, wherein the optical position tracking system is used to longitudinally evaluate changes in brain images acquired over time periods selected from the group consisting of minutes, hours, days, weeks, and months.

19. The method of claim 1, wherein the optical position tracking system is independent of human operator input.

20. The method of claim 1, wherein the optical position tracking system is not reliant on pixel size.

21. The method of claim 1, wherein the position tracking system is insensitive to signal variations in and between MR images with respect to position measurement.

22. The method of claim 1, wherein operation of the position tracking device is independent of the MR scanner.

23. The method of claim 1, wherein the motion tracking system is used to determine the position of anatomy as a function of a scanning session to enable coregistration of image data and to detect and quantify changes caused by motion.

24. The method of claim 1, wherein the motion tracking system assists positioning of the body so relative to MRI system so that MRI scans are performed with the anatomy in the same location within the MRI scanner on each session or wherein the motion tracking system assists in providing data for positioning the body during MR imaging to provide the same spatial resolution and orientation as between different examinations.

25. The method of claim 1, wherein the optical position tracking method is used to co-register neuroanatomical MRI with fMRI images of brain activity.

26. The method of claim 1, wherein the optical position tracking system tracks position and the position tracking is used to validate image-based coregistration algorithms.

27. The method of claim 15, wherein the optical position tracking system operates with real-time computer control to sense and maintain the position of an interventional treatment system for use with objects selected from the group consisting of surgical tools and tissue manipulators, devices for in vivo delivery of drugs, angioplasty devices, biopsy and sampling devices, devices for delivery of energy or radiation, internal illumination devices and internal imaging devices.

28. The method of claim 1, wherein the optical tracking system uses a local pattern matching technique dependent on known geometry of tools within the MRI field that contain optically reflective markers, the optical tracking system being insensitive to signal variations in and between MR images and local pattern matching technique is used when MR signal variations are related to flow effects, motion effects, or wash-through of contrast agents.

29. The method of claim 22, wherein a zone of optimal accuracy and sensitivity of said position tracking device is made independent of the MRI field-of-view and wherein the zone of optimal accuracy and sensitivity of the position tracking device is made larger than a 45 cm field-of-view.

30. The apparatus of claim 17, wherein position measurements made with the optical position tracking device are used to track motions in a fringe magnetic field of the scanner.

31. The apparatus of claim 15, wherein the independent position-tracking device is used to validate other approaches for motion measurement and correction on the basis of simulated data sets or by comparison with other more established algorithms.

32. The method of claim 1, wherein the position tracking system provides intra-acquisition motion information and wherein the intra-acquisition motion information includes measurement of positional displacement that occurs during the acquisition of a certain image.

33. The method of claim 21, wherein the accuracy of said position monitoring system has properties elected from the group consisting of a) independence of MR image quality, b) being unaffected by inhomogeneity of a main field of view, c) being unaffected by nonlinearity of the MR gradients, and being unaffected by tissue nonzero magnetic susceptibility

34. The method of claim 9, wherein the position tracking system is used to provide visual feedback of head position and orientation during anatomical MR to help prevent head motion.

35. An optical image-based motion tracking method for determining the location and orientation of at least one object moving through three-dimensional space within or on the surface of a human or non-human body undergoing magnetic resonance (MR) imaging, comprising:

(a) obtaining 3D coordinates of the at least one object within a field-of-view of the MR imaging system using a plurality of MR-compatible cameras;

(b) obtaining motion information coordinates with an optical tracking system;

(c) converting the motion information coordinates obtained with the optical tracking system into coordinates of said MR imaging system;

(d) acquiring a motion information file for each MR imaging scan;

(e) converting the motion information file into coordinates of the MR imaging system using a registration transformation;

(e) applying each converted motion information file to realign its corresponding functional MRI time series of images; and

(f) applying each converted motion information file and corresponding functional MR time series of images to accurately track movement of the at least one object in said field-of-view.

36. An optical image-based motion tracking method for determining the location and orientation of at least one object moving through three-dimensional space within or on the surface of a human or non-human body undergoing magnetic resonance (MR) imaging comprising:

(a) obtaining 3D coordinates of the at least one object within a field-of-view of the MR imaging system using a plurality of MR-compatible cameras;

(b) obtaining motion information coordinates with an optical tracking system;

(c) converting the motion information coordinates obtained with the optical tracking system into coordinates of the MR imaging system;

(d) acquiring a motion information file for each MR imaging scan;

(e) converting the motion information file into coordinates of the MR imaging stem using a registration transformation;

(e) applying each converted motion information file to correct or augment a corresponding MR anatomical time series of images;

(f) applying each converted motion information file and corresponding MR anatomical time series of images to track movement of the at least one object in said field-of-view.

37. An optical image-based motion tracking method for determining the location and orientation of at least one object moving through three-dimensional space within or on the surface of a human or non-human body undergoing magnetic resonance (MR) imaging, comprising:

(a) obtaining 3D coordinates of the at least one object within a field-of-view of the MR imaging system using a plurality of MR-compatible cameras;

(b) obtaining motion information coordinates with an optical tracking system;

(c) converting the motion information coordinates obtained with the optical tracking system into coordinates of the MR imaging system;

(d) acquiring a motion information file for each MR imaging scan;

(e) converting the motion information file for each MR imaging scan into coordinates of the MR imaging system using a registration transformation;

(e) applying each converted motion information file to correct or augment a corresponding interventional MRI time series of images; and

(f) applying each converted motion information file and corresponding interventional MRI time series of images to accurately track movement of the at least one object in the field-of-view.

38. A multi-modality imaging system comprising a motion tracking system, an MRI system and a tool that is responsive to MRI signals that can be tracked in three dimensions in coordinates of the MRI system, the motion tracking system being referencable in time against images taken by MRI so that motion effects in an MRI image can be corrected.

39. The imaging system of claim 38 wherein the tool comprises a device having holes that are marked with an MRI responsive material.

40. The system of claim 39 wherein movement of the tool is tracked to provide information on the movement of a body segment imaged by the MRI containing or supporting the tool without any free range of movement independent of the body segment.

41. An optical image-based motion tracking method for determining the location and orientation of at least one object moving through three-dimensional space within or on the surface of a human or non-human body undergoing magnetic resonance (MR) imaging, the method comprising:

(a) obtaining 3D coordinates of the at least one object within a field-of-view of said MR imaging system using a plurality of MR-compatible cameras;

(b) obtaining motion information coordinates with the optical tracking system;

(c) converting motion information coordinates obtained with the optical tracking system into coordinates of said MR imaging system;

(d) acquiring a motion information file for each MR imaging scan of the body;

(e) converting said motion information file into coordinates of the MR imaging system using a registration transformation;

(f) applying each converted motion information file to realign its corresponding MR time series of images; and

applying each converted motion information file and corresponding MR time series of images to effect position tracking to enable retrospective k-space corrections for reducing motion artifacts in anatomical MRI applications.