Surgical operation navigating system using a reference frame

• US 6,640,127 B1
• Filed: 06/09/2000
• Issued: 10/28/2003
• Est. Priority Date: 06/10/1999
• Status: Expired due to Fees

• Current Assignee: Olympus Optical Company Ltd. (Olympus Corporation)
• Original Assignee: Olympus Optical Company Ltd. (Olympus Corporation)
• Inventors: Kosaka, Akio, Saito, Akito, Shibasaki, Takao, Furuhashi, Yukihito, Matsuzaki, Hiroshi, Asano, Takeo
• Primary Examiner(s): Lateef, Marvin M.
• Assistant Examiner(s): Lin, Jeoyuh
• Application Number:
  US09/590,466
• Time in Patent Office: 1,236 Days
• Field of Search: 600/407, 600/410, 600/411, 600/425, 600/427, 600/417, 600/414, 600/426, 600/429, 600/476, 600/473, 382/128, 382/131, 606/130
• US Class Current: 600/426
• CPC Class Codes: A61B 2034/2055 Optical tracking systems
• CPC Class Codes: A61B 2034/2072 Reference field transducer attached to an instrument or patient
• CPC Class Codes: A61B 2090/364 Correlation of different images or relation of image positions in respect to the body
• CPC Class Codes: A61B 2090/3945 Active visible markers, e.g. light emitting diodes
• CPC Class Codes: A61B 2090/3979 infrared
• CPC Class Codes: A61B 2090/3983 Reference marker arrangements for use with image guided surgery
• CPC Class Codes: A61B 2090/3995 Multi-modality markers
• CPC Class Codes: A61B 34/20 Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
• CPC Class Codes: A61B 90/14 Fixators for body parts, e.g. skull clamps; Constructional details of fixators, e.g. pins
• CPC Class Codes: A61B 90/36 Image-producing devices or illumination devices not otherwise provided for
• CPC Class Codes: A61B 90/39 Markers, e.g. radio-opaque or breast lesions markers

Abstract

A reference frame adapted to be fitted to a subject of medical treatment and provided with markers for determining the position or the orientation of the subject comprises fitting section for fitting the reference frame with the subject at least three spots (tops of the left and right ears and the nasal projection) along the undulations of the surface thereof and three or more than three markers detectable at least ether in an X-ray image or in an MRI image of the reference frame, the markers being to be arranged at predetermined positions not connectable by a straight line. A surgical operation navigating system determines the coordinates of the markers in a coordinate system defined for the image taken for the purpose of medical examination of the subject who is carrying the reference frame on the basis of the obtained image. Then the corresponding relationship is established between the coordinate system for the image for examination and the coordinate system for the real space containing the markers on the basis of the result of the operation of determining the coordinates of the markers in the coordinate system for the image for examination and the coordinates of the markers in the coordinate system for the real space.

Claims

1. A surgical operation navigating system comprising:

a reference frame being fitted to a subject of medical treatment in a tomographic image of the subject by using three spots on the surface of the body of the subject, which include at least one of the top of the left ear, the top of the right ear and the nasal projection, and having three or more than three markers detectable at least either in an X-ray image or in an MRI image thereof, said markers being arranged at predetermined positions constituting a plane;

a coordinate computing section for computationally determining the coordinates of the markers on the reference frame in terms of a coordinate system uniquely defined for the image for examination; and

a correspondence computing section for computationally determining the transformation between said coordinate system for the tomographic image for examination and a coordinate system defined for the real space containing said markers on the basis of the coordinates of the markers as determined by said coordinate computing section in terms of the coordinate system for the tomographic image for examination and the coordinates of the markers as determined in terms of said coordinate system for the real space.

2. A surgical operation navigating system comprising:

a reference frame being fitted to a subject of medical treatment in a tomographic image of the subject by using three spots on the surface of the body of the subject, which include at least one of the top of the left ear, the top of the right ear and the nasal projection, and having three or more than three markers detectable at least either in an X-ray image or in an MRI image thereof, said markers being arranged at predetermined positions constituting a plane;

a coordinate computing section for computationally determining the coordinates of the markers on the reference frame in terms of a coordinate system uniquely defined for the image for examination;

a first correspondence computing section for computationally determining the transformation between said coordinate system for the tomographic image for examination and a coordinate system defined for the real space containing said markers on the basis of the output of said coordinate computing section and the coordinates of the markers as determined in terms of said coordinate system for the real space;

a second correspondence computing section for computationally determining the transformation between said coordinate system for the real space and a coordinate system uniquely defined for a surgical instrument on the basis of the coordinates of the surgical instrument as determined in terms of the coordinate system for the real space; and

a third correspondence computing section for computationally determining the transformation between said coordinate system for the tomographic image for examination and said coordinate system for the surgical instrument on the basis of the outputs of said first and second correspondence computing sections.

3. A surgical operation navigating system according to claim 2, further comprising:

a display section adapted to display a plurality of images obtained from different view angles to show the positional relationship of the subject, a target and the surgical instrument on the basis of the outputs of said first through third correspondence computing section.

4. A surgical operation navigating system according to claim 2, further comprising:

a display section adapted to display an image obtained from a view angle directed along the surgical instrument on the basis of the outputs of said first through third correspondence computing section.

5. A surgical operation navigating system comprising:

a reference frame being fitted to a subject of medical treatment in a tomographic image of the subject by using three spots on the surface of the body of the subject, which include at least one of the top of the left ear, the top of the right ear and the nasal projection, and having three or more than three markers detectable at least either in an X-ray image or in an MRI image thereof, said markers being arranged at predetermined positions constituting a plane,

a second reference frame being relatively fitted to said subject;

a coordinate computing section for computationally determining the coordinates of the markers on the first reference frame in terms of a coordinate system uniquely defined for the image for examination;

a correspondence computing section for computationally determining the transformation between said coordinate system for the image for examination and a coordinate system defined for the real space containing said markers on the first reference frame on the basis of the output of said coordinate computing section and the coordinates of the markers on the first reference frame as determined in terms of said coordinate system for the real space; and

a correcting section for correcting the result of said correspondence computing section on the basis of the coordinates of the second reference frame as determined during a surgical operation in terms of said coordinate system for the real space.

6. A surgical operation navigating system according to claim 5, wherein said second reference frame is removably fitted to said first reference frame.

7. A surgical operation navigating system according to claim 5, wherein said second reference frame is provided with a plurality of markers that are IR emitting diodes.

8. A surgical operation navigating system according to claim 7, wherein said second reference frame is removably fitted to said first reference frame.

9. A surgical operation navigating system comprising:

a reference frame adapted to be rigidly anchored to a subject of medical treatment by utilizing three spots on the surface of the body of the subject, which include at least one of the top of the left ear, the top of the right ear and the nasal projection, and to carry at least three markers thereon at positions constituting a plane, said markers containing a material adapted to make them detectable at least either in an X-ray image or an MRI image of the frame; and

an image acquisition section for acquiring, tomographic images of the subject for medical examination with the reference frame;

a marker position detecting section for detecting the positions of the markers in terms of the coordinate system for the tomographic image for examination;

a marker detecting section for detecting the markers on the frame fitted to the subject in the real space; and

a registering section for registering the coordinates of the tomographic image for examination and those of the subject by registering the coordinates of the marker positions as detected by said marker position detecting section and the coordinates of the markers as detected by said marker detecting section.

10. A surgical operation navigating system according to claim 9, wherein at least the tops of the left and right ears and the nasal projection are selected for said three spots on the surface of the body of the subject.

11. A surgical operation navigating system according to claim 9, wherein said reference frame is positionally regulated by a material that hardens with time before rigidly anchoring said reference frame to the subject by utilizing the three spots on the surface of the body of the subject.

12. A surgical operation navigating system according to claim 9, wherein said marker detecting section registers the coordinates of the image for examination and the body of the subject as it probes and detects the markers by a 3-D position sensor when detecting the markers of the reference frame in the real space.

13. A surgical operation navigating system according to claim 12, wherein said 3-D position sensor is an optical sensor system adapted to detect infrared rays.

14. A surgical operation navigating system according to claim 12, wherein said reference frame is fitted to the subject, one of a iodine-containing type drape, a transparent drape and a translucent drape is placed on the subject and then said 3-D position sensor probes the markers on the reference frame from above the drape.

15. A surgical operation navigating system according to claim 12, wherein the reference frame and a secondary marker plate are fitted to the subject, the coordinates of the reference frame and those of the secondary marker plate are registered and subsequently the relative positions of the subject and the surgical instrument are defined by defining the positions of secondary markers and detecting the relative positions of the secondary marker plate and the surgical instrument by said 3-D position sensor.

16. A surgical operation navigating system according to claim 15, wherein said markers have a substantially cylindrical profile and the tops thereof defined as marker positions.

17. A surgical operation navigating system according to claim 15, wherein either said markers are or said secondary marker plate is removable.

18. A surgical operation navigating system according to claim 9, wherein

said markers have one of a conical profile, a truncated cone profile and a conical recess,

when said markers have one of the conical profile and the truncated cone profile, the tops of said markers are defined as marker positions, and

when said markers have the conical recess, the bottoms of the recesses are defined as marker positions.

19. A surgical operation navigating system according to claim 9, wherein said marker position detecting section recognizes the profiles of the markers in the image of for examination and detects the marker positions from the profiles of the markers.

20. A reference frame comprising:

a fitting section for fitting the reference frame with a subject of medical treatment at least three spots on the surface of a body of the subject, one of the three spots including one of the top of the left ear, the top of the right ear and the nasal projection; and

markers formed by combining a material easily detectable in an image of a first examining method and a material easily detectable in an image of a second examining method.

21. A reference frame according to claim 20, wherein said first and second examining methods utilizes X-rays and MRI respectively.

22. A calibration method for computing positional and orientational transformation between a subject of medical treatment and a tomographic image of the subject by using the corresponding relationship between the coordinates of a reference frame fitted to the subject in the image and the coordinates of the reference frame in the real space, said method comprising steps of:

anchoring said reference frame to the subject of medical treatment by using three spots on the surface of the body of the subject, one of the three spots including one of the top of the left ear, the top of the right ear and the nasal projection;

fitting markers other than said reference frame to said subject;

determining the coordinates of said markers in said image by using the coordinates of the markers in the real space and said corresponding relationship; and

computing positional and orientational transformation between said subject and the image of said subject by using the determined coordinates of the markers.

23. A calibration method according to claim 22, wherein said markers are plural in number and only the markers having errors found within a predetermined range as detected in the real space are used to compute positional and orientational transformation between said subject and the image of said subject.

24. A calibration apparatus for computing positional and orientational transformation between a patient to be subjected to a surgical operation and a tomographic image of the patient by using the corresponding relationship between the coordinates of a reference frame fitted to the patient in the image and the coordinates of the reference frame in the real space, said apparatus comprising:

an anchoring mechanism for anchoring said reference frame to the patient by using three spots on the surface of the body of the patient one of the three spots including one of the top of the left ear, the top of the right ear and the nasal projection;

markers fitted to the patient other than the reference frame;

a coordinate detecting section for determining the coordinates of said markers on said image by using the coordinates of the markers in the real space and said corresponding relationship; and

a registering section for computing positional and orientational transformation between said patient and the image of said patient by using the coordinates of the markers determined by said coordinate detecting section.

25. A calibration apparatus according to claim 24, wherein said markers are plural in number and only the markers having errors found within a predetermined range as detected in the real space are used to compute positional and orientational transformation between said patient and the image of said patient.

26. A calibration method for computing positional and orientational transformation between a subject of medical treatment and a tomographic image of the subject by using the corresponding relationship between the coordinates of a reference frame fitted to the subject in the image and the coordinates of the reference frame in the real space, said method comprising steps of:

anchoring the reference frame to the patient by using three spots on the surface on the body of the subject, one of the three spots including one of the top of the left ear, the top of the right ear and the nasal projection;

fitting markers other than said reference frame to said subject;

determining the coordinates of said markers on said image by using the coordinates of the markers in the real space and said corresponding relationship; and

computing positional and orientational transformation between said subject and the image of said subject by using said markers.

27. A calibration method according to claim 26, wherein said markers have respective position detecting sensors.

28. A calibration method according to claim 26, wherein said markers are plural in number and only the markers having errors found within a predetermined range as detected in the real space are used to compute positional and orientational transformation between said subject and the image of said subject.

29. A calibration method according to claim 28, wherein said markers have respective position detecting sensors.

30. A method of computing positional and orientational transformation between a subject of medical treatment and a tomographic image of said subject, said method comprising steps of:

fitting a reference frame adapted to be removably placed on the subject by using three spots on the surface of the body of the subject, one of the three spots including one of the top of the left ear, the top of the right ear and the nasal projection, said reference frame being provided thereon with a plurality of first markers;

taking a tomographic image of the subject carrying said reference frame thereon and determining the coordinates of the markers appearing in the image of said subject in terms of a coordinate system defined for said image;

fitting a plurality of second markers to the subject carrying said reference frame and determining the coordinates of the first markers and those of the second markers in terms of a coordinate system defined for the real space;

computing the positional and orientational transformation between the coordinate system defined for the real space and the coordinate system defined for said image on the basis of the coordinates of said first markers in the coordinate system defined for the real space and those of said first markers in the coordinate system defined for the image;

determining the coordinates of said second markers in the coordinate system defined for said image by using the coordinates of said second markers in the coordinate system defined for said real space and said positional and orientational transformation; and

computing positional and orientational transformation between said subject and the image of said subject by using the coordinates of said second markers.

31. An operative calibration apparatus of computing positional and orientational transformation between a patient to be subjected to a surgical operation and a tomographic image of said patient, said apparatus comprising:

a reference frame to be fitted to the patient by using three spots on the surface of the body of the subject, one of the three spots including one of the top of the left ear, the top of the right ear and the nasal projection, said reference frame being adapted to be removably placed on the patient and provided thereon with a plurality of first markers;

a first detecting section for taking a tomographic image of the patient carrying said reference frame thereon and determining the coordinates of the markers appearing in the image of said patient in terms of a coordinate system defined for said image;

a second detecting section for detecting it plurality of second markers to be fitted to the patient carrying said reference frame and determining the coordinates of the first markers and those of the second markers in terms of a coordinate system defined for the real space;

a relationship computing section for computing the positional and orientational transformation between the coordinate system defined for the real space and the coordinate system defined for said image on the basis of the coordinates of said first markers in the coordinate system defined for the real space determined by said first detecting section and those of said first markers in the coordinate system defined for the image;

a coordinate computing section for determining the coordinates of said second markers in the coordinate system defined for said image by using the coordinates of said second markers in the coordinate system defined for said real space determined by said second detecting section and said positional and orientational transformation determined by said relationship computing section; and

a registering section for computing positional and orientational transformation between said patient and the image of said patient by using the coordinates of said second markers determined by said coordinate computing section.

32. A calibration method of calibrating the position and orientation of a subject of medical treatment and a tomographic image of the subject by using a reference frame securely fitted to the subject, said method comprising steps of:

securely fitting the reference frame to the subject by using three spots on the surface of the body of the subject, one of the three spots including one of the top of the left ear, the top of the right ear and the nasal projection;

fitting markers to said subject, said mark being located at a different position from the position of the reference frame;

defining the positions of said markers in a coordinate system for the image for examination as defined for the image for examination by, using said reference frame; and

registering the coordinates of said coordinate system for the image for examination and the coordinate system for the real space by detecting the positions of said markers in the coordinate system for the real space as defined for the real space containing said subject.

33. A calibration method according to claim 32, wherein the values of the detected positions of the markers having errors exceeding a predetermined value are eliminated when registering the coordinates of said coordinate system for the image for examination and the coordinate system for the real space.

34. A calibration method according to claim 33, wherein said markers have respective position detecting sensors.

35. A calibration apparatus of calibrating the position and orientation of a patient to be subjected to a surgical operation and a tomographic image of the patient by using a reference frame securely fitted to the subject, said apparatus comprising:

a fitting mechanism for securely fitting the reference frame to the patient by using three spots on the surface of the body of the patient, one of the three spots including one of the top of the left ear, the top of the right ear and the nasal projection;

markers being located at a different position from the position of said reference frame and being adapted to be fitted to said patient;

a position defining section for defining the positions of said markers in a coordinate system for the image for examination as defined for the image for examination by using said reference frame; and

an registering section for registering the coordinates of said coordinate system for the image for examination and the coordinate system for the real space by detecting the positions of said markers in the coordinate system for the real space as defined for the real space containing said patient.

36. A calibration apparatus according to claim 35, wherein said registering section eliminates the values of the detected positions of the markers having errors exceeding a predetermined when registering the coordinates of said coordinate system for the image for examination and the coordinate system for the real space.

37. A calibration method according to claim 35, wherein said markers have respective position detecting sensors.

38. A surgical operation navigating system comprising:

a reference means being fitted to a subject of medical treatment in a tomographic image of the subject by using three spots on the surface of the body of the subject, which include at least one of the top of the left ear, the top of the right ear and the nasal projection having three or more than three markers detectable at least either in an X-ray image or in an MRI image thereof, said markers being arranged at predetermined positions constituting a plane;

a coordinate computing means for computationally determining the coordinates of the markers on the reference means in terms of a coordinate system uniquely defined for the image for examination; and

a correspondence computing means for computationally determining the transformation between said coordinate system for the image for examination and a coordinate system defined for the real space containing said markers on the basis of the coordinates of the markers as determined by said coordinate computing means in terms of the coordinate system for the tomographic image for examination and the coordinates of the markers as determined in terms of said coordinate system for the real space.

39. A surgical operation navigating system comprising:

a reference means being fitted to a subject of medical treatment in a tomographic image of the subject by using three spots on the surface of the body of the subject, which include at least one of the top of the left ear, the top of the right ear and the nasal projection having three or more than three markers detectable at least either in an X-ray image or in an MRI image thereof, said markers being arranged at predetermined positions constituting a plane;

a coordinate computing means for computationally determining the coordinates of the markers on the reference means in terms of a coordinate system uniquely defined for the image for examination;

a first correspondence computing means for computationally determining the transformation between said coordinate system for the tomographic image for examination and a coordinate system defined for the real space containing said markers on the basis of the output of said coordinate computing means and the coordinates of the markers as determined in terms of said coordinate system for the real space;

a second correspondence computing means for computationally determining the transformation between said coordinate system for the real space and a coordinate system uniquely defined for a surgical instrument on the basis of the coordinates of the surgical instrument as determined in terms of the coordinate system for the real space; and

a third correspondence computing means for computationally determining the transformation between said coordinate system for the image for examination and said coordinate system for the surgical instrument on the basis of the outputs of said first and second correspondence computing means.

40. A surgical operation navigating system comprising:

a reference means being fitted to a subject of medical treatment in a tomographic image of the subject by using three spots on the surface of the body of the subject, which include at least one of the top of the left ear, the top of the right ear and the nasal projection having three or more than three markers detectable at least either in an X-ray image or in an MRI image thereof, said markers being arranged at predetermined positions constituting a plane,

a second reference means being relatively fitted to said subject;

a coordinate computing means for computationally determining the coordinates of the markers on the first reference means in terms of a coordinate system uniquely defined for the tomographic image for examination;

a correspondence computing means for computationally determining the transformation between said coordinate system for the tomographic image for examination and a coordinate system defined for the real space containing said markers on the first reference means on the basis of the output of said coordinate computing means and the coordinates of the markers on the first reference means as determined in terms of said coordinate system for the real space; and

a correcting means for correcting the result of said correspondence computing means on the basis of the coordinates of the second reference means as determined during a surgical operation in terms of said coordinate system for the real space.

41. A surgical operation navigating system comprising:

a reference means adapted to be rigidly anchored to a subject of medical treatment by utilizing three spots on the surface of the body of the subject, which include at least one of the top of the left ear, the top of the right ear and the nasal projection to carry at least three markers thereon at positions constituting a plane, said markers containing a material adapted to make them detectable at least either in an X-ray image or an MRI image of the frame; and

an image acquisition means for acquiring, images of the subject for medical examination with the reference means;

a marker position detecting mans for detecting the positions of the markers in terms of the coordinate system for the image for examination;

a marker detecting means for detecting the markers on the frame fitted to the subject in the real space; and

a registering means for registering the coordinates of the image for examination and those of the subject by registering the coordinates of the marker positions as detected by said marker position detecting means and the coordinates of the markers as detected by said marker detecting means.

42. A calibration apparatus for computing positional and orientational transformation between a patient to be subjected to a surgical operation and a tomographic image of the patient by using the corresponding relationship between the coordinates of a reference means fitted to the patient in the image and the coordinates of the reference means in the real space, said apparatus comprising:

an anchoring means for anchoring said reference means to the patient by using three spots on the surface of the body of the patient, one of the three spots including one of the top of the left ear, the top of the right ear and the nasal projection;

markers fitted to the patient other than the reference means;

a coordinate detecting means for determining the coordinates of said markers on said image by using the coordinates of the markers in the real space and said corresponding relationship; and

a registering means for computing positional and orientational transformation between said patient and the image of said patient by using the coordinates of the markers determined by said coordinate detecting means.

43. An operative calibration apparatus of computing positional and orientational transformation between a patient to be subjected to a surgical operation and a tomographic image of said patient, said apparatus comprising:

a reference means to be fitted to the patient by using three spots on the surface of the body of the subject, one of the three spots including one of the top of the left ear, the top of the right ear and the nasal projection, said reference means being adapted to be removably placed on the patient and provided thereon with a plurality of first markers;

a first detecting means for taking a tomographic image of the patient carrying said reference means thereon and determining the coordinates of the markers appearing in the image of said patient in terms of a coordinate system defined for said image;

a second detecting means for detecting a plurality of second markers to be fitted to the patient carrying said reference means and determining the coordinates of the first markers and those of the second markers in terms of a coordinate system defined for the real space;

a relationship computing means for computing the positional and orientational transformation between the coordinate system defined for the real space and the coordinate system defined for said image on the basis of the coordinates of said first markers in the coordinate system defined for the real space determined by said first detecting means and those of said first markers in the coordinate system defined for the image;

a coordinate computing means for determining the coordinates of said second markers in the coordinate system defined for said image by using the coordinates of said second markers in the coordinate system defined for said real space determined by said second detecting means and said positional and orientational transformation determined by said relationship computing means; and

a registering means for computing positional and orientational transformation between said patient and the image of said patient by using the coordinates of said second markers determined by said coordinate computing means.

44. A calibration apparatus of calibrating the position and orientation of a patient to be subjected to a surgical operation and a tomographic image of the subject by using a reference means securely fitted to the subject, said apparatus comprising:

a fitting means for securely fitting the reference means to the patient by using three spots on the surface of the body of the patient, one of the three spots including one of the top of the left ear, the top of the right ear and the nasal projection; and

markers being located at a different position from the position of said reference means and being adapted to be fitted to said patient;

a position defining means for defining the positions of said markers in a coordinate system for the image for examination as defined for the image for examination by using said reference means; and

a registering section for registering the coordinates of said coordinate system for the image for examination and the coordinate system for the real space by detecting the positions of said markers in the coordinate system for the real space as defined for the real space containing said patient.