Method and apparatus for video presentation from scanner imaging sources

• US 5,398,684 A
• Filed: 03/31/1992
• Issued: 03/21/1995
• Est. Priority Date: 12/23/1988
• Status: Expired due to Term

• Current Assignee: Tyrone L. Hardy
• Original Assignee: Tyrone L. Hardy
• Inventors: Hardy, Tyrone L.
• Primary Examiner(s): Smith, Ruth S.
• Application Number:
  US07/860,926
• Time in Patent Office: 1,085 Days
• Field of Search: 128/653.1, 128/653.2, 606/130, 364/413.13, 364/413.15, 364/413.19, 364/413.22
• US Class Current: 600/391
• CPC Class Codes: A61B 2090/3937 Visible markers
• CPC Class Codes: A61B 34/10 Computer-aided planning, simulation or modelling of surgical operations
• CPC Class Codes: A61B 90/10 for stereotaxic surgery, e.g. frame-based stereotaxis
• CPC Class Codes: A61B 90/11 with guides for needles or instruments, e.g. arcuate slides or ball joints
• CPC Class Codes: A61N 5/1031 using a specific method of dose optimization
• CPC Class Codes: G06T 17/00 Three dimensional [3D] modelling, e.g. data description of 3D objects

Abstract

The disclosure is directed to a method and apparatus for presenting a plurality of scanning images in a video presentation. The disclosure is particularly directed to the use of such an apparatus and method in stereotactic surgery, wherein acquisition of a plurality of scanner images, conversion of these images into a selected standard format, storage of the acquired and converted images, selective recall and display of at least two of the images, and independent manipulation of each of the images for comparison are provided. Probe placement can be simulated and the images can be enhanced in various ways. The images used can be, for example, CT, PET, X-ray, DSA, isotope, and NMR scans. Brain map atlas images can be superimposed on and fitted to the scan images of a particular brain. Video displays of three dimensional simulations can also be produced.

Claims

1. An apparatus for generating a presentation of images from a variety of imaging sources, the apparatus comprising:

means for acquiring a plurality of images from a plurality of separate imaging sources;

means for converting said plurality of images into a selected format;

means for storing said plurality of images;

means for selectively recalling and displaying at least two images of said plurality of images upon a single display device;

means for manipulating at least one of said at least two images independently of the other image;

means for comparing said at least two images;

means for determining stereotactic coordinates and performing volumetric determinations from said at least two images; and

means for determining distances and areas from said at least two images.

2. The apparatus of claim 1 wherein said means for acquiring a plurality of images comprises means for acquiring body part-related images with at least one of said images being of an actual patient'"'"'s body part.

3. The apparatus of claim 2 wherein said means for acquiring body part-related images comprises means for acquiring brain-related images with at least one of said images being of the actual patient'"'"'s brain.

4. The apparatus of claim 3 wherein said means for acquiring said brain-related image further comprises means for obtaining at least one image from a brain map atlas.

5. The apparatus of claim 4 wherein said brain map atlas comprises a composite of brain maps.

6. The apparatus of claim 4 wherein said means for manipulating at least one of said at least two images comprises means for manipulating said image from the brain map atlas to conform to said image of the patient'"'"'s brain.

7. The apparatus of claim 3 further comprising means for displaying a representation of the patient'"'"'s brain selected from the group consisting of anatomical configurations, physiological configurations, electrophysiological configurations, and combinations thereof.

8. The apparatus of claim 3 wherein said means for determining distances and areas comprises means for obtaining within the actual patient'"'"'s brain, the distance between two points within the patient'"'"'s brain and the area of a selected portion of the patient'"'"'s brain.

9. The apparatus of claim 3 wherein said means for determining distances and areas comprises means for obtaining within the actual patient'"'"'s brain, the volume of a selected part of the patient'"'"'s brain.

10. The invention of claim 9 further comprising means for simulating a surgical device and determining trajectory of said device comprising:

means for locating the target point on an image of the patient'"'"'s brain;

means for intersecting said target point by deriving the anterior-posterior and lateral angles of the device, wherein said angles are derived by using a stereotactic device.

11. The apparatus of claim 10 wherein said means for intersecting said target point comprises means for deriving azimuth and declination angles of said stereotactic device.

12. The apparatus of claim 11 wherein said azimuth and declination angles are derived using said stereotactic device.

13. The apparatus of claim 3 wherein said means for manipulating said images further comprises means for manipulating and swapping brain anatomical images in frontal, sagittal and horizontal sections.

14. The apparatus of claim 1 wherein said image acquiring means comprises means for obtaining at least one said image directly from at least one imaging source without the use of magnetic transport media.

15. The apparatus of claim 1 wherein said image acquiring means comprising media means for obtaining at least one said image by the use of magnetic transport.

16. The apparatus of claim 1 wherein said image acquiring means comprises a direct coaxial link with at least one imaging source.

17. The apparatus of claim 1 wherein at least one imaging source comprises a scanner source selected from the group consisting of computerized axial tomography (CT) scanners, nuclear magnetic resonance (NMR) scanners, positron emission tomography (PET) scanners, isotope scanners, digital substraction angiography (DSA) scanners, and X-ray scanners.

18. The apparatus of claim 1 wherein at least one imaging source comprises a video source.

19. The apparatus of claim 1 wherein said recalling and displaying means comprises means for selectively recalling and displaying an image comprising references for stereotactic localization.

20. The apparatus of claim 1 further comprising user means to input data within a sterile environment.

21. The apparatus of claim 1 wherein said means for acquiring a plurality of images comprises means for acquiring a predetermined number of image types.

22. The apparatus of claim 21 wherein said means for acquiring a predetermined number of image types comprises means for acquiring different image types from a single imaging source.

23. The apparatus of claim 1 further comprising means for manipulating both of said at least two images independently of each other.

24. The apparatus of claim 1 wherein said means for manipulating at least one of said at least two images comprises means for shaping and sizing at least one of said at least two images.

25. The apparatus of claim 24 wherein said means for manipulating comprises means for shaping and sizing at least one of said images to conform to at least one other said image in shape and size.

26. The apparatus of claim 1 further comprising means for superimposing at least one of said at least two images upon the other of said at least two images.

27. The apparatus of claim 1 wherein said manipulating means comprises at least one means selected from the group consisting of filtering, smoothing, sharpening, pseudocoloring, and edge detection means.

28. The apparatus of claim 27 wherein said edge detection means comprises means for executing at least one routine selected from the group consisting of Laplacian, Roberts, Sorbel, and Frei routines.

29. The apparatus of claim 1 further comprising means for recording and archiving the procedural use of said apparatus.

30. The apparatus of claim 1 further comprising means for providing stereotactic coordinates for a user selected point on the presentation.

31. The apparatus of claim 1 further comprising means for simulating at least one image.

32. The apparatus of claim 31 wherein said simulating means comprises means for simulating at least one acquired image.

33. The apparatus of claim 31 wherein said means for simulating is selected from the group consisting of simulating at least one two-dimensional graphic image, and simulating at least one three-dimensional graphic image.

34. The apparatus of claim 31 wherein said simulated image comprises a composite of images.

35. The apparatus of claim 34 wherein said simulated image comprises a composite of manipulated images.

36. The apparatus of claim 35 wherein said simulating means comprises means for independently manipulating components of said composite of images as subsets.

37. The apparatus of claim 36 wherein said simulating means comprises means for manipulating said subsets independently of other said images.

38. The apparatus of claim 1 wherein said displayed images comprise a composite of images.

39. The apparatus of claim 38 wherein said composite of images comprises at least one said acquired image and one simulated image.

40. The apparatus of claim 39 wherein said recalling and displaying means comprises means for independently manipulating said acquired image and said simulated image.

41. The apparatus of claim 1 further comprising an infrared grid disposed across said image displaying device.

42. The apparatus of claim 1 further comprising means for simulating at least one device selected from the group consisting of stereotactic devices, probes, electrodes, implantation devices, and needles.

43. The apparatus of claim 42 further comprising means for simulating manipulation of said device.

44. The apparatus of claim 42 wherein said device comprises an isodose implantation device and said apparatus further comprises means for determining optimum placement for isodose implantation, means for determining optimum dosage for isodose implantation, and means for simulating an isodose implant.

45. The apparatus of claim 1 wherein said means for determining stereotactic coordinates further comprises means for determining stereotactic coordinates of at least one entry point, target point, placement point and trajectory of a device.

46. The apparatus of claim 1 further comprising means for pixel analysis.

47. The apparatus of claim 46 wherein said means for pixel analysis comprises means for pixel analysis of an image selected from the group consisting of an entire image, a user-defined area of an image and a combination thereof.

48. The apparatus of claim 47 further comprising means for selecting image data on said images on the basis of said pixel analysis.

49. The apparatus of claim 48 further comprising means for generating composite images from said image data so as to provide at least one representation selected from the group consisting of anatomical configurations, physiological configurations, electrophysiological configurations, and combinations thereof, of a patient'"'"'s brain.

50. The apparatus of claim 1 wherein said means for recalling and displaying comprises video presentation means.

51. The apparatus of claim 1 wherein said means for recalling and displaying comprises means for displaying images independent of the imaging sources.

52. The apparatus of claim 1 further comprising means for coding and storing representations of physiological response points and means for selectively recalling and displaying any of said response points within the presentation.

53. A method for generating a presentation of images from a variety of imaging sources, the method comprising the steps of:

acquiring a plurality of images from a plurality of separate imaging sources;

converting the plurality of images into a selected format;

storing the plurality of images;

selectively recalling and displaying at least two images of the plurality of images upon a single display device;

manipulating at least one of the at least two images independently of the other image;

comparing the at least two images;

determining stereotactic coordinates and performing volumetric determinations from the at least two images; and

determining distances and areas from the at least two images.

54. The method of claim 53 wherein the step of acquiring a plurality of images comprises acquiring body part-related images with at least one image being of the actual patient'"'"'s body part.

55. The method of claim 54 wherein the step of acquiring body part-related images comprises acquiring brain-related images with at least one of the images being of the actual patient'"'"'s brain.

56. The invention of claim 55 wherein the step of acquiring the brain-related image further comprises obtaining at least one image from a brain map atlas.

57. The method of claim 56 wherein the step of obtaining at least one image from a brain map atlas comprises the step of obtaining at least one image from a composite of brain maps.

58. The method of claim 56 wherein the step of manipulating at least one of the at least two images comprises manipulating the image from the brain map atlas to conform to the image of the patient'"'"'s brain.

59. The method of claim 55 further comprising displaying a representation of the patient'"'"'s brain selected from the group consisting of anatomical configurations, physiological configurations, electrophysiological configurations, and combinations thereof.

60. The method of claim 55 wherein the step of determining distances and areas comprises obtaining within the actual patient'"'"'s brain, the distance between two points within the patient'"'"'s brain and the area of a selected portion of the patient'"'"'s brain.

61. The method of claim 55 wherein the step of determining distances and areas comprises obtaining within the actual patient'"'"'s brain, the volume of a selected part of the patient'"'"'s brain.

62. The method of claim 61 further comprising simulating a surgical device and determining trajectory of the device comprising:

locating the target point on an image of the patient'"'"'s brain; and

intersecting the target point by deriving the anterior-posterior and lateral angles of the device, wherein the angles are derived using a stereotactic device.

63. The method of claim 62 wherein intersecting the target point comprises deriving azimuth and declination angles of said stereotactic device.

64. The method of claim 63 wherein the azimuth and declination angles are derived using said stereotactic device.

65. The method of claim 55 wherein the step of manipulating the images further comprises manipulating and swapping brain anatomical images in frontal, sagittal and horizontal sections.

66. The method of claim 55 further comprising actually executing functional and morphological stereotactical procedures for brain targets selected from the group consisting of dyskinesias, pain syndromes, tumors, lesions, aneurysms, seizure disorders, functional anatomical sites, physiological response points, blood vessels, abnormalities and neuropathological conditions.

67. The method of claim 52 wherein the step of acquiring images comprises obtaining at least one of the images directly from at least one imaging source without the use of magnetic transport media.

68. The method of claim 52 wherein the step of acquiring images comprises obtaining at least one of the images by the use of magnetic transport media.

69. The method of claim 52 wherein the step of acquiring images comprises providing a direct coaxial link with at least one imaging source.

70. The method of claim 53 wherein the step of acquiring images comprises the step of acquiring images from at least one imaging source comprising a scanner source selected from the group consisting of computerized axial tomography (CT) scanners, nuclear magnetic resonance (NMR) scanners, positron emission tomography (PET) scanners, isotope scanners, digital substraction angiography (DSA) scanners, and X-ray scanners.

71. The method of claim 53 wherein the step of acquiring images from at least one imaging source comprises the step of acquiring images from a video source.

72. The method of claim 53 wherein the step of acquiring images further comprises the step of providing references for stereotactic localization.

73. The method of claim 53 further comprising the step of providing for a user to input data within a sterile environment.

74. The method of claim 53 wherein the step of acquiring the plurality of images comprises the step of acquiring any of a predetermined number of image types.

75. The method of claim 74 wherein the step of acquiring the plurality of images from the separate image sources comprises the step of acquiring different types of images from a single type of imaging source.

76. The method of claim 53 further comprising manipulating both of the images independently of each other.

77. The method of claim 53 wherein the step of manipulating the at least two images comprises shaping and sizing at least one of the at least two images.

78. The method of claim 77 wherein the step of manipulating comprises shaping and sizing at least one of the images to conform to at least one other image in shape and size.

79. The method of claim 53 further comprising superimposing at least one of the at least two images upon the other of the at least two images.

80. The method of claim 53 wherein the step of manipulating the at least two images comprises utilizing at least one procedure selected from the group consisting of filtering, smoothing, sharpening, pseudocoloring, and edge detection.

81. The method of claim 80 wherein the edge detection procedure comprises at least one routine selected from the group consisting of Laplacian, Roberts, Sorbel, and Frei routines.

82. The method of claim 53 further comprising recording and archiving the method.

83. The method of claim 53 further comprising providing stereotactic coordinates for a user selected point on the presentation.

84. The method of claim 53 further comprising the step of simulating at least one image.

85. The method of claim 84 wherein the step of simulating at least one image comprises the step of simulating at least one acquired image.

86. The method of claim 84 wherein the step comprising simulating at least one image is selected from the group consisting of simulating at least one two-dimensional graphic image and simulating at least one three-dimensional graphic image.

87. The method of claim 84 wherein the step of simulating at least one image comprises the step of simulating a composite of images from more than one imaging source.

88. The method of claim 87 wherein the step of simulating at least one image comprises the step of simulating a composite of manipulated images.

89. The method of claim 88 further comprising the step of independently manipulating components of the composite image as subsets.

90. The method of claim 89 further comprising the step of independently manipulating the subsets independently of the other images.

91. The method of claim 53 wherein the displaying of images comprises displaying a composite of images.

92. The method of claim 91 wherein the step of displaying a composite of images comprises the step of displaying at least one acquired image and one simulated image.

93. The method of claim 92 further comprising the step of independently manipulating the acquired image and the simulated image.

94. The method of claim 53 further comprising the step of utilizing an infrared grid disposed across the image displaying device.

95. The method of claim 53 further comprising simulating at least one device selected from the group consisting of stereotactic devices, probes, electrodes, implantation devices, and needles.

96. The method of claim 95 further comprising simulating manipulation of the device.

97. The method of claim 95 wherein the device comprises an isodose implantation device and the method further comprises determining optimum placement for isodose implantation, determining optimum dosage for isodose implantation and simulating an isodose implant.

98. The method of claim 53 wherein the step of determining stereotactic coordinates further comprises determining stereotactic coordinates of at least one entry point, target point, placement point and trajectory of a device.

99. The method of claim 53 further comprising providing pixel analysis.

100. The method of claim 99 wherein the step of providing pixel analysis is selected from the group consisting of providing pixel analysis to an entire image, a user-defined area of an image and a combination thereof.

101. The method of claim 100 further comprising means for selecting image data on the images on the basis of the pixel analysis.

102. The method of claim 101 further comprising the step of generating composite images from the image data so as to provide at least one representation selected from the group consisting of anatomical configurations, physiological configurations, electrophysiological configurations, and combinations thereof, of a patient'"'"'s brain.

103. The method of claim 53 wherein step of generating a presentation of the images comprises the step of generating a video presentation.

104. The method of claim 53 wherein the step of generating a presentation of images is independent of the step of acquiring a plurality of images from a plurality of separate imaging sources.

105. The method of claim 53 further comprising coding and storing representations of physiological response points and selectively recalling and displaying any of the response points within the presentation.

106. The method of claim 53 further comprising the steps of:

a) providing an image acquiring apparatus;

b) providing a stereotactic reference system to a patient;

c) placing the patient'"'"'s body part to be analyzed in the imaging source;

d) acquiring the images desired using the image source;

e) saving and storing the acquired image in the apparatus;

f) taking the apparatus and the patient into the operating suite;

g) using image manipulation routines in the apparatus to calibrate the desired image areas;

h) using image manipulation routines in the apparatus to enhance desired image areas; and

i) using the apparatus to determine desired coordinates.

107. The method of claim 106 further comprising using a brain map to precisely define the desired coordinates.

108. The method of claim 106 further comprising determining volumetric regions of the brain.

109. The method of claim 106 further comprising simulating brain surgical procedures.