Method and apparatus for producing an accessing composite data

• US 6,526,415 B2
• Filed: 06/11/2001
• Issued: 02/25/2003
• Est. Priority Date: 04/11/1997
• Status: Expired due to Term

• Current Assignee: Surgical Navigation Technologies, Inc. (Medtronic Plc)
• Original Assignee: Surgical Navigation Technologies, Inc. (Medtronic Plc)
• Inventors: Smith, Kurt R., Bucholz, Richard D., Schaewe, Timothy J.
• Primary Examiner(s): AMSBURY, WAYNE P
• Application Number:
  US09/877,144
• Publication Number:
  US 20010029509A1
• Time in Patent Office: 624 Days
• Field of Search: 707/104.1, 704/7
• US Class Current: 1/1
• CPC Class Codes: G06F 16/30 of unstructured textual data document management systems G06F16/93
• CPC Class Codes: G06F 16/40 of multimedia data, e.g. slideshows comprising image and additional audio data retrieval of still image data G06F16/50; retrieval of audio data G06F16/60; retrieval of video data G06F16/70
• CPC Class Codes: G06F 16/904 Browsing; Visualisation therefor for navigating the web G06F16/954; browsing optimisation for the web G06F16/957
• CPC Class Codes: Y10S 707/99936 Pattern matching access
• CPC Class Codes: Y10S 707/99943 Generating database or data structure, e.g. via user interface
• CPC Class Codes: Y10S 707/99945 Object-oriented database structure processing
• CPC Class Codes: Y10S 707/99948 Application of database or data structure, e.g. distributed, multimedia, or image

Abstract

An apparatus and method for producing composite data by a server computer involves deforming a template creating a mapping relationship between co-registered data and subject data, filtering the co-registered data, and mapping this filtered co-registered data according to the mapping data. A client computer requests the composite data from the server computer and transmits the subject data to the server computer. The client presents the received composite data to an operator and monitors the operators use of the composite data.

Claims

1. A method for presenting an operator with composite medical data containing subject data and co-registered data representing a knowledge base providing supplemental information about structure contained in the subject data, said method comprising:

creating a mapping relationship between the subject data and the co-registered data by deforming a template corresponding to the subject data;

linking, based on the mapping relationship, co-registered data in co-registered databases that include dose curve data and medical atlas data;

filtering the co-registered data to allow mapping of at least a portion of the co-registered data;

mapping the filtered co-registered data to the subject data according to the mapping relationship to produce the composite data; and

presenting the operator the composite medical data including the dose curve data and medical atlas data.

2. The method of claim 1, wherein the step of linking the medical atlas data to the dose curve data includes co-registering the dose curve data and the medical atlas data to a common atlas coordinate system.

3. The method of claim 1, wherein the dose curve data is a graphical representation of computed dosages.

4. The method of claim 1, wherein the dose curve data is a graphical representation of calculated therapy settings.

5. The method of claim 1, wherein the step of mapping includes the step of relating a point in a subject data space coordinate system to an element of co-registered data.

6. The method of claim 1, wherein the presenting step includes displaying the composite medical data as a VRML display.

7. The method of claim 1, wherein the step of presenting the composite medical data includes composing the composite medical data on a server computer and transmitting the composite medical data to a client computer for presentation to the operator.

8. An apparatus for presenting an operator with composite medical data containing subject data and co-registered data representing a knowledge base providing supplemental information about structure contained in the subject data, said apparatus comprising:

a deformation engine that creates a mapping relationship between co-registered data, in co-registered databases, and subject data by deforming a template corresponding to the subject data;

links that, based on the mapping relationship, specify a relationship in co-registered databases that include medical atlas data and dose curve data;

a filtering engine that filters the co-registered data to allow mapping of at least a portion of the co-registered data;

a mapping engine that maps the filtered co-registered data according to the mapping relationship to produce the composite medical data; and

a graphical display that presents to the operator the composite medical data, including the dose curve data and the medical atlas data.

9. The apparatus of claim 8, wherein the links are created by co-registering the dose curve data and the medical atlas to a common atlas coordinate system.

10. The apparatus of claim 8, wherein the dose curve data is a graphical representation of computed dosages.

11. The apparatus of claim 8, wherein the dose curve data is a graphical representation of calculated therapy settings.

12. The apparatus of claim 8, wherein the graphical display is located at a client computer and the composite medical data is composed on a server computer and transmitted to the client computer for presentation to the operator.

13. The apparatus of claim 8, wherein the graphical display presents the dose curve data and the medical atlas data as a VRML image.

14. An apparatus for presenting an operator with composite medical data containing subject data and co-registered data representing a knowledge base providing supplemental information about structure contained in the subject data, and apparatus comprising:

a deformation engine that creates a mapping relationship between the subject data and the co-registered data, in co-registered databases, by deforming a template corresponding to the subject data;

a filtering engine that filters the co-registered data corresponding to a map position supplied by a surgical navigation system to allow at least a portion of the corresponding co-registered data to be mapped;

a mapping engine that maps the filtered co-registered data corresponding to the map position to the subject data according to the mapping relationship to produce the composite medical data; and

a display that presents the operator with the composite medical data composed of the corresponding co-registered data mapped to the subject data.

15. The apparatus of claim 14, wherein the surgical navigation system selects the map position based on a location of a surgical probe in a subject space.

16. The apparatus of claim 14, wherein the display presents the composite medical data as an image.

17. The apparatus of claim 14, wherein the display presents the composite medical data as text.

18. The apparatus of claim 14, wherein the display presents the composite medical data as a VRML image.

19. An method for presenting an operator with composite medical data containing subject data and co-registered data representing a knowledge base providing supplemental information about structure contained in the subject data, said method comprising:

creating a mapping relationship between the subject data and the co-registered data, in co-registered databases, by deforming a template corresponding to the subject data;

filtering the co-registered data corresponding to a map position supplied by a surgical navigation system to allow at least a portion of the corresponding co-registered data to be mapped;

mapping the filtered co-registered data corresponding to the map position to the subject data according to the mapping relationship to produce the composite medical data; and

displaying to an operator a representation of the composite medical data composed of the co-registered corresponding data mapped to the subject data.

20. The method of claim 19, wherein supplying the map position includes the surgical navigation system selecting a map position based on a location of a surgical probe in a subject space.

21. The method of claim 19, wherein the displaying step includes presenting the composite medical data as an image.

22. The method of claim 19, wherein the displaying step includes presenting the composite medical data as text.

23. The method of claim 19, wherein the displaying step includes presenting the composite medical data as a VRML image.

24. An apparatus for presenting an operator with composite medical data containing subject data and co-registered data representing a knowledge base providing supplemental information about structure contained in the subject data, said apparatus comprising:

means for creating a mapping relationship between the subject data and the co-registered data, in co-registered databases, by deforming a template corresponding to the subject data;

means for filtering the co-registered data corresponding to a map position supplied by a surgical navigation system to allow at least a portion of the corresponding co-registered data to be mapped;

means for mapping the filtered co-registered data corresponding to the map position to the subject data according to the mapping relationship to produce the composite medical data; and

means for presenting the operator with composite medical data composed of the corresponding co-registered data mapped to the subject data.

25. The apparatus of claim 24, wherein the means for filtering comprises means for use with a surgical navigation system for selecting the map position based on a location of a surgical probe.

26. The apparatus of claim 24, wherein the means for presenting the composite medical data comprises means for displaying the composite medical data image.

27. The apparatus of claim 24, wherein the means for presenting composite medical data comprises means for displaying the composite medical data as a VRML image.

28. The method of claim 24, wherein the means for presenting the composite medical data comprises means for displaying the composite medical data as text.

29. An apparatus for tracking change of brain structures and lesions with composite medical data, comprising:

a deformation engine that creates a mapping relationship between scans of a subject'"'"'s brain structures and lesions and subject data by deforming a template corresponding to the subject data;

a filtering engine that filters the scans to allow the mapping of at least a portion of the scans to the subject data;

a mapping engine that maps the scans that have been filtered to the subject data to form the composite medical data; and

a graphical display that presents the composite medical data composed of the scans of the subject'"'"'s brain structures and lesions, and the subject data.

30. The apparatus of claim 29, wherein the scans are sequential scans of a subject'"'"'s brain structure and lesions.

31. The apparatus of claim 29, wherein the mapping engine produces the composite medical data by relating points in a subject space coordinate system to scans in a co-registered database coordinate system.

32. The apparatus of claim 29, wherein the graphical display presents the composite medical data to the operator as a VRML image.

33. An apparatus for tracking change of brain structures and lesions with composite medical data, comprising:

means for creating a relationship between scans of a subject'"'"'s brain structures and lesions and subject data by mapping or deforming a template corresponding to the subject data;

means for filtering the scans to allow at least a portion of the scans to be mapped to the subject data;

means for mapping the scans that have been filtered to the subject data to form the composite medical data; and

means for displaying the composite medical data composed of the scans of the subject'"'"'s brain structures and lesions, and the subject data.

34. The apparatus of claim 33, wherein the means for creating the mapping relationship comprises means for creating the mapping relationship between sequential scans of the subject'"'"'s brain structures and lesions and the subject data.

35. The apparatus of claim 33, wherein the means for mapping the scans comprises means for producing the composite medical data by relating points in a subject space coordinate system to the scans in a co-registered database coordinate system.

36. The apparatus of claim 35, wherein the means for displaying includes means for presenting the composite medical data to the operator as a VRML image.

37. A method for change of brain structures and lesions with composite medical data, comprising:

creating a relationship between scans of a subject'"'"'s brain structures and lesions and the subject data by mapping or deforming a template corresponding to the subject data;

filtering the scans to allow the mapping of at least a portion of the scans to the subject data;

mapping the scans that have been filtered to the subject data to form the composite medical data; and

displaying the composite medical data composed of the scans of the subject'"'"'s brain structures and lesions, and the subject data.

38. The method of claim 37, wherein the relationship is created between sequential scans of the subject'"'"'s brain structures and lesions and the subject data.

39. The method of claim 37, wherein the mapping step includes forming the composite medical data by relating points in a subject space coordinate system to the scans in a co-registered database coordinate system.

40. The method of claim 37, wherein the displaying step includes representing the composite medical data to the operator as a VRML image.

41. An apparatus for linking a region of interest in a subject data set to a statistical database that relates the region of interest to information on procedures, comprising:

a deformation engine that creates a mapping relationship between the statistical database and the subject data set by deforming a template corresponding to the subject data set;

a filtering engine that filters the statistical database to allow at least a portion of the statistical database to be mapped to the subject data;

a mapping engine that maps the filtered statistical database, which contains the information on procedures, to the subject data to form the composite medical data; and

a display that presents the composite medical data composed of the subject data and information on procedures.

42. The apparatus of claim 41, wherein the procedure includes the use of electrodose settings.

43. The apparatus of claim 41, wherein the display presents the composite medical data composed of the subject data and information on procedures as text and a VRML image.

44. The apparatus of claim 41, wherein the mapping engine forms the composite medical data by relating points in a subject space coordinate system to the statistical database in a co-registered database coordinate system.

45. The apparatus of claim 41, wherein the display presents the composite medical data as graphics and text.

46. An apparatus for linking a region of interest in subject data to a statistical database that relates the region of interest to information on procedures, comprising:

means for creating a mapping relationship between the statistical database and the subject data;

means for filtering the statistical database to allow at least a portion of the statistical database to be mapped to the subject data;

means for mapping the filtered statistical database, which contains the information on procedures, to the subject data to form the composite medical data; and

means for presenting the composite medical data composed of the subject data and information on procedures.

47. The apparatus of claim 46, wherein the means for presenting includes means for presenting a procedure that uses electrodose settings.

48. The apparatus of claim 46, wherein the means for mapping includes means for forming the composite medical data by relating points in a subject space coordinate system to the statistical database in a co-registered database coordinate system.

49. The apparatus of claim 46, wherein the means for presenting includes means for displaying the composite medical data as graphics and text.

50. The apparatus of claim 46, wherein the means for presenting includes means for displaying the composite medical data as a VRML image and text.

51. A method for linking a region of interest in subject data to a statistical database that relates the region of interest to information on procedures, comprising:

creating a mapping relationship between the statistical database and a subject data set by deforming a template corresponding to the subject data;

filtering the statistical database to map at least a portion of the statistical database to the subject data set;

mapping the filtered statistical database, which contains the information on procedures, to the subject data to form the composite medical data; and

presenting the composite medical data composed of the subject data and information on procedures that correspond with a selected point.

52. The method of claim 51, wherein the step of presenting includes displaying a procedure that uses electrodose settings.

53. The method of claim 51, wherein the step of mapping includes forming the composite medical data by relating points in a subject space coordinate system to the statistical database in a co-registered database coordinate system.

54. The apparatus of claim 51, wherein the step of presenting includes displaying the composite medical data as graphics and text.

55. The apparatus of claim 51, wherein the step of presenting includes displaying the composite medical data as a VRML image and text.

56. An apparatus for creating an object based model of an area of interest within a subject, comprising:

a deformation engine that creates a mapping relationship between segmented atlases of a plurality of dimensions and a subject data set by deforming a template corresponding to the subject data set;

a filtering engine that filters the segmented atlases to allow at least a portion of the segmented atlases to be mapped to the subject data set;

a mapping engine that maps the segmented atlases that have been filtered to the subject data set to form the composite medical data, which includes the object based model; and

a display that presents the composite medical data composed of the object based model of the area of interest.

57. The apparatus of claim 56, wherein the object based model of the area of interest is a representation of one of lesions, targets, and brain structures.

58. The apparatus of claim 56, wherein the display presents the composite medical data composed of the object based model of the area of interest displayed as a graphical image.

59. The apparatus of claim 56, wherein the display represents the composite medical data composed of the object based model of the area of interest displayed as a VRML image.

60. A method for creating an object based model of an area of interest within a subject, comprising:

creating a relationship between segmented atlases of a plurality of dimensions and a subject data set by deforming a template corresponding to the subject data set;

filtering the segmented atlases to allow at least a portion of the segmented atlases to be mapped to the subject data set;

mapping the segmented atlases that have been filtered to the subject data set to form the composite medical data, which includes the object based mode; and

displaying the composite medical data composed of the object based model of the area of interest.

61. The method of claim 60, wherein the displaying step includes a graphic representation of the object based model of one of lesions, targets, and brain structures.

62. The method of claim 60, wherein the displaying step includes a VRML image of the object based model of one of lesions, targets, and brain structures.

63. An apparatus for creating an object based model of an area of interest within a patient said apparatus for use with one or more co-registered databases representing a knowledge base providing supplemental information about structure contained in the subject data, said apparatus comprising:

means for creating a relationship between segmented atlases of a plurality of dimensions and a subject data set by deforming a template corresponding to the subject data set;

means for filtering the segmented atlases to allow at least a portion of the segmented atlases to be mapped to the subject data set;

means for mapping the segmented atlases that have been filtered to the subject data set to form the composite medical data, which include the object based model; and

means for displaying the composite medical data composed of the object based model of the area of interest.

64. The apparatus of claim 63, wherein the means for displaying includes means for providing a graphic representation of the object based model of one of lesions, targets, and brain structures.

65. The apparatus of claim 63, wherein means for displaying include means for providing a VRML image of the object based model of one of lesions, targets, and brain structures.

66. An apparatus that uses composite medical data to supply a navigation system with a surgical plan, said apparatus for use with one or more co-registered databases representing a knowledge base providing supplemental information about structure contained in the subject data, said apparatus comprising:

a deformation engine that creates a relationship between segmented atlases of a plurality of dimensions and a subject data set by deforming a template corresponding to the subject data set;

a mapping engine that receives a map position from the navigation system and queries at least one of the co-registered databases for data corresponding to the map position and supplies the data corresponding to the map position to the navigation system.

67. The apparatus of claim 66, wherein the mapping engine supplies a surgical plan to the navigation system based on atlas information.

68. An apparatus that uses composite medical data to supply a navigation system with a surgical plan, said apparatus for use with one or more co-registered databases representing a knowledge base providing supplemental information about structure contained in the subject data, said apparatus comprising:

means for creating a relationship between segmented atlases of a plurality of dimensions and a subject data set by deforming a template corresponding to the subject data set;

means for receiving a map position from the surgical navigation system and querying at least one of the co-registered databases for data corresponding to the map position; and

means for supplying the data corresponding to the map position to the navigation system.

69. The apparatus of claim 68, wherein the means for supplying include means for providing a surgical plan to the navigation system based on atlas information.

70. An apparatus that in conjunction with a navigation system presents an operator with composite medical data containing subject data and co-registered data representing a knowledge base providing supplemental information about structure contained in the subject data, said apparatus comprising:

a deformation engine that creates a relationship between the subject data and the co-registered data, in at least one co-registered database, by deforming a template corresponding to the subject data;

a mapping engine that receives a map position from the navigation system and queries the at least one co-registered database for data corresponding to the map position;

a filtering engine that filters the data corresponding to the map position to allow at least a portion of the corresponding data to be mapped to the subject data; and

a display on the navigation system that presents the operator with the composite medical data composed of the corresponding data mapped to the subject data.

71. The apparatus of claim 70, wherein the display is a VRML display.

72. The apparatus of claim 70, wherein the display is a graphical display.

73. The apparatus of claim 70, wherein the display on the navigation system only displays the boundaries of an atlas found in the at least one co-registered database.

74. A method for presenting composite medical data containing subject data and co-registered data representing a knowledge base providing supplemental information about structure contained in the subject data on a navigation system, said method comprising:

generating a relationship between the subject data and the co-registered data, in at least one co-registered database, by deforming a template corresponding to the subject data;

receiving a map position from the navigation system and querying the at least one co-registered database for data corresponding to the map position;

filtering the data corresponding to the map position to allow at least a portion of the corresponding data to be mapped to the subject data; and

presenting on the navigation system composite medical data composed of the corresponding data mapped to the subject data.

75. The method of claim 74, wherein the step of presenting includes displaying the composite medical data as a VRML display.

76. The method of claim 74, wherein the step of presenting includes displaying the composite medical data as a graphical display.

77. The method of claim 74, wherein the step of presenting includes only displaying on the navigation system the boundaries of an atlas found in the at least one co-registered database.

78. An apparatus that in conjunction with a navigation system presents an operator with composite medical data containing subject data and co-registered data representing a knowledge base providing supplemental information about structure contained in the subject data, said apparatus comprising:

means for creating a relationship between the subject data and the co-registered data, in at least one co-registered database, by deforming a template corresponding to the subject data;

means for receiving a map position from the navigation system and querying the at least one co-registered database for data corresponding to the map position;

means for filtering the data corresponding to the map position to allow at least a portion of the corresponding data to be mapped to the subject data; and

means for presenting on the navigation system composite medical data composed of the corresponding data mapped to the subject data.

79. The apparatus of claim 78, wherein the means for presenting includes means for displaying the composite medical data as a VRML display.

80. The apparatus of claim 78, wherein the means for presenting includes means for displaying the composite medical data as a graphical display.

81. The apparatus of claim 78, wherein the means for presenting includes means for only displaying on the navigation system the boundaries of an atlas found in the at least one co-registered database.

82. An apparatus for automatically presenting an operator with composite medical data containing patient data and co-registered data representing a knowledge base providing supplemental information about structure contained in the patient data, said apparatus comprising:

means for requesting composite medical data from a server computer;

means for transmitting the patient data to the server computer;

means for transmitting the requested composite medical data from the server computer; and

means including a surgical navigation system for presenting the received composite medical data to an operator.

83. An apparatus for automatically presenting an operator with composite medical data containing patient data and co-registered data representing a knowledge base providing supplemental information about structure contained in the patient data, said apparatus comprising:

means including a surgical navigation system for requesting composite medical data from a server computer;

means for transmitting that patient data to the server computer;

means for transmitting the requested composite medical data from the server computer; and

means for presenting the received composite medical data to an operator.

84. A method for automatically producing composite data containing subject data and co-registered data representing a knowledge base providing supplemental information about structure contained in the subject data, said method comprising the steps, performed in a computer having a mapping engine, a search and filter engine, and a deformation engine, of:

creating a mapping relationship between the co-registered data and the subject data by deforming a template to fit the subject data;

filtering the co-registered data; and

mapping the filtered co-registered data to the subject data according to the mapping relationship to produce the composite data.

85. The method of claim 84, wherein the co-registered data contains co-registered subject data.

86. The method of claim 84, wherein the step of mapping includes the substep of relating a point in a subject data space coordinate system to an element of co-registered data.

87. The method of claim 84, wherein the step of mapping includes the substep of relating an element of co-registered data to a point in a subject data space coordinate system.

88. The method of claim 84, further comprising the step of receiving a request for the composite data from an operator.

89. The method of claim 88, further comprising the step of processing said request using a filtering context for the composite data.

90. The method of claim 84, further comprising the step of communicating the composite data to a display on the computer.

91. The method of claim 84, further comprising the step of generating a map representing the relationship between the subject data and the co-registered data with the computer.

92. The method of claim 84, further comprising the step of filtering the co-registered data according to a filtering context.

93. A computer having a mapping engine, a deformation engine, and a search and filter engine for automatically producing a composite medical data containing subject data and co-registered medical data representing a knowledge base providing supplemental information about structure contained in the subject data, said computer comprising:

means for creating a mapping relationship between the co-registered medical data and the subject data by mapping or deforming a template to fit the subject data;

means for filtering the co-registered medical data;

means for mapping the filtered co-registered medical data to the subject data according to the mapping relationship to produce the composite medical data.

94. The computer of claim 93, wherein the co-registered medical data contains co-registered subject data.

95. The computer of claim 93, wherein the means for creating a mapping relationship comprises means for relating a point in a subject data space coordinate system to an element of co-registered medical data.

96. The computer of claim 93, wherein the means for mapping further comprises means for relating an element of co-registered medical data to a point in a subject data space coordinate system.

97. The computer of claim 93, further comprising means for receiving a request for the composite medical data from an input device.

98. The computer of claim 93, further comprising means for processing a filtering context;

and

means for processing a request, including a filtering context, for the composite medical data.

99. The computer of claim 93, further comprising means for displaying the composite medical data to an operator.

100. The computer of claim 93, further comprising means for communicating a map representing the relationship between the subject data and the co-registered medical data to an operator using the computer.

101. The computer of claim 93, wherein the means for producing composite medical data comprises means for filtering the co-registered medical data according to a filtering context.