SYSTEMS AND METHODS FOR TRACKING A SURGICAL INSTRUMENT AND FOR CONVEYING TRACKING INFORMATION VIA A NETWORK

• US 20080118116A1
• Filed: 11/20/2006
• Published: 05/22/2008
• Est. Priority Date: 11/20/2006
• Status: Abandoned Application

• Current Assignee: General Electric Company
• Original Assignee: General Electric Company
• Inventors: Chandonnet, Jason Rene, Robert, Nicholas, Zuhars, Joel Frederick, Lea, Jon Thomas
• Application Number:
  US11/561,678
• Publication Number:
  US 20080118116A1
• Time in Patent Office: Days
• US Class Current: 382/128
• CPC Class Codes: A61B 2034/102 Modelling of surgical devices, implants or prosthesis
• CPC Class Codes: A61B 2034/2051 Electromagnetic tracking systems
• CPC Class Codes: A61B 2090/365 augmented reality, i.e. correlating a live optical image with another image
• CPC Class Codes: A61B 2090/374 NMR or MRI
• CPC Class Codes: A61B 2090/376 using X-rays, e.g. fluoroscopy
• CPC Class Codes: A61B 2090/3762 using computed tomography systems [CT]
• CPC Class Codes: A61B 34/20 Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis

Abstract

Systems and methods for tracking a surgical instrument and for conveying tracking information via a network provide a primary tracking image generally within an operating room, and also a variety of types of secondary tracking images, either outside of the operating room or within the operating room.

Claims

1. A method of generating a tracking image, comprising:

receiving first raw image data with a primary imaging and tracking system;

communicating upon a network at least one of the first raw image data, first raw tracking data, first position and orientation data, first transformed position and orientation data, or first registration matrix data, wherein the first position and orientation data is associated with a first coordinate system, wherein the first raw image data is associated with a second coordinate system, wherein the first raw tracking data is representative of raw information provided by a first tracking sensor adapted to track a primary surgical instrument, wherein the first position and orientation data is indicative of a position and orientation of the primary surgical instrument in the first coordinate system, wherein the first transformed position and orientation data is indicative of a transformed position and orientation of the primary surgical instrument in the second coordinate system, and wherein the first registration matrix data is representative of a transformation from the first coordinate system to the second coordinate system; and

displaying with the primary imaging and tracking system a primary tracking image indicative of the first transformed position and orientation data associated with the primary surgical instrument combined with the first raw image data.

2. The method of claim 1, further comprising receiving from the network with a secondary imaging and tracking system at least one of the first raw image data, the first raw tracking data, the first position and orientation data, the first transformed position and orientation data, or the first registration matrix data.

3. The method of claim 2, further comprising displaying with the secondary imaging and tracking system a second version of the primary tracking image.

4. The method of claim 2, further comprising:

receiving from the network second raw image data with the secondary imaging and tracking system, wherein the second raw image data is associated with a third coordinate system;

transforming the second raw image data to provide transformed second raw image data, wherein the transformed second raw image data is associated with the second coordinate system; and

displaying with the secondary imaging and tracking system a secondary tracking image indicative of the first transformed position and orientation data associated with the primary surgical instrument combined with the transformed second raw image data.

5. The method of claim 4, further comprising displaying with the secondary imaging and tracking system an experimental tracking image different from the primary and secondary tracking images, wherein the experimental tracking image is indicative of at least one of an experimental transformed position and orientation of the primary surgical instrument combined with a selected one of the first raw image data or the transformed second raw image data, an experimental visualization of the first transformed position and orientation data associated with the primary surgical instrument combined with a selected one of the first raw image data or the transformed second raw image data.

6. The method of claim 2, further comprising:

receiving from the network with the secondary imaging and tracking system second raw tracking data, wherein the second raw tracking data is representative of raw information provided by second tracking sensors adapted to track a secondary surgical instrument; and

displaying with the secondary imaging and tracking system a secondary tracking image indicative of second transformed position and orientation data associated with the secondary surgical instrument combined with the first raw image data, wherein the second transformed position and orientation data is indicative of a transformed position and orientation of the secondary surgical instrument in the second coordinate system.

7. The method of claim 6, further comprising displaying with the secondary imaging and tracking system a second version of the primary tracking image.

8. The method of claim 6, further comprising:

communicating to the network with the secondary imaging and tracking system the second transformed position and orientation data;

receiving from the network the second transformed position and orientation data with the primary imaging and tracking system; and

displaying with the primary imaging and tracking system a second version of the secondary tracking image.

9. System for generating a tracking image, comprising:

a primary imaging and tracking system adapted to;

receive first raw image data,

communicate upon a network at least one of the first raw image data, first raw tracking data, first position and orientation data, first transformed position and orientation data, or first registration matrix data, wherein the first position and orientation data is associated with a first coordinate system, wherein the first raw image data is associated with a second coordinate system, wherein the first raw tracking data is representative of raw information provided by tracking sensors, wherein the first position and orientation data is indicative of a position and orientation of a primary surgical instrument in the first coordinate system, wherein the first transformed position and orientation data is indicative of a transformed position and orientation of the primary surgical instrument in the second coordinate system, and wherein the first registration matrix data is representative of a transformation from the first coordinate system to the second coordinate system, and

display a primary tracking image indicative of the first transformed position and orientation data associated with the primary surgical instrument combined with the first raw image data.

10. The system of claim 9, further comprising a secondary imaging and tracking system adapted to receive from the network at least one of the first raw image data, the first raw tracking data, the first position and orientation data, the first transformed position and orientation data, or the first registration matrix data.

11. The system of claim 10, wherein the secondary imaging and tracking system is further adapted to display a second version of the primary tracking image.

12. The system of claim 10, wherein the secondary imaging and tracking system is further coupled to receive from the network second raw image data associated with a third coordinate system, wherein the secondary imaging and tracking system is adapted to transform the second raw image data to provide transformed second raw image data associated with the second coordinate system, wherein the secondary imaging and tracking system is further adapted to display a secondary tracking image indicative of the first transformed position and orientation data associated with the primary surgical instrument combined with the transformed second raw image data.

13. The system of claim 12, wherein the secondary imaging and tracking system is further adapted to display an experimental tracking image different from the primary or secondary tracking images, which is indicative of at least one of an experimental transformed position and orientation of the primary surgical instrument combined with a selected one of the first raw image data or the transformed second raw image data, or an experimental visualization of the first transformed position and orientation data associated with the primary surgical instrument combined with a selected one of the first raw image data or the transformed second raw image data.

14. The system of claim 10, wherein the secondary imaging and tracking system is further coupled to receive from the network second raw tracking data, wherein the second raw tracking data is representative of raw information provided by a second tracking sensor adapted to track a secondary surgical instrument, and wherein the secondary imaging and tracking system is adapted to display a secondary tracking image indicative of second transformed position and orientation data associated with the secondary surgical instrument combined with the first raw image data, wherein the second transformed position and orientation data is indicative of a transformed position and orientation of the secondary surgical instrument in the second coordinate system.

15. The system of claim 14, wherein the secondary imaging and tracking system is further adapted to display a second version of the primary tracking image.

16. The system of claim 14, wherein the secondary imaging and tracking system is further adapted to communicate to the network the second transformed position and orientation data, and wherein the primary imaging and tracking system is further adapted to receive from the network the second transformed position and orientation data and to display a secondary version of the secondary tracking image.

17. The system of claim 10, wherein the secondary imaging and tracking system comprises:

a secondary communications module adapted to couple to the network, wherein the secondary communications module is coupled to receive from the network at least one of second raw image data, the first raw image data, the first raw tracking data, the first registration matrix data, the first position and orientation data, or the first transformed position and orientation data;

a secondary position and orientation module coupled to receive the first raw tracking data and adapted to generate at least one of a second version of the first position and orientation data or experimental position and orientation data;

an image transformation module coupled to receive the first raw image data and the second raw image data, and adapted to generate transformed second raw image data, wherein the transformed second raw image data is associated with the second coordinate system; and

a secondary viewing module coupled to receive at least one of the second version of the first position and orientation data, the experimental position and orientation data, the first registration matrix data, the first position and orientation data, the first raw image data, the transformed second raw image data, or the first transformed position and orientation data, and adapted to generate at least one of a second version of the primary tracking image, a secondary tracking image indicative of the first transformed position and orientation data associated with the primary surgical instrument combined with the second raw image data, or an experimental tracking image different from the primary or secondary tracking images, which is indicative of an experimental transformed position and orientation of the primary surgical instrument combined with at least one of the first or the second raw image data.

18. The system of claim 10, wherein the secondary imaging and tracking system comprises:

a secondary communications module adapted to couple to the network, wherein the secondary communications module is coupled to receive at least one of the first raw image data, the first raw tracking data, second raw tracking data, the first registration matrix data, the first position and orientation data, or the first transformed position and orientation data;

a secondary position and orientation module coupled to receive at least one of the first raw tracking data or the second raw tracking data, and adapted to generate at least one of a second version of the first position and orientation data or second position and orientation data;

a secondary registration module coupled to receive from the network the second position and orientation data and the first raw image data, and adapted to generate second registration matrix data; and

a secondary viewing module coupled to receive at least one of the second version of the first position and orientation data, the second position and orientation data, the first registration matrix data, the second registration matrix data, the second position and orientation data, the first raw image data, or the first transformed position and orientation data, and adapted to generate at least one of secondary tracking image indicative of a the second transformed position and orientation data associated with the secondary surgical instrument combined with first raw image data or a second version of the primary tracking image.

19. The system of claim 9, wherein the primary imaging and tracking system comprises:

a primary communications module adapted to couple to the network, wherein the primary communications module is coupled to receive at least one of the first raw image data or the first raw tracking data;

a primary position and orientation module coupled to receive the first raw tracking data and adapted to generate the first position and orientation data;

a primary registration module coupled to receive the first position and orientation data and the first raw image data, and adapted to generate the first registration matrix data; and

a primary viewing module coupled to receive from the network at least one of the first position and orientation data, the first registration matrix data, or the first raw image data, wherein the primary viewing module is further adapted to generate the first transformed position and orientation data, and wherein the primary viewing module is further adapted to combine the first transformed position and orientation data with the first raw image data to generate the primary tracking image.

20. System for generating a tracking image, comprising:

a primary imaging and tracking system adapted to couple to a network and adapted to communicate tracking data to or from the network, wherein the tracking data is associated with a position and an orientation of a surgical instrument.

21. The system of claim 20, wherein the tracking data includes at least one of first raw image data, first raw tracking data, first registration matrix data, first position and orientation data, first transformed position and orientation data, and second transformed position and orientation data, wherein the first position and orientation data is associated with a first coordinate system, wherein the first raw image data is associated with a second coordinate system, wherein the first raw tracking data is indicative of a position and orientation of a primary surgical instrument, the first position and orientation data is indicative of a position and orientation of the primary surgical instrument in the first coordinate system, the first transformed position and orientation data is indicative of a transformed position and orientation of the primary surgical instrument in the second coordinate system, the first registration matrix data is representative of a transformation from the first coordinate system to the second coordinate system, and the second transformed position and orientation data is indicative of a transformed position and orientation of a secondary surgical instrument in the second coordinate system.

22. The system of claim 20, further comprising a secondary imaging and tracking system adapted to couple to the primary imaging and tracking system via the network, wherein the primary imaging and tracking system and the secondary imaging and tracking system are adapted to exchange the tracking data.

23. Method of generating a tracking image, comprising:

communicating tracking data to or from a network associated with a primary imaging and tracking system, wherein the tracking data is associated with a position and an orientation of a surgical instrument.

24. The method of claim 23, wherein the tracking data includes at least one of the first raw image data, first raw tracking data, first position and orientation data, first transformed position and orientation data, second transformed position and orientation data, or first registration matrix data, wherein the first position and orientation data is associated with a first coordinate system, wherein the first raw image data is associated with a second coordinate system, wherein the first raw tracking data is representative of raw information provided by a first tracking sensor adapted to track a primary surgical instrument, wherein the first position and orientation data is indicative of a position and orientation of the primary surgical instrument in the first coordinate system, wherein the first transformed position and orientation data is indicative of a transformed position and orientation of the primary surgical instrument in the second coordinate system, wherein the first registration matrix data is representative of a transformation from the first coordinate system to the second coordinate system, and wherein the second transformed position and orientation data is indicative of a transformed position and orientation of a secondary surgical instrument in the second coordinate system.

25. The method of claim 23, further comprising exchanging the tracking data via the network, between the primary imaging and tracking system and a secondary imaging and tracking system coupled to the network.