Apparatus and method for visualizing ultrasonic images

• US 5,810,008 A
• Filed: 12/03/1996
• Issued: 09/22/1998
• Est. Priority Date: 12/03/1996
• Status: Expired due to Term

• Current Assignee: Brainlab AG
• Original Assignee: ISG Technologies, Inc. (International Business Machines Corporation)
• Inventors: Dekel, Doron, Hall, Charles Ryan
• Primary Examiner(s): JAWORSKI, FRANCIS J
• Application Number:
  US08/758,721
• Time in Patent Office: 658 Days
• Field of Search: 128/660.01, 128/660.07, 128/662.05, 128/916, 128/662.06
• US Class Current: 600/443
• CPC Class Codes: A61B 2034/2051 Electromagnetic tracking systems
• CPC Class Codes: A61B 2090/365 augmented reality, i.e. correlating a live optical image with another image
• CPC Class Codes: A61B 2090/367 creating a 3D dataset from 2D images using position information
• CPC Class Codes: A61B 2090/378 using ultrasound
• CPC Class Codes: A61B 34/20 Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
• CPC Class Codes: A61B 34/25 User interfaces for surgical systems
• CPC Class Codes: A61B 8/00 Diagnosis using ultrasonic, sonic or infrasonic waves imaging of objects using sonar G01S15/00
• CPC Class Codes: A61B 8/14 Echo-tomography
• CPC Class Codes: A61B 8/483 involving the acquisition of a 3D volume of data
• CPC Class Codes: G01S 15/899 Combination of imaging systems with ancillary equipment
• CPC Class Codes: G01S 15/8993 Three dimensional imaging systems
• CPC Class Codes: G01S 5/10 Position of receiver fixed by co-ordinating a plurality of position lines defined by path-difference measurements , e.g. omega or decca systemsG01S5/12 takes precedence ; beacons and receivers cooperating therewith G01S1/306, G01S1/308
• CPC Class Codes: G01S 7/5205 Means for monitoring or calibrating
• CPC Class Codes: G01S 7/52071 Multicolour displays; using colour coding; Optimising colour or information content in displays, e.g. parametric imaging
• CPC Class Codes: Y10S 128/916 Ultrasound 3-D imaging

Abstract

The present invention provides a system and method for visualizing internal images of an anatomical body. Internal images of the body are acquired by an ultrasound imaging transducer. The position and orientation of the ultrasound imaging transducer is tracked in a frame of reference by a spatial determinator. The position of the images in the frame of reference is determined by calibrating the ultrasound imaging transducer to produce a vector position of the images with respect to a fixed point on the transducer. This vector position can then be added to the position and orientation of the fixed point of the transducer in the frame of reference determined by the spatial determinator. The position and orientation of a medical instrument used on the patient are also tracked in the frame of reference by spatial determinators. The position and orientation of the instrument is mapped onto the position and orientation of the images. This information is used to generate processed images from the images acquired by the transducer. The processed images are generated from a view spatially related to the position of the instrument. The system is expandable so that more than one instrument and more than one transducer can be used.

Claims

1. A system for visualizing internal images of a body in relation to an instrument within the body, said images having been acquired by an ultrasound imaging transducer, the system comprising:

first spatial determinator means for determining spatial positional information of the instrument comprising a position and an orientation of the instrument in a frame of reference and for sending a first spatial signal representing the spatial positional information of the instrument;

second spatial determinator means for determining spatial positional information of the ultrasound imaging transducer comprising a position and an orientation of the ultrasound imaging transducer in the frame of reference and for sending a second spatial signal representing the spatial positional information of the transducer;

mapping means for receiving the first spatial signal and the second spatial signal and generating a first mapping signal indicative of the position and orientation of the instrument relative to the position and orientation of the images;

image processing means for receiving the first mapping signal and signals representing the images acquired by the transducer and generating processed images from a view which is spatially related to the position of the instrument; and

display means for displaying the processed images.

2. The system as claimed in claim 1 wherein the image processing means generates a representation of the instrument based on the first mapping signal, said representation of the instrument having a position relative to the processed images of the body corresponding to the position of the instrument relative to the body.

3. The system as claimed in claim 1 wherein the mapping means comprises:

memory means for storing spatial positional information of the images with respect to the transducer; and

processing means for determining the position of the images in the frame of reference from the second spatial signal and the spatial positional information of the images with respect to the transducer stored in the memory means and for mapping the position of the instrument onto the position of the images to generate the first mapping signal.

4. The system as claimed in claim 3 wherein the spatial positional information of the images with respect to the transducer stored in the memory means comprises a vector position of the images acquired by the transducer with respect to a fixed point on the transducer determined by calibrating the transducer;

wherein the second spatial signal representing the spatial positional information of the transducer comprises a position of the fixed point on the transducer in the frame of reference; and

wherein the processing means determines the spatial position of the images in the frame of reference by adding the vector position of the images with respect to the fixed point on the transducer to the spatial positional information of the fixed point on the transducer.

5. The system as claimed in claim 4 wherein the images of the body comprise a sequence of three dimensional images which can be displayed in a sequence in substantially real time;

and

wherein the view of the processed images displayed on the display change corresponding to changes in the position and orientation of the instrument relative to the body; and

wherein the image processing means generates a three dimensional representation of the instrument on the display, said representation having a position and an orientation relative to the processed images corresponding to the position and orientation of the instrument relative to the body.

6. The system as claimed in claim 5 wherein the three dimensional images have a view and a perspective which is spatially related to the position and orientation of the instrument.

7. The system as claimed in claim 4 wherein the body is an anatomical body and the instrument is a surgical instrument.

8. The system as claimed in claim 4 further comprising:

third spatial determinator means for determining spatial positional information of an other instrument comprising a position and an orientation of the other instrument in the frame of reference and for sending a third spatial signal representing the spatial positional information of the other instrument;

wherein the mapping means receives the third positional signal and generates a second mapping signal indicative of the position and orientation of the other instrument mapped onto the position and orientation of the images; and

wherein the image processing means receives the second mapping signal and generates processed images from a view related to the spatial position of the instrument or the other instrument dependent upon a user selection.

9. The system as claimed in claim 4 further comprising:

third spatial determinator means for determining spatial positional information of an additional ultrasound imaging transducer acquiring images of the body comprising a position and an orientation of the additional transducer in the frame of reference and for sending a third spatial signal representing the spatial positional information of the additional transducer;

wherein the mapping means receives the third positional signal and generates a second mapping signal indicative of the position and the orientation of the instrument relative to a position and an orientation of the images acquired by the additional transducer;

wherein the image processing means receives the second mapping signal and signals representing the images acquired by the additional transducer and generates processed images from a view related to the position and the orientation of the instrument, based on the signals representing the images acquired by the transducer and the additional transducer.

10. The system as claimed in claim 4 wherein the instrument has parts and the memory means stores spatial positional information of the parts of the instrument with respect to a point fixed to the instrument;

wherein the first spatial signal represents spatial positional information of the point fixed to the instrument;

wherein the processing means determines spatial positional information of the parts of the instrument in the frame of reference based on the first spatial signal and the spatial positional information of the parts of the instrument with respect to the point fixed to the instrument;

wherein the processing means maps the position of the parts of the instrument onto the position of the images such that the first mapping signal is indicative of the position of one of the parts of the instrument relative to the position of the images; and

wherein the image processing means generates processed images from a view spatially related to the position of one of the parts of the instrument in the body.

11. The system as claimed in claim 3 wherein the image processing means stores the acquired images with the spatial positional information of each image in a slice stack of two dimensional images.