Coloring electroanatomical maps to indicate ultrasound data acquisition

• US 7,831,076 B2
• Filed: 12/08/2006
• Issued: 11/09/2010
• Est. Priority Date: 12/08/2006
• Status: Active Grant

• Current Assignee: Biosense Webster Incorporated (Johnson & Johnson)
• Original Assignee: Biosense Webster Incorporated (Johnson & Johnson)
• Inventors: Kirshenbaum, Dina, Govari, Assaf, Altmann, Andres Claudio
• Primary Examiner(s): AZARIAN, SEYED H
• Application Number:
  US11/608,506
• Publication Number:
  US 20080137927A1
• Time in Patent Office: 1,432 Days
• Field of Search: 382/100, 382/128, 382/129, 382/130, 382/131, 382/132, 382/133, 382/134, 382/154, 382/162, 382/165, 382/168, 382/180, 382/181, 382/184, 382/199, 382/203, 382/224, 382/232, 382/254, 382/274, 382/276, 382285-291, 382/305, 382/312, 600/459, 600/463, 600/424, 600/34, 378/21
• US Class Current: 382/128
• CPC Class Codes: A61B 2034/105 Modelling of the patient, e.g. for ligaments or bones
• CPC Class Codes: A61B 2034/2051 Electromagnetic tracking systems
• CPC Class Codes: A61B 2090/364 Correlation of different images or relation of image positions in respect to the body
• CPC Class Codes: A61B 2090/365 augmented reality, i.e. correlating a live optical image with another image
• CPC Class Codes: A61B 2090/367 creating a 3D dataset from 2D images using position information
• CPC Class Codes: A61B 2090/378 using ultrasound
• CPC Class Codes: A61B 34/20 Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
• CPC Class Codes: A61B 5/339 Displays specially adapted therefor
• CPC Class Codes: A61B 5/7285 for synchronising or triggering a physiological measurement or image acquisition with a physiological event or waveform, e.g. an ECG signal A61B6/5205, A61B6/541, A61B8/5207, A61B8/543 take precedence
• CPC Class Codes: A61B 5/743 Displaying an image simultaneously with additional graphical information, e.g. symbols, charts, function plots
• CPC Class Codes: A61B 6/08 Auxiliary means for directing the radiation beam to a particular spot, e.g. using light beams
• CPC Class Codes: A61B 6/463 characterised by displaying multiple images or images and diagnostic data on one display
• CPC Class Codes: A61B 6/5229 combining image data of a patient, e.g. combining a functional image with an anatomical image
• CPC Class Codes: A61B 6/5241 combining overlapping images of the same imaging modality, e.g. by stitching
• CPC Class Codes: A61B 8/12 in body cavities or body tracts, e.g. by using catheters catheters per se A61M25/00
• CPC Class Codes: A61B 8/13 Tomography A61B8/10, A61B8/12 take precedence; tomography for radiation diagnosis A61B6/02
• CPC Class Codes: A61B 8/4488 the transducer being a phased array
• CPC Class Codes: A61B 8/463 characterised by displaying multiple images or images and diagnostic data on one display composite display in devices for short-range imaging with acoustic waves G01S7/52074
• CPC Class Codes: A61B 8/466 adapted to display 3D data 3D imaging and stereoscopic displays in devices for short-range imaging with acoustic waves G01S15/8993 and G01S7/52068, respectively; 3D image rendering G06T15/00; manipulating 3D models for computer graphics G06T19/00
• CPC Class Codes: A61B 8/483 involving the acquisition of a 3D volume of data
• CPC Class Codes: A61B 8/5238 : for combining image data of patient, e.g. merging several images from different acquisition modes into one image for image registration algorithms G06T7/30
• CPC Class Codes: A61B 8/543 : involving acquisition triggered by a physiological signal
• CPC Class Codes: A61B 90/36 : Image-producing devices or illumination devices not otherwise provided for

Abstract

During acquisition of ultrasound data in a medical imaging procedure, three-dimensional model of a structure being imaged, e.g., an electroanatomical map, is co-displayed and visually marked, to indicate progress of data acquisition. The plane of intersection successive two-dimensional images are marked on the as a line or colored region on the three-dimensional model. This display enables the operator to determine regions where sufficient data have been captured, and guides the operator to areas where additional data collection is still needed. Various color schemes are used to indicate the relative sufficiency of data collection.

Claims

1. A computer-assisted method for producing images of a living subject, comprising the steps of:

displaying a three-dimensional model of a surface of a structure in a body of said subject;

acquiring a sequence of two-dimensional images of at least a portion of said structure, said two-dimensional images having respective image planes;

while acquiring said sequence, marking said three-dimensional model to show respective intersections of said image planes with said surface;

wherein said two-dimensional images are acquired as realtime images by acquiring a plurality of two-dimensional ultrasound slices, computed tomographic slices, or realtime magnetic resonance slices, further comprising the steps of constructing three-dimensional images from said realtime images for use in said step of displaying.

2. The method according to claim 1, wherein said two-dimensional images are selected from the group consisting of two-dimensional ultrasound images, computed tomographic images and magnetic resonance images.

3. The method according to claim 1, further comprising the step of displaying said three-dimensional model and said respective intersections of said image planes with said surface on said three-dimensional model.

4. The method according to claim 3, wherein displaying said three-dimensional model comprises applying a pseudocolor to said respective intersections of said image planes with said surface.

5. The method according to claim 3, wherein marking said three-dimensional model comprises the steps of:

interpolating areas of said three-dimensional model between said respective intersections;

marking said interpolated areas, and

said step of displaying said three-dimensional model comprises displaying said interpolated areas.

6. The method according to claim 1, further comprising the steps of:

reconstructing a three-dimensional anatomic image of said structure from said two-dimensional images; and

displaying at least a portion of said three-dimensional anatomic image with said three-dimensional model.

7. The method according to claim 6, wherein said portion of said three-dimensional anatomic image does not extend beyond a predefined distance from a surface of said three-dimensional model.

8. The method according to claim 1, wherein said structure is a heart and said three-dimensional model is an anatomical map.

9. An apparatus for producing images of a living subject comprising:

a display;

a memory for storing a three-dimensional model of a surface of a structure in a body of said subject;

a two-dimensional imaging module operative for acquiring a sequence of two-dimensional anatomic images of at least a portion of said structure, said two-dimensional anatomic images having respective image planes;

a processor linked to said memory and to said two-dimensional imaging module, said processor operative for marking said three-dimensional model on said display to show respective intersections of said image planes with said surface; and

wherein said two-dimensional images are acquired as realtime images by acquiring a plurality of two-dimensional ultrasound slices, computed tomographic slices, or realtime magnetic resonance slices, and wherein said three-dimensional images are constructed from said realtime images for use on the display.

10. The apparatus according to claim 9, wherein said processor is operative for automatically registering said image planes with said three-dimensional model.

11. The apparatus according to claim 9, wherein said processor is operative for:

reconstructing a three-dimensional anatomic image of said structure from said two-dimensional anatomic images; and

displaying said three-dimensional anatomic image with said three-dimensional model.

12. The apparatus according to claim 9, wherein said two-dimensional imaging module generates ultrasound images, said structure is a heart and said three-dimensional model is an electroanatomical map.

13. A computer-assisted method for producing images of a living subject, comprising the steps of:

introducing a probe into a heart of said subject, said probe having a location sensor;

with said probe determining respective spatial coordinates of different locations in said heart to define a three-dimensional space;

generating a functional model comprising a three-dimensional map of said heart comprising functional information relating to said heart measured at multiple points of said heart;

acquiring an ultrasound image of a portion of said heart;

registering said ultrasound image with said three-dimensional space;

automatically marking a region on said map that corresponds to said portion of said heart; and

displaying said ultrasound image and said map, wherein said region is shown in a pseudocolor.

14. The method according to claim 13, wherein said functional model is selected from the group consisting of an anatomical map, a volumetric intraluminal ultrasound image, a Doppler image, and a regional wall motion image.

15. The method according to claim 13, wherein said ultrasound image is a two-dimensional ultrasound image, and said step of automatically marking a region comprises determining an intersection of a plane of said two-dimensional ultrasound image with said map.

16. The method according to claim 15, wherein said step of acquiring an ultrasound image comprises acquiring a plurality of two-dimensional ultrasound images of respective portions of said heart, the method further comprising the steps of:

reconstructing a three-dimensional anatomic image of said heart from said two-dimensional ultrasound images;

iterating said step of automatically marking a region using respective ones of said two-dimensional ultrasound images to define a composite marked region; and

said step of displaying comprises displaying said three-dimensional anatomic image with said map, wherein said composite marked region is shown in said pseudocolor.

17. The method according to claim 13, said step of displaying comprises displaying said ultrasound image superimposed on said map.

18. An apparatus for imaging a heart in a body of a subject, comprising:

an imaging device for capturing an anatomic image of a portion of said heart;

a processor linked to said imaging device, said processor being linked to a probe adapted for insertion into said heart and having a position sensor for determining position and orientation information of said probe, said processor being operative for generating a functional map of said heart comprising functional information relating to said heart measured at multiple points on said heart, said processor being operative for automatically marking a region of said map that corresponds to of said portion of said heart; and

a display device linked to said processor for displaying said map and said anatomic image, wherein said region is displayed in a pseudocolor.

19. The apparatus according to claim 18, wherein said functional map is an electroanatomical map.

20. The apparatus according to claim 18, wherein said imaging device is operative for acquiring a plurality of two-dimensional anatomic images of respective portions of said heart.

21. The apparatus according to claim 20, wherein said processor is operative for:

reconstructing a three-dimensional anatomic image of said heart from said two-dimensional anatomic images;

iteratively automatically marking a region using respective ones of said two-dimensional anatomic images to define a composite marked region; and

said display device is operative for displaying said three-dimensional anatomic image with said map, wherein said composite marked region is shown in said pseudocolor.

22. A computer-assisted method for producing images of a living subject, comprising the steps of:

displaying a three-dimensional model of a surface of a structure in a body of said subject;

acquiring a sequence of three-dimensional anatomic images of respective portions of said structure, said three-dimensional anatomic images having respective image planes;

while acquiring said sequence, automatically registering said image planes with said three-dimensional model;

marking said three-dimensional model to show respective intersections of said three-dimensional anatomic images with said surface; and

wherein said three-dimensional anatomic images are acquired as realtime images by acquiring a plurality of two-dimensional ultrasound slices, computed tomographic slices, or realtime magnetic resonance slices, further comprising the steps of constructing said three-dimensional anatomic images from said realtime images for use in said step of displaying.

23. The method according to claim 22, wherein said sequence is acquired using an ultrasound probe.