System and method for image registration

• US 8,675,945 B2
• Filed: 03/27/2012
• Issued: 03/18/2014
• Est. Priority Date: 03/29/2011
• Status: Active Grant

• Current Assignee: Boston Scientific Neuromodulation Corporation (Boston Scientific Corporation)
• Original Assignee: Boston Scientific Neuromodulation Corporation (Boston Scientific Corporation)
• Inventors: Barnhorst, Jordan, Carlton, Keith, Kokones, Scott, Sparks, Troy, Zeng, Zhen, Shinn, Aaron Omar
• Primary Examiner(s): Tabatabai, Abolfazl
• Application Number:
  US13/431,221
• Publication Number:
  US 20120314923A1
• Time in Patent Office: 721 Days
• Field of Search: 382/128, 382/129, 382/130, 382/131, 382/132, 382/133, 382/134, 382/151, 382/294, 378/4, 378/8, 378/28, 378/901, 600/407, 600/425, 600/554, 600/558, 600/559, 601/12, 607/2, 607/12, 607/15, 607/26, 607/39, 607/40, 607/58, 607/59, 607/62, 607/118, 607/123, 128/920, 128/922
• US Class Current: 382/131
• CPC Class Codes: A61B 34/25 User interfaces for surgical systems
• CPC Class Codes: A61N 1/36128 Control systems
• CPC Class Codes: A61N 1/37247 User interfaces, e.g. input or presentation means
• CPC Class Codes: F04C 2270/041 Controlled or regulated
• CPC Class Codes: G06F 18/22 Matching criteria, e.g. proximity measures
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06T 11/003 Reconstruction from projections, e.g. tomography
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text
• CPC Class Codes: G06T 15/005 General purpose rendering architectures
• CPC Class Codes: G06T 15/08 Volume rendering
• CPC Class Codes: G06T 19/00 Manipulating 3D models or images for computer graphics
• CPC Class Codes: G06T 19/003 Navigation within 3D models or images
• CPC Class Codes: G06T 2200/04 involving 3D image data
• CPC Class Codes: G06T 2200/24 involving graphical user interfaces [GUIs]
• CPC Class Codes: G06T 2207/10064 Fluorescence image
• CPC Class Codes: G06T 2207/10072 Tomographic images
• CPC Class Codes: G06T 2207/10081 Computed x-ray tomography [CT]
• CPC Class Codes: G06T 2207/10088 Magnetic resonance imaging [MRI]
• CPC Class Codes: G06T 2207/10092 Diffusion tensor magnetic resonance imaging [DTI]
• CPC Class Codes: G06T 2207/30016 : Brain
• CPC Class Codes: G06T 2219/028 : Multiple view windows (top-side-front-sagittal-orthogonal)
• CPC Class Codes: G06T 3/40 : Scaling of whole images or parts thereof, e.g. expanding or contracting
• CPC Class Codes: G06T 3/4038 : Image mosaicing, e.g. composing plane images from plane sub-images
• CPC Class Codes: G06T 7/0012 : Biomedical image inspection
• CPC Class Codes: G06T 7/30 : Determination of transform parameters for the alignment of images, i.e. image registration
• CPC Class Codes: G06T 7/33 : using feature-based methods
• CPC Class Codes: G06T 7/38 : Registration of image sequences
• CPC Class Codes: G16H 20/40 : relating to mechanical, radiation or invasive therapies, e.g. surgery, laser therapy, dialysis or acupuncture
• CPC Class Codes: G16H 30/20 : for handling medical images, e.g. DICOM, HL7 or PACS
• CPC Class Codes: G16H 30/40 : for processing medical images, e.g. editing

Abstract

A system and method for providing processable data associated with anatomical images may provide a user interface including a pivot and stem tool via which to align multiple images, a flashlight bar for viewing portions of an overlaid image, and/or user-movable markers for establishing a location of one or more anatomical landmarks with regions of one or more images.

Claims

1. A system for providing image alignment data, the system comprising:

a computer processor configured to;

display a first image, a first position of the image relative to an object being recorded;

display an image positioning control including;

a first edge positioned at a first location of the image, a second edge, and a shaft extending between the first and second edges, the second edge being user-shiftable; and

responsive to user input to shift the second edge from a second location to a third location;

display the image in a second position relative to the object, the second position being offset from the first position; and

update the recorded position of the image to reflect the second relative position in a memory where the recorded position is accessible for generating, based on the recorded position, a model of an anatomical region.

2. The system of claim 1, wherein at least one of the first and second edges is shiftable via a drag and drop action.

3. The system of claim 1, wherein:

the second and third locations are angularly offset from each other about the first location; and

the second position is rotationally offset from the first position about the first location.

4. The system of claim 3, wherein, responsive to user input to select and shift the first edge, the image is shifted relative to the object, such that the shifted first edge is at the first location of the shifted image.

5. The system of claim 3, wherein, responsive to a user input to drag the second edge, the shaft is one of lengthened and shortened, the shaft length determining an extent of a linear positional offset of the second edge that is required for a corresponding rotation of the image by a particular angular offset.

6. The system of claim 3, wherein the image is an image of an anatomical region obtained via a first imaging modality and the object is an image of the anatomical region obtained via a second imaging modality.

7. The system of claim 6, wherein the first imaging modality is magnetic resonance (MR) and the second imaging modality is computed tomography (CT).

8. The system of claim 1, wherein the anatomical region is of a brain and the object is a representation of a mid-sagittal plane.

9. The system of claim 1, wherein:

the first image (a) is displayed in a first two-dimensional view of a three-dimensional object, and (b) is of a first two-dimensional plane of the three-dimensional object;

the processor is configured to display, in a second two-dimensional view of the three-dimensional object, a second image of a second two-dimensional plane of the three-dimensional object;

the second and third locations are angularly offset from each other about the first location;

the second position is rotationally offset from the first position about the first location; and

responsive to the user input to shift the second edge from the second location to the third location, the processor is further configured to at least one of;

modify the second two-dimensional view; and

(i) remove the second image from the second two-dimensional view, and (ii) display in the second two-dimensional view a third image that is of a third two-dimensional plane of the three-dimensional object, the second and third two-dimensional planes being orthogonal to the first two-dimensional plane along a predetermined axis of the first two-dimensional view.

10. The system of claim 9, wherein the second two-dimensional view is orthogonal to the first two-dimensional view.

11. A computer-implemented method for providing a user interface for at least one of showing and setting relative positions of objects, the method comprising:

displaying, by a computer processor, a flashlight object in a display area;

displaying, by the processor, a first portion of a first object in a first region of the display area that extends in a predefined manner from the flashlight object; and

displaying, by the processor, a first portion of a second object in one or more second regions of the display area that do not extend in the predefined manner from the flashlight object;

wherein the flashlight object is user-shiftable to shift the first region, thereby responsively;

bringing into view a second portion of the first object;

removing from view at least a part of the first portion of the first object;

bringing into view a second portion of the second object; and

removing from view at least a part of the first portion of the second object.

12. The method of claim 11, wherein at least one of:

(a) positions of the first and second objects relative to each other, and (b) the portion of one of the first and second object being displayed in the display area are modifiable in response to a same user interaction within the display area, the modifiability of the relative positions being at least one of rotational and translational; and

the first and second objects are different images of a same anatomical region.

13. The method of claim 11, wherein:

a size of the flashlight object is user-modifiable; and

at least one of;

the size modification correspondingly modifies a size of the first region, an amount of the first object that is displayed in the display area, and an amount of the second object that is displayed in the display area; and

graphical protrusions extending from opposite edges of the flashlight object are user-shiftable towards a center of the flashlight object and away from the center of the flashlight object, for, respectively, decreasing the size of the flashlight object and increasing the size of the flashlight object.

14. A non-transitory computer-readable medium having stored thereon instructions executable by a processor, the instructions which, when executed by the processor, cause the processor to perform a method for associating a region with a predefined landmark, the method comprising:

displaying a first two-dimensional plane of a three-dimensional object;

displaying a second two-dimensional plane of the three-dimensional object;

displaying a first user-selectable and shiftable marker associated by the processor with a landmark; and

responsive to a user-shift of the first marker to a region of the first two-dimensional plane;

displaying a second marker associated with the landmark in a region of the second two-dimensional plane that corresponds to the region of the first two-dimensional plane; and

recording an association of the landmark with each of the regions.

15. The computer-readable medium of claim 14, wherein:

the second two-dimensional plane is substantially orthogonal to the first two-dimensional plane; and

the region of the second two-dimensional plane provides a substantially orthogonal view of the region of the first two-dimensional plane.

16. The computer-readable medium of claim 15, wherein:

the orthogonality of the second two-dimensional plane to the first two-dimensional plane is along a line extending between predefined points of a first display area in which the first two dimensional plane is displayed;

the first two-dimensional plane is user-rotatable within the first display area and relative to the line, thereby modifying where along the first two-dimensional plane the line extends; and

the method further comprises, responsive to a rotation of the first two-dimensional plane within the first display area, modifying a second display area in which the second two-dimensional plane was displayed to display a different two-dimensional plane orthogonal to the rotated first two-dimensional plane along the line.

17. The computer-readable medium of claim 15, wherein at least one of:

the three-dimensional object is one of;

anatomical, the first and second two-dimensional planes being two-dimensional images of the anatomical object; and

a region targeted for a stimulation and of which the first and second two-dimensional planes are two-dimensional representations; and

the landmark is an anterior commissure, and the method further comprises displaying a third marker, the third marker being user-selectable and shiftable and associated by the processor with a posterior commissure.

18. The computer-readable medium of claim 15, wherein the method further comprises, responsive to a subsequent user-shift of the first marker to a second region of the first two-dimensional plane that does not have a corresponding region in the second two-dimensional plane occurs, removing the second marker from display.

19. The computer-readable medium of claim 15, wherein at least one of:

in a first display area in which the first two-dimensional plane is displayed, two-dimensional planes of the three-dimensional object are scrollable between the first two-dimensional plane and other two-dimensional planes that are parallel to the first two-dimensional plane, in response to which scrolling the processor adjusts the brightness of the first marker so that it gradually fades as a distance between the scrolled-to two-dimensional plane in the first display area and the first two-dimensional plane increases; and

(a) the method further comprises, responsive to a user-input zoom instruction, magnifying at least a portion of the first two-dimensional plane that is within the first marker, and (b) at least one of;

the at least the portion of the first two-dimensional plane that is magnified is displayed within a demarcated magnification window, the magnification window having protruding therefrom a first user-selectable control, in response to selection of which magnification is increased, and the magnification window having protruding therefrom a second user-selectable control, in response to selection of which magnification is decreased; and

responsive to a scrolling instruction for scrolling from the first two-dimensional plane to another two-dimensional plane that is parallel to the first two-dimensional plane, the scrolling instruction received while the at least the portion of the first two-dimensional plane is magnified, the processor, executing the instructions, at least one of (a) modifies the recorded association of the landmark to be with a region in the scrolled-to two-dimensional plane and not with the region of the first two-dimensional plane, and (b) automatically shifts the second marker to another region of the second two-dimensional plane.