Method and apparatus for interactive 4-dimensional (4D) virtual endoscopy

• US 8,007,437 B2
• Filed: 10/19/2007
• Issued: 08/30/2011
• Est. Priority Date: 11/08/2006
• Status: Active Grant

• Current Assignee: Siemens Healthcare GMBH (Siemens AG)
• Original Assignee: Siemens AG
• Inventors: Lombaert, Herve Jun Alfred, Sun, Yiyong, Xu, Chenyang, Sauer, Frank
• Primary Examiner(s): Cheng; Jacqueline
• Application Number:
  US11/874,975
• Publication Number:
  US 20080270095A1
• Time in Patent Office: 1,411 Days
• Field of Search: 600/437, 600/428, 600/413
• US Class Current: 600/437
• CPC Class Codes: A61B 5/7289 Retrospective gating, i.e. associating measured signals or images with a physiological event after the actual measurement or image acquisition, e.g. by simultaneously recording an additional physiological signal during the measurement or image acquisition
• CPC Class Codes: A61B 6/503 for diagnosis of the heart
• CPC Class Codes: A61B 8/0883 for diagnosis of the heart
• CPC Class Codes: A61B 8/14 Echo-tomography
• CPC Class Codes: G06T 15/08 Volume rendering
• CPC Class Codes: G06T 2207/10076 4D tomography; Time-sequential 3D tomography
• CPC Class Codes: G06T 2207/10136 3D ultrasound image
• CPC Class Codes: G06T 2207/30048 Heart; Cardiac
• CPC Class Codes: G06T 7/0012 Biomedical image inspection

Abstract

A method of performing 4-dimensional virtual endoscopy includes acquiring a sequence of cardiac images of a patient'"'"'s heart from an imaging device; acquiring an electrocardiographic signal exhibiting cardiac cycles of the heart; and utilizing the electrocardiographic signal to gate the images for deriving respective 3-dimensional views in succession at corresponding cardiac cycles, from respective cardiac images at a selected phase point common to each of the corresponding cardiac cycles.

Claims

1. A method of performing 4-dimensional (4D) virtual endoscopy, comprising:

acquiring a sequence of cardiac images of a patient'"'"'s heart from an imaging device;

acquiring an electrocardiographic signal exhibiting cardiac cycles of said heart;

utilizing said electrocardiographic signal to gate said images for deriving respective 3-dimensional (3D) views in succession at corresponding cardiac cycles, from respective cardiac images at a selected phase point common to each of said corresponding cardiac cycles so as to provide a 3 dimensional visualization of said patient'"'"'s heart as a function of time for said 4D virtual endoscopy;

utilizing a virtual camera; and

virtually attaching said virtual camera to a point selected on a wall or surface in said sequence of cardiac images of said patient'"'"'s heart, such that said virtual camera moves together with said point and will appear static in said respective 3D views in succession so as to provide said 3-dimensional visualization of said patient'"'"'s heart as a function of time for said 4D virtual endoscopy, so as to produce a substantially steady image of said heart.

2. A method in accordance with claim 1, wherein said step for deriving respective 3D views includes placing said cardiac images in a 3D space and reconstructing a volume.

3. A method in accordance with claim 1, wherein said step of acquiring an electrocardiographic signal includes a step of detecting said cardiac cycles and a step of interactively selecting said phase point.

4. A method in accordance with claim 1, wherein said step for deriving respective 3D views utilizes one of (a) a ray casting algorithm and (b) a mesh extraction algorithm.

5. A method in accordance with claim 1, wherein said step for deriving respective 3D views in succession includes amending a 3D view so as to produce the next 3D view in said succession.

6. A method in accordance with claim 1, wherein said step for deriving respective 3D views includes a step of sensing breathing of said patient and excluding ones of said images affected by said breathing.

7. A method in accordance with claim 1, wherein said step for deriving respective 3D views includes a step of sensing breathing and respiratory cycles of said patient and excluding images not in the same phase of a respiratory cycle.

8. A method in accordance with claim 1, wherein said step for deriving respective 3D views includes a step of sensing sudden catheter movements in said patient and excluding ones of said images affected by said sudden catheter movements.

9. A method of performing 4-dimensional (4D) virtual endoscopy, comprising:

acquiring a motion signal of a patient'"'"'s organ exhibiting motion cycles of said organ;

acquiring a sequence of 3-dimensional (3D) images of said organ from an imaging device;

utilizing said motion signal to gate said images for deriving respective 3D views in succession at corresponding motion cycles, from respective organ images at a selected phase point common to each of said corresponding motion cycles so as to provide a 3 dimensional visualization of said patient'"'"'s organ as a function of time for said 4D virtual endoscopy;

utilizing a virtual camera; and

virtually attaching said virtual camera to a point selected on a wall or surface in said sequence of organ images of said patient'"'"'s organ, such that said virtual camera moves together with said point and will appear static in said respective 3D views in succession so as to provide said 3-dimensional visualization of said patient'"'"'s organ as a function of time for said 4D virtual endoscopy, so as to produce a substantially steady image of said organ.

10. A method in accordance with claim 9, wherein said step of acquiring a sequence of 3D images includes one of:

(a) utilizing a real-time 3D ultrasound imaging device with multiple transducer arrays, and

(b) utilizing a tracked ultrasound imaging device collecting data over space.

11. A method in accordance with claim 9, wherein said step of acquiring a motion signal includes a step of detecting said motion cycles and a step of interactively selecting said phase point.

12. A method in accordance with claim 9, wherein said step of deriving respective 3D views includes amending a 3D view so as to produce the next 3D view in said succession.

13. A method in accordance with claim 9, wherein said step of deriving respective 3D views includes a step of sensing breathing of said patient and excluding ones of said images affected by said breathing.

14. A method in accordance with claim 9, wherein said step of deriving respective 3D views includes a step of sensing sudden catheter movements in said patient and excluding ones of said images affected by said sudden catheter movements.

15. A system for performing 4-dimensional (4D) virtual endoscopy, comprising:

a non-transitory memory device for storing a program and other data; and

a processor in communication with said memory device, said processor operative with said program to perform;

acquiring a sequence of cardiac images of a patient'"'"'s heart from an imaging device;

acquiring an electrocardiographic signal exhibiting cardiac cycles of said heart;

utilizing said electrocardiographic signal to gate said images for deriving respective 3-dimensional (3D) views in succession at corresponding cardiac cycles, from respective cardiac images at a selected phase point common to each of said corresponding cardiac cycles so as to provide a 3 dimensional visualization of said patient'"'"'s heart as a function of time for said 4D virtual endoscopy;

utilizing a virtual camera; and

virtually attaching said virtual camera to a point selected on a wall or surface in said sequence of cardiac images of said patient'"'"'s heart, such that said virtual camera moves together with said point and will appear static in said respective 3D views in succession so as to provide said 3-dimensional visualization of said patient'"'"'s heart as a function of time for said 4D virtual endoscopy, so as to produce a substantially steady image of said heart.

16. A system in accordance with claim 15, wherein said step for deriving respective 3D views includes placing said cardiac images in a 3D space and reconstructing a volume.

17. A system in accordance with claim 15, wherein said step of acquiring an electrocardiographic signal includes a step of detecting said cardiac cycles and a step of interactively selecting said phase point.

18. A system in accordance with claim 15, wherein said step for deriving respective 3D views utilizes one of (a) a ray casting algorithm and (b) a mesh extraction algorithm.

19. A system in accordance with claim 15, wherein said step for deriving respective 3D views includes amending a 3D view so as to produce the next 3D view in said succession.

20. A system for performing 4-dimensional (4D) virtual endoscopy, comprising:

means for acquiring a motion signal of a patient'"'"'s organ exhibiting motion cycles of said organ;

means for acquiring a sequence of 3-dimensional (3D) images of said organ from an imaging device; and

a processor configured for;

utilizing said motion signal to gate said images for deriving respective 3D views in succession at corresponding motion cycles, from respective organ images at a selected phase point common to each of said corresponding motion cycles so as to provide a 3 dimensional visualization of said patient'"'"'s organ as a function of time for said 4D virtual endoscopy;

utilizing a virtual camera; and

virtually attaching said virtual camera to a point selected on a wall or surface in said sequence of organ images of said patient'"'"'s organ, such that said virtual camera moves together with said point and will appear static in said respective 3D views in succession so as to provide said 3-dimensional visualization of said patient'"'"'s organ as a function of time for said 4D virtual endoscopy, so as to produce a substantially steady image of said organ.

21. A computer program product comprising a computer useable non-transitory medium having executable computer program logic recorded thereon for program code for performing 4-dimensional (4D) virtual endoscopy, comprising:

acquiring a sequence of cardiac images of a patient'"'"'s heart from an imaging device;

acquiring an electrocardiographic signal exhibiting cardiac cycles of said heart;

utilizing said electrocardiographic signal to gate said images for deriving respective 3-dimensional (3D) views in succession at corresponding cardiac cycles, from respective cardiac images at a selected phase point common to each of said corresponding cardiac cycles so as to provide a 3 dimensional visualization of said patient'"'"'s heart as a function of time for said 4D virtual endoscopy;

utilizing a virtual camera; and

virtually attaching said virtual camera to a point selected on a wall or surface in said sequence of cardiac images of said patient'"'"'s heart, such that said virtual camera moves together with said point and will appear static in said respective 3D views in succession so as to provide said 3-dimensional visualization of said patient'"'"'s heart as a function of time for said 4D virtual endoscopy, so as to produce a substantially steady image of said heart.

22. A computer program product in accordance with claim 21, wherein said step of acquiring an electrocardiographic signal includes a step of detecting said cardiac cycles and a step of interactively selecting said phase point;

and wherein said step for deriving a series of respective 3D views includes amending a 3D view so as to produce the next 3D view in said succession.