Simulated Fluoroscopy Images with 3D Context

• US 20180310907A1
• Filed: 05/01/2017
• Published: 11/01/2018
• Est. Priority Date: 05/01/2017
• Status: Abandoned Application

• Current Assignee: EchoPixel, Inc.
• Original Assignee: EchoPixel, Inc.
• Inventors: Zhang, Yu, Chen, Anthony, Aguirre-Valencia, Sergio
• Application Number:
  US15/583,035
• Publication Number:
  US 20180310907A1
• Time in Patent Office: Days
• CPC Class Codes: A61B 6/466 adapted to display 3D data
• CPC Class Codes: A61B 6/467 characterised by special input means
• CPC Class Codes: A61B 6/5223 generating planar views from image data, e.g. extracting a coronal view from a 3D image
• CPC Class Codes: G06F 3/00 Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06T 11/00 2D [Two Dimensional] image generation
• CPC Class Codes: G06T 11/008 Specific post-processing after tomographic reconstruction, e.g. voxelisation, metal artifact correction
• CPC Class Codes: G06T 2200/24 involving graphical user interfaces [GUIs]
• CPC Class Codes: G06T 2211/428 Real-time
• CPC Class Codes: H04N 13/106 Processing image signals for multi-view video sequence encoding H04N19/597
• CPC Class Codes: H04N 13/156 Mixing image signals
• CPC Class Codes: H04N 13/279 the virtual viewpoint locations being selected by the viewers or determined by tracking
• CPC Class Codes: H04N 13/332 Displays for viewing with the aid of special glasses or head-mounted displays [HMD]
• CPC Class Codes: H04N 13/383 for tracking with gaze detection, i.e. detecting the lines of sight of the viewer's eyes
• CPC Class Codes: H04N 2213/006 Pseudo-stereoscopic systems, i.e. systems wherein a stereoscopic effect is obtained without sending different images to the viewer's eyes

Abstract

A computer system that provides a simulated 2D fluoroscopy image is described. During operation, the computer system may generate the simulated 2D fluoroscopy image based on data in a predetermined 3D image associated with an individual'"'"'s body. For example, generating the simulated 2D fluoroscopy image may involve a forward projection. Moreover, the forward projection may involve calculating accumulated absorption corresponding to density along X-ray lines through pixels in the predetermined 3D image. Then, the computer system may provide the simulated 2D fluoroscopy image with a 3D context associated with a predefined cut plane in the individual'"'"'s body. Note that the providing may involve displaying, on a display, the simulated 2D fluoroscopy image with the 3D context.

Claims

1. A method for providing a simulated two-dimensional (2D) fluoroscopy image, comprising:

by a computer system;

generating the simulated 2D fluoroscopy image based at least in part on data in a predetermined three-dimensional (3D) image associated with an individual'"'"'s body, and relative positions of a fluoroscopy source in a C-arm measurement system, a detector in the C-arm measurement system and a predefined cut plane in the individual'"'"'s body; and

providing the simulated 2D fluoroscopy image with a 3D context associated with the predefined cut plane, wherein the 3D context comprises a stereoscopic image with image parallax of at least a portion of the individual'"'"'s body based at least in part on the 3D model of the individual'"'"'s body.

2. The method of claim 1, wherein generating the simulated 2D fluoroscopy image involves a forward projection.

3. The method of claim 1, wherein generating the simulated 2D fluoroscopy image involves calculating accumulated absorption corresponding to density along lines, corresponding to X-ray trajectories, through pixels in the predetermined 3D image.

4. The method of claim 1, wherein the 3D context comprises a slice, based at least in part on a 3D model of the individual'"'"'s body, having a thickness through the individual'"'"'s body that comprises the predefined cut plane.

5. The method of claim 1, wherein the 3D context comprises at least partial views of anatomical structures located behind the predefined cut plane via at least partial transparency of stereoscopic image.

6. The method of claim 1, wherein the method further comprises providing, based at least in part on the 3D model, a second stereoscopic image with image parallax adjacent to the simulated 2D fluoroscopy image with the 3D context;

and

wherein the second stereoscopic image comprises graphical representations of the relative positions of the fluoroscopy source in the C-arm measurement system, the detector in the C-arm measurement system and the predefined cut plane.

7. The method of claim 1, wherein the 3D context and the simulated 2D fluoroscopy image are superimposed.

8. The method of claim 1, wherein the method further comprises:

receiving a user-interface command associated with user-interface activity; and

providing the simulated 2D fluoroscopy image without the 3D context based at least in part on the user-interface command.

9. The method of claim 1, wherein the providing involves displaying the simulated 2D fluoroscopy image with the 3D context.

10. The method of claim 1, wherein an orientation and a location of the predefined cut plane is specified based at least in part on a position of the fluoroscopy source and the detector in a C-arm measurement system.

11. A non-transitory computer-readable storage medium for use in conjunction with a computer system, the computer-readable storage medium storing program instructions that facilitate providing a simulated two-dimensional (2D) fluoroscopy image, wherein, when executed by the computer system, the program instructions cause the computer system to:

generate the simulated 2D fluoroscopy image based at least in part on data in a predetermined three-dimensional (3D) image associated with an individual'"'"'s body, and relative positions of a fluoroscopy source in a C-arm measurement system, a detector in the C-arm measurement system and a predefined cut plane in the individual'"'"'s body; and

provide the simulated 2D fluoroscopy image with a 3D context associated with the predefined cut plane, wherein the 3D context comprises a stereoscopic image with image parallax of at least a portion of the individual'"'"'s body based at least in part on the 3D model of the individual'"'"'s body.

12. A computer system, comprising:

a processor; and

memory, coupled to the processor, which stores program instructions, wherein, when executed by the processor, the program instructions cause the computer system to;

generate a simulated 2D fluoroscopy image based at least in part on data in a predetermined three-dimensional (3D) image associated with an individual'"'"'s body, and relative positions of a fluoroscopy source in a C-arm measurement system, a detector in the C-arm measurement system and a predefined cut plane in the individual'"'"'s body; and

provide the simulated 2D fluoroscopy image with a 3D context associated with the predefined cut plane, wherein the 3D context comprises a stereoscopic image with image parallax of at least a portion of the individual'"'"'s body based at least in part on the 3D model of the individual'"'"'s body.

13. The computer system of claim 12, wherein generating the simulated 2D fluoroscopy image involves a forward projection.

14. The computer system of claim 12, wherein generating the simulated 2D fluoroscopy image involves calculating accumulated absorption corresponding to density along lines, corresponding to X-ray trajectories, through pixels in the predetermined 3D image.

15. The computer system of claim 12, wherein the 3D context comprises a slice, based at least in part on a 3D model of the individual'"'"'s body, having a thickness through the individual'"'"'s body that comprises the predefined cut plane.

16. The computer system of claim 12, a wherein the 3D context comprises at least partial views of anatomical structures located behind the predefined cut plane via at least partial transparency of stereoscopic image.

17. The computer system of claim 12, a wherein, when executed by the processor, the program instructions cause the computer system to provide, based at least in part on the 3D model, a second stereoscopic image with image parallax adjacent to the simulated 2D fluoroscopy image with the 3D context;

and

wherein the second stereoscopic image comprises graphical representations of relative positions of the fluoroscopy source in the C-arm measurement system, the detector in the C-arm measurement system and the predefined cut plane.

18. The computer system of claim 12, wherein, when executed by the processor, the program instructions cause the computer system to:

receive a user-interface command associated with user-interface activity; and

provide the simulated 2D fluoroscopy image without the 3D context based at least in part on the user-interface command.

19. The computer system of claim 12, wherein computer system further comprises a display coupled to the processor;

and

wherein the providing involves displaying, on the display, the simulated 2D fluoroscopy image with the 3D context.

20. The computer system of claim 12, wherein computer system further comprises an interface circuit configured to communicate with a C-arm measurement system;

and

wherein an orientation and a location of the predefined cut plane is specified based at least in part on the position of the fluoroscopy source and the detector in the C-arm measurement system.