Method and system for indicating light direction for a volume-rendered image

• US 9,818,220 B2
• Filed: 12/28/2011
• Issued: 11/14/2017
• Est. Priority Date: 12/28/2011
• Status: Active Grant

• Current Assignee: General Electric Company
• Original Assignee: General Electric Company
• Inventors: Schroecker, Gerald
• Primary Examiner(s): CHEN, FRANK S
• Application Number:
  US13/338,888
• Publication Number:
  US 20130169641A1
• Time in Patent Office: 2,148 Days
• CPC Class Codes: G06T 15/08 Volume rendering
• CPC Class Codes: G06T 15/80 Shading
• CPC Class Codes: G06T 2210/41 Medical

Abstract

A method and system for volume-rendering. The method and system include generating a volume-rendered image that is shaded from a light direction, displaying the volume-rendered image, displaying a model of a solid at the same time as the volume-rendered image, and displaying a light direction indicator with respect to the model of the solid, wherein the position of the light direction indicator corresponds to the light direction used for shading the volume-rendered image.

Claims

1. A method of volume-rendering 3D medical imaging data comprising:

generating a volume-rendered image from a 3D dataset acquired with a medical imaging device, wherein the volume-rendered image is shaded from a light direction;

displaying the volume-rendered image;

displaying a model of a solid at the same time as the volume-rendered image; and

displaying a light direction indicator with respect to the model of the solid, wherein the position of the light direction indicator with respect to the model of the solid corresponds to the light direction used for shading the volume-rendered image.

2. The method of claim 1, wherein the model of the solid and the volume-rendered image are both displayed on the same display device and wherein displaying the model of the solid at the same time as the volume-rendered image includes displaying the model of the solid and the volume-rendered image at different positions on the same display device.

3. The method of claim 2, wherein the model of the solid is positioned at a bottom right-hand region of the display device.

4. The method of claim 1, wherein the model of the solid and the volume-rendered image are displayed on separate display devices.

5. The method of claim 1, wherein the light direction indicator comprises a light source icon and wherein the light source icon comprises a representation of a polygonal model.

6. The method of claim 1, wherein a combination of the model of the solid and the light direction indicator form a light navigator, the light navigator displayed separate from the volume-rendered image.

7. The method of claim 1, wherein the light direction indicator comprises a light source icon and wherein the light source icon comprises an arrow with an arrow head to indicate the light direction.

8. The method of claim 1, wherein the light direction indicator comprises a highlight on the model of the solid.

9. The method of the claim 1, wherein the light direction indicator comprises both a light source icon and a highlight on the model of the solid.

10. The method of claim 1, further comprising displaying a scale volume-rendered image within the model of the solid at the same time as the volume-rendered image, wherein the scale volume-rendered image comprises a smaller representation of the volume-rendered image.

11. The method of claim 1, wherein the model of the solid comprises a model of a sphere, wherein the light direction indicator comprises a light source icon comprising an arrow with an arrow head to indicate the light direction, and wherein the arrow head is adjacent to an outer surface of the model of the sphere.

12. The method of claim 1, wherein the model of the solid is a different shape than the volume-rendered image.

13. The method of claim 1, further comprising shading the volume-rendered image based on a second light direction in addition to the light direction and further comprising displaying a second light direction indicator at the same time as the light direction indicator, wherein the position of the second light direction indicator with respect to the model of the solid corresponds to the second light direction.

14. The method of claim 1, wherein the 3D dataset includes voxel data where each voxel of the voxel data is assigned a value corresponding to an intensity, where each voxel is a volume-element.

15. The method of claim 14, wherein generating the volume-rendered image includes shading the volume-rendered image based on the light direction and light interaction through the 3D dataset.

16. The method of claim 15, wherein shading the volume-rendered image further includes calculating how light from the light direction would reflect, refract, and diffuse through an object represented in the volume-rendered image based on a color, opacity, and location of each voxel in the 3D dataset.

17. The method of claim 14, wherein generating the volume-rendered image includes summing intensities of each voxel along a single ray cast from a single pixel in a view plane to the 3D dataset to assign a value to the single pixel, the view plane including a plurality of pixels forming the volume-rendered image.

18. The method of claim 14, wherein the volume-rendered image is formed by a plurality of pixels on a view plane, wherein each voxel is assigned an opacity, and wherein generating the volume-rendered image includes:

casting a plurality of parallel rays from the view plane to the 3D dataset, each ray corresponding to a single pixel of the plurality of pixels;

for each voxel, multiplying the assigned intensity by the assigned opacity to generate an opacity-weighted value; and

accumulating the opacity-weighted values along each ray of the plurality of parallel rays to assign a value to each corresponding pixel.

19. The method of claim 1, wherein the model of the solid comprises a representation of a polygonal model and the volume-rendered image represents the 3D dataset, where the 3D dataset includes voxel data.

20. The method of claim 1, wherein the model of the solid is transparent or semi-transparent.

21. The method of claim 1, further comprising moving a position of the light direction indicator on the model of the solid to a new position based on user input received from a trackball, where rotational movement of the light direction indicator on the model of the solid mirrors rotational movement of the trackball.

22. The method of claim 21, further comprising updating the shading of the volume-rendered image based on the new position of the light direction indicator.

23. A method of volume-rendering 3D medical imaging data comprising:

displaying a volume-rendered image that is shaded from a first light direction, wherein the volume-rendered image is based on a 3D dataset acquired from a medical imaging device;

displaying a model of a solid at the same time as said displaying the volume-rendered image;

displaying a light source indicator at a first position with respect to the model of the solid, wherein the first position of the light source indicator corresponds to the first light direction used to shade the volume-rendered image;

moving with a user interface the light source indicator to a second position with respect to the model of the solid; and

automatically updating the shading on the volume-rendered image to correspond with the second position of the light source indicator with respect to the model of the solid.

24. The method of claim 23, further comprising displaying a scale volume-rendered image within the model of the solid, wherein the scale volume-rendered image comprises a smaller representation of the volume-rendered image.

25. The method of claim 23, wherein the model of the solid comprises a model of a sphere, wherein the light source indicator comprises a light source icon comprising an arrow with an arrow head to indicate the first light direction, and wherein the arrow head is adjacent to an outer surface of the model of the sphere.

27. The method of claim 23, wherein the 3D dataset acquired from the medical imaging device comprises voxel data including a plurality of voxels, each voxel having an assigned intensity.

28. The method of claim 23, wherein moving with a user interface the light source indicator to a second position with respect to the model of the solid includes adjusting the light source indicator to the second position on an outer surface of the model of the solid based on direct input from the user interface, where the user interface includes a trackball where rotational movement of the trackball results in rotational movement of the light source indicator on the outer surface of the model of the solid.

26. The method of 23, wherein the model of the solid comprises a representation of a polygonal model and is transparent or semi-transparent, wherein the model of the solid is a different shape than the volume-rendered image, and wherein displaying the model of the solid at the same time as displaying the volume-rendered image includes displaying the model of the solid at the same time as but separate from the volume-rendered image on a display device.

29. A system for interacting with a 3D dataset comprising:

a display device;

a memory;

a user input; and

a processor communicatively connected to the display device, the memory and the user input, wherein the processor is configured to;

access a 3D dataset from the memory, where the 3D dataset was acquired with a medical imaging device;

generate a volume-rendered image from the 3D dataset that is shaded from a light direction;

display the volume-rendered image on the display device;

display a model of a solid at the same time as the volume-rendered image; and

display a light source indicator at a position with respect to the model of the solid to indicate the light direction used for shading the volume-rendered image.

30. The system of claim 29, wherein the user input comprises a trackball or a touch screen and the processor is configured to directly move the light source indicator using a virtual trackball, wherein when the user input is a trackball, movements of the trackball are directly mapped to the virtual trackball, and wherein the processor is further configured to display the model of the solid on the display device at the same time as the volume-rendered image but at a different position on the display device than the volume-rendered image.

31. The system of claim 29, wherein the 3D dataset includes voxel data where each volume-element of the voxel data is assigned an intensity value and wherein the volume-rendered image is generated by summing the intensity values of each voxel along a ray cast from a view plane containing a plurality of pixels to the 3D dataset for each pixel.

32. The method of claim 29, wherein the processor is further configured to display a scale volume-rendered image within the model of the solid and wherein the processor is further configured to shade both the scale volume-rendered image and the model of the solid based on the light direction.

33. The system of claim 29, wherein the model of the solid is generated from a polygonal model and is transparent or semi-transparent with a convex outer surface and wherein the processor is further configured to update the shading of the volume-rendered image to correspond with the position of the light source indicator with respect to the model of the solid as the light source indicator is moved.