Visualizing a 3D volume dataset of an image at any position or orientation from within or outside

• US 8,244,018 B2
• Filed: 01/18/2012
• Issued: 08/14/2012
• Est. Priority Date: 11/27/2010
• Status: Active Grant

• Current Assignee: AuthenTec Incorporated (Apple Inc.)
• Original Assignee: Intrinsic Imaging LLC (WCG Clinical, Inc.)
• Inventors: McKenzie, Lee R., McKenzie, Mark C.
• Primary Examiner(s): STREGE, JOHN B
• Application Number:
  US13/352,502
• Publication Number:
  US 20120133656A1
• Time in Patent Office: 209 Days
• Field of Search: 382/131, 382/154, 348/77
• US Class Current: 382/131
• CPC Class Codes: G06T 15/06 Ray-tracing
• CPC Class Codes: G06T 15/08 Volume rendering
• CPC Class Codes: G06T 19/20 Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts

Abstract

A machine-implemented display method that, with respect to a volume dataset being rendered, enables a user to navigate to any position in space and look in any direction. Preferably, the volume dataset is derived from a computer tomography (CT) or magnetic resonance imaging (MRI) scan. With the described approach, the user can see details within the dataset that are not available using conventional visualization approaches. The freedom-of-motion capability allows the user to go to places (positions) within the volume rendering that are not otherwise possible using conventional “orbit” and “zoom” display techniques. Thus, for example, using the described approach, the display image enables a user to travel inside physical structures (e.g., a patient'"'"'s heart, brain, arteries, and the like).

Claims

1. An article comprising a tangible, non-transitory machine-readable medium that stores a program, the program being executed by a machine having a hardware component to perform a method, the method comprising:

receiving a volume dataset defining a volume; and

rendering, with respect to any position and orientation in the volume, an image of the volume dataset at a given number of frames per second, each frame of the image having a uniform distribution of pixels, at least two frames of an image sequence having varying resolution with respect to one another, and at least two pixels within a particular frame each being associated with a ray having a varying number of ray tracing steps with respect to one another, each ray, as it traverses the volume dataset during rendering, samples the volume dataset along a set of sampling points whose locations along the ray are determined as the ray is cast, wherein, for each pair of sampling points, a location of at least a next sample point along the ray is determined by a value of a voxel at a current sample point, together with a focus value, such that a distance between two sample locations varies dynamically and in a non-uniform manner.

2. The article as described in claim 1 wherein the volume dataset is received from a medical imaging scan.

3. The article as described in claim 1 wherein the image is rendered from a perspective that is external to the volume dataset.

4. The article as described in claim 1 wherein the image is rendered from a perspective that is internal to the volume dataset.

5. The article as described in claim 1 wherein the distance is defined as a size of a step between a pair of samples along the ray associated with the pixel, wherein the size of the step is a function of a value in the volume dataset at each sample point.

20. The article as described in claim 1 wherein the distance equals an absolute value of a difference between a currently sampled value and the focus value, multiplied by a value to ensure smoothness.

6. Apparatus, comprising:

a display;

a processor; and

computer memory holding computer program instructions that, when executed by or in association with the processor, render a 3D image on the display at a frame rate with two frames of an image sequence having varying resolution with respect to one another, and at least two pixels within a particular frame each being associated with a ray having a varying number of ray tracing steps with respect to one another, each ray, as it traverses the volume dataset during rendering, samples the volume dataset along a set of sampling points whose locations along the ray are determined as the ray is cast, wherein, for each pair of sampling points, a location of at least a next sample point along the ray is determined by a value of a voxel at a current sample point, together with a focus value, such that a distance between two sample locations varies dynamically and in a non-uniform manner.

7. The apparatus as described in claim 6 wherein the image is rendered from a perspective that is external to the 3D image.

8. The apparatus as described in claim 6 wherein the set of images are rendered from a perspective that is internal to the 3D image.

9. The apparatus as described in claim 6 wherein the processor is one of:

a CPU, and a GPU.

10. The apparatus as described in claim 6 wherein the 3D image is one of:

a CT scan, and an MRI scan.

11. The apparatus as described in claim 6 further including an input device.

12. The apparatus as described in claim 11 wherein data is received from the input device to simulate a user of the input device being positioned at any position in space, and to view in any direction, and with full freedom of motion, with respect to the 3D image.

18. The apparatus as described in claim 6 wherein the distance is defined as a size of a step between a pair of samples along the ray associated with the pixel, wherein the size of the step is a function of a value in the volume dataset at each sample point.

21. The apparatus as described in claim 6 wherein the distance equals an absolute value of a difference between a currently sampled value and the focus value, multiplied by a value to ensure smoothness.

13. A display method, comprising:

receiving a volume dataset defining a volume; and

rendering, using a hardware processor, and with respect to any position and orientation in the volume, an image of the volume dataset from a perspective of a virtual camera, at least two frames of an image sequence having varying resolution with respect to one another, and at least two pixels within a particular frame each being associated with a ray having a varying number of ray tracing steps with respect to one another, each ray, as it traverses the volume dataset during rendering, samples the volume dataset along a set of sampling points whose locations along the ray are determined as the ray is cast, wherein, for each pair of sampling points, a location of at least a next sample point along the ray is determined by a value of a voxel at a current sample point, together with a focus value, such that a distance between two sample locations varies dynamically and in a non-uniform manner.

14. The display method as described in claim 13 wherein the image is rendered from a perspective of the virtual camera that is external to the volume dataset.

15. The display method as described in claim 13 wherein the image is rendered from a perspective of the virtual camera that is internal to the volume dataset.

16. The display method as described in claim 15 wherein an orientation of the virtual camera is adjusted from within a position internal to the volume dataset.

17. The display method as described in claim 13 wherein the volume dataset is received from a medical imaging scan.

19. The display method as described in claim 13 wherein the distance is defined as a size of a step between a pair of samples along the ray associated with the pixel, wherein the size of the step is a function of a value in the volume dataset at each sample point.

22. The display method as described in claim 13 wherein the distance equals an absolute value of a difference between a currently sampled value and the focus value, multiplied by a value to ensure smoothness.