Treatment planning in a virtual environment

• US 8,819,591 B2
• Filed: 04/15/2010
• Issued: 08/26/2014
• Est. Priority Date: 10/30/2009
• Status: Active Grant

• Current Assignee: Accuray Incorporated
• Original Assignee: Accuray Incorporated
• Inventors: Wang, Bai, Zhang, Kun, Cheng, Xiangyong, Chang, I-Ning, Hill, Robert W., Sims, Colin, Wang, Hongwu
• Primary Examiner(s): Kim, Matt
• Assistant Examiner(s): IPAKCHI, MARYAM M
• Application Number:
  US12/799,072
• Publication Number:
  US 20110107270A1
• Time in Patent Office: 1,594 Days
• Field of Search: 715/848, 715/849, 715/852
• US Class Current: 715/850
• CPC Class Codes: A61N 5/103 Treatment planning systems
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G16H 20/40 relating to mechanical, radiation or invasive therapies, e.g. surgery, laser therapy, dialysis or acupuncture
• CPC Class Codes: G16H 30/40 for processing medical images, e.g. editing
• CPC Class Codes: G16H 50/50 for simulation or modelling of medical disorders

Abstract

A method and apparatus for treatment planning are described. A treatment planning system provides a computer-simulated virtual environment including a virtual artifact that is a three-dimensional simulation of a patient anatomy, wherein the three-dimensional simulation is generated from one or more diagnostic images taken of the patient anatomy. The treatment planning system performs a treatment planning operation associated with the virtual artifact in response to a user interaction with the virtual environment.

Claims

1. A method of treatment planning, comprising:

providing, by a treatment planning system, a three-dimensional computer-simulated virtual environment including a virtual artifact that is a three-dimensional simulation of a patient anatomy, wherein the three-dimensional simulation is generated from one or more images taken of the patient anatomy; and

performing at least one treatment planning operation within the virtual environment, the at least one treatment planning operation comprising a contouring operation that comprises performing the following to create a three-dimensional volume of interest (VOI) contour;

delineating a single three-dimensional volume around a three-dimensional region of the virtual artifact within the three-dimensional computer-simulated virtual environment that corresponds to at least a portion of a VOI without performing delineation within a plurality of two-dimensional slices; and

generating the three-dimensional VOI contour in the three-dimensional computer-simulated virtual environment responsive to the single three-dimensional volume being delineated.

2. The method of claim 1, wherein the at least one treatment planning operation is associated with the virtual artifact and performed in response to a user interaction with the virtual environment, wherein the user interaction is based on an input received from an input device that receives input for three or more dimensions.

3. The method of claim 2, wherein the input device is a six-dimensional input device.

4. The method of claim 2, wherein the input device is one of a data glove, a six-dimensional mouse, or a tracking system.

5. The method of claim 1, further comprising:

displaying the virtual artifact via at least one of a stereoscopic display or a volumetric display.

6. The method of claim 1, wherein the at least one treatment planning operation further comprises a manual image fusion operation, the method further comprising:

receiving user input to adjust a position and orientation of a first virtual artifact along six degrees of freedom, wherein the first virtual artifact is a first three-dimensional simulation of the patient anatomy generated from a first diagnostic image;

adjusting the position and orientation of the first virtual artifact to cause the first virtual artifact to align with a second virtual artifact, wherein the second virtual artifact is a second three-dimensional simulation of the patient anatomy generated from a second diagnostic image; and

updating a display of the first virtual artifact and the second virtual artifact in the virtual environment as the first virtual artifact is aligned with the second virtual artifact.

7. The method of claim 6, further comprising:

dividing the first virtual artifact and the second virtual artifact by a cutting plane, wherein the first virtual artifact is displayed on a first side of the cutting plane and the second virtual artifact is displayed on a second side of the cutting plane.

8. The method of claim 7, further comprising:

modifying a position and orientation of the cutting plane based on user input.

9. The method of claim 1, further comprising:

displaying a first view of the virtual artifact on a first stereoscopic display; and

displaying an additional view of the virtual artifact on at least one of the first stereoscopic display, a second stereoscopic display or a volumetric display.

10. The method of claim 1, wherein the at least one treatment planning operation further comprises an automatic image fusion operation, the method further comprising:

receiving user input moving a first virtual artifact onto a second virtual artifact, wherein the first virtual artifact is a first three-dimensional simulation of the patient anatomy generated from a first diagnostic image and the second virtual artifact is a second three-dimensional simulation of the patient anatomy generated from a second diagnostic image; and

initiating the automatic image fusion operation using specified regions of the first virtual artifact and the second virtual artifact as seed locations for the automatic fusion operation, wherein the automatic image fusion operation aligns the first virtual artifact with the second virtual artifact.

11. The method of claim 1, further comprising:

receiving user input controlling a three-dimensional drawing tool in the three-dimensional computer-simulated virtual environment, wherein a location and shape of the three-dimensional drawing tool is represented by a cursor in the three-dimensional computer-simulated virtual environment, wherein the delineating of the volume around at least the portion of the region is based on the user input, and wherein the generating of the three-dimensional VOI contour is performed as the region is delineated.

12. The method of claim 1, further comprising:

automatically reshaping the VOI contour to conform to a three-dimensional shape of an overlapping anatomical structure based on image properties of the anatomical structure and image properties of surrounding tissue.

13. The method of claim 11, wherein the three-dimensional drawing tool is a volumetric drawing tool that draws and manipulates three-dimensional structures, the method further comprising:

as the cursor is moved against a surface of the VOI contour, modifying the VOI contour based on an interaction of the shape of the three-dimensional drawing tool with the VOI contour.

14. The method of claim 13, further comprising:

determining whether the cursor is located within the VOI contour or outside of the VOI contour;

when the cursor is located within the VOI contour, as the cursor is moved against the surface of the VOI contour, expanding the VOI contour based on the interaction of the shape of the three-dimensional drawing tool with the VOI contour; and

when the cursor is located outside the VOI contour, as the cursor is moved against the surface of the VOI contour, shrinking the VOI contour based on the interaction of the shape of the three-dimensional drawing tool with the VOI contour.

15. The method of claim 1, the contouring operation further comprising:

receiving user input controlling a three-dimensional drawing tool in the three-dimensional computer-simulated virtual environment, wherein a location of the three-dimensional drawing tool is represented by a cursor in the three-dimensional computer-simulated virtual environment;

delineating an additional volume around an additional region of the virtual artifact that corresponds to an additional portion of the volume of interest (VOI) based on the user input; and

interpolating a space between the region and the additional region to create the three-dimensional VOI contour in the three-dimensional computer-simulated virtual environment.

16. The method of claim 1, the contouring operation further comprising:

receiving a user selection of a type of anatomy to contour;

identifying a set of image properties that are characteristic of the selected type of anatomy;

receiving a user selection of a seed point within the three-dimensional computer-simulated virtual environment, wherein the seed point is located at the region of the virtual artifact that corresponds to the volume of interest (VOI) having the selected type of anatomy; and

automatically delineating the three-dimensional VOI contour for the VOI based on a comparison of image properties of the virtual artifact to the identified set of image properties.

17. The method of claim 1, further comprising:

computing an original treatment plan based on existing treatment planning constraints, including generating a dose level structure that includes a total radiation that will be delivered to the volume of interest (VOI) and to surrounding tissue;

illustrating the dose level structure in the three-dimensional computer-simulated virtual environment;

changing a shape of the dose level structure using a drawing tool;

performing at least one of generating new treatment planning constraints or modifying the existing treatment planning constraints without user input based on the changed shape of the dose level structure; and

re-computing the treatment plan using the original treatment plan and at least one of the new treatment planning constraints or the modified treatment planning constraints.

18. The method of claim 1, further comprising:

receiving a selection of a prescription dose level;

receiving user input controlling a three-dimensional drawing tool in the three-dimensional computer-simulated virtual environment, wherein a location and shape of the three-dimensional drawing tool is represented by a cursor in the three-dimensional computer-simulated virtual environment;

tracing the region of the three-dimensional simulation of the patient anatomy that corresponds to the volume of interest (VOI) based on the user input;

generating a three-dimensional dose level structure based on the traced region;

generating point constraints based on the dose level structure; and

computing a radiation treatment plan based on the point constraints.

19. The method of claim 1, further comprising:

computing an original treatment plan based on existing treatment planning constraints, including generating a dose level structure that includes a total radiation that will be delivered to the volume of interest (VOI) and to surrounding tissue;

receiving input from a six-dimensional input device; and

performing at least one of generating new treatment planning constraints or modifying existing treatment planning constraints based on the received input.

20. A non-transitory computer readable medium including instructions that, when executed by a processing device, cause the processing device to perform a method of treatment planning, comprising:

providing, by a treatment planning system, a three-dimensional computer-simulated virtual environment including a virtual artifact that is a three-dimensional simulation of a patient anatomy, wherein the three-dimensional simulation is generated from one or more images taken of the patient anatomy; and

performing a treatment planning operation within the virtual environment, the treatment planning operation comprising a contouring operation that comprises performing the following to create a three-dimensional volume of interest (VOI) contour;

delineating a single three-dimensional volume around a three-dimensional region of the virtual artifact within the three-dimensional computer-simulated virtual environment that corresponds to at least a portion of a VOI without performing delineation within a plurality of two-dimensional slices; and

generating the three-dimensional VOI contour in the three-dimensional computer-simulated virtual environment responsive to the single three-dimensional volume being delineated.

21. A treatment planning system, comprising:

an input device that receives user input; and

a computing device, connected with the input device, to provide a computer-simulated virtual environment including a virtual artifact that is a three-dimensional simulation of a patient anatomy, wherein the three-dimensional simulation is generated from one or more images taken of the patient anatomy;

wherein the computing device is to perform a treatment planning operation within the virtual environment based on the user input, the treatment planning operation comprising a contouring operation that comprises performing the following to create a three-dimensional volume of interest (VOI) contour;

delineating a single three-dimensional volume around a three-dimensional region of the virtual artifact within the three-dimensional computer-simulated virtual environment that corresponds to at least a portion of a VOI without performing delineation within a plurality of two-dimensional slices; and

generating the three-dimensional VOI contour in the three-dimensional computer-simulated virtual environment responsive to the single three-dimensional volume being delineated.

22. A treatment planning system, comprising:

means for providing, by the treatment planning system, a three-dimensional computer-simulated virtual environment including a virtual artifact that is a three-dimensional simulation of a patient anatomy, wherein the three-dimensional simulation is generated from one or more images taken of the patient anatomy; and

means for performing a treatment planning operation within the virtual environment, the treatment planning operation comprising a contouring operation that comprises performing the following to create a three-dimensional volume of interest (VOI) contour;

delineating a single three-dimensional volume around a three-dimensional region of the virtual artifact within the three-dimensional computer-simulated virtual environment that corresponds to at least a portion of a VOI without performing delineation of a plurality of two-dimensional slices; and

generating the three-dimensional VOI contour in the three-dimensional computer-simulated virtual environment responsive to the single three-dimensional volume being delineated.

23. A method comprising:

performing one of generating or loading a treatment plan by a treatment planning system, the treatment plan including a three dimensional rendering of a patient anatomy, wherein the three dimensional rendering is generated from one or more images of the patient anatomy;

receiving input identifying a volume of interest (VOI) contour, wherein the VOI contour is associated with a portion of the patient anatomy and has a shape that conforms to the portion of the patient anatomy;

defining the VOI contour as a perimeter for a three dimensional view window; and

displaying a portion of the three dimensional simulation of the patient anatomy that is within the perimeter of the three dimensional view window while eliminating display of the three dimensional simulation of the patient anatomy that is outside of the perimeter of the three dimensional view window.