Guide system and a probe therefor

• US 20040254454A1
• Filed: 07/21/2004
• Published: 12/16/2004
• Est. Priority Date: 06/13/2001
• Status: Abandoned Application

• Current Assignee: Volume Interactions Pte Ltd. (Bracco SPA)
• Original Assignee: Volume Interactions Pte Ltd. (Bracco SPA)
• Inventors: Kockro, Ralf Alfons
• Application Number:
  US10/480,715
• Publication Number:
  US 20040254454A1
• Time in Patent Office: Days
• US Class Current: 600/424
• CPC Class Codes: A61B 2017/00199 with a console, e.g. a control panel with a display
• CPC Class Codes: A61B 2017/00207 with hand gesture control or hand gesture recognition
• CPC Class Codes: A61B 2034/2055 Optical tracking systems
• CPC Class Codes: A61B 2034/2068 using pointers, e.g. pointers having reference marks for determining coordinates of body points
• CPC Class Codes: A61B 2090/365 augmented reality, i.e. correlating a live optical image with another image
• CPC Class Codes: A61B 2090/368 changing the image on a display according to the operator's position
• CPC Class Codes: A61B 34/20 Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
• CPC Class Codes: A61B 34/25 User interfaces for surgical systems
• CPC Class Codes: A61B 90/36 Image-producing devices or illumination devices not otherwise provided for

Abstract

A probe to be held by a surgeon who performs an operation within a defined region is proposed. The surgeon employs an image-based guide system having a head-mounted semi-transparent display for displaying computer-generated images of the patient overlying real images of the patient. The position of the probe is tracked by the system and is visible to the surgeon. The computer-generated image includes a line extending from the probe along its longitudinal axis. The surgeon can control the extension of the line, to signal to the system a distance into the patient. The images seen by the user are modified accordingly, to facilitate navigation or simulate an operation.

Claims

1. A guide system for use by a user who performs an operation in a defined three-dimensional region, the system including a data processing apparatus for generating an image of the subject of the operation, a display for displaying the image to the user in co-registration with the subject, a probe having a longitudinal axis and having a position which is visible to the user, and a tracking unit for tracking the location of the probe by the system and transmitting that location to the data processing apparatus,

the data processing apparatus being arranged to generate the image according to a line extending parallel to the longitudinal axis of the probe, the line having an extension which is controlled according to the output of an extension control device controlled by the user, and

and the data processing apparatus further being controlled to modify the image of the subject of the operation according to the controlled extension of the line.

2. A system according to claim 1 wherein the display is arranged to generate images of the subject of the operation overlaid on the subject.

3. A system according to claim 1 in which the data processing apparatus is arranged to display a section of the subject in a plane within the subject selected by controlling the extension of the line.

4. A system according to claim 1 in which the data processing apparatus is arranged to modify the computer-generated image to simulate an operation performed on the subject user, the simulated operation being controlled by controlling the extension of the line.

5. A system according to claim 4 in which the simulated operation includes removal of portions of the computer-generated image to a depth within the patient indicated by the extension of the line.

9. A system according to any preceding claim in which the display is adapted to be mounted on the head of a user, the user being able to view the subject of the operation through the display, so as to see the computer-generated image superimposed on a true image of the subject of the image, the tracking unit monitoring the position of the display and transmitting the monitored position of the display to the processing apparatus, which is arranged to modify the computer-generated image according to the position of the display to maintain the computer-generated image and the real image stereoscopically in register.

10. A system according to any preceding claim in which the display is adapted to be mounted on a microscope, the user being able to view the microscope image through the display, so as to see the computer-generated image superimposed on the microscope image, the tracking unit monitoring the position of the microscope and transmitting the monitored position of the microscope to the processing apparatus, which is arranged to modify the computer-generated image according to the position of the microscope to maintain the computer-generated image and the real image stereoscopically in register.

6. A guide system for use by a user who performs an operation in a defined three-dimensional region, the system including:

a data processing apparatus for generating an image of the subject of the operation in co-registration with the subject,

a display for displaying the image to the user, a probe having a position which is visible to the user, and

a tracking unit for tracking the location of the probe by the system and transmitting that location to the data processing apparatus,

the data processing apparatus being arranged to modify the image to represent a change in the physical shape of the subject of the operation, the modification depending upon the tracked location of the probe.

7. A system according to claim 6 wherein the data processing apparatus is arranged to generate images of the subject of the operation overlaid on the subject.

8. A system according to claim 6 in which the modification of the image simulates a removal of a part of the subject of the operation, the part being determined by the location of the probe.

11. A method for use by a user who performs an operation in a defined three-dimensional region with guidance from an image guided system, for modifying the image displayed to the user by the image guided system, the system including a data processing apparatus for generating images of the subject of the operation in co-registration with the subject, a display for displaying the images to the user, a probe having a position which is visible to the user, and a tracking unit for tracking the location of the probe by the system and transmitting that location to the data processing apparatus, the method including:

the user moving the probe to a selection region outside and surrounding the defined region,

the data processing apparatus registering the position of the probe within the selection region, and thereupon generating within the image one or more virtual buttons, each of the buttons being associated with a corresponding instruction to the system,

the user selecting one of the buttons, the selection including positioning of the probe in relation to the apparent position of that virtual button, and

the data processing apparatus registering the selection, and modifying the computer-generated image based on the corresponding instruction.

12. A method according to claim 11 wherein the data processing generates images of the subject of the operation overlaid on the subject.

13. A method according to claim 11 in which, while the data processing apparatus displays the virtual buttons, it further displays a line extending from the probe along a longitudinal axis thereof, the positioning of the probe includes aligning the longitudinal axis of the probe with the button.

22. A method according to claim 11 in which the display is mounted on the head of a user, the user being able to view the subject of the operation through the display, so as to see the computer-generated image superimposed on a true image of the subject of the image, the tracking unit monitoring the position of the display and transmitting the monitored position of the display to the processing apparatus, which modifies the computer-generated image according to the position of the display to maintain the computer-generated image and the real image stereoscopically in register.

23. A method according to claim 11 in which the display is mounted on a microscope, the user being able to view the microscope image through the display, so as to see the computer-generated image superimposed on the microscope image, the tracking unit monitoring the position of the microscope and transmitting the monitored position of the microscope to the processing apparatus, which modifies the computer-generated image according to the position of the microscope to maintain the computer-generated image and the real image stereoscopically in register.

14. A method for use by a user who performs an operation in a defined three-dimensional region with guidance from an image guided system, for modifying the image displayed to the user by the image guided system, the system including a data processing apparatus for generating images of the subject of the operation in co-registration with the subject, a display for displaying the images to the user, a probe having a longitudinal axis and a position which is visible to the user, and a tracking unit for tracking the location of the probe by the system and transmitting that location to the data processing apparatus, the method including:

the data processing apparatus generating the image according to a line extending parallel to the longitudinal axis of the probe,

the user controlling the extension of the line having an extension using an extension control device, and

the data processing apparatus modifying the image of the subject of the operation according to the controlled extension of the line.

15. A method according to claim 14 wherein the data processing generates images of the subject of the operation overlaid on the subject.

16. A method according to claim 14 in which the data processing apparatus modifies the image to display a section of the subject in a plane within the subject selected by controlling the extension of the line.

17. A method according to claim 16 in which the data processing apparatus is modifies the computer-generated image to simulate an operation performed on the subject user, the simulated operation being controlled by controlling the extension of the line.

18. A method according to claim 17 in which the simulated operation includes removal of portions of the computer-generated image to a depth within the patient indicated by the extension of the line.

19. A method for use by a user who performs an operation in a defined three-dimensional region with guidance from an image guided system, for modifying the image displayed to the user by the image guided system, the system including:

a data processing apparatus for generating an image of the subject of the operation in co-registration with the subject,

a display for displaying the image to the user, a probe having a position which is visible to the user, and

a tracking unit for tracking the location of the probe by the system and transmitting that location to the data processing apparatus,

the data processing apparatus modifying the image to represent a change in the physical shape of the subject of the operation, the modification depending upon the tracked location of the probe.

20. A method according to claim 19 wherein the data processing generates images of the subject of the operation overlaid on the subject.

21. A method according to claim 19 in which the data processing apparatus modifies the image simulating a removal of a part of the subject of the operation, the part being determined by the location of the probe