Haptic Enabled Robotic Training System and Method

• US 20090253109A1
• Filed: 04/20/2007
• Published: 10/08/2009
• Est. Priority Date: 04/21/2006
• Status: Abandoned Application

• Current Assignee: Handshake VR, Inc.
• Original Assignee: Handshake VR, Inc.
• Inventors: Tuer, Kevin, Anvari, Mehran
• Application Number:
  US12/297,892
• Publication Number:
  US 20090253109A1
• Time in Patent Office: Days
• US Class Current: 434/262
• CPC Class Codes: G09B 23/28 for medicine

Abstract

A surgical training system comprising: a virtual environment including a virtual model of a surgical site; a trainer'"'"'s haptic device for controlling a surgical tool in the virtual environment; a trainee'"'"'s haptic device for controlling the surgical tool in the virtual environment, wherein the trainee'"'"'s haptic device applies force feedback in dependence on signals received from the trainer'"'"'s haptic device; and a controller for scaling the force feedback applied by the trainee'"'"'s haptic device in dependence on a specified scaling value.

Claims

1. A surgical training system comprising:

a virtual environment including a virtual model of a surgical site;

a trainer'"'"'s haptic device for controlling a surgical tool in the virtual environment;

a trainee'"'"'s haptic device for controlling the surgical tool in the virtual environment, wherein the trainee'"'"'s haptic device applies force feedback in dependence on signals received from the trainer'"'"'s haptic device; and

a controller for scaling the force feedback applied by the trainee'"'"'s haptic device in dependence on a specified scaling value.

2. The surgical training system of claim 1 wherein the specified scaling value falls within a range of 0% to 100% of a force applied at the trainer'"'"'s haptic device.

3. The surgical training system of claim 1 including a trainer'"'"'s station associated with the trainer'"'"'s haptic device, the trainer'"'"'s station including an interface through which a trainer can input a value for use as the specified scaling value.

4. The surgical training system of claim 1 wherein the trainer'"'"'s haptic device applies force feedback in dependence on signals received from the trainee'"'"'s haptic device.

5. The surgical training system of claim 1 wherein the training system is a telehaptic training system in which the trainer'"'"'s haptic device is at a location remote from a location of the trainee'"'"'s haptic device, and haptic information is exchanged between the locations over a communications network.

6. The surgical training system of claim 5 in which visual information about the virtual environment is also communicated between the locations over the communications network, the training system including a latency compensation manager at least at one of the locations for reducing an apparent latency on the communications network to facilitate telehaptic interactions between the locations.

7. The surgical training system of claim 1 including a trainer'"'"'s visual interface for viewing a trainer'"'"'s representation of the virtual environment and a trainee'"'"'s visual interface for viewing a trainee'"'"'s representation of the virtual environment, wherein the virtual model includes at least one virtual anatomical object that is visible in both the trainer'"'"'s visual interface and the trainee'"'"'s visual interface and wherein differing haptic characteristics are assigned to one or more areas adjacent the at least one anatomical object such that in at least one mode of operation varying force feedback is applied to at least the trainee'"'"'s haptic device in dependence on a location of the virtual surgical tool respective to a boundary of the at least one anatomical object.

8. The surgical training system of claim 7 including a trainer'"'"'s interface through which the trainer can adjust the haptic characteristics, including a geometric size, geometric shape and haptic feedback force magnitude, assigned to the one or more areas.

9. The surgical training system of claim 1 wherein the virtual model simulates laparoscopic surgery.

10. A method of training a trainee to perform surgery comprising:

displaying a virtual model of a surgical site;

providing a trainee haptic input device for use by the trainee to move a virtual surgical tool in the displayed virtual model;

receiving force feedback information in dependence on manipulations of an trainer input device used by a trainer at a remote location;

scaling the force feedback information based on a specified value; and

applying a scaled force feedback to the trainee through the trainee haptic input device in dependence on the scaled force feedback information.

11. The method of claim 10 comprising:

assigning a zone around an anatomical object displayed in the virtual model, the zone having a set of associated haptic characteristics;

accepting input from a trainer to dynamically adjust the haptic characteristics, including a geometric size, a geometric shape, and haptic feedback force magnitude, of the zone while training a trainee; and

varying the force feedback applied to the trainee through the trainee haptic input device in dependence on the relative location of the virtual surgical tool to the assigned zone and the associated haptic characters of the assigned zone.

12. A haptic enabled surgical training system, comprising:

a master device, including;

a master controller for controlling the operation of the master device,

a master display responsive to the controller for displaying a representation of a virtual surgical environment, a master electronic storage element coupled to the master controller and having stored thereon attributes for the virtual environment, the virtual surgical environment having regions, wherein each region is associated with a corresponding haptic response, and

a master haptic input device coupled to the controller for controlling a corresponding virtual surgical tool in the virtual environment; and

a slave device for communication with the master device via a network, having;

a slave controller for controlling the operation of the slave device, a slave display responsive to the slave controller for displaying the virtual surgical environment,

a slave electronic storage element coupled to the slave controller and having stored thereon attributes of the virtual surgical environment, and

a slave haptic input device coupled to the slave controller for controlling the virtual surgical tool in the virtual surgical environment and responsive to the haptic response associated with each region,

wherein, an input of the master haptic input device generates a master-to-slave corresponding haptic response onto the slave haptic input device.

13. The haptic enabled training system of claim 12, wherein in at least one operational mode an input of the slave haptic input device generates a slave-to-master corresponding haptic response onto the master haptic input device.

14. The haptic enabled training system of claim 12, wherein communication between the master device and the slave device is facilitated via a latency management tool to reduce an apparent latency on the communications network.

15. The haptic enabled training system of claim 12, wherein the master device further comprises a master user interface for manipulating the corresponding haptic response associated with each region in the virtual surgical environment, and for manipulating the size and shape of the regions.

16. The haptic enabled training system of claim 12, wherein each region has a corresponding visual appearance representative of the haptic response associated with the region.

17. The haptic enabled training system of claim 12, wherein the master device is operable to manipulate a degree of force in the master-to-slave corresponding haptic response.

18. The haptic enabled training system of claim 12, wherein the master device is operable to enable and disable the master-to-slave corresponding haptic response.

19. The haptic enabled training system of claim 12, wherein at least one of the master device and the slave device is configured to collect haptic and other information about the operation of the system during a training session for subsequent analysis and review with a trainee.

20. A method of training a trainee to perform surgery comprising:

displaying a virtual model of a surgical site;

providing a trainee haptic input device for use by the trainee to move a virtual surgical tool in the displayed virtual model;

assigning a zone around an anatomical object displayed in the virtual mode, the zone having a set of associated haptic characteristics;

accepting input from a trainer to dynamically adjust the haptic characteristics, including a geometric size, a geometric shape, and haptic feedback force magnitude, of the zone while training a trainee; and

varying the force feedback applied to the trainee through the trainee haptic input device in dependence on the relative location of the virtual surgical tool to the assigned zone and the associated haptic characters of the assigned zone.

21. A method of training a trainee to perform surgery at a trainee station that includes a trainee haptic input device comprising:

displaying at the trainee station a virtual model of a surgical site;

receiving visual and haptic information over a communications network;

applying latency compensation to the at least the haptic information; and

applying force feedback to the trainee haptic input device in dependance on the compensated haptic information and modifying the displayed virtual model in dependence on the visual information.