Multimodal Ultrasound Training System

• US 20120058457A1
• Filed: 09/23/2011
• Published: 03/08/2012
• Est. Priority Date: 11/30/2004
• Status: Active Grant

• Current Assignee: Regents of the University of California (University of California)
• Original Assignee: Regents of the University of California (University of California)
• Inventors: Savitsky, Eric A.
• Granted Patent: US 8,480,404 B2
• Time in Patent Office: Days
• US Class Current: 434/262
• CPC Class Codes: G09B 23/286 for scanning or photography techniques, e.g. X-rays, ultrasonics

Abstract

The present invention teaches a medical procedure training system based on a PC platform that provides multimodal education within a virtual environment. The system integrates digital video, three-dimensional modeling, and force-feedback devices for the purpose of training medical professionals medical procedures.

Claims

1. A medical procedure training system for simulating ultrasound imaging and ultrasound-guided medical procedures, the system comprising:

a control device;

a graphical interface connected to the control device providing a plurality of interface sections, wherein a first interface section displays a digital video and a second interface section displays a virtual anatomical model and a three-dimensional ultrasound probe model, wherein the digital video comprises images previously recorded by scanning a live subject and correlated to the virtual anatomical model; and

a user input device connected the control device, the user input device comprising an inertial sensor, wherein the graphical interface displays dynamic images corresponding to signals provided by the user input device, the signals corresponding to a spatial orientation of the user input device in relation to an area of examination, wherein the system is configured to simulate ultrasound imaging and ultrasound-guided medical procedures through system feedback.

2. The system according to claim 1, wherein the plurality of interface sections include a digital video section, an anatomical section, an interactive three-dimensional model section and a real-patient-based case library comprising volumes of anatomical patient data.

3. The system according to claim 1, wherein the system has two graphical interfaces, wherein a first graphical interface displays a three-dimensional model and a second graphical interface displays a digital video.

4. The system according to claim 1, further comprising a mechanical tracking device connected to the control device, wherein the mechanical tracking device simulates a medical tool.

5. The medical procedure training system according to claim 2, wherein the anatomical section comprises data created from a CT scan.

6. The medical procedure training system according to claim 2, wherein the anatomical section comprises data created from an MRI scan.

7. The medical procedure training system according to claim 2, wherein the anatomical section comprises data created from ultrasound images.

8. The medical procedure training system according to claim 1, wherein the control device is a computer.

9. The system according to claim 1, wherein the three-dimensional model has user selectable views, wherein a user may visually remove a portion of the three-dimensional anatomical model from the graphical interface thereby allowing a different three-dimensional view.

10. The system according to claim 1, further comprising a memory storage device having a library of medical data linked to simulated medical procedures, wherein a user may access the library during a training procedure.

11. The system according to claim 1, further comprising a memory storage device, wherein user performance data is stored in the memory storage device.

12. The system according to claim 1, wherein the system further comprises a second user input device that simulates a combination needle and syringe.

13. The system according to claim 12, wherein the plurality of interface sections include a digital video section corresponding to the orientation of the user input device, an interactive three-dimensional model section corresponding to the second user input device in relation to an anatomical model, and a library access section for accessing data stored in a memory storage device.

14. The system according to claim 13, wherein the library access section contains data accessed from an online source.

15. The system according to claim 13, wherein the library access section contains medical data.

16. The system according to claim 12, wherein the control device is a laptop PC.

17. A method of operating a multimodal medical training system, comprising the steps of:

selecting a first simulated medical procedure from a library;

displaying images on a graphical interface, wherein the images correspond to the simulated medical procedure;

receiving a first input from a first user input device, wherein the first user input device is an inertial sensor;

processing the first input in relation to the simulated medical procedure;

modifying images corresponding to the first user input device, the first user input device images comprises images previously recorded by scanning a live subject, the images corresponding to a position, an angle, and movement of the inertial sensor;

receiving a second input from a second user input device, wherein the second user input device is a force-feedback device simulating a medical tool;

processing the second input in relation to the simulated medical procedure;

modifying images corresponding to the second user input device;

providing force-feedback signals to the second user input device;

receiving input from the second user input device based upon the force-feedback signals; and

determining whether the simulated medical procedure reached a desired end point.

18. The method according to claim 17, wherein the images displayed by the graphical interface include a digital video section comprising real-patient anatomical data, an anatomical section, and an interactive three-dimensional model section.

19. The method according to claim 17, wherein the simulated medical procedure is selected from the group consisting of anoscopy, central line placement, cricothyrodotomy cricothyroidotomy, anterior and posterior nasal packing, arterial cannulation, arterial blood gas, arthrocentesis, bladder catheterization, cardiac massage, cardiac placing/cardioversion, endotracheal intubation, foreign body removal from cornea, fracture reduction, incision and drainage of abscess, intraosseous line placement, local anesthesia, lumbar puncture, nail trephination, needle thoracotomy, nerve blocks, nasogastric tube placement, percutaneous transtracheal ventilation, pericardiocentesis, peripheral intravenous line placement, thoracentesis, tube thoracotomy, and venous cutdown.