Virtual reality representation of medical devices

• US 9,594,877 B2
• Filed: 08/31/2012
• Issued: 03/14/2017
• Est. Priority Date: 08/31/2012
• Status: Active Grant

• Current Assignee: Cirtec Medical Corp.
• Original Assignee: Nuvectra Corporation
• Inventors: Kaula, Norbert, Iyassu, Yohannes
• Primary Examiner(s): Vu, Kieu
• Assistant Examiner(s): Chaudhuri, Anita D
• Application Number:
  US13/601,449
• Publication Number:
  US 20140062900A1
• Time in Patent Office: 1,656 Days
• US Class Current: 1/1
• CPC Class Codes: A61N 1/37247 User interfaces, e.g. input or presentation means
• CPC Class Codes: G16H 30/20 for handling medical images, e.g. DICOM, HL7 or PACS
• CPC Class Codes: G16H 50/50 for simulation or modelling of medical disorders
• CPC Class Codes: G16Z 99/00 Subject matter not provided for in other main groups of this subclass

Abstract

The present disclosure involves a method of facilitating visualization in a medical context. The method includes displaying a virtual reality representation of a medical device via a touch-sensitive user interface. The virtual reality representation of the medical device includes a movable and rotatable three-dimensional model of the medical device. The method includes displaying a virtual reality representation of an anatomical environment of a patient via a touch-sensitive user interface. The virtual reality representation of the anatomical environment is zoomable and scalable. The method includes customizing the virtual reality representation of the medical device. The method includes positioning the customized virtual reality representation of the medical device in an appropriate location of the virtual reality representation of the anatomical environment. The customizing and the positioning are performed in response to user input.

Claims

1. An electronic device configured to visualize one or more medical devices in its suitable anatomical surroundings, the electronic device comprising:

a touchscreen display configured to receive input from a user and display an output to the user;

a memory storage component configured to store programming code; and

a computer processor configured to execute the programming code to perform the following tasks;

illustrating, via the touchscreen display, a respective three-dimensional (3-D) model of a plurality of different kinds of medical devices that include at least a first medical device that comprises an implantable lead and a second medical device that comprises;

an implantable pulse generator, an external pulse generator, or a connector block, wherein the respective 3-D model for each of the first medical device and the second medical device is configured to be moved and rotated in response to user input;

illustrating, via the touchscreen display, a visual representation of a suitable anatomical surrounding for the first or second medical devices, wherein the visual representation of the anatomical surrounding is configured to be zoomed in and out and scaled up and down in response to user input;

placing, in response to user input, the 3-D model of the first or second medical devices in a target position of the visual representation of the anatomical surrounding; and

establishing a simulated coupling between the first medical device and the second medical device, wherein the establishing the simulated coupling comprises;

determining whether the simulated coupling causes a mismatch between the first medical device and the second medical device; and

notifying the user that the simulated coupling is impermissible in response to a determination that the simulated coupling causes the mismatch between the first medical device and the second medical device.

2. The electronic device of claim 1, wherein the

illustrating comprises illustrating the respective 3-D models of the plurality of different kinds of medical devices on a spinnable virtual carousel;

and

selecting, in response to user input, one of the medical devices from the virtual carousel to be further manipulated by the user.

3. The electronic device of claim 1, wherein the programming code can be executed to further perform the following tasks:

detecting, before the illustrating the respective 3-D models, a digital identification code in response to an image scan; and

matching the detected digital identification code to a corresponding one of the plurality of different kinds of medical devices, wherein the corresponding one of the medical devices is one of the medical devices whose 3-D model is to be illustrated.

4. The electronic device of claim 3, wherein the digital identification code comprises one of:

a barcode and a Quick Response (QR) code associated with the medical device, and wherein the digital identification code contains digital 3-D information of the medical device for rendering the 3-D model of the corresponding medical device on the touchscreen display of the electronic device.

5. The electronic device of claim 1, wherein the programming code can be executed to further perform the following task:

preventing inadvertent movement or rotation of the 3-D model of the first medical device or the second medical device; and

removing the 3-D model of the first medical device or the second medical device from the touchscreen display.

6. The electronic device of claim 1, wherein the programming code can be executed to further perform the following task:

configuring a relational pattern of the 3-D model of the first medical device.

7. The electronic device of claim 6, wherein the configuring a relational pattern comprises:

displaying a single lead pattern and a double lead pattern; and

selecting, in response to user input, the single lead pattern or the double lead pattern as the implantable lead.

8. The electronic device of claim 1, wherein the programming code can be executed to further perform:

communicating a failsafe message in response to a detection of one or more predefined events.

9. The electronic device of claim 1, wherein the electronic device is one of:

a clinician programmer, a patient programmer, and a computer tablet, and wherein the electronic device is portable and is configured to communicate with external devices according to a wireless communications protocol.

10. The electronic device of claim 1, wherein the tasks further comprise:

visually emphasizing, via the touchscreen display, at least one of the first and second medical devices in response to a successful simulated coupling between the first and second medical devices.

11. A medical system, comprising:

one or more medical devices configurable to deliver a medical therapy to a patient; and

an electronic device configured to provide a visual representation of the one or more medical devices via a touch-sensitive visual user interface, wherein the electronic device includes a non-transitory, tangible machine-readable storage medium storing a computer application, wherein the computer application contains machine-readable instructions that when executed electronically by processors, perform the following actions;

demonstrating, via a spinnable virtual carousel in the touch-sensitive visual user interface, three-dimensional models of an implantable lead as a first medical device and at least one of;

an implantable pulse generator, an external pulse generator, or a connector block as a second medical device;

demonstrating, via the touch-sensitive visual user interface, a virtual reality representation of a suitable anatomical environment for at least one of the first and second medical devices;

positioning the at least one of the first and second medical devices in a target area of the anatomical environment;

simulating an electrical or physical coupling between the first and second medical devices in response to user input, wherein the simulating comprises;

determining whether the simulated electrical or physical coupling causes a mismatch between the first medical device and the second medical device; and

notifying a user that the simulated electrical or physical coupling is impermissible in response to a determination that the simulated electrical or physical coupling causes the mismatch between the first medical device and the second medical device.

12. The medical system of claim 11, wherein:

the virtual reality representations of the first and second medical devices comprise three-dimensional models that are movable, rotatable, lockable, and removable; and

the virtual reality representation of the suitable anatomical environment is zoomable and scalable.

13. The medical system of claim 11, wherein the electronic device further comprises an integrated camera, and wherein the instructions are executed by processors to further perform:

scanning a digital code with the integrated camera; and

displaying, via the touch-sensitive visual user interface, a virtual reality representation of a medical device associated with the digital code.

14. The medical system of claim 11, wherein the instructions are executed by processors to further perform:

setting a relational pattern of the virtual reality representation of at least one of the first and second medical devices.

15. The medical system of claim 14, wherein the setting the relational pattern comprises:

displaying a single lead pattern and a double lead pattern; and

setting, in response to user input, the single lead pattern or the double lead pattern as the implantable lead.

16. The medical system of claim 11, wherein the instructions are executed by processors to further perform:

communicating a failsafe warning in response to a detection of one or more predefined events.

17. The medical system of claim 11, wherein the electronic device has a portable form factor and comprises a wireless transceiver.

18. The medical system of claim 11, wherein:

the first medical device comprises;

the implantable lead;

the second medical device comprises the implantable pulse generator, an external pulse generator, or a connector block; and

the electronic device comprises;

one of;

a clinician programmer, a patient programmer, and a computer tablet.

19. The medical system of claim 11, wherein the tasks further comprise:

visually emphasizing, via the touch-sensitive visual user interface, at least one of the first and second medical devices in response to a successful simulated coupling between the first and second medical devices.

20. A method of facilitating visualization of devices in a medical context, comprising:

displaying, via a touch-sensitive user interface, a virtual reality representation of at least a first medical device comprising an implantable lead and a second medical device comprising;

an implantable pulse generator, an external pulse generator, or a connector block, wherein the virtual reality representation of the first and second medical devices includes a movable and rotatable three-dimensional model for each of the first and second medical devices;

displaying, via the touch-sensitive user interface, a virtual reality representation of an anatomical environment of a patient, wherein the virtual reality representation of the anatomical environment is zoomable and scalable;

customizing the virtual reality representation of the first or the second medical device; and

positioning the customized virtual reality representation of the first or the second medical device in an target location of the virtual reality representation of the anatomical environment;

establishing a simulated coupling between the first medical device and the second medical device, wherein the establishing the simulated coupling comprises;

determining whether the simulated coupling causes a mismatch between the first medical device and the second medical device; and

notifying a user that the simulated coupling is impermissible in response to a determination that the simulated coupling causes the mismatch between the first medical device and the second medical device;

wherein the customizing and the positioning are performed in response to user input.

21. The method of claim 20, wherein the displaying the virtual reality representation of the medical device comprises:

offering virtual reality representations of a plurality of different types of medical devices on a spinnable digital carousel, the different types of medical devices including the first and second medical devices; and

selecting, in response to user input, one of the medical devices from the digital carousel to be customized.

22. The method of claim 20, further comprising, before the displaying of the virtual reality representation:

detecting a digital identifier in response to an image scan; and

matching the digital identifier to a corresponding medical device, wherein the corresponding medical device is one of the medical devices whose virtual reality representation is to be displayed.

23. The method of claim 22, wherein the digital identifier comprises one of:

a barcode and a Quick Response (QR) code associated with the medical device.

24. The method of claim 20, wherein the three-dimensional model of the medical device is lockable and deletable.

25. The method of claim 20, wherein the customizing comprises setting a relational pattern of the virtual reality representation of the first medical device.

26. The method of claim 25, wherein the setting the relational pattern comprises:

displaying a single lead pattern and a double lead pattern; and

setting, in response to user input, the single lead pattern or the double lead pattern as the implantable lead.

27. The method of claim 20, further comprising:

communicating a failsafe message in response to a detection of one or more predefined events.

28. The method of claim 20, wherein the touch-sensitive user interface is displayed on a touch-sensitive screen of a portable electronic device with wireless communication capabilities.

29. The method of claim 28, wherein the portable electronic device comprises one of:

a clinician programmer, a patient programmer, and a computer tablet.

30. The method of claim 20, further comprising:

visually emphasizing, via the touch-sensitive user interface, at least one of the first and second medical devices in response to a successful simulated coupling between the first and second medical devices.

31. An electronic apparatus for displaying virtual reality representations of medical devices, the electronic apparatus comprising:

user interface means for communicating with a user, the user interface means including a touch-sensitive screen;

memory storage means for storing executable instructions; and

computer processor means for executing the instructions to perform;

displaying, via the touch-sensitive screen, a virtual representation of a portion of a human body;

displaying, via the touch-sensitive screen, a virtual carousel containing a plurality of three-dimensional (3-D) models corresponding to a plurality of different types of medical devices that include at least a first medical device and a second medical device, respectively, wherein the first medical device comprises an implantable pulse generator, and wherein the second medical device comprises;

an implantable pulse generator, an external pulse generator, or a connector block; and

placing, in response to user input received through the user interface means, the 3-D models of one or more of the medical devices within an appropriate location of the virtual representation of the portion of the human body; and

establishing a simulated coupling between the first medical device and the second medical device, wherein the establishing the simulated coupling comprises;

determining whether the simulated coupling causes a mismatch between the first medical device and the second medical device; and

notifying the user that the simulated coupling is impermissible in response to a determination that the simulated coupling causes the mismatch between the first medical device and the second medical device.

32. The electronic apparatus of claim 31, wherein the computer processor executes the instructions to further perform:

customizing the 3-D models of the different types of the medical devices.

33. The electronic apparatus of claim 32, wherein the customizing the 3-D models comprises configuring a relational pattern of the different types of the medical devices.

34. The electronic apparatus of claim 33, wherein the configuring the relational pattern comprises:

displaying a single lead pattern and a double lead pattern; and

setting, in response to user input, the single lead pattern or the double lead pattern as the implantable lead.

35. The electronic apparatus of claim 31, further comprising, imaging means for capturing a digital identifier associated with a medical tool;

and wherein the computer processor executes the instructions to further perform;

displaying, via the touch-sensitive screen, a 3-D model of the medical tool associated with the digital identifier.

36. The electronic apparatus of claim 35, wherein the digital identifier comprises one of:

a barcode and a Quick Response (QR) code located on a packaging of the medical tool.

37. The electronic apparatus of claim 31, wherein the virtual representation of the portion of the human body is zoomable and scalable.

38. The electronic apparatus of claim 31, wherein the 3-D models of the medical devices are rotatable, movable, lockable, and removable.

39. The electronic apparatus of claim 31, wherein the computer processor means is configured to execute the instructions to further perform:

visually emphasizing, via the touch-sensitive screen, at least one of the first and second medical devices in response to a successful simulated coupling between the first and second medical devices.

40. The electronic apparatus of claim 31, wherein the computer processor executes the instructions to further perform:

communicating a failsafe message in response to a detection of a predefined event.