Gesture-Based Interface for a Multi-Modality Medical Imaging System

• US 20140181716A1
• Filed: 12/19/2013
• Published: 06/26/2014
• Est. Priority Date: 12/26/2012
• Status: Active Grant

• Current Assignee: Volcano Corporation (Koninklijke Philips N.V.)
• Original Assignee: Volcano Corporation (Koninklijke Philips N.V.)
• Inventors: Merritt, Fergus, Cheline, Aaron J., Cohen, Asher
• Granted Patent: US 10,368,836 B2
• Time in Patent Office: Days
• US Class Current: 715/771
• CPC Class Codes: A61B 5/00 Measuring for diagnostic purposes radiation diagnosis A61B6/00; diagnosis by ultrasonic, sonic or infrasonic waves A61B8/00; Identification of persons
• CPC Class Codes: A61B 5/0022 Monitoring a patient using a global network, e.g. telephone networks, internet
• CPC Class Codes: A61B 5/0035 adapted for acquisition of images from more than one imaging mode, e.g. combining MRI and optical tomography
• CPC Class Codes: A61B 5/0066 Optical coherence imaging
• CPC Class Codes: A61B 5/0084 for introduction into the body, e.g. by catheters A61B5/1459 takes precedence
• CPC Class Codes: A61B 5/0095 by applying light and detecting acoustic waves, i.e. photoacoustic measurements
• CPC Class Codes: A61B 5/02007 Evaluating blood vessel condition, e.g. elasticity, compliance
• CPC Class Codes: A61B 5/021 Measuring pressure in heart or blood vessels A61B5/0205 takes precedence
• CPC Class Codes: A61B 5/029 Measuring or recording blood output from the heart, e.g. minute volume A61B8/065 takes precedence
• CPC Class Codes: A61B 5/107 Measuring physical dimensions, e.g. size of the entire body or parts thereof
• CPC Class Codes: A61B 5/4848 Monitoring or testing the effects of treatment, e.g. of medication
• CPC Class Codes: A61B 5/743 Displaying an image simultaneously with additional graphical information, e.g. symbols, charts, function plots
• CPC Class Codes: A61B 5/7435 Displaying user selection data, e.g. icons in a graphical user interface
• CPC Class Codes: A61B 5/7475 User input or interface means, e.g. keyboard, pointing device, joystick
• CPC Class Codes: A61B 5/748 Selection of a region of interest, e.g. using a graphics tablet
• CPC Class Codes: A61B 5/749 Voice-controlled interfaces
• CPC Class Codes: A61B 8/12 in body cavities or body tracts, e.g. by using catheters catheters per se A61M25/00
• CPC Class Codes: G06F 2203/0381 Multimodal input, i.e. interface arrangements enabling the user to issue commands by simultaneous use of input devices of different nature, e.g. voice plus gesture on digitizer
• CPC Class Codes: G06F 3/038 Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G16H 30/20 : for handling medical images, e.g. DICOM, HL7 or PACS
• CPC Class Codes: G16H 30/40 : for processing medical images, e.g. editing
• CPC Class Codes: G16H 40/63 : for local operation
• CPC Class Codes: G16H 50/20 : for computer-aided diagnosis, e.g. based on medical expert systems

Abstract

Systems and methods for multi-modality data processing are provided. Some embodiments are particularly directed to interpreting gesture-based commands in a multi-modality processing system. In one embodiment, a method for interpreting user input in a medical processing system includes receiving a state designator corresponding to a mode of operation of the medical processing system, where the mode of operation includes a value representative of a modality selected from the group consisting of: IVUS, OCT, pressure, and flow. A list of active commands is generated based on the received state designator. A user input sequence is received from one or more user input devices. The medical processing system correlates the user input sequence to a command of the list of active commands, and the command is utilized to control operation of a component of the system. The list of active command may include a subset of commands common to multiple modalities.

Claims

1. A method for interpreting user input in a medical processing system, the method comprising:

receiving a state designator corresponding to a mode of operation of the medical processing system, the mode of operation including a value representative of a modality selected from the group of modalities consisting of;

IVUS, OCT, pressure, and flow;

generating a list of active commands based on the received state designator;

receiving a user input sequence from one or more user input devices;

correlating, by the medical processing system, the user input sequence to a command of the list of active commands; and

utilizing the command to control operation of a component of the medical processing system.

2. The method of claim 1, wherein the list of active commands includes a plurality of commands associated with diagnostic measurements.

3. The method of claim 2, wherein the diagnostic measurements include one or more measurements selected from the group consisting of:

length, area, and volume.

4. The method of claim 2, wherein the diagnostic measurements include one or more measurements selected from the group consisting of:

fractional flow reserve and coronary flow reserve.

5. The method of claim 1, wherein the list of active commands includes a subset of commands common to multiple modalities.

6. The method of claim 1 further comprising displaying a visual representation of the command on a user display device prior to the utilizing the command to control the operation of the component of the medical processing system.

7. The method of claim 6 further comprising receiving a confirmation of the displayed command from the user input device prior to the utilizing of the command to control the operation of the component of the medical processing system.

8. The method of claim 1, wherein the generating of the list of active commands includes querying an electronic database based on the received state designator.

9. The method of claim 1 further comprising determining a parameter of the command based on an element of the user input sequence.

10. A method for controlling a medical processing system, the method comprising:

displaying medical data on a user display device, the medical data corresponding to an active modality of the medical processing system, the active modality being selected from a plurality of modalities of the medical processing system;

determining a list of active commands based on the active modality;

receiving, by the medical processing system, a user input sequence from one or more user input devices, the user input sequence provided by a user in response to the displayed medical data;

matching the user input sequence to a selected command from the list of active commands; and

utilizing the selected command to control operation of a component of the medical processing system.

11. The method of claim 10, wherein the list of active commands includes a subset of commands common to at least two modalities of the plurality of modalities.

12. The method of claim 10 further comprising displaying a visual representation of the selected command on the user display device prior to the utilizing of the selected command to control operation of the component of the medical processing system.

13. The method of claim 10, wherein the determining of the list of active commands includes querying an electronic database.

14. The method of claim 10, wherein the selected command is a measurement command.

15. The method of claim 14, wherein the measurement command corresponds to one or more measurements selected from the group consisting of:

length, area, and volume.

16. The method of claim 14, wherein the measurement command corresponds to one or more measurements selected from the group consisting of:

fractional flow reserve and coronary flow reserve.

17. An apparatus comprising:

a non-transitory, computer-readable storage medium that stores a plurality of instructions for execution by at least one computer processor, wherein the instructions are for;

determining a mode of operation of a medical processing system, the mode of operation corresponding to a modality of the medical processing system;

generating a list of active commands based on the mode of operation;

receiving a user input sequence from one or more user input devices;

correlating the user input sequence to a command of the list of active commands; and

utilizing the command to control a behavior of the medical processing system.

18. The apparatus of claim 17, wherein the modality is selected from the group consisting of:

IVUS, OCT, pressure, and flow.

19. The apparatus of claim 17, wherein the list of active commands includes a subset of commands common to at least two modalities of the medical processing system.

20. The apparatus of claim 17, wherein the instructions include further instructions for displaying a visual representation of the command on a user display device prior to utilizing the command to control the behavior of the medical processing system.

21. The apparatus of claim 17, wherein the instructions for the generating of the list of active commands include instructions for querying an electronic database.

22. The apparatus of claim 17, wherein the instructions include further instructions for specifying a parameter of the command based on an element of the user input sequence.

23. The apparatus of claim 17, wherein the command is a measurement command.

24. The apparatus of claim 23, wherein the measurement command corresponds to one or more measurements selected from the group consisting of:

length, area, and volume.

25. The apparatus of claim 23, wherein the measurement command corresponds to one or more measurements selected from the group consisting of:

fractional flow reserve and coronary flow reserve.