System and method for accessing and annotating electronic medical records using a multi-modal interface
First Claim
1. A method of exchanging medical information between a user and a computer device arranged to receive input from the user in a plurality of modes of user input, the method comprising:
- receiving from the user a synchronized combination of a plurality of user inputs associated with a medical condition and a bodily location of the medical condition on a patient, the plurality of user inputs including user inputs in at least two user input modes;
using a multi-modal finite state transducer to combine the plurality of user inputs and to determine an indication of the received medical condition and the bodily location of the medical condition;
presenting to the user an output of the indication; and
presenting to the user an indication that the computer device is ready to receive further information.
0 Assignments
0 Petitions
Accused Products
Abstract
A system and method of exchanging medical information between a user and a computer device is disclosed. The computer device can receive user input in one of a plurality of types of user input comprising speech, pen, gesture and a combination of speech, pen and gesture. The method comprises receiving information from the user associated with a medical condition and a bodily location of the medical condition on a patient in one of a plurality of types of user input, presenting in one of a plurality of types of system output an indication of the received medical condition and the bodily location of the medical condition, and presenting to the user an indication that the computer device is ready to receive further information. The invention enables a more flexible multi-modal interactive environment for entering medical information into a computer device. The medical device also generates multi-modal output for presenting a patient'"'"'s medical condition in an efficient manner.
-
Citations
20 Claims
-
1. A method of exchanging medical information between a user and a computer device arranged to receive input from the user in a plurality of modes of user input, the method comprising:
-
receiving from the user a synchronized combination of a plurality of user inputs associated with a medical condition and a bodily location of the medical condition on a patient, the plurality of user inputs including user inputs in at least two user input modes; using a multi-modal finite state transducer to combine the plurality of user inputs and to determine an indication of the received medical condition and the bodily location of the medical condition; presenting to the user an output of the indication; and presenting to the user an indication that the computer device is ready to receive further information. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16)
-
-
17. An apparatus for exchanging medical information between the apparatus and a user, the apparatus the apparatus comprising:
-
(1) a plurality of user interfaces for receiving a synchronized combination of inputs from the user associated with a medical condition and a bodily location of the medical condition on a patient, the interfaces including interfaces capable of receiving user inputs in at least two user input modes; (2) a multi-modal recognition module using a finite-state machine to build a single meaning representation from user inputs received in the at least two user input modes; and (3) at least one user interface for presenting an indication of the received medical condition and the bodily location of the medical condition. - View Dependent Claims (18, 19, 20)
-
Specification