Voice-controlled clinical information dashboard

• US 8,688,459 B2
• Filed: 10/08/2008
• Issued: 04/01/2014
• Est. Priority Date: 10/08/2007
• Status: Expired due to Fees

• Current Assignee: Regents of the University of California (University of California)
• Original Assignee: Regents of the University of California (University of California)
• Inventors: Nenov, Valeriy I., Martin, Neil A., Buxey, Farzad D., Hu, Xiao
• Primary Examiner(s): COLUCCI, MICHAEL C
• Application Number:
  US12/247,981
• Publication Number:
  US 20090177477A1
• Time in Patent Office: 2,001 Days
• Field of Search: 340/12.54, 704/270, 704/251, 704/275
• US Class Current: 704/275
• CPC Class Codes: A61B 2017/00203 with speech control or speech recognition
• CPC Class Codes: A61B 5/0002 Remote monitoring of patients using telemetry, e.g. transmission of vital signals via a communication network A61B5/07 takes precedence; transmission systems for measured values G08C; transmission H04B; transmission of digital information H04L; wireless communication networks H04W
• CPC Class Codes: A61B 5/7445 Display arrangements, e.g. multiple display units
• CPC Class Codes: A61B 5/749 Voice-controlled interfaces
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G10L 15/1815 Semantic context, e.g. disambiguation of the recognition hypotheses based on word meaning
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence
• CPC Class Codes: G10L 2015/228 of application context
• CPC Class Codes: G16H 10/60 for patient-specific data, e.g. for electronic patient records
• CPC Class Codes: G16H 40/63 for local operation

Abstract

A method provides a display area of a computer system for displaying a set of data. The data includes clinical data for one or more medical patients. The method provides multiple controls for performing multiple functions. The method provides an audio interface for controlling at least one of the controls through audio commands.

Claims

1. A method for controlling clinical data in a medical computer system having a display, comprising:

displaying a first set of clinical data from at least one clinical database in a first set of windows on the display, the display having a plurality of controls for performing a plurality of functions;

generating a subset of available voice commands based upon the first set of clinical data displayed in the first set of windows from a set of voice commands stored in at least one voice command database, the subset of available voice commands having fewer voice commands than the set of voice commands;

receiving at least one new item of clinical data;

displaying said at least one new item of clinical data in the first set of windows;

generating at least one new available voice command based on said at least one new item of clinical data;

incorporating the at least one new available voice command into the subset of available voice commands;

receiving a spoken command from a user via an audio input device;

comparing the spoken command with the subset of available voice commands; and

executing a function of the display associated with said spoken command if said spoken command corresponds to the subset of available voice commands.

2. The method of claim 1, wherein a particular control is associated with at least one spoken command.

3. The method of claim 2, wherein the particular control is associated with at least two different spoken commands.

4. The method of claim 1, wherein a particular spoken command is a macro voice command for controlling more than one of said controls.

5. The method of claim 1, wherein a particular control comprises one of a button, a menu, a menu item, a list, a list box, a list item, a combo box, a radio button, a check box, a text area, a text pane, a scroll bar, a cursor, and a slider.

6. The method of claim 1, wherein a particular set of voice commands is for rearranging at least one of said windows in said display area.

7. The method of claim 6, wherein said rearranging comprises one of moving, maximizing, minimizing, opening, and closing one of said windows in said display area.

8. The method of claim 1, wherein said plurality of controls is a first plurality of controls, and said plurality of controls further comprises a second plurality of controls that are displayed within said display area.

9. The method of claim 1, wherein a particular set of voice commands is for altering at least one of said windows in said display area, wherein said altering comprises at least one of zoom in, zoom out, pan left, pan right, pan up, pan down, increase resolution, and decrease resolution.

10. The method of claim 1, wherein said data displayed in said display area comprises a list of selectable names, wherein a particular voice command that selects a particular name comprises the particular name itself.

11. The method of claim 10, wherein said particular voice command that selects the particular name comprises only the particular name itself.

12. The method of claim 1, wherein each time new clinical data is removed in the display, the voice command database is updated to include some of the content removed from the display.

13. The method of claim 1, wherein the medical computer system is located in a sterile environment.

14. The method of claim 1, wherein a visual feedback is provided in the display upon receiving the spoken command.

15. The method of claim 1, wherein an audio feedback is provided to a user upon successfully executing the spoken command.

16. The method of claim 15, wherein a separate audio feedback is provided to the user when the spoken command is unsuccessfully executed.

17. The method of claim 1, wherein the spoken command is customizable by a user.

18. The method of claim 1, wherein the clinical data is provided to the at least one clinical data database from at least two data sources.

19. The method of claim 1, wherein the method is used during a medical procedure.

20. The method of claim 1, wherein the at least two voice commands stored in the at least one voice command database are dynamic.

21. The method of claim 1, wherein the subset includes at least two voice commands.

22. The method of claim 1, wherein the first set of clinical data displayed is based upon an identification of a user.

23. The method of claim 1,

wherein the step of comparing the spoken command with a subset of available voice commands includes converting the spoken command into a spoken text string and comparing the spoken text string to a plurality of text strings in the voice command database.

24. The method of claim 23, wherein if the spoken text string matches one of the plurality of text strings in the voice command database, the method includes the step of returning a token corresponding to the spoken text string and comparing the token against a second database to determine if the second database has a matching function to the token.

25. The method of claim 24, wherein if the second database has a matching function to the received token, executing the function associated with said spoken command to control at least one of said controls in the display.

26. The method of claim 25, wherein the second database includes multiple dashboard functions for each token.

27. A medical computer system comprising:

at least one voice command database for storing at least two voice commands;

at least one clinical data database for storing clinical data,

a display, including a display area comprising a plurality of windows, the display having a plurality of controls for performing a plurality of functions and the display displaying some of the clinical data stored in the at least one clinical data database in the plurality of windows in the display area;

software executing on the computer system, the software executing on the computer system generating a subset of available voice commands based upon the data displayed in the plurality of windows displayed in the display area from a set of voice commands stored in at least one voice command database, the subset of available voice commands having fewer voice commands than the set of voice commands,

the software executing on the computer system receiving at least one new item of clinical data, displaying said at least one new item of clinical data in the first set windows, generating at least one new available voice command based on said at least one new item of clinical data and incorporating the at least one new available voice command into the subset of available voice commands; and

an audio input device, the audio input device able to receive a spoken command, such that upon receiving the spoken command, the software executing on the computer system compares the spoken command with the subset of available voice commands and executes a function associated with said spoken command if said spoken command corresponds to the subset of available voice commands.

28. The medical computer system of claim 27, wherein upon receiving the spoken command, the software executing on the computer converts the spoken command into a spoken text string and compares the spoken text string to a plurality of text strings in the voice command database.

29. The medical computer system of claim 28, wherein if the spoken text string matches one of the plurality of text strings in the voice command database, the method includes the step of returning a token corresponding to the spoken text string and comparing the token against a second database to determine if the second database has a matching function to the token.

30. The medical computer system of claim 29, wherein if the second database has a matching function to the received token, the method then executes the function associated with said spoken command to control at least one of said controls in the display.

31. The medical computer system of claim 30, wherein the second database controls multiple dashboard functions for each token.

32. The medical computer system of claim 27, wherein the token returned from the at least one voice command database corresponds to at least two different text strings.

33. The medical computer system of claim 27, wherein a particular control is associated with the spoken voice command.

34. The medical computer system of claim 27, wherein the software executing on the computer system includes software for speech recognition and software for interacting with the at least one voice command database and the at least one clinical data database.

35. The medical system of claim 27, wherein the subset includes at least two voice commands.

36. The medical computer system of claim 27, wherein the clinical data displayed in the display area is based upon the location of the user.

37. The medical computer system of claim 27, wherein the software executing on the computer system converts the spoken command into a spoken text string, compares the spoken text string to a plurality of text strings in the voice command database, and updates the subset of available voice commands with the spoken command.