VOICE ASSISTANT SYSTEM

• US 20100036667A1
• Filed: 08/06/2009
• Published: 02/11/2010
• Est. Priority Date: 08/07/2008
• Status: Active Grant

• Current Assignee: Vocollect, Inc. (Honeywell International Inc.)
• Original Assignee: Vocollect Healthcare Systems, Inc. (Honeywell International Inc.)
• Inventors: Winters, Christopher M., Tellish, Kathleen A., Byford, Roger Graham, Logan, James R., Shearon, James E., Findlay, David M., Laughery, Michael, Mellott, Mark B.
• Granted Patent: US 8,255,225 B2
• Time in Patent Office: Days
• US Class Current: 704/270
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G16H 10/20 for electronic clinical trials or questionnaires
• CPC Class Codes: G16H 20/40 relating to mechanical, radiation or invasive therapies, e.g. surgery, laser therapy, dialysis or acupuncture
• CPC Class Codes: G16H 20/70 relating to mental therapies, e.g. psychological therapy or autogenous training
• CPC Class Codes: G16H 40/20 for the management or administration of healthcare resources or facilities, e.g. managing hospital staff or surgery rooms
• CPC Class Codes: G16H 40/67 for remote operation

Abstract

Methods and apparatuses to assist a user in the performance of a plurality of tasks are provided. The method may comprise storing at least one care plan in a voice assistant, the care plan defining a plurality of tasks to be performed, capturing speech input from the user, determining, from the speech input, a selected interaction with a care plan, and in response to the selected interaction, providing a speech dialog with the user reflective of the care plan. Alternatively, the method may comprise capturing speech input from a user, determining from the speech input, a first weight associated with a resident, associating the first weight with a care plan in turn associated with the resident, comparing the first weight to a second weight associated with the resident and the care plan, and providing a speech dialog regarding reweighting the resident based on the comparison.

Claims

1. A method of assisting a user in the performance of a plurality of tasks, the method comprising;

storing at least one care plan in a voice assistant device carried by a user, the care plan defining a plurality of tasks to be performed by the user as part of a workflow,

capturing speech input from the user with the voice assistant device;

determining, from the speech input, a selected interaction with a care plan, and

in response to the selected interaction, providing a speech dialog with the user through the voice assistant device that is reflective of the care plan.

2. The method of claim 1, wherein the care plan includes a plurality of selectable parameters and further comprising determining from the speech input a selected interaction with one or more selectable parameters of the care plan.

3. The method of claim 1, wherein the care plan is associated with care provision for a resident of at least one of a care facility or medical facility.

4. The method of claim 3, wherein a selected interaction with the care plan provides assistance to the user in documenting at least one of the care or treatment of the resident.

5. The method of claim 1, wherein the speech dialog assists with identifying information to be input through speech input of the user.

6. The method of claim 1, wherein the speech dialog includes an interrogatory for identifying information to be input through speech input of the user.

7. The method of claim 1, further comprising:

in response to activation of the voice assistant device, requesting any care plans associated with the user for performance by the user.

8. The method of claim 1, wherein the speech input is an interrogatory selected from the group of interrogatories consisting of an interrogatory regarding at least one resident cared for by the user, an interrogatory regarding at least one resident that needs their vital signs documented, an interrogatory regarding at least one resident that is associated with an update, an interrogatory regarding at least one resident that needs restorative care, an interrogatory regarding at least one resident that needs care, an interrogatory regarding at least one resident that needs bathing, an interrogatory regarding the most important tasks currently assigned to the user, an interrogatory regarding recent changes to at least one of tasks or at least one resident currently assigned to the user, an interrogatory regarding tasks that are yet to be completed that are in turn associated with the user an interrogatory regarding tasks that are scheduled that are in turn associated with the user, an interrogatory regarding the identity of another user assigned to at least one resident or an interrogatory regarding the contents of a shift report from a previous shift.

9. The method of claim 1, wherein the speech input includes an interrogatory that includes at least one situational awareness question to make a user aware of the tasks of their workflow, the method further comprising answering the situational awareness question with a speech dialog.

10. The method of claim 1, further comprising:

in response to the voice assistant device determining that there is an outstanding page associated with the user, providing a page earcon to the user indicating the outstanding page for the user.

11. The method of claim 10, wherein the page earcon includes at least one of a page tone or a speech dialog indicating the number of outstanding pages for the user.

12. The method of claim 11, further comprising:

determining, from an additional speech input of the user captured by the voice assistant device, an interaction to play the outstanding page; and

in response to determining the interaction to play the outstanding page, playing the outstanding page audibly for the user.

13. The method of claim 1, further comprising:

in response to the voice assistant device determining that there is an outstanding reminder associated with the user, providing a reminder earcon to the user indicating the outstanding reminder for the user.

14. The method of claim 13, wherein the reminder earcon includes at least one of a reminder tone or a speech dialog indicating the number of outstanding reminders for the user.

15. The method of claim 13, further comprising:

determining, from an additional speech input of the user captured by the voice assistant device, an interaction to play the outstanding reminder; and

in response to determining the interaction to play the outstanding reminder, playing the outstanding reminder.

16. The method of claim 1, further comprising:

in response to the voice assistant device determining that there are no outstanding reminders or pages associated with the user, providing an all clear earcon to the user indicating that there are no outstanding reminders or pages associated with the user.

17. The method of claim 16, wherein the all clear earcon includes at least one of an all clear tone or a speech dialog indicating that there are no outstanding reminders or pages associated with the user.

18. The method of claim 1, further comprising:

dynamically receiving, with the voice assistant device, at least one update to a care plan, and

in response to receiving the at least one update, providing a page ea con to the user indicating receipt of the at least one update.

19. The method of claim 18, wherein the page earcon includes at least one of a page tone or a speech dialog indicating the receipt of the at least one update.

20. The method of claim 1, wherein the selected interaction includes a command for engaging at least one care plan.

21. The method of claim 20, wherein the command is a command selected from the group of commands consisting of a selection command, a document command, a review command, a record command, a page command, or a general command.

22. The method of claim 1, wherein the selected interaction is a document command for documenting a first weight of a resident, and wherein the speech dialog is an interrogatory regarding verification that the user is documenting the first weight of the resident.

23. The method of claim 22, further comprising:

determining, from an additional speech input of the user captured by the voice assistant device, the first weight of the resident;

comparing the determined first weight to a second weight for the resident; and

providing a speech dialog regarding reweighing the resident based on the comparison of the first weight and the second weight.

24. The method of claim 23, wherein comparing the determined first weight to a second weight for the resident includes:

calculating a difference between the first weight and the second weight; and

comparing the difference to a predetermined value.

25. The method of claim 24, further comprising:

in response to determining that the difference exceeds the predetermined value) providing a speech dialog with the user regarding reweighing the resident.

26. The method of claim 24, further comprising:

in response to determining that the difference does not exceed the predetermined value providing a speech dialog with the user indicating the first weight.

27. The method of claim 23, further comprising:

determining whether an additional speech input of the user captured by the voice assistant is associated with a valid weight.

28. The method of claim 27, further comprising:

in response to determining that the additional speech input is not associated with a valid weight, providing an additional speech dialog indicating that the second speech input is associated with an invalid weight.

29. The method of claim. 27, further comprising:

in response to determining that the additional speech input is associated with a valid weight, providing an additional speech dialog indicating that the additional speech input is associated with a valid weight.

30. The method of claim 1, wherein determining a selected interaction with a care plan from the speech input of the user includes:

receiving the speech input of the user;

converting the speech input of the user into machine readable input; and

processing the machine readable input to determine whether there is a selected interaction with the care plan.

31. A method of assisting a user with a plurality of tasks, the method comprising:

capturing speech input from a user with a voice assistant device;

determining, from the captured speech input of the user, a first weight associated with a resident;

associating the first weight with a care plan using the voice assistant device, the care plan being associated with the resident;

comparing the first weight to a second weight for the resident, the second weight associated with the resident and the care plan; and

providing a speech dialog regarding reweighing the resident based on the comparison of the first weight and the second weight.

32. The method of claim 31, wherein comparing the determined first weight to a second weight for the resident includes:

calculating a difference between the first weight and the second weight; and

comparing the difference to a predetermined value.

33. The method of claim 32, further comprising:

in response to determining that the difference exceeds the predetermined value, providing a speech dialog with the user regarding reweighing the resident.

34. The method of claim 32, further comprising:

in response to determining that the difference does not exceed the predetermined value, providing a speech dialog to the user indicating the first weight.

35. The method of claim 31, further comprising:

determining whether an additional speech input of the user captured by the voice assistant is associated with a valid weight.

36. The method of claim 35, further comprising:

in response to determining that the additional speech input is not associated with a valid weight, providing an additional speech dialog indicating that the second speech input is associated with an invalid weight.

37. The method of claim 35, farther comprising:

in response to determining that the additional speech input is associated with a valid weight, providing and additional speech dialog indicating that the additional speech input is associated with a valid weight.

38. The method of claim 31, wherein determining the first weight associated with the resident includes:

receiving the speech input of the user;

converting the speech input of the user into machine readable input; and

processing the machine readable input to determine the first weight.

39. An apparatus, comprising:

a microphone;

a speaker;

a processor;

a memory; and

program code resident in the memory and configured to be executed by the processor to assist a user with a plurality of tasks by storing at least one care plan in the memory, the care plan defining a plurality of tasks to be performed by a user as part of a workflow, the program code further configured to determine a selected interaction with a care plan from speech input of the user that is captured by the microphone and to provide a speech dialog with the user through the speaker in response to the selected interaction, the speech dialog being associated with the care plan.

40. The apparatus of claim 39, wherein the care plan includes a plurality of selectable parameters and the program code is further configured for determining from the speech input a selected interaction with one or more selectable parameters of the care plan.

41. The apparatus of claim 39, wherein the care plan is associated with at least one resident of a care facility or medical facility.

42. The apparatus of claim 41, wherein the care plan assists the user in documenting at least one of the cafe or treatment of the resident.

43. The apparatus of claim 39, wherein the speech dialog assists with identifying information to be input to the apparatus through speech input of the user.

44. The apparatus of claim 39, wherein the speech dialog includes an interrogatory for identifying information to be input through speech input of the user.

45. The apparatus of claim 39, wherein the program code is further configured to request any care plans associated with the user in response to activation of the apparatus.

46. The apparatus of claim 39, wherein the speech input is an interrogatory selected from the group of interrogatories consisting of:

an interrogatory regarding at least one resident cared for by the user, an interrogatory regarding at least one resident that needs their vital signs documented, an interrogatory regarding at least one resident that is associated with an update, an interrogatory regarding at least one resident that needs restorative care, an interrogatory regarding at least one resident that needs care, an interrogatory regarding at least one resident that needs bathing, an interrogatory regarding the most important tasks currently assigned to the user, an interrogatory regarding recent changes to at least one of tasks or at least one resident currently assigned to the user, an interrogatory regarding tasks that are yet to be completed that are in turn associated with the user, an interrogatory regarding tasks that are scheduled that are in turn associated with the user, an interrogator regarding the identity of another user assigned to at least one resident, or an interrogatory regarding the contents of a shift report from a previous shift.

47. The apparatus of claim 39, wherein the speech input of the user includes an interrogatory that includes at least one situational awareness question to make a user aware of the tasks of their workflow, the program code farther configured to answer the situational awareness question with a speech dialog.

48. The apparatus of claim 39, wherein the program code is further configured to provide a page earcon through the speaker to indicate an outstanding page for the user in response to determining that there is an outstanding page associated with the user.

49. The apparatus of claim 48, wherein the page earcon includes at least one of a page tone or a speech dialog indicating the number of outstanding pages for the user.

50. The apparatus of claim 48, wherein the program code is further configured to determine, from an additional speech input of the user captured by the microphone, an interaction to play the outstanding page and to play the outstanding page in response to determining the interaction to play the outstanding page.

51. The apparatus of claim 39, wherein the program code is further configured to provide a reminder earcon through the speaker to indicate an outstanding reminder for the user in response to determining that there is an outstanding reminder associated with the user.

52. The apparatus of claim 51, wherein the reminder earcon includes at least one of a reminder tone or a speech dialog indicating the number of outstanding reminders for the user.

53. The apparatus of claim 51, wherein the program code is further configured to determine, from an additional speech input of the user captured by the microphone, an interaction to play the outstanding reminder and to play the outstanding reminder in response to determining the interaction to play the outstanding reminder.

54. The apparatus of claim 39, wherein the program code is further configured to provide an all clear earcon to the user through the speaker to indicate that there are no outstanding reminders or pages associated with the user in response to the determining that there are no outstanding reminders or pages associated with the user.

55. The apparatus of claim 54, wherein the all clear earcon includes at least one of an all clear tone or a speech dialog indicating that there are no outstanding reminders or pages associated with the user.

56. The apparatus of claim 39, wherein the program code is further configured to dynamically receive at least one update to the care plan and, in response, to provide a page earcon to the user to indicate the receipt of the at least one update.

57. The apparatus of claim 56, wherein the page earcon includes at least one of a page tone or a speech dialog indicating the receipt of the at least one update.

58. The apparatus of claim 39, wherein the selected interaction includes a command for engaging at least one care plan.

59. The apparatus of claim 58, wherein the command is a command selected from the group of commands consisting of a selection command, a document command, a review command, a record command, a page command, or a general command.

60. The apparatus of claim 59, wherein the selected interaction is a document command for documenting a first weight of a resident, and wherein the speech dialog is an interrogatory regarding verification that the user is documenting the first weight of the resident.

61. The apparatus of claim 39, the program code further configured to determine, from an additional speech input of the user captured by the microphone, the first weight of the resident, to compare the determined first weight to a second weight for the resident, and to provide a speech dialog regarding reweighing the resident based on the comparison of the first weight and the second weight.

62. The apparatus of claim 61, wherein the program code is further configured to calculate a difference between the first weight and the second weight and compare the difference to a predetermined value.

63. The apparatus of claim 62, wherein the program code is further configured to provide all additional speech dialog to the user suggesting that the user reweigh the resident in response to determining that the difference exceeds the predetermined value.

64. The apparatus of claim 62, wherein the program code is further configured to provide an additional speech dialog to the user indicating the first weight in response to determining that the difference does not exceed the predetermined value.

65. The apparatus of claim 61, wherein the program code is further configured to determine whether an additional speech input of the user captured by the voice assistant is associated with a valid weight.

66. The apparatus of claim 65, wherein the program code is further configured to provide an additional speech dialog indicating that the additional speech input is associated with an invalid weight in response to determining that the additional speech input is not associated with a valid weight.

67. The apparatus of claim 65, wherein the program code is further configured to provide an additional speech dialog indicating that the additional speech input is associated with a valid weight in response to determining that the additional speech input is associated with a valid weight.

68. The apparatus of claim 39, wherein the program code is further configured to receive the speech input of the user, convert the speech input of the user into machine readable input, and process the machine readable input to determine whether there is interaction with the selectable parameter of the care plan.

69. An apparatus, comprising:

a microphone;

a speaker;

a processor;

a memory; and

program code resident in the memory and configured to be executed by the processor to assist a user with a plurality of tasks by determining, from speech input of a user captured by the microphone, a first weight associated with a resident, associating the first weight with a care plan that is associated with the resident, comparing the first weight to a second weight for the resident, the second weight associated with the resident and the care plane and providing a speech dialog regarding reweighing the resident based on the comparison of the first weight and the second weight.

70. The apparatus of claim 69, wherein the program code is further configured to calculate a difference between the first weight and the second weight and compare the difference to a predetermined value.

71. The apparatus of claim 70, wherein the program code is farther configured to provide a speech dialog to the user suggesting that the user reweigh the resident in response to determining that the difference exceeds the predetermined value.

72. The apparatus of claim 70, wherein the program code is further configured to provide a speech dialog to the user indicating the first weight in response to determining that the variance does not exceed the predetermined value.

73. The apparatus of claim 69, wherein the program code is further configured to determine whether an additional speech input of the user captured by the voice assistant is associated with a valid weight.

74. The apparatus of claim 73, wherein the program code is further configured to provide an additional speech dialog indicating that the additional speech input is associated with an invalid weight in response to determining that the additional speech input is not associated with a valid weight.

75. The apparatus of claim 73, wherein the program code is further configured to provide an additional speech dialog indicating that the additional speech input is associated with a valid weight in response to determining that the additional speech input is not associated with a valid weight.

76. The apparatus of claim 69, wherein the program code is farther configured to receive the speech input of the user, convert the speech input of the user into machine readable input, and process the machine readable input to determine the first weight.