Voice assistant system

• US 10,431,220 B2
• Filed: 11/10/2017
• Issued: 10/01/2019
• Est. Priority Date: 08/07/2008
• Status: Active Grant

• Current Assignee: Vocollect, Inc. (Honeywell International Inc.)
• Original Assignee: Vocollect, Inc. (Honeywell International Inc.)
• Inventors: Emerick, Charles Thomas, Logan, James R., Bates, Richard Anthony, Wahl, James
• Primary Examiner(s): Godbold, Douglas
• Application Number:
  US15/809,299
• Publication Number:
  US 20180151179A1
• Time in Patent Office: 690 Days
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G16H 10/20 for electronic clinical trials or questionnaires
• CPC Class Codes: G16H 20/40 relating to mechanical, radiation or invasive therapies, e.g. surgery, laser therapy, dialysis or acupuncture
• CPC Class Codes: G16H 20/70 relating to mental therapies, e.g. psychological therapy or autogenous training
• CPC Class Codes: G16H 40/20 for the management or administration of healthcare resources or facilities, e.g. managing hospital staff or surgery rooms
• CPC Class Codes: G16H 40/67 for remote operation

Abstract

Methods and apparatuses to assist a user in the performance of a plurality of tasks are provided. The invention includes storing at least one care plan for a resident, the care plan defining a plurality of tasks to be performed for providing care to the resident. The method includes capturing speech inputs from the user and providing speech outputs to the user to provide a speech dialog with the user reflective of the care plan. Information is captured with a contactless communication interface and is used for engaging the care plan.

Claims

1. A method, comprising:

receiving, at a voice assistant system, a care plan individualized for a resident, the care plan defining a task to be performed by a user to provide care to the resident, wherein the care plan is automatically identified by scanning a contactless communication tag associated with the resident when the user approaches the resident;

storing the received care plan at the voice assistant system;

capturing, by the voice assistant system, a speech input from the user;

providing, based on the captured speech input and the care plan, a speech dialog to the user;

providing, via the speech dialog, a speech output to the user, wherein the speech output includes instructions for the task to be performed for engaging the care plan for the resident;

receiving an input from the user, wherein the input is associated with a request to turn off the speech dialog;

and

turning off the speech dialog in response to the input from the user.

2. The method of claim 1, comprising:

determining if the voice assistant system can connect to an available network;

in response to the determination that the voice assistant system can connect to the available network, connecting the voice assistant system to the available network and transmitting the captured speech input, and/or stored care plan over the available network; and

in response to a determination that the voice assistant system cannot connect to the available network, storing the captured speech input, and/or updating the stored care plan.

3. The method of claim 1, comprising:

determining if the voice assistant system can connect to an available network; and

in response to the determination that the voice assistant system can connect to the available network, connecting the voice assistant system to the available network and receiving updates to the care plan via the available network.

4. The method of claim 1, comprising:

determining if the voice assistant system can connect to an available network; and

in response to the determination that the voice assistant system can connect to the available network, connecting the voice assistant system to the available network and receiving updates to the care plan via the available network.

5. The method of claim 1, comprising:

determining if the voice assistant system can connect to an available network; and

in response to the determination that the voice assistant system can connect to the available network, connecting the voice assistant system to the available network and receiving real-time updates to the care plan via the available network.

6. The method of claim 1, comprising:

determining if the voice assistant system can connect to an available network; and

in response to the determination that the voice assistant system can connect to the available network, connecting the voice assistant system to the available network and transmitting the captured speech input, and/or stored care plan over the available network in near real-time and/or in a delayed manner.

7. An apparatus, comprising:

a microphone for capturing a speech input from a user;

a speaker for providing a speech output to the user;

a processor;

a memory; and

program code resident in the memory and configured to be executed by the processor to assist the user for providing care to a resident by;

storing, in the memory, a care plan for the resident, the care plan defining a task to be performed by the user to provide care to the resident, wherein the care plan is automatically identified by reading a contactless communication tag associated with the resident when the user approaches the resident;

providing, based on the captured speech input and the care plan, a speech dialog to the user;

providing, via the speech dialog, the speech output to the user, wherein the speech output includes instructions for the task to be performed for engaging the care plan for the resident;

receiving an input from the user to turn off the speech dialog;

and

turning off the speech dialog in response to the input from the user.

8. The apparatus of claim 7, wherein the program code is configured to be executed by the processor to assist the user for providing care to the resident by:

determining if the apparatus can connect to an available network;

in response to the determination that the apparatus can connect to the available network, connecting the apparatus to the available network and transmitting the captured speech input, and/or stored care plan over the available network; and

in response to a determination that the apparatus cannot connect to the available network, storing the storing the captured speech input, and/or updating the stored care plan.

9. The apparatus of claim 7, wherein the program code is configured to be executed by the processor to assist the user for providing care to the resident by:

determining if the apparatus can connect to an available network;

in response to the determination that the apparatus can connect to an available network, connecting the apparatus to the available network and receiving updates to the care plan via the available network.

10. The apparatus of claim 7, wherein the program code is configured to be executed by the processor to assist the user for providing care to the resident by:

determining if the apparatus can connect to an available network;

in response to the determination that the apparatus can connect to an available network, connecting the apparatus to the available network and receiving updates to the care plan via the available network.

11. The apparatus of claim 7, wherein the program code is configured to be executed by the processor to assist the user for providing care to the resident by:

determining if the apparatus can connect to an available network;

in response to the determination that the apparatus can connect to an available network, connecting the apparatus to the available network and receiving real-time updates to the care plan via the available network.

12. The apparatus of claim 7, wherein the program code is configured to be executed by the processor to assist the user for providing care to the resident by:

determining if the apparatus can connect to an available network;

in response to the determination that the apparatus can connect to an available network, connecting the apparatus to the available network and transmitting the captured speech input, and/or stored care plan over the available network in real-time.

13. The apparatus of claim 7, wherein the program code is configured to be executed by the processor to assist the user for providing care to the resident by:

determining if the apparatus can connect to an available network;

in response to the determination that the apparatus can connect to an available network, connecting the apparatus to the available network and transmitting the captured speech input, and/or stored care plan over the available network in near real-time and/or in a delayed manner.

14. A mobile device, comprising:

a microphone for capturing a speech input from a user;

a speaker for providing a speech output to the user;

a network interface;

a processor;

a memory; and

program code resident in the memory and configured to be executed by the processor to assist the user for providing care to a resident by;

storing, in the memory, a care plan for the resident, the care plan defining a task to be performed by the user to provide care to the resident, wherein the care plan is automatically identified by reading a contactless communication tag associated with the resident when the user approaches the resident;

providing, based on the captured speech input and the care plan, a speech dialog to the user;

providing, via the speech dialog, the speech output to the user, wherein the speech output includes instructions for the task to be performed for engaging the care plan for the resident;

receiving an input from the user to turn off the speech dialog;

and

turning off the speech dialog in response to the input from the user.

15. The mobile device of claim 14, wherein the program code is configured to be executed by the processor to assist the user for providing care to the resident by:

in response to a determination that the mobile device can connect to an available network, connecting the mobile device to the available network and transmitting the captured speech input, and/or stored care plan over the available network.

16. The mobile device of claim 14, wherein the program code is configured to be executed by the processor to assist the user with for providing care to the resident by:

in response to a determination that the mobile device can connect to an available network, connecting the mobile device to the available network and receiving updates to the care plan via the available network.

17. The mobile device of claim 14, wherein the program code is configured to be executed by the processor to assist the user for providing care to the resident by:

in response to a determination that the mobile device can connect to an available network, connecting the mobile device to the available network and receiving updates to the care plan via the available network.

18. The mobile device of claim 14, wherein the program code is configured to be executed by the processor to assist the user for providing care to the resident by:

in response to a determination that the mobile device can connect to an available network, connecting the mobile device to the available network and receiving real-time updates to the care plan via the available network.

19. The mobile device of claim 14, wherein the program code is configured to be executed by the processor to assist the user for providing care to the resident by:

in response to a determination that the mobile device can connect to an available network, connecting the mobile device to the available network and transmitting the captured speech input, and/or stored care plan over the available network in real-time.

20. The mobile device of claim 14, wherein the program code is configured to be executed by the processor to assist the user for providing care to the resident by:

in response to a determination that the mobile device can connect to an available network, connecting the mobile device to the available network and transmitting the captured speech input, and/or stored care plan over the available network in near real-time and/or in a delayed manner.