Virtual assistant focused user interfaces

• US 10,445,115 B2
• Filed: 04/18/2013
• Issued: 10/15/2019
• Est. Priority Date: 04/18/2013
• Status: Active Grant

• Current Assignee: Verint Americas Incorporated (Verint Systems Incorporated)
• Original Assignee: Verint Americas Incorporated (Verint Systems Incorporated)
• Inventors: Brown, Fred A, Miller, Tanya M, Morris, Richard
• Primary Examiner(s): Sax, Steven P
• Application Number:
  US13/865,789
• Publication Number:
  US 20140317502A1
• Time in Patent Office: 2,371 Days
• Field of Search: 715706
• CPC Class Codes: A61K 2039/5254 avirulent or attenuated
• CPC Class Codes: A61K 2039/575 humoral response
• CPC Class Codes: A61K 39/12 Viral antigens
• CPC Class Codes: C07K 16/1063 env, e.g. gp41, gp110/120, gp160, V3, PND, CD4 binding site
• CPC Class Codes: C07K 16/2812 against CD4
• CPC Class Codes: C12N 2740/16122 New viral proteins or individual genes, new structural or functional aspects of known viral proteins or genes
• CPC Class Codes: C12N 2740/16134 Use of virus or viral component as vaccine, e.g. live-attenuated or inactivated virus, VLP, viral protein
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/0486 Drag-and-drop
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G06F 9/453 Help systems
• CPC Class Codes: G06Q 10/02 Reservations, e.g. for tickets, services or events

Abstract

Conversation user interfaces that are configured for virtual assistant interaction may include contextual interface items that are based on contextual information. The contextual information may relate to a current or previous conversation between a user and a virtual assistant and/or may relate to other types of information, such as a location of a user, an orientation of a device, missing information, and so on. The conversation user interfaces may additionally, or alternatively, control an input mode based on contextual information, such as an inferred input mode of a user or a location of a user. Further, the conversation user interfaces may tag conversation items by saving the conversation items to a tray and/or associating the conversation items with indicators.

Claims

1. One or more non-transitory computer-readable storage media storing computer-readable instructions that, when executed, instruct one or more processors to perform operations comprising:

causing a conversation user interface to be presented by a mobile smart device to enable a conversation between a user of the mobile smart device and a virtual assistant implemented at least in part by the mobile smart device;

identifying contextual information that is related to the conversation between the user and the virtual assistant;

causing a first conversation item to be presented within the conversation user interface based at least in part on the contextual information;

causing a second conversation item to be presented partly behind the first conversation item so that a first portion of the second conversation item is hidden behind the first conversation item and a second portion of the second conversation item is displayed, the second conversation item representing a history of the conversation in a condensed format within the conversation user interface; and

receiving a selection of the second conversation item while the second conversation item is at least partially behind the first conversation item to present information in the second conversation item in the conversation user interface.

2. The one or more computer-readable storage media of claim 1, wherein the contextual information comprises at least one of a location of a user, an event associated with a user, environmental data obtained by a sensor of the smart device, a preference of the user, conversation history of the user with the virtual assistant in a current conversation, or conversation history of the user with virtual assistant in a previous conversation.

3. The one or more computer-readable storage media of claim 1, wherein:

the contextual information comprises event information related to a future event associated with the user; and

the first conversation item comprises information that is relevant to the future event associated with the user, the information being personalized for the user based on previous interactions of the user with the virtual assistant.

4. The one or more computer-readable storage media of claim 1, wherein:

the contextual information comprises input from the user that is received during a current conversation, the input from the user being open to multiple interpretations; and

the first conversation item comprises a mixed response information item that includes a first item that satisfies one of the multiple interpretations of the input of the user and a second item that satisfies another of the multiple interpretations of the input of the user.

5. The one or more computer-readable storage media of claim 4, wherein at least one of the first item of the mixed response information item or the second item of the mixed response information item comprises a selectable item to perform a task that satisfies at least one of the multiple interpretations.

6. The one or more computer-readable storage media of claim 1, wherein:

the contextual information comprises a portion of information that is needed for the virtual assistant to perform a task; and

the first conversation item comprises a missing information item that indicates that the portion of the information has been obtained and indicates that another portion of the information is needed for the virtual assistant to perform the task.

7. The one or more computer-readable storage media of claim 1, wherein:

the contextual information comprises an input mode that is currently used by the user to interact with the virtual assistant; and

the first conversation item comprises a suggestion item that suggests an alternative input mode to the input mode that is currently used by the user.

8. The one or more computer-readable storage media of claim 1, wherein:

the contextual information comprises collected information that has been collected during a current conversation between the user and the virtual assistant; and

the first conversation item comprises an information item that represents the collected information in a condensed format.

9. The one or more computer-readable storage media of claim 8, wherein the information item further represents information for a task that has been performed by the virtual assistant based on the collected information.

10. The one or more computer-readable storage media of claim 1, wherein:

the contextual information identifies an orientation of the smart device; and

the first conversation item is presented based at least in part on the orientation of the smart device.

11. The one or more computer-readable storage media of claim 10, wherein the one or more contextual conversation items are scrollable in a horizontal direction within the conversation user interface when the identified orientation of the smart device is a portrait orientation.

12. The one or more computer-readable storage media of claim 10, wherein the first conversation item is presented on a timeline when the identified orientation of the smart device is a landscape orientation.

13. The one or more computer-readable storage media of claim 10, wherein the first conversation item comprises one or more option items representing options for the user.

14. The one or more computer-readable storage media of claim 1, wherein the first conversation item comprises:

an information item that provides information that is relevant to a future event associated with the user, the information being personalized for the user based on previous interactions of the user with the virtual assistant;

a mixed response information item that includes a first item that satisfies one of multiple interpretations of input of the user and a second item that satisfies another of the multiple interpretations of the input of the user;

a missing information item that indicates a portion of information that has been obtained by the virtual assistant to perform a task and indicates another portion of the information that is needed for the virtual assistant to perform the task;

a suggestion item that suggests an alternative input mode to an input mode that has been used by the user;

a conversation item that is tagged by the user; and

an input mode item for receiving input from the user according to an inferred mode of input of the user.