Generating dialog recommendations for chat information systems based on user interaction and environmental data

• US 10,026,400 B2
• Filed: 06/27/2013
• Issued: 07/17/2018
• Est. Priority Date: 06/27/2013
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google LLC (Alphabet Inc.)
• Inventors: Gelfenbeyn, Ilya Gennadyevich, Goncharuk, Artem, Platonov, Ilya Andreevich, Sirotin, Pavel Aleksandrovich, Gelfenbeyn, Olga Aleksandrovna
• Primary Examiner(s): GUERRA-ERAZO, EDGAR X
• Application Number:
  US14/901,026
• Publication Number:
  US 20160217784A1
• Time in Patent Office: 1,846 Days
• Field of Search: 704 9, 704 10, 704235, 704246, 704270, 7042701, 704275
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G10L 13/00 Speech synthesis; Text to speech systems
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G10L 15/32 Multiple recognisers used in sequence or in parallel; Score combination systems therefor, e.g. voting systems
• CPC Class Codes: G10L 2015/225 Feedback of the input speech
• CPC Class Codes: G10L 2015/228 of application context

Abstract

Disclosed is the technology for dynamic and intelligent generation of dialog recommendations for the users of chat information systems based on multiple criteria. An example method may include receiving a speech-based user input, recognizing at least a part of the speech-based user input to generate a recognized input, and providing at least one response to the recognized input. The method may further include identifying at least one triggering event, generating at least one dialog recommendation based at least in part on the identification, and presenting the at least one dialog recommendation to a user via a user device.

Claims

1. A method for delivering dialog recommendations in a hardware-based chat information system (CIS), the method comprising:

receiving, by a processor operatively coupled to a memory, a speech-based user input;

recognizing, by the processor, at least a part of the speech-based user input to generate a recognized input;

providing, by the processor, at least one response to the recognized input, the at least one response provided for presentation via a user device in response to the speech-based user input;

monitoring, by the processor, for occurrence of at least one triggering event;

identifying, by the processor and based on the monitoring, the occurrence of the at least one triggering event, wherein identifying the occurrence of the at least one triggering event comprises recognizing one or more CIS operating modes, based on at least one of;

the one or more CIS operating modes having never been used by the user, and

the one or more CIS operating modes having not been used by the user over a predetermined period of time;

based at least in part on the identification, generating, by the processor, at least one dialog recommendation that is related to the at least one triggering event;

presenting, by the processor, the at least one dialog recommendation to a user via the user device, wherein the at least one dialog recommendation is presented via the user device separate from the at least one response;

receiving, by the processor after the presenting, either a selection of the dialog recommendation or a second speech-based user input that is based on a user speaking the at least one dialog recommendation; and

providing, by the processor, a corresponding response in response to the receiving, wherein the corresponding response corresponds to the at least one dialog recommendation, and wherein the corresponding response is provided when either of the selection or the second speech-based user input is received.

2. The method of claim 1, wherein the identifying of the at least one triggering event further includes recognizing, by the processor, one or more predetermined words in the recognized input.

3. The method of claim 1, wherein the identifying of the at least one triggering event further includes recognizing, by the processor, a type of user-CIS dialog context.

4. The method of claim 1, wherein the identifying of the at least one triggering event further includes recognizing, by the processor and based on the monitoring, one or more events associated with at least one social networking or blogging site.

5. The method of claim 1, further comprising:

determining, by the processor, a current time associated with the user device; and

wherein the identifying of the at least one triggering event is further based at least in part on the current time.

6. The method of claim 5, wherein the identifying of the at least one triggering event includes recognizing, by the processor and based on the monitoring, one or more calendar events scheduled within a predetermined time period from the current time.

7. The method of claim 1, further comprising:

determining, by the processor, a current geographical location associated with the user device; and

wherein the identifying of the at least one triggering event is further based at least in part on the current geographical location.

8. The method of claim 7, wherein the identifying of the at least one triggering event further includes establishing, by the processor and based on the monitoring, presence of the user device within a predetermined geographical area.

9. The method of claim 7, wherein the identifying of the at least one triggering event further includes recognizing, by the processor and based on the monitoring, presence of one or more peripheral electronic devices within a predetermined distance from the current geographical location associated with the user device.

10. The method of claim 1, wherein the identifying of the at least one triggering event further includes recognizing, by the processor and based on the monitoring, presence of the user device within one or more wireless networks.

11. The method of claim 1, wherein the identifying of the at least one triggering event further includes recognizing, by the processor and based on the monitoring, behavior similar to user-CIS interactions associated with at least one another user.

12. The method of claim 1, further comprising:

receiving, by the processor, the second speech-based user input, wherein the second speech-based user input is associated with the at least one dialog recommendation;

performing, by the processor, automatic speech recognition of at least a part of the second speech-based user input to generate a second recognized input; and

providing, by the processor, a second response to the second recognized input.

13. The method of claim 1, wherein the at least one dialog recommendation is delivered to the user device as an actionable message.

14. The method of claim 1, wherein the recognizing of the at least a part of the speech-based user input to generate a recognized input includes performing automatic speech recognition utilizing one or more speech recognizers.

15. The method of claim 14, wherein the one or more speech recognizers include one or more of the following:

a pattern-based speech recognizer, a free-dictation recognizer, an address book based recognizer, and a dynamically created recognizer.

16. A hardware-based chat information system (CIS), comprising:

a speech recognition module configured to receive a speech-based user input and recognize at least a part of the speech-based user input and generate a recognized input;

a dialog manager configured to generate at least one response to the recognized input;

an event manager configured to monitor for occurrence of at least one triggering event and, based on the monitoring, identify the occurrence of the at least one triggering event, wherein identifying the occurrence of the at least one triggering event comprises recognizing one or more CIS operating modes, based on at least one of;

the one or more CIS operating modes having never been used by the user, and

the one or more CIS operating modes having not been used by the user over a predetermined period of time;

a recommendation manager configured to generate at least one dialog recommendation based at least in part on the identification of the at least one triggering event, wherein the at least one dialog recommendation is related to the at least one triggering event; and

an output renderer configured to;

provide the at least one response, and provide the at least one dialog recommendation separate from the at least one response,

receive, after the providing, either a selection of the dialog recommendation or a second speech-based user input that is based on a user speaking the at least one dialog recommendation, and

provide a corresponding response in response to the receiving, wherein the corresponding response corresponds to the at least one dialog recommendation, and wherein the corresponding response is provided when either of the selection or the second speech-based user input is received.

17. The CIS of claim 16, wherein the output renderer includes a text-to-speech generator.

18. The CIS of claim 16, wherein the output renderer is configured to provide the at least one response as an audio message.

19. The CIS of claim 16, wherein the output renderer is configured to provide the at least one dialog recommendation as a text message or an image message.

20. The CIS of claim 16, wherein the speech recognition module includes a plurality of speech recognizers.

21. The CIS of claim 16, wherein at least one of the speech recognition module, the dialog manager, the event manager, and the recommendation manager is a distributed computing module.

22. The CIS of claim 16, wherein at least one of the speech recognition module, the dialog manager, the event manager, and the recommendation manager is a cloud computing module.

23. A non-transitory processor-readable medium having instructions stored thereon, which when executed by one or more processors, cause the one or more processors to implement a method for delivering dialog recommendations in a hardware-based chat information system (CIS), the method comprising:

receiving a speech-based user input;

recognizing at least a part of the speech-based user input to generate a recognized input;

providing, for presentation via a user device in response to the speech-based user input, at least one response to the recognized input;

monitoring for occurrence of at least one triggering event;

identifying at least one triggering event based on the monitoring, wherein identifying the occurrence of the at least one triggering event comprises recognizing one or more CIS operating modes, based on at least one of;

the one or more CIS operating modes having never been used by the user,

the one or more CIS operating modes having not been used by the user over a predetermined period of time;

based at least in part on the identification, generating at least one dialog recommendation that is related to the at least one triggering event;

presenting the at least one dialog recommendation to a user via the user device, wherein the at least one dialog recommendation is presented via the user device separate from the at least one response;

receiving either a selection of the dialog recommendation or a second speech-based user input that is based on a user speaking the at least one dialog recommendation; and

providing a corresponding response in response to the receiving, wherein the corresponding response corresponds to the at least one dialog recommendation, and wherein either of selecting the dialog recommendation and speaking the dialog recommendation causes a corresponding response to be provided.