Generating dialog recommendations for chat information systems based on user interaction and environmental data

• US 10,573,309 B2
• Filed: 05/30/2018
• Issued: 02/25/2020
• Est. Priority Date: 06/27/2013
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google LLC (Alphabet Inc.)
• Inventors: Gelfenbeyn, Ilya Gennadyevich, Goncharuk, Artem, Platonov, Ilya Andreevich, Sirotin, Pavel Aleksandrovich, Gelfenbeyn, Olga Aleksandrovna
• Primary Examiner(s): Guerra-Erazo, Edgar X
• Application Number:
  US15/993,434
• Publication Number:
  US 20180277115A1
• Time in Patent Office: 636 Days
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G10L 13/00 Speech synthesis; Text to speech systems
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G10L 15/32 Multiple recognisers used in sequence or in parallel; Score combination systems therefor, e.g. voting systems
• CPC Class Codes: G10L 2015/225 Feedback of the input speech
• CPC Class Codes: G10L 2015/228 of application context

Abstract

Disclosed is the technology for dynamic and intelligent generation of dialog recommendations for the users of chat information systems based on multiple criteria. An example method may include receiving a speech-based user input, recognizing at least a part of the speech-based user input to generate a recognized input, and providing at least one response to the recognized input. The method may further include identifying at least one triggering event, generating at least one dialog recommendation based at least in part on the identification, and presenting the at least one dialog recommendation to a user via a user device.

Claims

1. A method for delivering dialog recommendations in a chat information system (CIS), the method comprising:

receiving, by a processor operatively coupled to a memory, a speech-based user input provided via a user device;

recognizing, by the processor, at least a part of the speech-based user input to generate a recognized input;

providing, by the processor, at least one response to the recognized input;

monitoring, by the processor, for occurrence of one or more triggering events;

recognizing, by the processor based on the monitoring, an occurrence of at least one triggering event, wherein the at least one triggering event includes both of;

detecting presence of the user device within a local area wireless network, and

detecting presence of one or more peripheral electronic devices within a predetermined distance of the user device;

based at least in part on the recognizing the occurrence of the at least one triggering event, generating, by the processor, at least one dialog recommendation;

presenting, by the processor, the at least one dialog recommendation via the user device, wherein the at least one dialog recommendation is selectable via a graphical user interface of the user device;

receiving, by the processor, a selection of the at least one dialog recommendation via the graphical user interface; and

causing, by the processor in response to the user selection, a response to be presented via the user device, wherein the response is responsive to the selected at least one dialog recommendation.

2. The method of claim 1, wherein the at least one dialog recommendation is delivered to the user device as an actionable message.

3. The method of claim 2, further comprising:

generating, by the processor, the response to the user selection.

4. The method of claim 1, further comprising:

determining, by the processor, a current geographical location associated with the user device; and

wherein recognizing the presence of one or more peripheral electronic devices within a predetermined distance of the user device is based on the current geographical location associated with the user device.

5. The method of claim 1, wherein the recognizing of the at least a part of the speech-based user input to generate the recognized input includes performing automatic speech recognition utilizing one or more speech recognizers.

6. The method of claim 5, wherein the one or more speech recognizers include one or more of the following:

a pattern-based speech recognizer, a free-dictation recognizer, an address book based recognizer, and a dynamically created recognizer.

7. A chat information system (CIS), comprising:

at least one processor; and

at least one computer-readable storage device storing instructions that, when executed by the at least one processor, cause the at least one processor to;

receive a speech-based user input from a user device of a user;

recognize at least a part of the speech-based user input to generate a recognized input;

generate at least one response to the recognized input;

communicate with at least one web service to identify an occurrence of at least one triggering event based on;

behavior of an additional user that is in addition to the user, and

presence of the user device within a local area wireless network;

generate at least one dialog recommendation based at least in part on the identification of the occurrence of the at least one triggering event; and

provide the at least one response and the at least one dialog recommendation to the user via the user device as a selectable text message or a selectable image message,

wherein the at least one dialog recommendation is selectable via a graphical user interface of the user device, and, when the dialog recommendation is selected or spoken by the user, an action corresponding to the dialog recommendation is performed by the CIS.

8. The CIS of claim 7, wherein the web service is a social networking site.

9. The CIS of claim 8, wherein the behavior of the additional user includes a post, an event, or a status created on the social networking site by the additional user.

10. The CIS of claim 7, wherein the instructions to recognize at least the part of the speech-based user input to generate the recognized input include instructions to perform automatic speech recognition utilizing a text-to-speech generator.

11. The CIS of claim 7, wherein the instructions to provide the at least one response include instructions to provide the at least one response as an audio message.

13. The CIS of claim 7, wherein the occurrence of the at least one triggering event is further based on:

detecting presence of one or more peripheral electronic devices within a predetermined distance of the user device.

12. A non-transitory machine-readable medium having instructions stored thereon, which when executed by one or more processors, cause the one or more processors to implement a method for delivering dialog recommendations in a chat information system (CIS), the method comprising:

receiving a speech-based user input provided via a user device;

recognizing at least a part of the speech-based user input to generate a recognized input;

providing at least one response to the recognized input;

recognizing an occurrence of at least one triggering event, wherein the at least one triggering event includes both of;

detecting presence of the user device within a local area wireless network, and

detecting presence of one or more peripheral electronic devices within a predetermined distance of the user device;

based at least in part on the recognizing the occurrence of the at least one triggering event, generating at least one dialog recommendation;

presenting the at least one dialog recommendation via the user device, wherein the at least one dialog recommendation is selectable via a graphical user interface of the user device;

receiving a selection of the at least one dialog recommendation via the graphical user interface; and

causing, in response to the user selection, a response to be presented via the user device, wherein the response is responsive to the selected at least one dialog recommendation.