Incorporating selectable application links into conversations with personal assistant modules

• US 10,291,565 B2
• Filed: 07/12/2016
• Issued: 05/14/2019
• Est. Priority Date: 05/17/2016
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google LLC (Alphabet Inc.)
• Inventors: Judd, Tilke, Adan, Yariv, Sabur, Zaheed, Behzadi, Behshad, Mirelmann, Lucas, Lamecki, Jan, Bakshi, Dhruv
• Primary Examiner(s): Zong, Ruolei
• Application Number:
  US15/207,821
• Publication Number:
  US 20170339088A1
• Time in Patent Office: 1,036 Days
• Field of Search: 709206
• CPC Class Codes: G06F 9/4843 by program, e.g. task dispatcher, supervisor, operating system
• CPC Class Codes: H04L 51/046 Interoperability with other network applications or services
• CPC Class Codes: H04L 51/18 Commands or executable codes
• CPC Class Codes: H04L 51/216 Handling conversation history, e.g. grouping of messages in sessions or threads
• CPC Class Codes: H04L 67/02 based on web technology, e.g. hypertext transfer protocol [HTTP]

Abstract

Methods, apparatus, systems, and computer-readable media are provided for: operating an instance of a personal assistant module to serve a user while the user operates the client computing device, wherein the instance of the personal assistant module has access to a persistent record of a message exchange thread between the user and instance(s) of the personal assistant module; detecting cue(s) emanating from the persistent message exchange thread; identifying candidate application(s) that are installed on a client computing device operated by the user, wherein the candidate application(s) are associated with content of the message exchange thread; and incorporating, into a transcript of the message exchange thread that is displayed in a graphical user interface rendered on the client computing device, selectable link( operable by the user to cause the client computing device to expose to the user an interface associated with a respective candidate application.

Claims

1. A computer-implemented method, comprising:

operating, by a client computing device operated by a user, an instance of a personal assistant module to serve the user while operating the client computing device, wherein the instance of the personal assistant module has access to a persistent transcript of a message exchange thread between the user and one or more instances of the personal assistant module;

rendering, by the instance of the personal assistant module, a graphical user interface that includes a persistent portion and an operable portion, wherein the persistent portion displays at least part of the persistent transcript of the message exchange thread, and the operable portion includes one or more graphical elements that are operable to incorporate content into the message exchange thread;

detecting, by the instance of the personal assistant module, one or more cues emanating from the message exchange thread, wherein the one or more cues trigger incorporation, into the message exchange thread, of one or more selectable links to one or more applications distinct from the instance of the personal assistant module;

and

selectively incorporating, by the instance of the personal assistant module based on one or more signals, into the operable portion of the graphical user interface, the one or more selectable links, wherein each selectable link is operable by the user to cause the client computing device to expose to the user an interface associated with a respective application of the one or more applications.

2. The computer-implemented method of claim 1, wherein the client computing device is one of a plurality of client computing devices operated by the user, and wherein each of the plurality of client computing devices is configured to operate a separate instance of the personal assistant module with access to the message exchange thread.

3. The computer-implemented method of claim 2, wherein the one or more cues comprise multiple messages incorporated into the message exchange thread by different client computing devices of the plurality of client computing devices.

4. The computer-implemented method of claim 1, wherein the one or more cues emanate from the content of the message exchange thread.

5. The computer-implemented method of claim 4, wherein the one or more cues include a keyword or phrase associated with a particular application.

6. The computer-implemented method of claim 1, further comprising identifying, by the instance of the personal assistant module, one or more candidate applications that are installed on the client computing device operated by the user, wherein the one or more candidate applications are associated with content of the message exchange thread, and wherein each selectable link is operable by the user to cause the client computing device to expose to the user an interface associated with a respective candidate application of the one or more candidate applications.

7. The computer-implemented method of claim 1, wherein the one or more signals comprises a history of interaction between the user and the particular application.

17. The computer-implemented method of claim 6, wherein the identifying is performed by one or more of the processors that is remote from the client computing device, and data indicative of the one or more selectable links is downloaded to the client computing device.

18. The computer-implemented method of claim 17, further comprising selecting, by the instance of the personal assistant module, a subset of the downloaded one or more selectable links for display based on one or more information signals.

19. The computer-implemented method of claim 18, wherein the one or more information signals comprise a frequency of use of the one or more candidate applications.

20. The computer-implemented method of claim 6, wherein the identifying is performed by one or more of the processors that is integral with the client computing device.

21. The computer-implemented method of claim 6, wherein the identifying comprises identifying, as a candidate application, a web browser installed on the client computing device in response to a determination that a given application associated with content of the message exchange thread is not installed on the client computing device;

and

wherein the selectively incorporating comprises selectively incorporating, into the operable portion or the persistent portion, a selectable link to an interactive webpage, wherein the interactive webpage includes functionality that corresponds to functionality of the given application that is not installed on the client computing device.

22. The computer-implemented method of claim 6, wherein the identifying comprises identifying, as a candidate application, a web browser installed on the client computing device in response to a determination that a given application associated with content of the message exchange thread is not installed on the client computing device;

and

wherein the selectively incorporating comprises selectively incorporating, into the operable portion or the persistent portion, a selectable link to a webpage associated with downloading an installer of the given application.

8. A system comprising one or more processors and memory storing instructions that, when executed by the one or more processors, cause the one or more processors to:

operate an instance of a personal assistant module to serve a user while the user operates a client computing device, wherein the instance of the personal assistant module has access to a persistent transcript of a message exchange thread between the user and one or more instances of the personal assistant module;

render, by the instance of the personal assistant module, a graphical user interface that includes a persistent portion and an operable portion, wherein the persistent portion displays at least part of the persistent transcript of the message exchange thread, and the operable portion includes one or more graphical elements that are operable to incorporate content into the message exchange thread;

detect one or more cues emanating from the persistent message exchange thread, wherein the one or more cues trigger incorporation, into the message exchange thread, of one or more selectable links to one or more applications distinct from the instance of the personal assistant module; and

selectively incorporate, into the operable portion of the graphical user interface, the one or more selectable links, wherein each selectable link is operable by the user to cause the client computing device to expose to the user an interface associated with a respective application of the one or more applications.

9. The system of claim 8, wherein the client computing device is one of a plurality of client computing devices operated by the user, and wherein each of the plurality of client computing devices is configured to operate a separate instance of the personal assistant module with access to the message exchange thread.

10. The system of claim 9, wherein the one or more cues comprise multiple messages incorporated into the message exchange thread by different client computing devices of the plurality of client computing devices.

11. The system of claim 8, further comprising instructions to identify one or more candidate applications that are installed on the client computing device operated by the user, wherein the one or more candidate applications are associated with content of the message exchange thread, and wherein each selectable link is operable by the user to cause the client computing device to expose to the user an interface associated with a respective candidate application of the one or more candidate applications;

wherein the identification is performed one or more of the processors that is remote from the given client computing device, and data indicative of the one or more selectable links is downloaded to the given client computing device.

12. The system of claim 11, further comprising instructions to select a subset of the downloaded one or more selectable links for display based on one or more information signals.

13. The system of claim 12, wherein the one or more information signals comprise a frequency of use of the one or more candidate applications.

14. The system of claim 8, wherein the one or more cues emanate from the content of the message exchange thread.

15. The system of claim 11, wherein the identification comprises identification, as a candidate application, of a web browser installed on the given client computing device in response to a determination that a given application associated with content of the message exchange thread is not installed on the given client computing device;

and

wherein the selective incorporation comprises selective incorporation, into the operable portion or the persistent portion, of a selectable link to an interactive webpage, wherein the interactive webpage includes functionality that corresponds to functionality of the given application that is not installed on the given client computing device.

16. At least one non-transitory computer-readable medium comprising instructions that, in response to execution of the instructions by a client computing device operated by a user, cause the client computing device to perform the following operations:

operating an instance of a personal assistant module to serve the user while the user operates the client computing device, wherein the instance of the personal assistant module has access to a persistent record of a message exchange thread between the user and one or more instances of the personal assistant module;

rendering, by the instance of the personal assistant module, a graphical user interface that includes a persistent portion and an operable portion, wherein the persistent portion displays at least part of the persistent transcript of the message exchange thread, and the operable portion includes one or more graphical elements that are operable to incorporate content into the message exchange thread;

detecting, by the instance of the personal assistant module, one or more cues emanating from the message exchange thread, wherein the one or more cues trigger incorporation, into the message exchange thread, of one or more selectable links to one or more applications distinct from the instance of the personal assistant module;

and

selectively incorporating, by the instance of the personal assistant module based on one or more signals, into the operable portion of the graphical user interface, the one or more selectable links, wherein each selectable link is operable by the user to cause the client computing device to expose to the user an interface associated with a respective application of the one or more applications.