SUGGESTED ITEMS FOR USE WITH EMBEDDED APPLICATIONS IN CHAT CONVERSATIONS

• US 20180367484A1
• Filed: 06/15/2017
• Published: 12/20/2018
• Est. Priority Date: 06/15/2017
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: RODRIGUEZ, Adam, CHEN, Rendong, HORN, Thomas, LEI, Florbela, LAUNAY, Yohan, CHUANG, Chen-Ting, ZHU, Bin
• Granted Patent: US 10,348,658 B2
• Time in Patent Office: Days
• CPC Class Codes: G06Q 10/101 Collaborative creation, e.g. joint development of products or services
• CPC Class Codes: H04L 51/02 using automatic reactions or user delegation, e.g. automatic replies or chatbot-generated messages
• CPC Class Codes: H04L 51/063 Content adaptation, e.g. replacement of unsuitable content
• CPC Class Codes: H04L 51/10 Multimedia information
• CPC Class Codes: H04L 65/1069 Session establishment or de-establishment
• CPC Class Codes: H04L 65/1093 by adding participants; by removing participants
• CPC Class Codes: H04L 65/403 Arrangements for multi-party communication, e.g. for conferences data switching systems for conference H04L12/18; arrangements for connecting several subscribers to a common circuit, i.e. affording conference facilities H04M3/56; television conferencing systems H04N7/15
• CPC Class Codes: H04L 65/762 at the source reformatting of additional data in video distribution servers H04N21/2355
• CPC Class Codes: H04L 67/75 Indicating network or usage conditions on the user display

Abstract

Implementations relate to suggested items for use with embedded applications in chat conversations. In some implementations, a method includes causing a chat interface to be displayed by a first user device, the chat interface generated by a messaging application. The chat interface is configured to display, in a chat conversation, messages provided by user devices participating in the chat conversation over a network. An embedded interface is associated with the chat interface and displayed by an embedded application associated with the messaging application. A suggestion event is determined to occur in association with the embedded application based on received data that indicates that a particular event has occurred at one or more other user devices participating in the chat conversation. Suggested response items are obtained based on the suggestion event, and the suggested response items are displayed by the first user device.

Claims

1. A computer-implemented method to provide suggested items, the computer-implemented method comprising:

causing a chat interface to be displayed by a first user device, wherein the chat interface is generated by a messaging application, and wherein the chat interface is configured to display one or more messages in a chat conversation, wherein the one or more messages are provided by a plurality of user devices that are participating in the chat conversation over a network;

causing an embedded interface to be displayed associated with the chat interface, wherein the embedded interface is provided by a first embedded application that executes at least in part on the first user device in association with the messaging application;

determining that a suggestion event has occurred in association with the first embedded application based on received data that indicates that a particular event has occurred at one or more of the plurality of user devices that are participating in the chat conversation, wherein the one or more of the plurality of user devices are different than the first user device;

obtaining one or more suggested response items based on the suggestion event; and

causing the one or more suggested response items to be displayed by the first user device.

2. The computer-implemented method of claim 1 wherein the particular event includes at least one of:

user input received by an associated chat interface of the one or more of the plurality of user devices;

user input received by an associated embedded interface of the one or more of the plurality of user devices; and

an embedded application event occurring in an associated embedded application executing on the one or more of the plurality of user devices.

3. The computer-implemented method of claim 1 wherein the received data that indicates that the particular event has occurred indicates at least one of:

a type of content feature displayed in a media item being played by the one or more of the plurality of user devices;

achievement of a predefined objective in a game of the one or more of the plurality of user devices;

user input received by a receiving user device participating in the chat conversation, wherein the user input is received in a different embedded interface displayed on the receiving user device; and

initiation of the embedded application from a particular user device of the plurality of user devices.

4. The computer-implemented method of claim 1 wherein the particular event includes one or more messages input to the chat conversation by respective users of the one or more of the plurality of user devices, wherein the suggestion event is determined based on detecting at least one of one or more predefined topics, words, and phrases in the one or more messages.

5. The computer-implemented method of claim 1 wherein obtaining one or more suggested response items based on the suggestion event includes determining at least one suggested response item of the one or more suggested response items based on at least one of:

one or more predefined associations of the at least one suggested response item with the suggestion event;

a model trained with particular suggestion events and responses input in response to the particular suggestion events; and

one or more of a plurality of rules and objectives used in a game provided by the embedded application.

6. The computer-implemented method of claim 1 further comprising:

receiving user input indicative of user selection of a selected suggested response item from the one or more suggested response items; and

outputting a selected message in the chat conversation, the selected message associated with the selected suggested response item.

7. The computer-implemented method of claim 1 wherein the one or more suggested response items include one or more text messages that indicate user reactions to the suggestion event.

8. The computer-implemented method of claim 1 further comprising:

receiving user input indicative of selection of a selected suggested response item from the one or more suggested response items; and

in response to the user input, providing a command to the first embedded application, wherein the command is associated with the selected suggested response item, wherein the command causes a change in state of the first embedded application, wherein the change in state is indicated to one or more other user devices of the plurality of user devices that are participating in the chat conversation.

9. The computer-implemented method of claim 8 wherein the command to the first embedded application includes at least one of:

a first command to perform an action in a game implemented by the first embedded application;

a second command to change a playback position in playback of media data by the first embedded application; and

a third command to change a shared object provided by the first embedded application.

10. The computer-implemented method of claim 1 wherein the one or more suggested response items include one or more suggested commands to the first embedded application and one or more suggested messages to be output to the chat conversation in the chat interface, wherein the one or more suggested commands are visually distinguished from the one or more suggested messages when displayed in the chat interface.

11. The computer-implemented method of claim 1 wherein the one or more suggested response items are determined by at least one of:

the first embedded application;

the messaging application; and

a remote server in communication with the messaging application over the network.

12. The computer-implemented method of claim 1 wherein the first embedded application is a media player application causing displayed playback of video data in the embedded interface, wherein the embedded interface is configured to receive input from a user that controls the displayed playback of the video data, and wherein at least one of the one or more suggested response items includes one or more suggested playback commands operative to adjust the displayed playback of the video data.

13. The computer-implemented method of claim 1 wherein the first embedded application is a game application causing display of game data in the embedded interface, wherein the embedded interface is configured to receive input from a user that changes one or more states of the game application, and wherein at least one of the one or more suggested response items includes one or more suggested commands operative to modify at least one state of the game application.

14. The computer-implemented method of claim 1 wherein the first embedded application is a shared document application causing display of a shared document in the embedded interface, wherein the embedded interface is configured to receive input from a user that changes one or more items of the shared document, and wherein at least one of the one or more suggested response items includes one or more suggested commands operative to modify the shared document.

15. The computer-implemented method of claim 1 wherein the embedded interface is output on a subset of the plurality of user devices participating in the chat conversation, wherein the subset includes user devices that have received second user input in an associated chat interface that causes the user devices to join an embedded session initiated by the first embedded application.

16. The computer-implemented method of claim 1 wherein the first embedded application displays output data that is at least one of:

generated by the first embedded application, and received from a server in connection with the first user device over the network.

17. A system comprising:

a memory; and

at least one processor configured to access the memory and configured to perform operations comprising;

causing a chat interface to be displayed by a first user device, wherein the chat interface is generated by a messaging application, and wherein the chat interface is configured to display one or more messages in a chat conversation, wherein the one or more messages are provided by a plurality of user devices participating in the chat conversation over a network;

causing an embedded interface to be displayed associated with the chat interface, wherein the embedded interface is provided by a first embedded application executing in association with the messaging application, wherein the first embedded application executes at least in part on the first user device;

determining that a suggestion event has occurred in association with use of the first embedded application based on at least one of;

user input received by the embedded interface, and event information from the first embedded application indicating that the suggestion event has occurred in the first embedded application;

obtaining one or more suggested response items responsive to the suggestion event; and

causing to be displayed the one or more suggested response items by the first user device, wherein the one or more suggested response items are each selectable by a first user of the first user device to cause the messaging application to at least one of;

provide an associated command to change one or more states of the first embedded application; and

cause an associated message to be displayed in the chat conversation by the plurality of user devices participating in the chat conversation.

18. The system of claim 17 wherein the operation of determining that the suggestion event has occurred is based on determining that a second user device of the plurality of user devices has initiated a second embedded application corresponding to the first embedded application to join an embedded session provided for the first embedded application.

19. A non-transitory computer readable medium having stored thereon software instructions that, when executed by a processor, cause the processor to perform operations including:

determining that a suggestion event has occurred in association with use of at least one embedded application of a plurality of corresponding embedded applications executed at least in part on associated user devices, wherein each embedded application executes in association with a messaging application executing on the associated user device, wherein each messaging application is configured to cause an associated chat interface to be displayed by the associated user device, wherein the associated chat interface is configured to display one or more messages in a chat conversation, wherein the associated user devices are participating in the chat conversation over a network;

obtaining one or more suggested response items responsive to the suggestion event; and

causing to be displayed the one or more suggested response items by at least one associated user device of the associated user devices, wherein the one or more suggested response items are each selectable by user input from a respective user of the at least one associated user device to at least one of;

provide an associated command to change one or more states of the plurality of corresponding embedded applications; and

cause display of an associated message in the chat conversation by the associated user devices participating in the chat conversation.

20. The non-transitory computer readable medium of claim 19 wherein the one or more states are one or more second states, and wherein the operation of determining that the suggestion event has occurred is based on at least one of:

user input received by at least one of the corresponding embedded applications, and user input received by at least one of the messaging applications that changes one or more first states of the corresponding embedded applications.