Interactive communication augmented with contextual information

• US 10,565,268 B2
• Filed: 12/19/2013
• Issued: 02/18/2020
• Est. Priority Date: 12/19/2013
• Status: Active Grant

• Current Assignee: Adobe Inc.
• Original Assignee: Adobe Inc.
• Inventors: Winnemoeller, Holger, Steinsapir Stitchkin, Daniela Cecilia
• Primary Examiner(s): Truong, Cam Y T
• Application Number:
  US14/133,806
• Publication Number:
  US 20150178388A1
• Time in Patent Office: 2,252 Days
• Field of Search: 707722
• CPC Class Codes: G06F 16/951 Indexing; Web crawling techniques
• CPC Class Codes: G06Q 10/10 Office automation; Time management
• CPC Class Codes: G06Q 50/01 Social networking
• CPC Class Codes: H04L 12/1827 Network arrangements for conference optimisation or adaptation
• CPC Class Codes: H04L 51/02 using automatic reactions or user delegation, e.g. automatic replies or chatbot-generated messages
• CPC Class Codes: H04L 51/10 Multimedia information

Abstract

Techniques are disclosed for augmenting an interactive communication session with contextually relevant information. A computing device, such as a smartphone or tablet computer, can be configured to provide an augmented chat application configured to create, send, receive and display a conversation, and further configured to locate, retrieve and display, via a graphical user interface (GUI), other information that is contextually relevant to the conversation. The contextual information may be shared with one or more other users who are participating in the conversation either automatically or in response to a user input. The contextual information can be displayed or otherwise presented to the user explicitly (e.g., the actual content of the contextual information can be displayed via the GUI) or implicitly (e.g., a referent to the contextual information, such as a hyperlink or other cue, can be displayed via the GUI).

Claims

1. A computer-implemented method comprising:

receiving, by at least one processor, a message entered into an input field of a graphical user interface (GUI) by a first user, the message forming a portion of a conversation stream in which a series of messages are exchanged among a plurality of users;

causing display, by the at least one processor, of the entered message in a first output field of the GUI;

causing, by the at least one processor, automatic construction of a search query based on at least one previous message in the conversation stream;

causing, by the at least one processor, performance of a search of at least one data repository based on the message, wherein the performance of the search is further based on the search query, and wherein the search query is constructed so that it includes at least one search term related to the conversation stream;

causing display, by the at least one processor, of contextual information based on results of the search in a second output field of the GUI, the second output field being displayed in a separate region of the GUI next to the first output field, the contextual information in the second output field configured to scroll within the GUI in sync with the entered message as the first output field scrolls within the GUI prior to a user selection of the contextual information; and

selectively sending, by the at least one processor, the contextual information displayed in the second output field to a remote device of a second user in response to receiving, from the first user, the user selection of the contextual information displayed in the second output field.

2. The method of claim 1, further comprising rendering the first output field and the second output field in different portions of the graphical user interface.

3. The method of claim 1, further comprising sending at least a portion of the contextual information to one or more remote devices, each remote device having a respective graphical user interface.

4. The method of claim 1, further comprising inserting, by the at least one processor, at least a portion of the contextual information into the conversation stream so that the inserted at least a portion of contextual information is displayed in both of the first output field and the second output field.

5. The method of claim 4, wherein the inserting is performed automatically in response to receiving the results of the search.

6. The method of claim 4, wherein the inserting is performed in response to receiving the input from the first user that selects the contextual information displayed in the second output field.

7. A computing device, comprising:

a display;

a storage comprising at least one memory; and

one or more processors operatively coupled to the storage and the display, the one or more processors configured to carry out a process that causes the one or more processors to;

receive a message entered into an input field of a graphical user interface (GUI) by a first user, the message forming a portion of a conversation stream in which a series of messages are exchanged among a plurality of users;

cause display of the entered message in a first output field of the GUI;

automatically construct a search query based on at least one previous message in the conversation stream;

cause performance of a search of at least one data repository based on the message, wherein the performance of the search is further based on the search query, and wherein the search query is constructed so that it includes at least one search term related to the conversation stream;

cause display of contextual information based on results of the search in a second output field of the GUI, the second output field to be displayed in a separate region of the GUI next to the first output field, the contextual information in the second output field configured to scroll within the GUI in sync with the entered message as the first output field scrolls within the GUI prior to a user selection of the contextual information; and

selectively sending the contextual information displayed in the second output field to a remote device of a second user in response to receiving, from the first user, the user selection of the contextual information displayed in the second output field.

8. The computing device of claim 7, wherein the process further causes the one or more processors to insert at least a portion of the contextual information into the conversation stream so that the inserted at least a portion of contextual information is displayed in both of the first output field and the second output field, and wherein the inserting is performed automatically in response to receiving the results of the search.

9. The computing device of claim 8, wherein the inserting is performed in response to receiving the input from the first user that selects the contextual information displayed in the second output field.

10. The computing device of claim 7, wherein the process further causes the one or more processors to render the first output field and the second output field in different portions of the graphical user interface.

11. The computing device of claim 7, wherein the process further causes the one or more processors to send at least a portion of the contextual information to one or more remote devices, each remote device having a respective graphical user interface.

12. A non-transitory computer-readable medium having instructions encoded thereon that when executed by one or more processors cause a process to be carried out, the process comprising:

receiving a message entered into an input field of a graphical user interface (GUI) by a first user, the message forming a portion of a conversation stream in which a series of messages are exchanged among a plurality of users;

causing display of the entered message in a first output field of the (GUI);

causing automatic construction of a search query based on at least one previous message in the conversation stream;

causing performance of a search of at least one data repository based on the message, wherein the performance of the search is further based on the search query, and wherein the search query is constructed so that it includes at least one search term related to the conversation stream;

causing display of contextual information based on results of the search in a second output field of the GUI, the second output field being displayed in a separate region of the GUI next to the first output field, the contextual information in the second output field configured to scroll within the GUI in sync with the entered message as the first output field scrolls within the GUI prior to a user selection of the contextual information; and

selectively sending the contextual information displayed in the second output field to a remote device of a second user in response to receiving an input from the first user that selects the contextual information displayed in the second output field.

13. The non-transitory computer-readable medium of claim 12, wherein the process further comprises inserting at least a portion of the contextual information into the conversation stream so that the inserted at least a portion of contextual information is displayed in both of the first output field and the second output field, and wherein the inserting is performed in response to at least one of receiving the results of the search and receiving the input from the first user that selects the contextual information displayed in the second output field.