Methods and computer program products for processing a search

• US 10,015,122 B1
• Filed: 11/05/2017
• Issued: 07/03/2018
• Est. Priority Date: 10/18/2012
• Status: Expired due to Fees

• Current Assignee: Gummarus, LLC (Oso IP, LLC)
• Original Assignee: Sitting Man LLC
• Inventors: Morris, Robert Paul
• Primary Examiner(s): Tran, Jimmy H
• Application Number:
  US15/803,822
• Time in Patent Office: 240 Days
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06Q 10/107 Computer-aided management of electronic mailing [e-mailing]
• CPC Class Codes: H04L 51/02 using automatic reactions or user delegation, e.g. automatic replies or chatbot-generated messages
• CPC Class Codes: H04L 51/046 Interoperability with other network applications or services
• CPC Class Codes: H04L 51/10 Multimedia information
• CPC Class Codes: H04L 51/18 Commands or executable codes
• CPC Class Codes: H04L 61/4547 for personal communications, i.e. using a personal identifier
• CPC Class Codes: H04L 67/02 based on web technology, e.g. hypertext transfer protocol [HTTP]

Abstract

In one embodiment, method is provided, comprising: creating at least a portion of an instant messaging application that is configured to cooperate with a relay that is configured to communicate with a web service, the instant messaging application configured to cause a device to: display an instant messaging interface; receive, from the relay and utilizing a communications agent, a first message; display, via the instant messaging interface, at least a portion of the first message; send, to the relay, a second message including text and an automatically determined contactee identifier, for causing the relay to: send, from the relay to the web service, a third message including the text, for causing the web service to: send, to the relay, a fourth message with at least one image that is identified based on the text, for causing the relay to: send, to the device, a fifth message including the at least one image.

Claims

1. A computer-implemented method, comprising:

creating at least a portion of an instant messaging application that is configured to cooperate with a relay that is configured to communicate with a web service, the instant messaging application, when executed, configured to cause a device, that includes at least one processor and non-transitory memory, to;

display an instant messaging interface including a textbox user interface element for receiving a message text portion and a send user interface element for sending the message text portion in response to a user selection thereof,

receive, from the relay and utilizing a communications agent on the device configured to receive incoming messages addressed to a communicant identifier associated with a user of the instant messaging application, a first message,

in response to the receipt, from the relay and utilizing the communications agent on the device configured to receive the incoming messages addressed to the communicant identifier associated with the user of the instant messaging application, of the first message;

display, via the instant messaging interface, at least a portion of the first message;

after the display, via the instant messaging interface, of the least portion of the first message;

receive, via the textbox user interface element of the instant messaging interface, text that is received as a reply to the first message,

after the receipt, via the textbox user interface element of the instant messaging interface, of the text;

receive, via the instant messaging interface, an indication of a selection on the send user interface element of the instant messaging interface,

in response to the receipt, via the instant messaging interface, of the indication of the selection on the send user interface element of the instant messaging interface;

send, to the relay and utilizing the communications agent on the device configured to send outgoing messages addressed from the communicant identifier associated with the user of the instant messaging application, a second message including the text and an automatically determined contactee identifier, for causing the relay to;

send, from the relay to the web service, a third message including the text, for causing the web service to;

send, to the relay, a fourth message with at least one image that is identified based on the text, for causing the relay to;

 

send, to the device, a fifth message including the at least one image,

receive, from the relay and utilizing the communications agent on the device configured to receive the incoming messages addressed to the communicant identifier associated with the user of the instant messaging application, the fifth message including the at least one image, and

in response to the receipt, from the relay and utilizing the communications agent on the device configured to receive the incoming messages addressed to the communicant identifier associated with the user of the instant messaging application, of the fifth message including the at least one image;

display, via the instant messaging interface, the at least one image; and

causing storage of the at least portion of the instant messaging application.

2. The computer-implemented method of claim 1, wherein the at least one image is automatically included with the fourth message based on the text.

3. The computer-implemented method of claim 1, wherein the instant messaging application is configured such that, when executed, the text are displayed, via the instant messaging interface, as the reply to the first message.

4. The computer-implemented method of claim 1, wherein the instant messaging application is configured such that, when executed, the contactee identifier is automatically identified based on a template.

5. The computer-implemented method of claim 1, wherein the instant messaging application is configured such that, when executed, the text is included in search information and the second message includes a search query based on the search information.

6. The computer-implemented method of claim 1, wherein the instant messaging application, when executed, is configured to cause the device to:

display a button with the at least one image,

receive, via the instant messaging interface, an indication of a selection on the button displayed via the instant messaging interface,

in response to the receipt, via the instant messaging interface, of the indication of the selection on the button displayed via the instant messaging interface;

generate a request corresponding to the button displayed via the instant messaging interface,

in response to the generation of the request corresponding to the button displayed via the instant messaging interface;

send, to the relay and utilizing the communications agent on the device configured to send the outgoing messages addressed from the communicant identifier associated with the user of the instant messaging application, a sixth message that includes the request,

after sending, to the relay and utilizing the communications agent on the device configured to send the outgoing messages addressed from the communicant identifier associated with the user of the instant messaging application, the sixth message that includes the request;

receive, from the relay and utilizing the communications agent on the device configured to receive the incoming messages addressed to the communicant identifier associated with the user of the instant messaging application, a seventh message,

after sending, to the relay and utilizing the communications agent on the device configured to send the outgoing messages addressed from the communicant identifier associated with the user of the instant messaging application, the sixth message that includes the request;

receive, from the relay and utilizing the communications agent on the device configured to receive the incoming messages addressed to the communicant identifier associated with the user of the instant messaging application, a response including at least one additional image, the response being attached to the seventh message, and

in response to the receipt, from the relay and utilizing the communications agent on the device configured to receive the incoming messages addressed to the communicant identifier associated with the user of the instant messaging application, of the seventh message and the response including the at least one additional image;

display, via the instant messaging interface, the at least one additional image.

7. The computer-implemented method of claim 1, wherein:

the instant messaging application is configured to utilize the communications agent on the device to communicate the incoming messages when the user is a contactee and the outgoing messages when the user is a contactor, utilizing a communications protocol, such that the incoming messages and the outgoing messages are addressed using the communicant identifier which takes the form of a communication address associated with a communicant alias corresponding to the user; and

the instant messaging interface is configured to simultaneously display at least a portion of at least one of the incoming messages and at least a portion of at least one of the outgoing messages in a form of a conversation which is simultaneously displayed with at least a portion of the at least one image, where the at least one image is displayed to be part of the conversation.

8. The computer-implemented method of claim 7, wherein the communications protocol includes a real-time, store and forward, instant messaging, request/reply protocol on top of a Transmission Control Protocol/Internet Protocol (TCP/IP), and the relay communicates with the web service utilizing a hypertext transfer protocol (HTTP).

9. The computer-implemented method of claim 1, wherein at least one of:

the at least portion of the instant messaging application includes an entirety of the instant messaging application;

the device includes at least one of a personal computer or a mobile device;

the at least portion of the instant messaging application is created by a development thereof;

the instant messaging application is configured to cooperate with the relay by communicating with the relay;

the instant messaging application is configured such that interaction therewith is capable of invoking a network browser application;

the relay is equipped with another communications agent;

the communicant identifier includes at least one of a contactor identifier or a contactee identifier;

in each instance of an operation including at least one of the displaying or the sending, in response to the receiving, the operation occurs in immediate response to the receiving;

in each instance of an operation including at least one of the displaying or the sending, in response to the receiving, the operation occurs after at least one intermediate operation that occurs in immediate response to the receiving;

each instance of receiving includes receiving, from the relay, that which was received by the relay from the web service;

each instance of sending includes sending, to the relay, that which is sent by the relay to the web service;

the communications agent is separate from the instant messaging application;

the communications agent is integrated with the instant messaging application;

the communications agent receives the incoming messages and sends the outgoing messages;

the incoming messages include automatically generated messages and the outgoing messages include messages edited by the user;

the incoming messages include automatically generated messages and the outgoing messages include messages prompted by the user;

the outgoing messages include the second message;

the incoming messages include the first message and the fifth message;

the addressing is automatic;

the addressing is manual;

the send user interface element includes a forward user interface element;

the send user interface element includes the word “

send”

;

the first message includes an initial message;

the first message is communicated first, the second message is communicated second, the third message is communicated third, the fourth message is communicated fourth, and the fifth message is communicated fifth;

no intermediate messages are communicated between the communication of the first message, the second message, the third message, the fourth message, and the fifth message;

at least one intermediate message is communicated between the communication of at least two of;

the first message, the second message, the third message, the fourth message, and the fifth message;

the text is part of an expression;

the text is part of search information;

the textbox user interface element includes a search input user interface element;

or

the at least portion of the instant messaging application is part of a system, where the system further comprises the relay and the device.

10. A non-transitory computer-readable media storing computer instructions of an instant messaging application, that when executed by one or more processors of a device, cause the one or more processors to:

display an instant messaging interface including a textbox user interface element for receiving a message text portion and a send user interface element for sending the message text portion in response to a user selection thereof,

receive, from a relay and utilizing a communications agent on the device configured to receive incoming messages addressed to a communicant identifier associated with a user of the instant messaging application, a first message,

in response to the receipt, from the relay and utilizing the communications agent on the device configured to receive the incoming messages addressed to the communicant identifier associated with the user of the instant messaging application, of the first message;

display, via the instant messaging interface, at least a portion of the first message;

after the display, via the instant messaging interface, of the least portion of the first message;

receive, via the textbox user interface element of the instant messaging interface, text that is received as a reply to the first message,

after the receipt, via the textbox user interface element of the instant messaging interface, of the text;

receive, via the instant messaging interface, an indication of a selection on the send user interface element of the instant messaging interface,

in response to the receipt, via the instant messaging interface, of the indication of the selection on the send user interface element of the instant messaging interface;

send, to the relay and utilizing the communications agent on the device configured to send outgoing messages addressed from the communicant identifier associated with the user of the instant messaging application, a second message including the text and an automatically determined contactee identifier, for causing the relay to;

send, from the relay to a web service, a third message including the text, for causing the web service to;

send, to the relay, a fourth message including at least one image that is located based on the text, for causing the relay to;

 

send, to the device, a fifth message including the at least one image,

receive, from the relay and utilizing the communications agent on the device configured to receive the incoming messages addressed to the communicant identifier associated with the user of the instant messaging application, the fifth message including the at least one image, and

in response to the receipt, from the relay and utilizing the communications agent on the device configured to receive the incoming messages addressed to the communicant identifier associated with the user of the instant messaging application, of the fifth message including the at least one image;

display, via the instant messaging interface, the at least one image.

11. The non-transitory computer-readable media of claim 10, wherein:

the instant messaging application is configured to utilize the communications agent on the device to communicate the incoming messages when the user is a contactee and the outgoing messages when the user is a contactor, utilizing a communications protocol, such that the incoming messages and the outgoing messages are addressed using the communicant identifier which takes the form of a communication address associated with a communicant alias corresponding to the user; and

the instant messaging interface is configured to simultaneously display at least a portion of at least one of the incoming messages and at least a portion of at least one of the outgoing messages in a form of a conversation which is simultaneously displayed with at least a portion of the at least one image.

12. The non-transitory computer-readable media of claim 11, wherein the communications protocol includes a real-time, store and forward, instant messaging, request/reply protocol on top of a Transmission Control Protocol/Internet Protocol (TCP/IP), and the relay communicates with the web service utilizing a hypertext transfer protocol (HTTP).

13. The non-transitory computer-readable media of claim 11, wherein:

the at least one image is automatically located based on the text;

the text is displayed, via the instant messaging interface, as the reply to the first message; and

the instant messaging application, when executed, is configured such that the contactee identifier is automatically identified.

14. The non-transitory computer-readable media of claim 13, wherein the text is included as part of search information and the second message includes a search query based on the search information.

15. The non-transitory computer-readable media of claim 14, wherein the instant messaging application, when executed, is configured to cause the device to:

display a button with the at least one image,

receive, via the instant messaging interface, an indication of a selection on the button displayed via the instant messaging interface,

in response to the receipt, via the instant messaging interface, of the indication of the selection on the button displayed via the instant messaging interface;

generate a request corresponding to the button displayed via the instant messaging interface,

in response to the generation of the request corresponding to the button displayed via the instant messaging interface;

send, to the relay and utilizing the communications agent on the device configured to send the outgoing messages addressed from the communicant identifier associated with the user of the instant messaging application, a sixth message that includes the request,

after sending, to the relay and utilizing the communications agent on the device configured to send the outgoing messages addressed from the communicant identifier associated with the user of the instant messaging application, the sixth message that includes the request;

receive, from the relay and utilizing the communications agent on the device configured to receive the incoming messages addressed to the communicant identifier associated with the user of the instant messaging application, a seventh message,

after sending, to the relay and utilizing the communications agent on the device configured to send the outgoing messages addressed from the communicant identifier associated with the user of the instant messaging application, the sixth message that includes the request;

receive, from the relay and utilizing the communications agent on the device configured to receive the incoming messages addressed to the communicant identifier associated with the user of the instant messaging application, a response including at least one additional image, the response being attached to the seventh message, and

in response to the receipt, from the relay and utilizing the communications agent on the device configured to receive the incoming messages addressed to the communicant identifier associated with the user of the instant messaging application, of the seventh message and the response including the at least one additional image;

display, via the instant messaging interface, the at least one additional image.

16. A computer-implemented method, comprising:

creating at least a portion of an instant messaging application that is configured to cooperate with a relay, the instant messaging application, when executed, configured to cause a device, that includes at least one processor and non-transitory memory, to;

display an instant messaging interface including a textbox user interface element for receiving editable text, a send user interface element for sending the text in response to a user selection thereof, and an uneditable user interface element,

receive, via the textbox user interface element of the instant messaging interface, an editable set of text,

after the receipt, via the textbox user interface element of the instant messaging interface, the editable set of text;

receive, via the instant messaging interface, an indication of a selection on the send user interface element of the instant messaging interface,

in response to the receipt, via the instant messaging interface, of the indication of the selection on the send user interface element of the instant messaging interface;

generate a first request message that includes the editable set of text,

in response to the generation of the first request message that includes the editable set of text;

send, to the relay and with a communicant identifier associated with a user of the instant messaging application, the first request message that includes the editable set of text,

after sending, to the relay and with the communicant identifier associated with the user of the instant messaging application, the first request message that includes the editable set of text;

receive, from the relay and with the communicant identifier associated with the user of the instant messaging application, a first response including at least one first image that is automatically located based on the editable set of text of the first request message;

in response to the receipt, from the relay and with the communicant identifier associated with the user of the instant messaging application, of the first response including the at least one first image that is automatically located based on the editable set of text of the first request message;

display, via the instant messaging interface, the at least one first image,

receive, via the instant messaging interface, an indication of a selection on the uneditable user interface element of the instant messaging interface,

in response to the receipt, via the instant messaging interface, of the indication of the selection on the uneditable user interface element of the instant messaging interface;

generate a second request message,

in response to the generation of the second request message;

send, to the relay and with the communicant identifier associated with a user of the instant messaging application, the second request message,

after sending, to the relay and with the communicant identifier associated with the user of the instant messaging application, the second request message;

receive, from the relay and with the communicant identifier associated with the user of the instant messaging application, a second response including at least one second image that is automatically located based on the second request message, and

in response to the receipt, from the relay and with the communicant identifier associated with the user of the instant messaging application, of the second response including the at least one second image that is automatically located based on the second request message;

display, via the instant messaging interface, the at least one second image; and

causing storage of the at least portion of the instant messaging application.

17. The computer-implemented method of claim 16, wherein the instant messaging application is configured such that, when executed, the uneditable user interface element is based on an instant message previously received, from the relay, at the device.

18. The computer-implemented method of claim 16, wherein the instant messaging application is configured such that, when executed, the uneditable user interface element is part of a dynamic portion of the instant messaging interface that displays the at least one first image, the at least one second image, the first request message, and the second request message as instant messages in a conversation;

and the textbox user interface element and the send user interface element are part of a static portion of the instant messaging interface such that the textbox user interface element and the send user interface element are displayed independent of the instant messages in the conversation.

19. The computer-implemented method of claim 18, wherein the instant messaging application is configured such that, when executed, the uneditable user interface element is displayed as an instant message in the dynamic portion of the instant messaging interface as part of the instant messages in the conversation.

20. A non-transitory computer-readable media storing computer instructions of an instant messaging application, that when executed by one or more processors of a device, cause the one or more processors to:

display an instant messaging interface including a textbox user interface element for receiving editable text, a send user interface element for sending the text in response to a user selection thereof, and an uneditable user interface element,

receive, via the textbox user interface element of the instant messaging interface, an editable set of text,

after the receipt, via the textbox user interface element of the instant messaging interface, the editable set of text;

receive, via the instant messaging interface, an indication of a selection on the send user interface element of the instant messaging interface,

in response to the receipt, via the instant messaging interface, of the indication of the selection on the send user interface element of the instant messaging interface;

generate a first request message that includes the editable set of text,

in response to the generation of the first request message that includes the editable set of text;

send, to an apparatus and with a communicant identifier associated with a user of the instant messaging application, the first request message that includes the editable set of text,

after sending, to the apparatus and with the communicant identifier associated with the user of the instant messaging application, the first request message that includes the editable set of text;

receive, from the apparatus and with the communicant identifier associated with the user of the instant messaging application, a first response including at least one first image that is automatically located based on the editable set of text of the first request message;

in response to the receipt, from the apparatus and with the communicant identifier associated with the user of the instant messaging application, of the first response including the at least one first image that is automatically located based on the editable set of text of the first request message;

display, via the instant messaging interface, the at least one first image,

receive, via the instant messaging interface, an indication of a selection on the uneditable user interface element of the instant messaging interface,

in response to the receipt, via the instant messaging interface, of the indication of the selection on the uneditable user interface element of the instant messaging interface;

generate a second request message,

in response to the generation of the second request message;

send, to the apparatus and with the communicant identifier associated with a user of the instant messaging application, the second request message,

after sending, to the apparatus and with the communicant identifier associated with the user of the instant messaging application, the second request message;

receive, from the apparatus and with the communicant identifier associated with the user of the instant messaging application, a second response including at least one second image that is automatically located based on the second request message, and

in response to the receipt, from the apparatus and with the communicant identifier associated with the user of the instant messaging application, of the second response including the at least one second image that is automatically located based on the second request message;

display, via the instant messaging interface, the at least one second image.

21. The non-transitory computer-readable media of claim 20, wherein the instant messaging application is configured such that, when executed, the uneditable user interface element is based on an instant message previously received, from the apparatus, at the device.

22. The non-transitory computer-readable media of claim 20, wherein the instant messaging application is configured such that, when executed, the uneditable user interface element is part of a dynamic portion of the instant messaging interface that displays the at least one first image, the at least one second image, the first request message, and the second request message as instant messages in a conversation;

and the textbox user interface element and the send user interface element are part of a static portion of the instant messaging interface such that the textbox user interface element and the send user interface element are displayed independent of the instant messages in the conversation.

23. The non-transitory computer-readable media of claim 22, wherein the instant messaging application is configured such that, when executed, the uneditable user interface element is displayed as an instant message in the dynamic portion of the instant messaging interface as part of the instant messages in the conversation.

24. The non-transitory computer-readable media of claim 23, wherein the instant messaging application is configured to utilize a first communications agent on the device to communicate incoming messages when the user is a contactee and outgoing messages when the user is a contactor, utilizing a communications protocol, such that the incoming messages and the outgoing messages are addressed using the communicant identifier which takes the form of a communication address associated with a communicant alias corresponding to the user.

25. The non-transitory computer-readable media of claim 24, wherein the communications protocol includes a real-time, store and forward, instant messaging, request/reply protocol on top of a Transmission Control Protocol/Internet Protocol (TCP/IP), and the apparatus communicates with a web service utilizing a hypertext transfer protocol (HTTP).

26. The non-transitory computer-readable media of claim 24, wherein the communications protocol includes a publish-subscribe protocol on top of a Transmission Control Protocol/Internet Protocol (TCP/IP).

27. The non-transitory computer-readable media of claim 26, wherein the publish-subscribe protocol includes an Extensible Messaging and Presence Protocol (XMPP).

28. The non-transitory computer-readable media of claim 24, wherein the instant messaging application is configured such that the first communications agent on the device is capable of communicating with a second communications agent using another communicant identifier which takes the form of another communication address.

29. The non-transitory computer-readable media of claim 28, wherein the second communications agent is on the apparatus.

30. The non-transitory computer-readable media of claim 28, wherein the second communications agent is part of a web service that is in communication with the device via the apparatus, where the apparatus includes a relay.