Systems and methods for improved processing of message queries

• US 10,104,028 B2
• Filed: 08/29/2014
• Issued: 10/16/2018
• Est. Priority Date: 08/29/2014
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google LLC (Alphabet Inc.)
• Inventors: Agarwal, Shalini, Yung, Clarence, Lee, Han Seul, Linnell, Mary, Chiu, Bikin, Ipince, Rodrigo, Vasudevan, Srinivas, Albiz, Syed
• Primary Examiner(s): Flynn, Kevin H
• Assistant Examiner(s): Molnar, Hunter A
• Application Number:
  US14/473,571
• Publication Number:
  US 20160063399A1
• Time in Patent Office: 1,509 Days
• Field of Search: 705 5
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06Q 10/02 Reservations, e.g. for tickets, services or events
• CPC Class Codes: H04L 12/1895 for short real-time information, e.g. alarms, notifications, alerts, updates
• CPC Class Codes: H04L 51/04 Real-time or near real-time messaging, e.g. instant messaging [IM]
• CPC Class Codes: H04L 51/08 Annexed information, e.g. attachments
• CPC Class Codes: H04L 51/224 providing notification on incoming messages, e.g. pushed notifications of received messages

Abstract

A method of processing messages executes at a computing device having one or more processors and memory. The memory stores one or more programs configured for execution by the one or more processors. A first message for a user is analyzed for a structured content element. When found, content from a data source distinct from the message is obtained by executing an associated action. A first message display state is formed for the message comprising a message notification and the content. A messaging application user interface, comprising an electronic message list with a plurality of objects, is updated. Responsive to selection of a first object of the plurality of objects, the first object representing the first message, the user is enabled to toggle the first message display state between first and second display states, the second display state differing from the first by providing direct access to the first message.

Claims

1. A method comprising:

analyzing, by one or more processors of a computing device, a first message, addressed to a user, for the presence of a first structured content element;

responsive to the first structured content element being present in the first message;

(i) executing, by the one or more processors, an action associated with the first structured content element to obtain content from a first data source that is distinct from the first message, and

(ii) forming, by the one or more processors, a first display state of a first object representing at least the first message, wherein the first display state of the first object comprises a combination of a notification of the first message and the content from the first data source;

responsive to identifying the presence of the first structured content element in the first message, updating, by the one or more processors, a user interface for a messaging application, the user interface comprising an electronic message list in an electronic message list panel, wherein the electronic message list comprises a plurality of objects including the first object,

each respective object in the plurality of objects is visually distinct in the electronic message list, and each respective object in at least a subset of the plurality of objects comprises one or more electronic messages in a plurality of messages addressed to the user; and

responsive to user selection of the first object, facilitating, by the one or more processors, user initiated toggling of a display state of the first object between the first display state and a second display state, wherein the second display state includes the content from the first data source and the first message, wherein the second display state differs from the first display state by providing direct access to the first message, wherein the first display state is a collapsed display state for the first object presented within the messaging application, and the second display state is an expanded display state for the first object presented within the messaging application, and wherein the first display state and the second display state are each configured to be used by the messaging application for displaying the first object.

2. The method of claim 1, wherein the first structured content element is an identification of an airline flight and the first data source is current flight information for the airline flight.

3. The method of claim 1, wherein the first structured content element is in a plurality of candidate structured content elements and the analyzing of the first message comprises analyzing the first message for the presence of each candidate structured content element in the plurality of candidate structured content elements thereby identifying the first structured content element as a match between all or a portion of the first message and a candidate structured content element of the plurality of candidate structured content elements.

4. The method of claim 3, wherein each candidate structured content element in the plurality of candidate structured content elements is associated with a different image stored in a second data source that is distinct from the first message, and wherein the forming the first display state comprises including the image associated with the first structured content element in the first display state of the first object along with the combination of the notification of the first message and the content.

5. The method of claim 1, wherein a task is associated with the first structured content element and wherein the forming the first display state comprises including information for performing the task in the first display state of the first object along with the combination of the notification of the first message and the content.

6. The method of claim 5, wherein the information for performing the task is in the form of a uniform resource locator.

7. The method of claim 5, wherein the first structured content element identifies an airline flight and the task is an option to cancel the flight.

8. The method of claim 5, wherein the first structured content element identifies a hotel or restaurant reservation and the task is an option to cancel the hotel or restaurant reservation, an option to confirm the hotel or restaurant reservation, an option to modify the hotel or restaurant reservation, or an option to view a map of a location of an address associated with the hotel or restaurant reservation.

9. The method of claim 8, wherein the forming the first display state comprises including a date associated with the hotel or restaurant reservation, wherein the date is retrieved from the first message.

10. The method of claim 1, wherein the first structured content element is an airline flight with a flight origin and a flight destination, the method further comprising:

obtaining a first image associated with the flight origin and a second image associated with the flight destination from a second data source that is distinct from (i) the first message and (ii) the first data source; and

wherein

the forming the first display state comprises including the first image and the second image in the first display state of the first object along with the combination of the notification of the first message and the content.

11. The method of claim 1, wherein the first structured content element identifies a purchase of a product and wherein the content is a picture of the product.

12. The method of claim 1, wherein the first structured content element identifies a purchase of a product and wherein the content is an estimated delivery date of the product.

13. The method of claim 12, wherein a task is associated with the first structured content element and wherein the forming the first display state comprises including information for performing the task in the first display state of the first object along with the combination of the notification of the first message and the content.

14. The method of claim 13 wherein the task is viewing an original order for the product or viewing tracking details for a delivery of the product.

15. The method of claim 1, wherein the first structured content element identifies a ticketed event and wherein the content is a picture associated with the ticketed event.

16. The method of claim 15, wherein a task is associated with the first structured content element and wherein the forming the first display state comprises including information for performing the task in the first display state of the message along with the combination of the notification of the first message and the content.

17. The method of claim 16, wherein the task is viewing tickets for the ticketed events or viewing a map associated with a location of the ticketed event.

18. The method of claim 1, wherein the first structured content element is a link to an image and the content is a rendering of the image.

19. The method of claim 1, wherein the first structured content element is a link to a video and the content is a frame from the video.

20. The method of claim 1, wherein the first object exclusively represents the first message.

21. The method of claim 1, wherein the first object represents a plurality of messages.

22. The method of claim 1, wherein the first data source that is distinct from the first message is a second message addressed to the user.

23. A computing device, comprising:

one or more processors;

memory; and

one or more programs stored in the memory configured for execution by the one or more processors, the one or more programs comprising instructions for;

analyzing a first message, addressed to a user, for the presence of a first structured content element;

responsive to the first structured content element being present in the first message;

(i) executing an action associated with the first structured content element to obtain content from a first data source that is distinct from the first message, and

(ii) forming a first display state of a first object representing at least the first message, wherein the first display state of the first object comprises a combination of a notification of the first message and the content from the first data source;

responsive to identifying the presence of the first structured content element in the first message, updating a user interface for a messaging application, the user interface comprising an electronic message list in an electronic message list panel, wherein the electronic message list comprises a plurality of objects including the first object, each respective object in the plurality of objects is visually distinct in the electronic message list, and each respective object in at least a subset of the plurality of objects comprises one or more electronic messages in a plurality of messages addressed to the user; and

responsive to user selection of the first object, facilitating user initiated toggling of a display state of the first object between the first display state and a second display state, wherein the second display state includes the content from the first data source and the first message, wherein the second display state differs from the first display state by providing direct access to the first message, wherein the first display state is a collapsed display state for the first object presented within the messaging application, and the second display state is an expanded display state for the first object presented within the messaging application, and wherein the first display state and the second display state are each configured to be used by the messaging application for displaying the first object.

24. A non-transitory computer readable storage medium storing one or more programs configured for execution by a computing device having one or more processors and memory, the one or more programs comprising instructions for:

analyzing a first message, addressed to a user, for the presence of a first structured content element;

responsive to the first structured content element being present in the first message;

(i) executing an action associated with the first structured content element to obtain content from a first data source that is distinct from the first message, and

(ii) forming a first display state of a first object representing at least the first message, wherein the first display state of the first object comprises a combination of a notification of the first message and the content from the first data source;

responsive to identifying the presence of the first structured content element in the first message, updating a user interface for a messaging application, the user interface comprising an electronic message list in an electronic message list panel, wherein the electronic message list comprises a plurality of objects including the first object, each respective object in the plurality of objects is visually distinct in the electronic message list, and each respective object in at least a subset of the plurality of objects comprises one or more electronic messages in a plurality of messages addressed to the user; and

responsive to user selection of the first object, facilitating user initiated toggling of a display state of the first object between the first display state and a second display state, wherein the second display state includes the content from the first data source and the first message, wherein the second display state differs from the first display state by providing direct access to the first message, wherein the first display state is a collapsed display state for the first object presented within the messaging application, and the second display state is an expanded display state for the first object presented within the messaging application, and wherein the first display state and the second display state are each configured to be used by the messaging application for displaying the first object.