Retrieving context from previous sessions

• US 10,275,485 B2
• Filed: 07/31/2014
• Issued: 04/30/2019
• Est. Priority Date: 06/10/2014
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google LLC (Alphabet Inc.)
• Inventors: Joshi, Ajay
• Primary Examiner(s): Mamillapalli, Pavan
• Application Number:
  US14/448,547
• Publication Number:
  US 20150356136A1
• Time in Patent Office: 1,734 Days
• Field of Search: 707736
• CPC Class Codes: G06F 16/245 Query processing
• CPC Class Codes: G06F 16/29 Geographical information databases
• CPC Class Codes: G06F 16/9537 Spatial or temporal dependent retrieval, e.g. spatiotemporal queries

Abstract

Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for retrieving and using contextual data from previous conversation sessions in conversational searches. In one aspect, a method includes receiving a first query for a first user session, determining that the first query refers to one or more tags in a first repository, the first repository associating respective identifiers to respective tags, each identifier representing a corresponding user session, determining one or more particular identifiers associated with the one or more tags in the first repository, retrieving particular contextual data associated with the determined particular identifiers in a second repository, the second repository associating respective identifiers to respective contextual data associated with corresponding user sessions represented by the respective identifiers, and performing an action responsive to the first query based on the retrieved particular contextual data.

Claims

1. A computer-implemented method comprising:

receiving, by a search engine and from a speech-to-text engine, a search query that is based on an utterance of a user that was detected by a digital assistant device during a current search session;

determining, by the search engine, that the search query refers to a time indicator, the time indicator indicating a time earlier than the current search session;

determining, by the search engine, that the search query refers to one or more other query terms;

determining, by the search engine and from session data stored in a repository associated with the search engine, a first set of relevant previous search sessions from a second set of previous search sessions, wherein the second set of previous search sessions includes more previous search sessions than the first set of relevant previous search sessions, wherein each previous search session in the first set of relevant previous search sessions is associated with a respective time label corresponding to the time indicator;

identifying, by the search engine, a particular previous search session, from among the first set of relevant previous search sessions determined from the session data stored in the repository associated with the search engine, based on the one or more other query terms associated with the search query of the current search session without searching any previous search sessions of the second set of previous search sessions that are not in the first set of relevant previous search sessions;

identifying, by the search engine, one or more entities that are associated with one or more search queries or search results of the particular previous search session, based on the one or more other query terms of the search query of the current search session; and

providing (i) a response to the search query that includes a representation of one or more of the entities, from a text-to-speech engine, that is configured to be output on a speaker of the digital assistant device in response to the search query of the current search session and (ii) metadata, from the search engine, related to the one or more entities that is configured to be rendered on a graphical user interface of the digital assistant device during output of at least a portion of the response to the search query using the speaker of the digital assistant device.

2. The method of claim 1, wherein identifying a particular previous search session, from among the first set of relevant previous search sessions comprises:

determining, for each previous search session of the first set of relevant previous search sessions, a plurality of query terms associated with the one or more search queries or search results of the previous search session;

determining a score based on comparing the plurality of query terms associated with the one or more search queries or search results of the previous search session with the one or more other query terms of the search query of the current search session; and

identifying a particular previous search session, from among the first set of relevant previous search sessions, based on the score.

3. The method of claim 1, wherein the operations further comprise:

before determining that the search query refers to a time indicator, determining that the search query is not associated with a previous query for the current search session.

4. The method of claim 1, wherein the operations further comprise:

determining that the search query refers to a user location indicator, the user location indicator indicating the location of the user during a previous search session; and

determining a plurality of previous search sessions, each previous search session being associated with a respective location label corresponding to the user location indicator.

5. The method of claim 1, wherein determining a first set of relevant previous search sessions from a second set of previous search sessions comprises identifying previous search sessions associated with time labels within a range of times associated with the time indicator.

6. The method of claim 1, wherein the operations further comprise:

before receiving a search query during a current search session, determining a user identifier for a user.

7. The method of claim 6, wherein determining a first set of relevant previous search sessions from a second set of previous search sessions comprises determining a plurality of previous search sessions associated with the user identifier.

8. The method of claim 1, wherein the operations further comprise:

performing an action based on the representation of one or more of the entities in response to the search query of the current search session.

9. The method of claim 8, wherein the action is a navigational action.

10. A system, comprising:

a data processing apparatus; and

a non-transitory computer readable storage medium in data communication with the data processing apparatus and storing instructions executable by the data processing apparatus and upon such execution cause the data processing apparatus to perform operations comprising;

receiving, by a search engine and from a speech-to-text engine, a search query that is based on an utterance of a user that was detected by a digital assistant device during a current search session;

determining, by the search engine, that the search query refers to a time indicator, the time indicator indicating a time earlier than the current search session;

determining, by the search engine, that the search query refers to one or more other query terms;

determining, by the search engine and from session data stored in a repository associated with the search engine, a first set of relevant previous search sessions from a second set of previous search sessions, wherein the second set of previous search sessions includes more previous search sessions than the first set of relevant previous search sessions, wherein each previous search session in the first set of relevant previous search sessions is associated with a respective time label corresponding to the time indicator;

identifying, by the search engine, a particular previous search session, from among the first set of relevant previous search sessions determined from the session data stored in the repository associated with the search engine, based on the one or more other query terms associated with the search query of the current search session without searching any previous search sessions of the second set of previous search sessions that are not in the first set of relevant previous search sessions;

identifying, by the search engine, one or more entities that are associated with one or more search queries or search results of the particular previous search session, based on the one or more other query terms of the search query of the current search session; and

providing (i) a response to the search query that includes a representation of one or more of the entities, from a text-to-speech engine, that is configured to be output on a speaker of the digital assistant device in response to the search query of the current search session and (ii) metadata, from the search engine, related to the one or more entities that is configured to be rendered on a graphical user interface of the digital assistant device during output of at least a portion of the response to the search query using the speaker of the digital assistant device.

11. The system of claim 10, wherein identifying a particular previous search session, from among the first set of relevant previous search sessions comprises:

determining, for each previous search session of the first set of relevant previous search sessions, a plurality of query terms associated with the one or more search queries or search results of the previous search session;

determining a score based on comparing the plurality of query terms associated with the one or more search queries or search results of the previous search session with the one or more other query terms of the search query of the current search session; and

identifying a particular previous search session, from among the first set of relevant previous search sessions, based on the score.

12. The system of claim 10, wherein the operations further comprise:

before determining that the search query refers to a time indicator, determining that the search query is not associated with a previous query for the current search session.

13. The system of claim 10, wherein the operations further comprise:

determining that the search query refers to a user location indicator, the user location indicator indicating the location of the user during a previous search session; and

determining a plurality of previous search sessions, each previous search session being associated with a respective location label corresponding to the user location indicator.

14. The system of claim 10, wherein determining a first set of relevant previous search sessions from a second set of previous search sessions comprises identifying previous search sessions associated with time labels within a range of times associated with the time indicator.

15. The system of claim 10, wherein the operations further comprise:

before receiving a search query during a current search session, determining a user identifier for a user.

16. The system of claim 15, wherein determining a first set of relevant previous search sessions from a second set of previous search sessions comprises determining a plurality of previous search sessions associated with the user identifier.

17. The system of claim 10, wherein the operations further comprise:

performing an action based on the representation of one or more of the entities in response to the search query of the current search session.

18. The system of claim 17, wherein the action is a navigational action.

19. A non-transitory computer readable storage medium storing instructions executable by a data processing apparatus and upon such execution cause the data processing apparatus to perform operations comprising:

receiving, by a search engine and from a speech-to-text engine, a search query that is based on an utterance of a user that was detected by a digital assistant device during a current search session;

determining, by the search engine, that the search query refers to a time indicator, the time indicator indicating a time earlier than the current search session;

determining, by the search engine, that the search query refers to one or more other query terms;

determining, by the search engine and from session data stored in a repository associated with the search engine, a first set of relevant previous search sessions from a second set of previous search sessions, wherein the second set of previous search sessions includes more previous search sessions than the first set of relevant previous search sessions, wherein each previous search session in the first set of relevant previous search sessions is associated with a respective time label corresponding to the time indicator;

identifying, by the search engine, a particular previous search session, from among the first set of relevant previous search sessions determined from the session data stored in the repository associated with the search engine, based on the one or more other query terms associated with the search query of the current search session without searching any previous search sessions of the second set of previous search sessions that are not in the first set of relevant previous search sessions;

identifying, by the search engine, one or more entities that are associated with one or more search queries or search results of the particular previous search session, based on the one or more other query terms of the search query of the current search session; and

providing (i)a response to the search query that includes a representation of one or more of the entities, from a text-to-speech engine, that is configured to be output on a speaker of the digital assistant device in response to the search query of the current search session and (ii) metadata, from the search engine, related to the one or more entities that is configured to be rendered on a graphical user interface of the digital assistant device during output of at least a portion of the response to the search query using the speaker of the digital assistant device.

20. The computer readable storage medium of claim 19, wherein identifying a particular previous search session, from among the first set of relevant previous search sessions comprises:

determining, for each previous search session of the first set of relevant previous search sessions, a plurality of query terms associated with the one or more search queries or search results of the previous search session;

determining a score based on comparing the plurality of query terms associated with the one or more search queries or search results of the previous search session with the one or more other query terms of the search query of the current search session; and

identifying a particular previous search session, from among the first set of relevant previous search sessions, based on the score.

21. The computer readable storage medium of claim 19, wherein the operations further comprise:

before determining that the search query refers to a time indicator, determining that the search query is not associated with a previous query for the current search session.

22. The computer readable storage medium of claim 19, wherein the operations further comprise:

determining that the search query refers to a user location indicator, the user location indicator indicating the location of the user during a previous search session; and

determining a plurality of previous search sessions, each previous search session being associated with a respective location label corresponding to the user location indicator.

23. The computer readable storage medium of claim 19, wherein determining a first set of relevant previous search sessions from a second set of previous search sessions comprises identifying previous search sessions associated with time labels within a range of times associated with the time indicator.

24. The computer readable storage medium of claim 19, wherein the operations further comprise:

before receiving a search query during a current search session, determining a user identifier for a user.

25. The computer readable storage medium of claim 24, wherein determining a first set of relevant previous search sessions from a second set of previous search sessions comprises determining a plurality of previous search sessions associated with the user identifier.

26. The computer readable storage medium of claim 19, wherein the operations further comprise:

performing an action based on the representation of one or more of the entities in response to the search query of the current search session.

27. The computer readable storage medium of claim 26, wherein the action is a navigational action.

28. The computer readable storage medium of claim 26, wherein the action is a reminder action.