Media object query submission and response

• US 9,092,459 B2
• Filed: 10/24/2013
• Issued: 07/28/2015
• Est. Priority Date: 03/31/2008
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Garg, Gaurav, Bapna, Abhishek
• Primary Examiner(s): HO, BINH VAN
• Application Number:
  US14/062,350
• Publication Number:
  US 20140289230A1
• Time in Patent Office: 642 Days
• Field of Search: 707/717
• US Class Current: 1/1
• CPC Class Codes: G06F 16/24578 using ranking
• CPC Class Codes: G06F 16/248 Presentation of query results
• CPC Class Codes: G06F 16/285 Clustering or classification
• CPC Class Codes: G06F 16/3329 Natural language query formulation or dialogue systems
• CPC Class Codes: G06F 16/532 Query formulation, e.g. graphical querying
• CPC Class Codes: G06F 16/90324 using system suggestions
• CPC Class Codes: G06F 16/951 Indexing; Web crawling techniques

Abstract

Methods and systems for submitting media object queries and receiving suggested answers for the media object queries. In one aspect, a method includes receiving from a first user a first media object and a first query relating to content in the first media object, presenting the first media object and the first query to multiple second users, receiving a suggested answer to the first query from each of two or more second users of the multiple second users, where at least two of the suggested answers are distinct, ranking the suggested answers, and presenting one or more of the ranked suggested answers to the first user.

Claims

1. A method comprising:

receiving, from a user device of a first user, an image and a text query related to the image, wherein the text query requests information identifying content presented in the image;

providing for presentation the image and the text query to a plurality of second users different from the first user; and

receiving a suggested answer to the text query from each of a group of second users of the plurality of second users, and wherein a suggested answer from a particular second user is either a new suggested answer submitted by the particular second user in response to the text query or a previous suggested answer to the text query, the previous suggested answer being a suggested answer previously submitted by a different second user of the plurality of second users in response to the text query.

2. The method of claim 1, further comprising:

providing one or more of the suggested answer for presentation to the first user.

3. The method of claim 2, wherein providing one or more of the suggested answers includes providing one or more ranked suggested answers and wherein providing one or more ranked suggested answers comprises:

grouping similar suggested answers based on a semantic similarity measure; and

ranking the suggested answers where each group of similar suggested answers is given a combined ranking.

4. The method of claim 3, wherein ranking the suggested answers further comprises:

for each group of similar suggested answers, determining a rank score for the group by counting the instances that a suggested answer in the group was submitted or selected by a second user;

for each distinct suggested answer, determining a rank score for the distinct suggested answer by counting the instances that the distinct suggested answer was submitted or selected by a second user; and

ranking the distinct suggested answers and groups of similar suggested answers based on the determined rank scores.

5. The method of claim 1, wherein providing the image and the text query to the plurality of second users further comprises:

including the image and the text query pair in a list of additional image and query pairs, the image and text query pair having a position in the list; and

selecting the image and text query pair from the list for presentation to the plurality of second users, the selection based on the position of the image and text query pair in the list.

6. The method of claim 5, further comprising:

modifying a position of the image and text query pair in the list based on indications of interest in the image and text query pair from one or more second users of the plurality of second users; and

selecting the image and text query pair from the list for presentation to one or more third users, the selection based on the modified position of the image and text query pair in the list.

7. The method of claim 5, further comprising:

determining an impression score for the image and text query pair based on an indication of interest received from each second user; and

modifying a position of the image and the text query pair in the list provided to a plurality of third users based on the impression score.

8. The method of claim 1, comprising:

providing data to the first user for presentation, the data relating to one or more image and text query pairs received from the first user or one or more suggested answers submitted or selected by the first user in response to image and text query pairs received from one or more second users.

9. A system comprising:

one or more computers and one or more storage devices storing instructions that are operable, when executed by the one or more computers, to cause the one or more computers to perform operations comprising;

receiving, from a user device of a first user, an image and a text query related to the image, wherein the text query requests information identifying content presented in the image;

providing for presentation the image and the text query to a plurality of second users different from the first user; and

receiving a suggested answer to the text query from each of a group of second users of the plurality of second users, and wherein a suggested answer from a particular second user is either a new suggested answer submitted by the particular second user in response to the text query or a previous suggested answer to the text query, the previous suggested answer being a suggested answer previously submitted by a different second user of the plurality of second users in response to the text query.

10. The system of claim 9, wherein the operations further comprise:

providing one or more of the suggested answer for presentation to the first user.

11. The system of claim 10, wherein providing one or more of the suggested answers includes providing one or more ranked suggested answers and wherein providing one or more ranked suggested answers comprises:

grouping similar suggested answers based on a semantic similarity measure; and

ranking the suggested answers where each group of similar suggested answers is given a combined ranking.

12. The system of claim 11, wherein ranking the suggested answers further comprises:

for each group of similar suggested answers, determining a rank score for the group by counting the instances that a suggested answer in the group was submitted or selected by a second user;

for each distinct suggested answer, determining a rank score for the distinct suggested answer by counting the instances that the distinct suggested answer was submitted or selected by a second user; and

ranking the distinct suggested answers and groups of similar suggested answers based on the determined rank scores.

13. The system of claim 9, wherein providing the image and the text query to the plurality of second users further comprises:

including the image and the text query pair in a list of additional image and query pairs, the image and text query pair having a position in the list; and

selecting the image and text query pair from the list for presentation to the plurality of second users, the selection based on the position of the image and text query pair in the list.

14. The system of claim 13, wherein the operations further comprise:

modifying a position of the image and text query pair in the list based on indications of interest in the image and text query pair from one or more second users of the plurality of second users; and

selecting the image and text query pair from the list for presentation to one or more third users, the selection based on the modified position of the image and text query pair in the list.

15. The system of claim 13, wherein the operations further comprise:

determining an impression score for the image and text query pair based on an indication of interest received from each second user; and

modifying a position of the image and text pair in the list provided to a plurality of third users based on the impression score.

16. The system of claim 9, wherein the operations comprise:

providing data to the first user for presentation, the data relating to one or more image and text query pairs received from the first user or one or more suggested answers submitted or selected by the first user in response to image and text query pairs received from one or more second users.

17. A non-transitory computer storage medium encoded with a computer program, the program comprising instructions that when executed by one or more computers cause the one or more computers to perform operations comprising:

receiving, from a user device of a first user, an image and a text query related to the image, wherein the text query requests information identifying content presented in the image;

providing for presentation the image and the text query to a plurality of second users different from the first user; and

receiving a suggested answer to the text query from each of a group of second users of the plurality of second users, and wherein a suggested answer from a particular second user is either a new suggested answer submitted by the particular second user in response to the text query or a previous suggested answer to the text query, the previous suggested answer being a suggested answer previously submitted by a different second user of the plurality of second users in response to the text query.

18. The computer storage medium of claim 17, further comprising instructions that when executed by one or more computers cause the one or more computers to perform operations comprising:

providing one or more of the suggested answer for presentation to the first user.

19. The computer storage medium of claim 18, wherein providing one or more of the suggested answers includes providing one or more ranked suggested answers and wherein providing one or more ranked suggested answers comprises:

grouping similar suggested answers based on a semantic similarity measure; and

ranking the suggested answers where each group of similar suggested answers is given a combined ranking.

20. The computer storage medium of claim 17, wherein providing the image and the text query to the plurality of second users further comprises:

including the image and the text query pair in a list of additional image and query pairs, the image and text query pair having a position in the list; and

selecting the image and text query pair from the list for presentation to the plurality of second users, the selection based on the position of the image and text query pair in the list.