MEDIA OBJECT QUERY SUBMISSION AND RESPONSE

• US 20120284254A1
• Filed: 07/18/2012
• Published: 11/08/2012
• Est. Priority Date: 03/31/2008
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Garg, Gaurav, Bapna, Abhishek
• Granted Patent: US 8,589,383 B2
• Time in Patent Office: Days
• US Class Current: 707/717
• CPC Class Codes: G06F 16/24578 using ranking
• CPC Class Codes: G06F 16/248 Presentation of query results
• CPC Class Codes: G06F 16/285 Clustering or classification
• CPC Class Codes: G06F 16/3329 Natural language query formulation or dialogue systems
• CPC Class Codes: G06F 16/532 Query formulation, e.g. graphical querying
• CPC Class Codes: G06F 16/90324 using system suggestions
• CPC Class Codes: G06F 16/951 Indexing; Web crawling techniques

Abstract

Methods and systems for submitting media object queries and receiving suggested answers for the media object queries. In one aspect, a method includes receiving from a first user a first media object and a first query relating to content in the first media object, presenting the first media object and the first query to multiple second users, receiving a suggested answer to the first query from each of two or more second users of the multiple second users, where at least two of the suggested answers are distinct, ranking the suggested answers, and presenting one or more of the ranked suggested answers to the first user.

Claims

1. A computer-implemented method comprising:

receiving, from a user device of a first user, a first media object and a first query relating to content in the first media object, wherein the first query requests information identifying content presented in the first media object;

providing for presentation the first media object and the first query to a plurality of second users different from the first user;

receiving a suggested answer to the first query from each of a group of second users of the plurality of second users, and wherein a suggested answer from a particular second user is either a new suggested answer submitted by the particular second user in response to the first query or a previous suggested answer to the first query selected by the particular second user, the previous suggested answer being a suggested answer previously submitted by a different second user of the plurality of second users in response to the first query; and

providing for presentation one or more of the suggested answers to the first user.

2. The method of claim 1, wherein providing one or more of the suggested answers includes providing one or more ranked suggested answers and wherein providing one or more ranked suggested answers includes:

grouping similar suggested answers based on a semantic similarity measure; and

ranking the suggested answers where each group of similar suggested answers is given a combined ranking

3. The method of claim 2, wherein ranking the suggested answers further comprises:

for each group of similar suggested answers, determining a rank score for the group by counting the instances that a suggested answer in the group was submitted or selected by a second user;

for each distinct suggested answer, determining a rank score for the distinct suggested answer by counting the instances that the distinct suggested answer was submitted or selected by a second user; and

ranking the distinct suggested answers and groups of similar suggested answers based on the determined rank scores.

4. The method of claim 1, wherein providing the first media object and the first query to the plurality of second users further comprises:

including the first media object and query pair in a list of second media object and query pairs, the first media object and query pair having a position in the list; and

selecting the first media object and query pair from the list for presentation to the plurality of second users, the selection based on the position of the first media object and query pair in the list.

5. The method of claim 4, further comprising:

modifying the position of the first media object and query pair in the list based on indications of interest in the first media object and query pair from the one or more second users of the plurality of second users; and

selecting the first media object and query pair from the list for presentation to one or more third users, the selection based on the modified position of the first media object and query pair in the list.

6. The method of claim 1, further comprising:

providing data to the first user for presentation, the data relating to one or more media object and query pairs received from the first user or one or more suggested answers submitted or selected by the first user in response to media object and query pairs received from second users.

7. The method of claim 1, wherein the media object is one of an image file, a video file, or an audio file.

8. A system comprising:

a user interface device; and

one or more computers operable to interact with the user interface device and to;

receive from a first user of the user interface device a first media object and a first query relating to content in the first media object, wherein the first query requests information identifying content presented in the first media object;

provide for presentation the first media object and the first query to a plurality of second users different from the first user;

receive a suggested answer to the first query from each of a group of second users of the plurality of second users, and wherein a suggested answer from a particular second user is either a new suggested answer submitted by the particular second user in response to the first query or a previous suggested answer to the first query selected by the particular second user, the previous suggested answer being a suggested answer previously submitted by a different second user of the plurality of second users in response to the first query; and

provide for presentation one or more of the suggested answers to the first user on the user interface device.

9. The system of claim 8, wherein providing one or more of the suggested answers includes providing one or more ranked suggested answers and wherein providing one or more ranked suggested answers includes:

grouping similar suggested answers based on a semantic similarity measure; and

ranking the suggested answers where each group of similar suggested answers is given a combined ranking

10. The system of claim 9, wherein ranking the suggested answers further comprises:

for each group of similar suggested answers, determining a rank score for the group by counting the instances that a suggested answer in the group was submitted or selected by a second user;

for each distinct suggested answer, determining a rank score for the distinct suggested answer by counting the instances that the distinct suggested answer was submitted or selected by a second user; and

ranking the distinct suggested answers and groups of similar suggested answers based on the determined rank scores.

11. The system of claim 8, wherein providing the first media object and the first query to the plurality of second users further comprises:

including the first media object and query pair in a list of second media object and query pairs, the first media object and query pair having a position in the list; and

selecting the first media object and query pair from the list for presentation to the plurality of second users, the selection based on the position of the first media object and query pair in the list.

12. The system of claim 11, wherein the one or more computers are further operable to:

modify the position of the first media object and query pair in the list based on indications of interest in the first media object and query pair from the one or more second users of the plurality of second users; and

select the first media object and query pair from the list for presentation to one or more third users, the selection based on the modified position of the first media object and query pair in the list.

13. The system of claim 8, wherein the one or more computers are further operable to:

provide data to the first user on the user interface device for presentation, the data relating to one or more media object and query pairs received from the first user or one or more suggested answers submitted or selected by the first user in response to media object and query pairs received from second users.

14. The system of claim 8, wherein the media object is one of an image file, a video file, or an audio file.

15. The system of claim 8, wherein the one or more computers comprise a server operable to interact with the user interface device through a data communication network, and the user interface device is operable to interact with the server as a client.

16. The system of claim 15, wherein the user interface device includes a networking interface.

17. The system of claim 8, wherein the one or more computers comprises one personal computer, and the personal computer comprises the user interface device.

18. A non-transitory computer storage medium encoded with a computer program, the program comprising instructions that when executed by one or more computers cause the one or more computers to perform operations comprising:

receiving, from a first user of the user interface device, a first media object and a first query relating to content in the first media object, wherein the first query requests information identifying content presented in the first media object;

providing for presentation the first media object and the first query to a plurality of second users different from the first user;

receiving a suggested answer to the first query from each of a group of second users of the plurality of second users, and wherein a suggested answer from a particular second user is either a new suggested answer submitted by the particular second user in response to the first query or a previous suggested answer to the first query selected by the particular second user, the previous suggested answer being a suggested answer previously submitted by a different second user of the plurality of second users in response to the first query; and

providing for presentation one or more of the suggested answers to the first user.

19. The non-transitory computer storage medium of claim 18, wherein providing one or more of the suggested answers includes providing one or more ranked suggested answers and wherein providing one or more ranked suggested answers includes:

grouping similar suggested answers based on a semantic similarity measure; and

ranking the suggested answers where each group of similar suggested answers is given a combined ranking

20. The non-transitory computer storage medium of claim 19, wherein ranking the suggested answers further comprises:

for each group of similar suggested answers, determining a rank score for the group by counting the instances that a suggested answer in the group was submitted or selected by a second user;

for each distinct suggested answer, determining a rank score for the distinct suggested answer by counting the instances that the distinct suggested answer was submitted or selected by a second user; and

ranking the distinct suggested answers and groups of similar suggested answers based on the determined rank scores.

21. The non-transitory computer storage medium of claim 18, wherein providing the first media object and the first query to the plurality of second users further comprises:

including the first media object and query pair in a list of second media object and query pairs, the first media object and query pair having a position in the list; and

selecting the first media object and query pair from the list for presentation to the plurality of second users, the selection based on the position of the first media object and query pair in the list.

22. The non-transitory computer storage medium of claim 21, wherein the computer program further comprises instructions that when executed by one or more computers cause the one or more computers to perform operations comprising:

modifying the position of the first media object and query pair in the list based on indications of interest in the first media object and query pair from the one or more second users of the plurality of second users; and

selecting the first media object and query pair from the list for presentation to one or more third users, the selection based on the modified position of the first media object and query pair in the list.

23. The non-transitory computer storage medium of claim 18, wherein the computer program further comprises instructions that when executed by one or more computers cause the one or more computers to perform operations comprising:

providing data to the first user for presentation, the data relating to one or more media object and query pairs received from the first user or one or more suggested answers submitted or selected by the first user in response to media object and query pairs received from second users.

24. The non-transitory computer storage medium of claim 18, wherein the media object is one of an image file, a video file, or an audio file.

25. A method comprising:

receiving, from a user device of a first user, a first media object and a first query relating to content in the first media object, wherein the first query requests information identifying content presented in the first media object;

providing for presentation the first media object and the first query to a plurality of second users different from the first user;

receiving a suggested answer to the first query from each of a group of second users of the plurality of second users, and wherein a suggested answer from a particular second user is either a new suggested answer submitted by the particular second user in response to the first query or a suggested answer selected by the particular second user from a plurality of suggested answers derived from previous suggested answers previously submitted by different second users of the plurality of second users in response to the first query; and

providing for presentation one or more of the suggested answers to the first user.

26. A system comprising:

a user interface device; and

one or more computers operable to interact with the user interface device and to;

receive, from a user device of a first user, a first media object and a first query relating to content in the first media object, wherein the first query requests information identifying content presented in the first media object;

provide for presentation the first media object and the first query to a plurality of second users different from the first user;

receive a suggested answer to the first query from each of a group of second users of the plurality of second users, and wherein a suggested answer from a particular second user is either a new suggested answer submitted by the particular second user in response to the first query or a suggested answer selected by the particular second user from a plurality of suggested answers derived from previous suggested answers previously submitted by different second users of the plurality of second users in response to the first query; and

provide for presentation one or more of the suggested answers to the first user.

27. A non-transitory computer storage medium encoded with a computer program, the program comprising instructions that when executed by one or more computers cause the one or more computers to perform operations comprising:

receiving, from a user device of a first user, a first media object and a first query relating to content in the first media object, wherein the first query requests information identifying content presented in the first media object;

providing for presentation the first media object and the first query to a plurality of second users different from the first user;

receiving a suggested answer to the first query from each of a group of second users of the plurality of second users, and wherein a suggested answer from a particular second user is either a new suggested answer submitted by the particular second user in response to the first query or a suggested answer selected by the particular second user from a plurality of suggested answers derived from previous suggested answers previously submitted by different second users of the plurality of second users in response to the first query; and

providing for presentation one or more of the suggested answers to the first user.