Resource scoring adjustment based on entity selections

• US 10,303,684 B1
• Filed: 08/27/2013
• Issued: 05/28/2019
• Est. Priority Date: 08/27/2013
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google LLC (Alphabet Inc.)
• Inventors: Kurihara, Kenichi
• Primary Examiner(s): Kindred, Alford W
• Assistant Examiner(s): Davanlou, Soheila (Gina)
• Application Number:
  US14/011,463
• Time in Patent Office: 2,100 Days
• Field of Search: None
• CPC Class Codes: G06F 16/2453 Query optimisation
• CPC Class Codes: G06F 16/951 Indexing; Web crawling techniques

Abstract

Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, are provided for resource scoring adjustment based on entity selection. In one aspect, a method includes the actions of accessing resource data that specifies, for each of a plurality of resources, a resource identifier and one or more referenced entities, and accessing search term data that specifies a plurality of search terms, and for each search term, a selection value for each resource, each selection value being based on user selections of search results that referenced the resource to which the selection value corresponds. From the resource data and search term data, for each search term and each entity, a search term-entity selection value is determined that is based on the selection values of resources that reference the entity and that were referenced by search results in response to a query that included the search term.

Claims

1. A method performed by data processing apparatus, the method comprising:

accessing, by the data processing apparatus, resource data that specifies, for each of a plurality of resources;

a resource identifier that uniquely identifies the resource; and

one or more entities referenced in the resource;

accessing, by the data processing apparatus, search term data that specifies;

a plurality of search terms; and

for each search term, a selection value for each resource, each selection value being based on user selections of search results that referenced the resource to which the selection value corresponds and that were provided in response to a query that included the search term, wherein the selection value for each resource is a ratio of a first value to a second value, the first value being proportional to a number of times that search results that referenced the resource were provided in response to a query that included the search term and were selected by users, and the second value being proportional to a number of times that the resource was referenced by search results that were provided in response to a query that included the search term;

determining, by the data processing apparatus, from the resource data and search term data, for each search term and each entity, a search term-entity selection value that is based on aggregating the selection values of resources that reference the entity and that were referenced by search results in response to a query that included the search term, wherein the search term-entity selection value is proportional to the aggregated selection values of resources that reference the entity; and

storing, by the data processing apparatus, the search term-entity selection values in a data storage.

2. The method of claim 1, further comprising:

receiving, by the data processing apparatus, a search query;

determining a first search term included in the search query;

receiving, from a search engine, data specifying;

resources responsive to the search query; and

a ranking of the resources according to a first order, the ranking being indicative of the responsiveness of each of the resources relative to each of the other resources;

determining, from the resource data, that one of the resources references a first entity;

selecting the search term-entity selection value for the first entity and the first search term;

adjusting, based on the search term-entity selection value, the ranking of the resources to form a ranking of the resources according to a second order, wherein one of the resources is ranked in the second order different from its ranking in the first order.

3. The method of claim 2, wherein adjusting the ranking of the resources comprises adjusting the ranking of the one of the resources so that it is ranked higher in the second order than in the first order.

4. The method of claim 1, further comprising:

receiving, by the data processing apparatus, a search query;

determining a first search term included in the search query;

receiving, from a search engine, data specifying;

resources responsive to the search query; and

a ranking of the resources according to a first order, the ranking being indicative of the responsiveness of each of the resources relative to each of the other resources;

determining, from the resource data, that one of the resources references a set of entities;

selecting the search term-entity selection values for each of the entities of the plurality of entities and the first search term; and

adjusting each of the search term-entity selection values in inverse proportion to a cardinality of the set of entities.

5. The method of claim 4, further comprising adjusting, based on the search term-entity selection values, the ranking of the resources to form a ranking of the resources according to a second order, wherein one of the resources is ranked in the second order different from its ranking in the first order.

6. The method of claim 5, wherein adjusting, based on the search term-entity selection values, comprises:

determining a central tendency of the search term-entity selection values; and

adjusting the ranking of the resources based on the central tendency of the search term-entity selection values.

7. The method of claim 1, wherein the entities referenced in the resources are instances of noun classes.

8. Software stored in a computer readable storage device and including instructions executable by a data processing apparatus and upon such execution cause the data process apparatus to perform operations comprising:

accessing, by the data processing apparatus, resource data that specifies, for each of a plurality of resources;

a resource identifier that uniquely identifies the resource; and

one or more entities referenced in the resource;

accessing, by the data processing apparatus, search term data that specifies;

a plurality of search terms; and

for each search term, a selection value for each resource, each selection value being based on user selections of search results that referenced the resource to which the selection value corresponds and that were provided in response to a query that included the search term, wherein the selection value for each resource is a ratio of a first value to a second value, the first value being proportional to a number of times that search results that referenced the resource were provided in response to a query that included the search term and were selected by users, and the second value being proportional to a number of times that the resource was referenced by search results that were provided in response to a query that included the search term;

determining, by the data processing apparatus, from the resource data and search term data, for each search term and each entity, a search term-entity selection value that is based on aggregating the selection values of resources that reference the entity and that were referenced by search results in response to a query that included the search term, wherein the search term-entity selection value is proportional to the aggregated selection values of resources that reference the entity; and

storing, by the data processing apparatus, the search term-entity selection values in a data storage.

9. The software stored in a computer readable storage device of claim 8, wherein execution of the instructions by the data processing apparatus causes the data process apparatus to perform operations further comprising:

receiving, by the data processing apparatus, a search query;

determining a first search term included in the search query;

receiving, from a search engine, data specifying;

resources responsive to the search query; and

a ranking of the resources according to a first order, the ranking being indicative of the responsiveness of each of the resources relative to each of the other resources;

determining, from the resource data, that one of the resources references a first entity;

selecting the search term-entity selection value for the first entity and the first search term;

adjusting, based on the search term-entity selection value, the ranking of the resources to form a ranking of the resources according to a second order, wherein one of the resources is ranked in the second order different from its ranking in the first order.

10. The software stored in a computer readable storage device of claim 8, wherein execution of the instructions by the data processing apparatus causes the data process apparatus to perform operations further comprising:

receiving, by the data processing apparatus, a search query;

determining a first search term included in the search query;

receiving, from a search engine, data specifying;

resources responsive to the search query; and

a ranking of the resources according to a first order, the ranking being indicative of the responsiveness of each of the resources relative to each of the other resources;

determining, from the resource data, that one of the resources references a set of entities;

selecting the search term-entity selection values for each of the entities of the plurality of entities and the first search term; and

adjusting each of the search term-entity selection values in inverse proportion to a cardinality of the set of entities.

11. The software stored in a computer readable storage device of claim 10, wherein execution of the instructions by the data processing apparatus causes the data process apparatus to perform operations further comprising adjusting, based on the search term-entity selection values, the ranking of the resources to form a ranking of the resources according to a second order, wherein one of the resources is ranked in the second order different from its ranking in the first order.

12. The software stored in a computer readable storage device of claim 11, wherein adjusting, based on the search term-entity selection values, comprises:

determining a central tendency of the search term-entity selection values; and

adjusting the ranking of the resources based on the central tendency of the search term-entity selection values.

13. A system, comprising:

a data processing apparatus; and

a computer readable storage device including instructions executable by the data processing apparatus and upon such execution cause the data process apparatus to perform operations comprising;

accessing, by the data processing apparatus, resource data that specifies, for each of a plurality of resources;

a resource identifier that uniquely identifies the resource; and

one or more entities referenced in the resource;

accessing, by the data processing apparatus, search term data that specifies;

a plurality of search terms; and

for each search term, a selection value for each resource, each selection value being based on user selections of search results that referenced the resource to which the selection value corresponds and that were provided in response to a query that included the search term, wherein the selection value for each resource is a ratio of a first value to a second value, the first value being proportional to a number of times that search results that referenced the resource were provided in response to a query that included the search term and were selected by users, and the second value being proportional to a number of times that the resource was referenced by search results that were provided in response to a query that included the search term;

determining, by the data processing apparatus, from the resource data and search term data, for each search term and each entity, a search term-entity selection value that is based on aggregating the selection values of resources that reference the entity and that were referenced by search results in response to a query that included the search term, wherein the search term-entity selection value is proportional to the aggregated selection values of resources that reference the entity; and

storing, by the data processing apparatus, the search term-entity selection values in a data storage.

14. The system of claim 13, wherein execution of the instructions by the data processing apparatus causes the data process apparatus to perform operations further comprising:

receiving, by the data processing apparatus, a search query;

determining a first search term included in the search query;

receiving, from a search engine, data specifying;

resources responsive to the search query; and

a ranking of the resources according to a first order, the ranking being indicative of the responsiveness of each of the resources relative to each of the other resources;

determining, from the resource data, that one of the resources references a first entity;

selecting the search term-entity selection value for the first entity and the first search term;

adjusting, based on the search term-entity selection value, the ranking of the resources to form a ranking of the resources according to a second order, wherein one of the resources is ranked in the second order different from its ranking in the first order.

15. The system of claim 13, wherein execution of the instructions by the data processing apparatus causes the data process apparatus to perform operations further comprising:

receiving, by the data processing apparatus, a search query;

determining a first search term included in the search query;

receiving, from a search engine, data specifying;

resources responsive to the search query; and

a ranking of the resources according to a first order, the ranking being indicative of the responsiveness of each of the resources relative to each of the other resources;

determining, from the resource data, that one of the resources references a set of entities;

selecting the search term-entity selection values for each of the entities of the plurality of entities and the first search term; and

adjusting each of the search term-entity selection values in inverse proportion to a cardinality of the set of entities.

16. The system of claim 15, wherein execution of the instructions by the data processing apparatus causes the data process apparatus to perform operations further comprising adjusting, based on the search term-entity selection values, the ranking of the resources to form a ranking of the resources according to a second order, wherein one of the resources is ranked in the second order different from its ranking in the first order.

17. The system of claim 16, wherein adjusting, based on the search term-entity selection values, comprises:

determining a central tendency of the search term-entity selection values; and

adjusting the ranking of the resources based on the central tendency of the search term-entity selection values.