Cloud search analytics

• US 9,152,667 B1
• Filed: 03/15/2013
• Issued: 10/06/2015
• Est. Priority Date: 03/15/2013
• Status: Active Grant

• Current Assignee: A9.com Incorporated (Amazon.com, Inc.)
• Original Assignee: A9.com Incorporated (Amazon.com, Inc.)
• Inventors: Wu, Nanheng, Kochummen Johnson, Anoop, Lewis, David Robert
• Primary Examiner(s): Liu, Hexing
• Application Number:
  US13/842,610
• Time in Patent Office: 935 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: G06F 16/245 Query processing
• CPC Class Codes: G06F 16/3331 Query processing
• CPC Class Codes: G06F 16/951 Indexing; Web crawling techniques

Abstract

Systems and methods of analyzing search metrics are disclosed. System users are provided with insight into the query or search activity in their system domains. Disclosed systems can enable continuous monitoring of search engine logs for search events (i.e., searches performed by applications using the search engine. Collected data regarding search events is used to derive various metrics such as the total number of queries performed in a relevant period, the total number of queries without results; the top N queries with counts; the top N queries which produced no results, with counts; and the top N documents in results, with counts. In at least one embodiment of the disclosure all such metrics are computed for a last full hour period and all metrics, except in some cases a top-N report, are available for user viewing on an hourly basis.

Claims

1. A computer-implemented method for analyzing keyword searches, comprising:

receiving information relating to a search submitted by a user;

determining whether each of one or more keywords in the search corresponds to one of a plurality of accessed keyword-counters, each accessed keyword-counter indicating a number of times the corresponding keyword was received in a search;

for each detected keyword corresponding to one of the accessed keyword-counters, incrementing the corresponding keyword-counter;

for each detected keyword which does not correspond to a keyword-counter, establishing a keyword-counter and setting the value of the established keyword-counter to an initial value;

storing the values of all keyword-counters in a first file in a fleet resource;

sending a copy of the first file to a reporting layer resource, the reporting layer resource receiving files with keyword-counter values from a plurality of network resources, wherein the reporting layer resource is capable of cumulating the values of the keyword-counters from the plurality of network resources to determine the N most commonly occurring cumulated values over a time T, the time T determined using at least one timer;

detecting a presence of one or more keywords in the search for which a search result was not returned;

determining whether each of one or more keywords in the search corresponds to one of a plurality of accessed keyword-counter, each accessed keyword-counter indicating a number of times the corresponding keyword was used in a search for which a search result was not returned;

for each detected keyword corresponding to an accessed keyword-counter, incrementing the corresponding keyword-counter;

for each such detected keyword not corresponding to a keyword-counter, establishing a keyword-counter and setting the value of the established keyword-counter to an initial value;

storing the values of all keyword-counters in a second file in the fleet resource;

sending a copy of the second file to a storage resource;

saving all sent copy files in the storage resource; and

setting the values of all keyword-counters in the second file in the fleet resource to zero (0).

2. The computer-implemented method of claim 1, further comprising:

retrieving all the saved files to a reporting layer resource;

deleting all the saved sent files on the storage resource;

cumulating the values of all the keyword-counters;

storing the cumulated values of the keyword-counters in the reporting layer resource;

determining the N most commonly occurring cumulated values; and

storing in the reporting layer resource, for subsequent retrieval, the N most commonly occurring values; and

storing in the reporting layer resource, for subsequent retrieval, the cumulated values of all keyword-counters for which a search result was not returned.

3. A computer-implemented method for analyzing keyword searches, comprising:

collecting data regarding search events occurring within multiple locations by

retrieving at least one copy of a first file containing values of document-counters from at least one fleet resource,

saving all retrieved copy files in at least one storage resource, and

setting at least one value of at least one document-counter in the first file in the fleet resource to zero (0);

periodically cumulating keyword-counter values based on the collected data by

setting the value of a timer to an initial value,

retrieving all relevant saved files containing values of keyword-counters from a storage resource to the reporting layer resource,

deleting all the relevant saved files on the storage resource,

cumulating the values of all the keyword-counters in the retrieved files,

storing the cumulated values of the keyword-counters in the reporting layer resource,

determining the N most commonly occurring cumulated values,

storing in the reporting layer resource, for subsequent retrieval, the N most commonly occurring values in the resource, and

storing in the reporting layer resource, for subsequent retrieval, the cumulated values of all keyword-counters for which a search result was not returned, until the value of the timer corresponds to a time T;

determining a first number of search events, occurring over a relevant period, producing search results and a second number of search events not producing search results;

determining at least one of N most commonly searched keywords or N most common documents produced by the search events in the relevant period; and

storing in a reporting layer resource at least one of the first number of search events or the second number of search events, and at least one of the N most commonly searched keywords or N most common documents, for subsequent retrieval.

4. The computer-implemented method of claim 3, wherein collecting data regarding search events occurring within multiple locations comprises:

receiving information relating to a search submitted by a user;

determining whether each of one or more keywords in the search corresponds to one of a plurality of accessed keyword-counters, each accessed keyword-counter indicating a number of times the corresponding keyword was received in a search for which a search was not returned;

for each detected keyword corresponding to an accessed keyword-counter, incrementing the corresponding keyword-counter;

for each detected keyword not corresponding to a keyword-counter, establishing a keyword-counter and setting the value of the established keyword-counter to an initial value; and

storing the values of all keyword-counters in a first file in at least one fleet resource.

5. The computer-implemented method of claim 3, wherein collecting data regarding search events comprises:

receiving information relating to a search submitted by a user;

determining whether each of one or more keywords corresponds to one of a plurality of accessed keyword-counters, each accessed keyword-counter indicating a number of times the corresponding keyword was received in the search;

for each detected keyword corresponding to one of the accessed keyword-counters, incrementing the corresponding keyword-counter;

for each detected keyword which does not correspond to a keyword-counter, establishing a keyword-counter and setting the value of the established keyword-counter to an initial value; and

storing the values of all keyword-counters in a first file in at least one fleet resource.

6. The computer-implemented method of claim 5, wherein collecting data regarding search events further comprises:

sending a copy of the first file to a storage resource;

saving all sent copy files in the storage resource; and

setting the values of all keyword-counters in the first file in the storage resource to zero (0).

7. The computer-implemented method of claim 6, wherein collecting data regarding search events further comprises:

retrieving all the saved files to the reporting layer resource;

deleting all the saved sent files on the storage resource;

cumulating the values of all the keyword-counters;

storing the cumulated values of the keyword-counters in the reporting layer resource;

determining an N most commonly occurring cumulated values; and

storing the N most commonly occurring values in the reporting layer resource for subsequent retrieval.

8. The computer-implemented method of claim 6, further periodically cumulating keyword-counter values based on the collected data comprises:

setting the value of a timer to an initial value; and

retrieving all the saved files to the reporting layer resource;

deleting all the saved sent files on the storage resource;

cumulating the values of all the keyword-counters;

storing the cumulated values of the keyword-counters in the reporting layer resource;

determining the N most commonly occurring cumulated values; and

storing the N most commonly occurring values in the reporting layer resource for subsequent retrieval,

until the value of the timer corresponds to a time T.

9. A system comprising:

at least one reporting layer resource;

at least one processor in signal communication with the reporting layer resource; and

a memory device including instructions that, when executed by the at least one processor, cause the system to;

collect data regarding search events occurring within multiple locations by

receiving information relating to a search submitted by a user,

determining whether each of one or more keywords in the search corresponds to one of a plurality of accessed keyword-counters, each accessed keyword-counter indicating a number of times the corresponding keyword was received in a search,

for each detected keyword corresponding to one of the accessed keyword-counters, incrementing the corresponding keyword-counter,

for each detected keyword not corresponding to a keyword-counter, establishing a keyword-counter and setting the value of the established keyword-counter to an initial value,

storing the values of all keyword-counters in a first file in a fleet resource,

periodically cumulate keyword-counter values based on the collected data

sending a copy of the first file to a storage resource,

saving all sent copy files in the storage resource, and

setting the values of all keyword-counters in the first file in the storage resource to zero (0); and

store in the reporting layer resource, for subsequent retrieval;

a determined total number of search events occurring in a relevant period producing search results;

a determined total number of search events occurring in the relevant period not producing search results;

a determined N most commonly searched keywords in the relevant period; and

a determined N most common documents produced by the search events.

10. The system of claim 9, wherein collecting data regarding search events occurring within multiple locations comprises:

retrieving at least one copy of a first file containing values of keyword-counters from at least one fleet resource;

saving all retrieved copy files in at least one storage resource;

setting at least one value of at least one keyword-counter in the first file in the fleet resource to zero (0).

11. The system of claim 9, wherein periodically cumulating keyword-counter values based on the collected data comprises:

setting the value of a timer to an initial value; and

retrieving all relevant saved files containing values of keyword-counters from a storage resource to the reporting layer resource;

deleting all the relevant saved files on the storage resource;

cumulating the values of all the keyword-counters in the retrieved files;

storing the cumulated values of the keyword-counters in the reporting layer resource;

determining the N most commonly occurring cumulated values; and

storing in the reporting layer resource, for subsequent retrieval, the N most commonly occurring values; and

storing in the reporting layer resource, for subsequent retrieval, the cumulated values of all keyword-counters for which a search result was not returned,

until the value of the timer corresponds to a time T.

12. The system of claim 9, wherein collecting data regarding search events occurring within multiple locations comprises:

receiving information relating to a search submitted by a user;

determining whether each of one or more keywords in the search corresponds to one of a plurality of accessed keyword-counters, each accessed keyword-counter indicating a number of times the corresponding keyword was received in a search for which a result was not returned;

for each detected keyword corresponding to an accessed keyword-counter, incrementing the corresponding keyword-counter;

for each detected keyword not corresponding to a keyword-counter, establishing a keyword-counter and setting the value of the established keyword-counter to an initial value; and

storing the values of all keyword-counters in a first file in a fleet resource.

13. The system of claim 9, wherein collecting data regarding search events further comprises:

retrieving all the saved files to the reporting layer resource;

deleting all the saved sent files on the storage resource;

cumulating the values of all the keyword-counters;

storing the cumulated values of the keyword-counters in the reporting layer resource;

determining an N most commonly occurring cumulated values; and

storing the N most commonly occurring values in the reporting layer resource for subsequent retrieval.

14. The system of claim 9, further periodically cumulating keyword-counter values based on the collected data comprises:

setting the value of a timer to an initial value; and

retrieving all the saved files to the network resource;

deleting all the saved sent files on the storage resource;

cumulating the values of all the keyword-counters;

storing the cumulated values of the keyword-counters in the reporting layer resource;

determining the N most commonly occurring cumulated values; and

storing the N most commonly occurring values in the reporting layer resource for subsequent retrieval,

until the value of the timer corresponds to a time T.

15. A non-transitory computer-readable storage medium including instructions for analyzing keyword searches, the instructions when executed by a processor of a computing system causing the computing system to:

collect data regarding search events occurring within multiple locations by

retrieving at least one copy of a first file containing values of keyword-counters from at least one fleet resource,

saving all retrieved copy files in at least one storage resource, and

setting at least one value of at least one keyword-counter in the first file in the fleet resource to zero (0);

periodically cumulate keyword-counter values based on the collected data by

setting the value of a timer to an initial value,

retrieving all relevant saved files containing values of keyword-counters from a storage resource to the reporting layer resource,

deleting all the relevant saved files on the storage resource,

cumulating the values of all the keyword-counters in the retrieved files,

storing the cumulated values of the keyword-counters in the reporting layer resource,

determining the N most commonly occurring cumulated values,

storing in the reporting layer resource, for subsequent retrieval, the N most commonly occurring values in the resource, and

storing in the reporting layer resource, for subsequent retrieval, the cumulated values of all keyword-counters for which a search result was not returned, until the value of the timer corresponds to a time T; and

store in the reporting layer resource, for subsequent retrieval;

a determined total number of search events occurring in a relevant period producing search results;

a determined total number of search events occurring in the relevant period not producing search results;

a determined N most commonly searched keywords in the relevant period; and

a determined N most common documents produced by the search events.

16. The non-transitory computer readable storage medium of claim 15, wherein collecting data regarding search events occurring within multiple locations comprises:

receiving information relating to a search submitted by a user;

determining whether each of one or more keywords in the search corresponds to one of a plurality of accessed keyword-counters, each accessed keyword-counter indicating a number of times the corresponding keyword was received in a search for which a search result was not returned;

for each detected keyword corresponding to an accessed keyword-counter, incrementing the corresponding keyword-counter;

for each detected keyword not corresponding to a keyword-counter, establishing a keyword-counter and setting the value of the established keyword-counter to an initial value; and

storing the values of all keyword-counters in a first file in a fleet resource.

17. The non-transitory computer readable storage medium of claim 15, wherein collecting data regarding search events comprises:

receiving information relating to a search submitted by a user;

determining whether each of one or more keywords in the search corresponds to one of a plurality of accessed keyword-counters, each accessed keyword-counter indicating a number of times the corresponding keyword was received in a search;

for each detected keyword corresponding to one of the accessed keyword-counters, incrementing the corresponding keyword-counter;

for each detected keyword not corresponding to a keyword-counter, establishing a keyword-counter and setting the value of the established keyword-counter to an initial value; and

storing the values of all keyword-counters in a first file in a fleet resource.