Cloud search analytics

• US 10,311,160 B2
• Filed: 09/17/2015
• Issued: 06/04/2019
• Est. Priority Date: 03/15/2013
• Status: Active Grant

• Current Assignee: A9.com Incorporated (Amazon.com, Inc.)
• Original Assignee: A9.com Incorporated (Amazon.com, Inc.)
• Inventors: Wu, Nanheng, Kochummen Johnson, Anoop, Lewis, David Robert
• Primary Examiner(s): Wilson, Kimberly L
• Application Number:
  US14/857,692
• Publication Number:
  US 20160004776A1
• Time in Patent Office: 1,356 Days
• Field of Search: 707769
• CPC Class Codes: G06F 16/245 Query processing
• CPC Class Codes: G06F 16/3331 Query processing
• CPC Class Codes: G06F 16/951 Indexing; Web crawling techniques

Abstract

Systems and methods of analyzing search metrics are disclosed. System users are provided with insight into the query or search activity in their system domains. Disclosed systems can enable continuous monitoring of search engine logs for search events (i.e., searches performed by applications using the search engine. Collected data regarding search events is used to derive various metrics such as the total number of queries performed in a relevant period, the total number of queries without results; the top N queries with counts; the top N queries which produced no results, with counts; and the top N documents in results, with counts. In at least one embodiment of the disclosure all such metrics are computed for a last full hour period and all metrics, except in some cases a top-N report, are available for user viewing on an hourly basis.

Claims

1. A computer-implemented method, comprising:

receiving, from a fleet resource, a search request for a keyword stored in a storage resource of keywords;

analyzing the storage resource of keywords to determine a first number of occurrences of the keyword;

associating the first number of occurrences with a first keyword-counter value;

storing the first keyword-counter value in a first file in the fleet resource;

saving a copy of the first file to a reporting layer resource, the storage resource of keywords remote from the fleet resource and the reporting layer resource;

detecting that a search result was not returned for the search request, indicating that the keyword was not found within the storage resource of keywords;

incrementing a second keyword-counter value associated with the keyword, the second keyword-counter value indicating a second number of occurrences the keyword was used in a search for which a search result was not returned;

storing the second keyword-counter value in a second file in the fleet resource;

saving a copy of the second file to the reporting layer resource;

deleting the first file and the second file from the fleet resource after the copy of the first file and the copy of the second file are saved to the reporting layer resource; and

associating at least the first keyword-counter value in the first file and the second-keyword counter value in the second file in the fleet resource to an initial value of zero after saving the copy of the first file and the copy of the second file.

2. The computer-implemented method of claim 1, wherein the reporting layer resource receives files with a plurality of keyword-counter values corresponding to a plurality of keywords from multiple network resources, and wherein the reporting layer resource is capable of determining calculating a cumulated keyword-counter value for the keyword over a time interval, the time interval determined using at least one timer.

3. The computer-implemented method of claim 1, further comprising:

retrieving the copy of the first file from the reporting layer resource;

deleting the copy of the second file on the storage resource;

storing a cumulated keyword-counter value for the keyword from the copy of the first file;

determining N highest cumulated values; and

storing the N highest cumulated values in the reporting layer resource for subsequent retrieval.

4. The computer-implemented method of claim 1, further comprising:

accessing the copy of the second file saved on the storage resource;

detecting a new keyword in the search that did not return a result;

set a new keyword-counter value for the new keyword to one (1); and

storing the new keyword-counter value for the new keyword in the second file in the fleet resource.

5. The computer-implemented method of claim 1, further comprising:

retrieving a subset of saved files to the reporting layer resource;

deleting the subset of saved files on the storage resource;

cumulating the values of a subset of the keyword-counters;

storing the cumulated values of the subset of the keyword-counters in the reporting layer resource;

determining N highest cumulated values;

storing, in the reporting layer resource, the N highest cumulated values; and

storing, in the reporting layer resource, the cumulated values of the subset of keyword-counters for which a search result was not returned.

6. A computer-implemented method comprising:

receiving a search that includes a keyword, the search for the keyword in a computing device, the computing device storing a plurality of documents;

analyzing a storage resource of documents to determine a first number of documents containing the keyword in a search result;

associating the first number of documents with a first keyword-counter value;

storing the first keyword-counter value in a first file in a resource;

saving a copy of the first file to a reporting layer resource, the storage resource of documents remote from the resource and the reporting layer resource;

detecting that a search result was not returned for the search indicating that the keyword was not found within the plurality of documents stored on the computing device;

incrementing a second keyword-counter value associated with the keyword, the second keyword-counter value indicating a second number of documents the keyword was used in a search for which a search result was not returned;

storing the second keyword-counter value in a second file in the resource;

saving a copy of the second file to the reporting layer resource; and

associating at least the first keyword-counter value in the first file and the second-keyword counter value in the second file in the resource to an initial value of zero after saving the copy of the first file and the copy of the second file.

7. The computer-implemented method of claim 6, further comprising:

determining a cumulated value of keyword-counters for which a search result was not returned within a relevant time period; and

storing in the reporting layer resource, for subsequent retrieval, the cumulated value of the keyword-counters for which a search result was not returned.

8. The computer-implemented method of claim 6, further comprising:

retrieving, over a relevant time period, the second file containing keyword-counter values;

determining whether each keyword corresponds to a keyword-counter, each keyword-counter indicating a number of times the corresponding keyword was received in the search, the determining based at least in part on information relating to the search;

for each keyword corresponding to a keyword-counter, incrementing the corresponding keyword-counter;

for each keyword which does not correspond to a keyword-counter, establishing a keyword-counter and setting the value of the established keyword-counter to one (1); and

storing a respective value of all keyword-counters in the second file in the resource.

9. The computer-implemented method of claim 8, wherein retrieving, over the relevant time period, the second file containing keyword-counter values further comprises:

sending a copy of the second file to a storage resource;

saving the copy of the second file to the storage resource; and

setting the respective value of all keyword-counters in the second file in the storage resource to zero (0).

10. The computer-implemented method of claim 6, further comprising:

collecting data regarding search events occurring within multiple locations;

periodically cumulating keyword-counter values based on the collected data;

determining a first number of search events, occurring over a relevant time period, producing search results and a second number of search events not producing search results; and

determining at least one of N highest cumulated keywords or N highest cumulated documents produced by the search events in the relevant time period.

11. The computer-implemented method of claim 10, wherein periodically cumulating keyword-counter values based on the collected data comprises:

setting the value of a timer to an initial value;

retrieving a subset of the saved files to the reporting layer resource;

deleting a subset of the saved sent files on the storage resource of documents;

cumulating the values of a subset of the keyword-counters;

storing the cumulated values of the keyword-counters in the reporting layer resource;

determining N highest cumulated values; and

storing the N highest cumulated values in the reporting layer resource for subsequent retrieval, until the value of the timer corresponds to a time T.

12. A system, comprising:

at least one reporting layer resource;

at least one processor in signal communication with the at least one reporting layer resource; and

a memory device including instructions that, when executed by the at least one processor, cause the system to;

collect data regarding search events occurring within multiple locations;

receive information relating to a search submitted by a user;

determining whether each of one or more keywords in the search corresponds to one of a plurality of accessed keyword-counters based at least in part on the collected data, each accessed keyword-counter indicating a number of times the corresponding keyword was received in a search for which a result was not returned;

for each detected keyword corresponding to one of the accessed keyword-counters, incrementing the corresponding keyword-counter;

for each detected keyword not corresponding to a keyword-counter, establishing a keyword-counter and setting a value of the established keyword-counter to an initial value;

store in the at least one reporting layer resource, in a first file for subsequent retrieval;

a determined total number of search events occurring in a relevant period not producing search results;

a determined N highest cumulated keywords in the relevant period; and

a determined N highest cumulated documents produced by the search events;

send a copy of the first file to a storage resource;

save all sent copy files in the storage resource; and

set a respective value of all keyword-counters in the first file in the storage resource to an initial value of zero after saving all sent copy files.

13. The system of claim 12, wherein collecting data regarding search events occurring within multiple locations comprises:

retrieving at least one copy of a first file containing values of keyword-counters from at least one fleet resource;

saving all retrieved copy files in at least one storage resource; and

setting at least one value of at least one keyword-counter in the first file in the fleet resource to zero (0).

14. The system of claim 12, wherein periodically cumulating keyword-counter values based on the collected data comprises:

setting the value of a timer to an initial value;

retrieving all relevant saved files containing values of keyword-counters from a storage resource to the at least one reporting layer resource;

deleting all the relevant saved files on the storage resource;

cumulating the values of all the keyword-counters in the retrieved files;

storing the cumulated values of the keyword-counters in the at least one reporting layer resource;

determining N highest cumulated values;

storing in the at least one reporting layer resource, for subsequent retrieval, the N highest cumulated values; and

storing in the reporting layer resource, for subsequent retrieval, the cumulated values of all keyword-counters for which a search result was not returned, until the value of the timer corresponds to a time T.

15. The system of claim 12, wherein collecting data regarding search events comprises:

receiving information relating to a search submitted by a user;

determining whether each of one or more keywords in the search corresponds to one of a plurality of accessed keyword-counters, each accessed keyword-counter indicating a number of times the corresponding keyword was received in a search;

for each detected keyword corresponding to one of the accessed keyword-counters, incrementing the corresponding keyword-counter;

for each detected keyword not corresponding to a keyword-counter, establishing a keyword-counter and setting the value of the established keyword-counter to an initial value; and

storing the respective values of all keyword-counters in the first file in the fleet resource.

16. A non-transitory computer-readable storage medium including instructions for analyzing keyword searches, the instructions when executed by a processor of a computing system causing the computing system to:

collect data regarding search events occurring within multiple locations;

receiving information relating to a search submitted by a user;

determining whether each of one or more keywords in the search corresponds to one of a plurality of accessed keyword-counters based at least in part on the collected data, each accessed keyword-counter indicating a number of times the corresponding keyword was received in a search for which a search result was not returned;

for each detected keyword corresponding to an accessed keyword-counter, incrementing the corresponding keyword-counter;

for each detected keyword not corresponding to a keyword-counter, establishing a keyword-counter and setting a value of the established keyword-counter to an initial value; and

store in a first file in the at least one reporting layer resource, for subsequent retrieval;

a determined total number of search events occurring in a relevant period producing search results;

a determined total number of search events occurring in the relevant period not producing search results;

a determined N highest cumulated keywords in the relevant period; and

a determined N highest cumulated documents produced by the search events;

retrieve at least one copy of a first file containing values of keyword-counters from at least one fleet resource;

save all retrieved copy files in at least one storage resource; and

set at least one value of at least one keyword-counter in the first file in the at least one fleet resource to zero (0) after saving all retrieved copy files.

17. The non-transitory computer readable storage medium of claim 16, wherein periodically cumulating keyword-counter values based on the collected data comprises:

setting the value of a timer to an initial value;

retrieving all relevant saved files containing values of keyword-counters from a storage resource to the at least one reporting layer resource;

deleting all the relevant saved files on the storage resource;

cumulating the values of all the keyword-counters in the retrieved files;

storing the cumulated values of the keyword-counters in the at least one reporting layer resource;

determining N highest cumulated values;

storing in the at least one reporting layer resource, for subsequent retrieval, the N highest cumulated values in the resource; and

storing in the reporting layer resource, for subsequent retrieval, the cumulated values of all keyword-counters for which a search result was not returned,

until the value of the timer corresponds to a time T.

18. The non-transitory computer readable storage medium of claim 16, wherein collecting data regarding search events comprises:

receiving information relating to a search submitted by a user;

determining whether each of one or more keywords in the search corresponds to one of a plurality of accessed keyword-counters, each accessed keyword-counter indicating a number of times the corresponding keyword was received in a search;

for each detected keyword corresponding to one of the accessed keyword-counters, incrementing the corresponding keyword-counter;

for each detected keyword not corresponding to a keyword-counter, establishing a keyword-counter and setting the value of the established keyword-counter to an initial value; and

storing the values of all keyword-counters in a first file in a fleet resource.