Updating a search index using reported browser history data

• US 9,424,356 B2
• Filed: 12/09/2010
• Issued: 08/23/2016
• Est. Priority Date: 12/09/2010
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Sun, Walter, Ahmed, Junaid, Li, Yipeng, Bailey, Peter, Dandekar, Nikhil, Parthasarathy, Sasi, Chen, Xin, Zhang, Xiao
• Primary Examiner(s): HUANG, MIRANDA M
• Application Number:
  US12/964,092
• Publication Number:
  US 20120150831A1
• Time in Patent Office: 2,084 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: G06F 16/22 Indexing; Data structures therefor; Storage structures
• CPC Class Codes: G06F 16/24578 using ranking
• CPC Class Codes: G06F 16/31 Indexing; Data structures therefor; Storage structures
• CPC Class Codes: G06F 16/951 Indexing; Web crawling techniques
• CPC Class Codes: G06F 16/9535 Search customisation based on user profiles and personalisation
• CPC Class Codes: G06F 16/955 using information identifiers, e.g. uniform resource locators [URL]

Abstract

Methods, systems, and computer-readable media are provided for updating a search index with new uniform resource locators (URLs) and spiking URLs with increased user interest. History data, provided from browser applications residing on users'"'"' computers that indicate URLs accessed by the users, is parsed to identify new/previously unknown URLs. The history data also indicates URLs in which there is increased interest based on a number of recent hits as compared to an average number of hits determined over time. Author postings of new URLs to social networking sites and a quality rating of the authors may also be used to identify and filter new URLs. Search indexes are updated with the new and spiking URL data. As such, lag time between posting of new URLs and spiking of URL interest and inclusion of this data in a search index is greatly decreased.

Claims

1. A computer-implemented method for updating a search index to identify documents with spiking interest, the method comprising:

periodically receiving, at a first computing device having a processor and a memory, a history file from each of a plurality of second computing devices, the history file including a uniform resource identifier (URI) that has been accessed via a respective one of the plurality of second computing devices and metadata indicating a time of day when the URIs were accessed, wherein the plurality of second computing devices form a group of second computing devices;

determining a number of instances of the URI in the history files for the group of second computing devices, wherein the number of instances occurs in a predetermined time period between a given start and stop time;

calculating, automatically without user interaction, an average number of instances of the URI in the history files for the group of second computing devices, wherein the average number of instances occurs in the predetermined time period over a predetermined number of previous days, and wherein the predetermined time period is between the given start and stop time each day;

determining that the number of instances of the URI in the history file is at least a predetermined amount greater than the average number of instances of the URI in the history files by, automatically without user interaction, comparing the number of instances of the URI for the group of second computing devices to the average number of instances of the URI over the predetermined number of days for said group of second computing devices;

identifying the URI as a spiking URI when the number of instances of the URI is at least a predetermined amount greater than the average number of instances of the URI occurring over the predetermined number of days; and

updating a search index to indicate the spiking URI, the search index being useable by a search engine to identify search results for a search query.

2. The method of claim 1, wherein the predetermined number of days is seven or an integer multiple of seven.

3. The method of claim 1, wherein the predetermined amount is greater than twice the average number of instances of the URI over the predetermined number of days.

4. The method of claim 1, wherein each of the second computing devices includes a browser application that generates the history file and communicates the history file to the first computing device.

5. The method of claim 4, wherein a user authorizes the browser application to track URIs accessed via the respective one of the plurality of second computing devices.

6. The method of claim 1, wherein a score is generated for the spiking URI based at least in part on the comparing of the number of instances of the URI to the average number of instances of the URI over the predetermined number of days.

7. The method of claim 6, wherein the search index is a fresh index that is periodically updated in intervals of less than one hour and the score is used to aid in ranking URIs in fresh index.

8. One or more computer-readable media having computer-executable instructions embodied thereon that, when executed, perform a method for updating a search index with new and spiking uniform resource identifiers (URIs), the method comprising:

periodically receiving, at a first computing device having a processor and a memory, a history file from each of a plurality of second computing devices, the history file including one or more URIs that have been accessed via a respective one of the plurality of second computing devices and metadata indicating a time of day when the URIs were accessed, wherein the history file is a file including one or more URIs, and wherein the plurality of second computing devices form a group of second computing devices;

identifying, by the first computing device, a first new URI from one or more of the history files for the group of second computing devices, the first new URI associated with a document that was previously unknown to the first computing device;

determining a number of instances of a second URI of the one or more URIs included in the history files for the group of second computing devices which were accessed within a predetermined time period between a given start and stop time;

determining an average number of instances of the second URI in the history files for the group of second computing devices accessed in the predetermined time period over a predetermined number of days, wherein the predetermined time period is between the given start and stop time each day;

determining that the number of instances of the second of the one or more URI included in the history file is at least a predetermined amount greater than the average number of instances of the second URI in the history files by, automatically without user interaction, comparing the number of instances of the second URI to the average number of instances of the second URI over the predetermined number of days for said group of second computing devices;

identifying the second URI as a spiking URI when the number of instances of the second URI is at least a predetermined amount greater than the average number of instances of the second URI over the predetermined number of days;

updating the search index with the first new URI; and

updating the search index to indicate the spiking URI, the search index being useable by a search engine to identify search results for a search query.

9. The computer-readable media of claim 8, further comprising:

generating a first score for the first new URI based at least partially on a number of the second computing devices from the plurality of second computing devices that include an indication of the first new URI in a respective history file; and

determining whether to update the search index with the first new URI based on the first score.

10. The computer-readable media of claim 9, further comprising:

identifying a third new URI from a list of URIs posted by authors on a social networking website, the third new URI not being previously included in the search index, and the third new URI being the same or different than the first new URL;

determining a quality of an author that posted the third new URI on the social networking website, wherein the quality of the author is based at least on a time that the author posted the third new URI and the author'"'"'s history of posting URIs that have not been previously included in the search index;

generating a second score for the third new URI based at least in part on the quality of the author.

11. The computer-readable media of claim 10,

wherein determining whether to update the search index with the first new URI based on the first score is also based on the second score when the first new URI and the third new URI are the same.

12. The computer-readable media of claim 8,

wherein the search index is updated with the first new URI within thirty minutes of identifying the first new URI.

13. The computer-readable media of claim 8,

wherein the first new URI and the second URI are the same.