SYSTEMS AND METHODS TO BUILD AND UTILIZE A SEARCH INFRASTRUCTURE

• US 20140032566A1
• Filed: 12/28/2012
• Published: 01/30/2014
• Est. Priority Date: 07/25/2012
• Status: Active Grant

• Current Assignee: eBay Inc.
• Original Assignee: eBay Inc.
• Inventors: Agarwal, Swati, Henderson, Richard D., Libenzi, Davide, Nallapaneni, Jagadish, Sankaranthi, Pradeep, Whyte, Nicholas, Pan, Thomas, Hoffacker, Carson, Basu, Amit, Melnick, Andrew, Gang, He, Sun, Mel
• Granted Patent: US 9,607,049 B2
• Time in Patent Office: Days
• US Class Current: 707/741
• CPC Class Codes: G06F 16/2228 Indexing structures
• CPC Class Codes: G06F 16/245 Query processing
• CPC Class Codes: G06F 16/24578 using ranking
• CPC Class Codes: G06F 16/316 Indexing structures
• CPC Class Codes: G06F 16/319 Inverted lists
• CPC Class Codes: G06F 16/337 Profile generation, learning or modification
• CPC Class Codes: G06F 16/93 Document management systems

Abstract

Methods and systems to build and utilize a search infrastructure are described. The system generates index information components in real-time based on a database that is time-stamped. The system updates index information at a plurality of query node servers based on the index information components. A query engine receives a search query from a client machine and identifies search results based on the query and the index information. The system communicates the search results, over the network, to the client machine.

Claims

1. A system comprising:

a map-reduce job module to generate index information components in real-time based on a database that is time-stamped, the index information components comprise a full-index and a plurality of mini-indexes, the full-index comprises a snapshot of contents of the database at a first time, the plurality of mini-indexes respectively corresponding to a plurality snapshots of updates to the database that correspond to a plurality of time periods comprised of a start-time and an end-time;

a query engine to update the index information at a plurality of query node servers based on the index information components, the query engine to further receive a search query, over a network, from a client machine and identify search results based on the query and the index information; and

a front-end server to communicate the search results, over the network, to the client machine.

2. The system of claim 1, wherein the plurality of query node servers includes a first query node server and wherein the query engine updates the index information at the first query node server with the full-index and with the plurality of mini-indexes.

3. The system of claim 2, wherein the plurality of mini-indexes includes a first mini-index and wherein the query engine updates the first query node server based on the first mini-index.

4. The system of claim 3, wherein the full-index is associated with full-index bill of material information and the first mini-index is associated with a first mini-index bill of material information, wherein the full-index bill of material information includes a full-index identifier and the first mini-index bill of material information includes a full-index identifier.

5. The system of claim 4, wherein the query engine compares the full-index identifier in the full-index bill of material information with the full-index identifier in the mini-index bill of material information.

6. The system of claim 3, wherein the plurality of mini-index indexes includes a second mini-index and a third mini-index.

7. The system of claim 6, wherein the query engine blocks an update of the index information in the first query node server responsive to an identification of the second mini-index as arriving out of sequence.

8. The system of claim 6, wherein the query engine blocks an update of the index information in the first query node server responsive to receipt of the second mini-index and identification of the first mini-index as not stored in mini-index storage information.

9. The system of claim 3, wherein the query engine blocks an update of the index information in the first query node server responsive to an identification the mini-index is not compatible with the full-index that was utilized to update the index information.

10. A method comprising:

generating index information components in real-time based on a database that is time-stamped, the index information components comprising a full-index and a plurality of mini-indexes, the full-index comprises a snapshot of contents of the database at a first time, the plurality of mini-indexes respectively corresponding to a plurality snapshots of updates to the database that correspond to a plurality of time periods comprised of a start-time and an end-time;

updating index information at a plurality of query node servers based on the index information components;

receiving a search query, over a network, from a client machine and identifying search results based on the query and the index information; and

communicating the search results, over the network, to the client machine.

11. The method of claim 10, wherein the plurality of query node servers includes a first query node server and wherein the updating the index information includes updating the index information at the first query node server with the full-index and with the plurality of mini-indexes.

12. The method of claim 11, wherein the plurality of mini-indexes includes a first mini-index and wherein the updating the index information at the plurality of query node servers includes updating the first query node server based on the first mini-index.

13. The method of claim 12, wherein the full-index is associated with full-index bill of material information and the first mini-index is associated with a first mini-index bill of material information, wherein the full-index bill of material information includes a full-index identifier and the first mini-index bill of material information includes a full-index identifier.

14. The method of claim 13, wherein the updating the index information comprises comparing the full-index identifier in the full-index bill of material information with the full-index identifier in the mini-index bill of material information.

15. The method of claim 12, wherein the plurality of mini-index indexes includes a second mini-index and a third mini-index.

16. The method of claim 15, wherein the updating the index information comprises blocking the first query node server from updating the index information in the first query node server responsive to identifying the second mini-index as arriving out of sequence.

17. The method of claim 15, wherein the updating the index information comprises blocking the first query node server from updating the index information in the first query node server responsive to receiving the second mini-index and identifying the first mini-index as not being stored in mini-index storage information.

18. The method of claim 10, wherein the updating the index information comprises the first query node server from updating the index information in the first query node server responsive to identifying the mini-index is not compatible with the full-index that was utilized to update the index information.

19. A machine-readable medium comprising instructions, which when executed on a processor, cause the processor to perform a method comprising:

generating index information components in real-time based on a database that is time-stamped, the index information components comprising a full-index and a plurality of mini-indexes, the full-index comprises a snapshot of contents of the database at a first time, the plurality of mini-indexes respectively corresponding to a plurality snapshots of updates to the database that correspond to a plurality of time periods comprised of a start-time and an end-time;

updating index information at a plurality of query node servers based on the index information components;

receiving a search query, over a network, from a client machine and identifying search results based on the query and the index information; and

communicating the search results, over the network, to the client machine.

20. A system comprising:

a means to generate index information components in real-time based on a database that is time-stamped, the index information components comprise a full-index and a plurality of mini-indexes, the full-index comprises a snapshot of contents of the database at a first time, the plurality of mini-indexes respectively corresponding to a plurality snapshots of updates to the database that correspond to a plurality of time periods comprised of a start-time and an end-time;

a query engine to update index information at a plurality of query node servers based on the index information components, the query engine to further receive a search query, over a network, from a client machine and identify search results based on the query and the index information; and

a front-end server to communicate the search results, over the network, to the client machine.