Method and system for search engine indexing and searching using the index

• US 20100287166A1
• Filed: 05/05/2010
• Published: 11/11/2010
• Est. Priority Date: 05/08/2009
• Status: Active Grant

• Current Assignee: Alibaba Group Holding Ltd.
• Original Assignee: Alibaba Group Holding Ltd.
• Inventors: Yang, Hanfei
• Granted Patent: US 8,977,623 B2
• Time in Patent Office: Days
• US Class Current: 707/741
• CPC Class Codes: G06F 16/2228 Indexing structures
• CPC Class Codes: G06F 16/285 Clustering or classification
• CPC Class Codes: G06F 16/316 Indexing structures
• CPC Class Codes: G06F 16/353 into predefined classes
• CPC Class Codes: G06F 16/90 Details of database functions independent of the retrieved data types
• CPC Class Codes: G06F 16/951 Indexing; Web crawling techniques

Abstract

Data indexing includes receiving data from a data source; classifying the data into one of a plurality of categories according to a predetermined data classification criteria; establishing a corresponding relationship between the data and an index associated with the data, the index having a preset maximum capacity; and recording the relationship between the data and the index. The index is one of a plurality of indices, and each of the plurality of indices is exclusively written by an index writing device.

Claims

1. A method for data indexing, comprising:

receiving data from a data source;

classifying the data into one of a plurality of categories according to a predetermined data classification criteria;

establishing a corresponding relationship between the data and an index associated with the data, the index having a preset maximum capacity; and

recording the relationship between the data and the index;

wherein;

the index is one of a plurality of indices; and

each of the plurality of indices is exclusively written by an index writing device.

2. The method of claim 1, further including:

receiving a search query;

determining an index in the plurality of indices that correspond to the received search query; and

outputting stored data associated with the index.

3. The method of claim 1, further including determining number of the plurality of indices based at least in part on capacity of the category and the preset maximum capacity of the index.

4. The method of claim 1, wherein establishing the corresponding relationship between the data and the index includes:

labeling the plurality of indices with consecutive positive integers;

assigning a unique integer value to the data;

dividing the unique integer value by the number of the plurality of indices and obtaining a remainder; and

establishing the correspondence relationship between the category of the data and one of the plurality of indices that has a serial number that is the same as the remainder.

5. The method of claim 1, wherein:

the index writing device is one of a plurality of index writing devices; and

recording the relationship between the data and the index includes;

labeling the plurality of index writing devices with consecutive positive integers;

dividing a serial number of the index by the number of the index writing devices to obtain a remainder; and

associating the data and an index writing device that has a serial number that is the same as the remainder.

6. The method of claim 1, wherein classifying the data into one of the plurality of categories is based at least in part on a property of the data.

7. The method of claim 1, wherein recording the relationship between the data and the index includes storing at least a portion of the data in a file, and storing the file and the data in a storage device.

8. A system for data indexing, comprising:

one or more processors configured to;

receive data from a data source;

classify the data into one of a plurality of categories according to a predetermined data classification criteria;

establish a corresponding relationship between the data and an index associated with the data, the index having a preset maximum capacity; and

record the relationship between the data and the index;

wherein;

the index is one of a plurality of indices; and

each of the plurality of indices is exclusively written by an index writing device; and

one or more memories coupled to the one or more processors, configured to provide the processors with instructions.

9. The system of claim 8, wherein the one or more processors are further configured to:

receive a search query;

determine an index in the plurality of indices that correspond to the received search query; and

output stored data associated with the index.

10. The system of claim 8, wherein the one or more processors are further configured to determine number of the plurality of indices based at least in part on capacity of the category and the preset maximum capacity of the index.

11. The system of claim 8, wherein establishing the corresponding relationship between the data and the index includes:

labeling the plurality of indices with consecutive positive integers;

assigning a unique integer value to the data;

dividing the unique integer value by the number of the plurality of indices and obtaining a remainder; and

establishing the correspondence relationship between the category of the data and one of the plurality of indices that has a serial number that is the same as the remainder.

12. The system of claim 8, wherein:

the index writing device is one of a plurality of index writing devices; and

recording the relationship between the data and the index includes;

labeling the plurality of index writing devices with consecutive positive integers;

dividing a serial number of the index by the number of the index writing devices to obtain a remainder; and

associating the data and an index writing device that has a serial number that is the same as the remainder.

13. The system of claim 8, wherein classifying the data into one of the plurality of categories is based at least in part on a property of the data.

14. The system of claim 8, wherein recording the relationship between the data and the index includes storing at least a portion of the data in a file, and storing the file and the data in a storage device.