Method of index recommendation for NoSQL database

• US 10,127,254 B2
• Filed: 09/29/2015
• Issued: 11/13/2018
• Est. Priority Date: 10/30/2014
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Chen, Hao, Li, Feng, Li, Shao C., Li, Qi Cheng, Mei, Li Jun, Xie, Fang Quan
• Primary Examiner(s): Truong, Dennis
• Application Number:
  US14/869,493
• Publication Number:
  US 20160125004A1
• Time in Patent Office: 1,141 Days
• Field of Search: 707741
• CPC Class Codes: G06F 16/2228 Indexing structures
• CPC Class Codes: G06F 16/93 Document management systems

Abstract

In one embodiment, a method for indexing a document database includes determining, according to user'"'"'s access status on a plurality of documents in the document database, index indicators from attributes of respective fields of the plurality of documents, wherein the index indicators are used for indexing the plurality of documents, dividing the plurality of documents into a plurality of document sets, indexing the plurality of document sets according to the index indicators. The method may include dividing a plurality of documents in a document database into document sets by utilizing an attribute that a document database is easy to be divided into chunks, and may effectively implement indexing of the document database for the document sets according to another embodiment.

Claims

1. A method for indexing a document database, comprising:

determining, according to user'"'"'s access status on a plurality of documents in the document database, index indicators from attributes of respective fields of the plurality of documents, wherein the index indicators are used for indexing the plurality of document, wherein the determining, according to user'"'"'s access status on a plurality of documents in the document database, index indicators from attributes of respective fields of the plurality of documents comprises;

recording user'"'"'s operation on the respective fields of the plurality of documents within a period of time;

collecting statistics about the attributes of the respective fields of the plurality of documents and collecting statistics about a number of times of a same operation for each attribute; and

determining the index indicators from the attributes according to the number of times of a same type of operation for each attribute;

dividing the plurality of documents into a plurality of document sets, wherein a number of the plurality of document sets is greater than or equal to a number of the index indicators; and

indexing the plurality of document sets according to the index indicators after dividing the plurality of documents.

2. The method according to claim 1, wherein, in response to an attribute of a field b in the respective fields including sub-attributes, the number of times of the same operation for each attribute is a sum of the numbers of times of the same operation for all the sub-attributes of the attribute of the field b.

3. The method according to claim 1, wherein user'"'"'s operation on the respective fields of the plurality of documents in the document database includes at least one of the following:

query operation, write operation, and grouping/sorting operation, and wherein the determining the index indicators from the attributes according to the number of times of the same type of operation for each attribute further comprises;

assigning a weight to each of the operations;

multiplying the weight for each of the same type of operation for each attribute by the number of times of the same type of operation to obtain weighted values for each of the same type of operation for each attribute;

summing the weighted values of all operations for each attribute to generate attribute weighted values;

sorting the attributes according to corresponding attribute weighted values; and

selecting a predetermined number of attributes that have a highest corresponding attribute weighted value.

4. The method according to claim 1, wherein the number of the plurality of document sets is a positive integer multiple of the number of the index indicators greater than one.

5. The method according to claim 1, wherein the indexing the plurality of document sets according to the index indicators comprises:

selecting document sets according to a number of the index indicators;

allocating an index indicator to each selected document set and performing indexing according to the allocated index indicator;

in response to determining that there is a document set that has been indexed, obtaining an index indicator a allocated to the document set that has been indexed; and

in response to determining that there are document sets to which index indicators are not allocated, selecting a document set to which an index indicator is not allocated, and performing indexing according to the index indicator a.

6. The method according to claim 5, wherein the indexing the plurality of document sets according to the index indicators further comprises:

in response to determining that there is no document set to which an index indicator is not allocated, judging whether each of the plurality of document sets has been indexed according to all the index indicators; and

in response to the judgment result being NO, selecting a document set to which index indicator a is not allocated, and performing indexing according to the index indicator a.

7. The method according to claim 5, further comprising:

obtaining a newly added index indicator; and

in response to determining that there are document sets to which index indicators are not allocated, selecting a document set to which an index indicator is not allocated, and performing indexing according to the newly added index indicator.

8. The method according to claim 7, further comprising:

in response to determining that there is no document set to which an index indicator is not allocated, judging whether each of the plurality of document sets has been indexed according to all the index indicators;

in response to the judgment result being NO, collecting statistics about a number of allocated index indicators for each document set; and

allocating the newly added index indicator to a document set to which a least number of index indicators are allocated, and performing indexing according to the newly added index indicator.

9. The method according to claim 5, further comprising:

obtaining a discarded index indicator; and

in response to determining that there is a document set that has been indexed according to the discarded index indicator, deleting indexes established according to the discarded index indicator and deleting the discarded index indicator.

10. An apparatus for indexing a document database, comprising:

at least one hardware processor configured to execute one or more modules;

a first determining module configured to cause the at least one processor to determine, according to user'"'"'s access status on a plurality of documents in the document database, index indicators from attributes of respective fields of the plurality of documents, wherein the index indicators are used for indexing the plurality of documents, wherein the first determining module further comprises;

a recording module configured to cause the at least one processor to record user'"'"'s operation on the respective fields of the plurality of documents within a period of time;

a first statistics collecting module configured to cause the at least one processor to collect statistics about the attributes of the respective fields of the plurality of documents and collect statistics about a number of times of a same operation for each attribute; and

a second determining module configured to cause the at least one processor to determine the index indicators from the attributes according to a number of times of a same type of operation for each attribute;

a dividing module configured to cause the at least one processor to divide the plurality of documents into a plurality of document sets; and

an indexing module configured to cause the at least one processor to index the plurality of document sets according to the index indicators after dividing the plurality of documents.

11. The apparatus according to claim 10, wherein in response to an attribute of a field b in the respective fields including sub-attributes, the number of times of the same operation for each attribute is a sum of numbers of times of the same type of operation for all the sub-attributes of the attribute of the field b.

12. The apparatus according to claim 10, wherein user'"'"'s operation on the respective fields of the plurality of documents in the document database includes at least one operation selected from a group of operations comprising:

query operation, write operation, and grouping/sorting operation.

13. The apparatus according to claim 10, wherein a number of the plurality of document sets is greater than or equal to a positive integer multiple greater than one of a number of the index indicators.

14. The apparatus according to claim 10, further comprising:

a first selecting module configured to cause the at least one processor to select document sets according to number of the index indicators;

a first allocating module configured to cause the at least one processor to allocate an index indicator to each selected document set and perform indexing according to the allocated index indicator;

a first obtaining module configured to, in response to determining that there is a document set that has been indexed, cause the at least one processor to obtain an index indicator a allocated to the document set that has been indexed; and

a second selecting module configured to, in response to determining that there are document sets to which index indicators are not allocated, cause the at least one processor to select a document set to which an index indicator is not allocated, and perform indexing according to the index indicator a.

15. The apparatus according to claim 14, further comprising:

a first judging module configured to, in response to determining that there is no document set to which an index indicator is not allocated, cause the at least one processor to judge whether each of the plurality of document sets has been indexed according to all the index indicators; and

a third selecting module configured to, in response to the judgment result being NO, cause the at least one processor to select a document set to which index indicator a is not allocated, and perform indexing according to the index indicator a.

16. The apparatus according to claim 15, further comprising:

a second obtaining module configured to cause the at least one processor to obtain a newly added index indicator; and

a fourth selecting module configured to, in response to determining that there are document sets to which index indicators are not allocated, cause the at least one processor to select a document set to which an index indicator is not allocated, and perform indexing according to the newly added index indicator.

17. The apparatus according to claim 16, further comprising:

a second judging module configured to, in response to determining that there is no document set to which an index indicator is not allocated, cause the at least one processor to judge whether each of the plurality of document sets has been indexed according to all the index indicators;

a second statistics collecting module configured to, in response to the judgment result being NO, cause the at least one processor to collect statistics about a number of allocated index indicators for each document set; and

a second allocating module configured to cause the at least one processor to allocate the newly added index indicator to a document set to which a least number of index indicators are allocated, and perform indexing according to the newly added index indicator.

18. The apparatus according to claim 15, further comprising:

a third obtaining module configured to cause the at least one processor to obtain a discarded index indicator; and

a deleting module configured to, in response to determining that there is a document set that has been indexed according to the discarded index indicator, cause the at least one processor to delete indexes established according to the discarded index indicator and delete the discarded index indicator.