Index constructing method, search method, device and system

• US 8,914,379 B2
• Filed: 06/12/2012
• Issued: 12/16/2014
• Est. Priority Date: 07/21/2011
• Status: Active Grant

• Current Assignee: Tencent Technology Company Limited (Tencent Holdings Limited)
• Original Assignee: Tencent Technology Company Limited (Tencent Holdings Limited)
• Inventors: Zhu, Zhengping, Ma, Chao, Shen, Yan
• Primary Examiner(s): Stevens, Robert
• Application Number:
  US14/234,058
• Publication Number:
  US 20140156671A1
• Time in Patent Office: 917 Days
• Field of Search: 707/741
• US Class Current: 707/741
• CPC Class Codes: G06F 16/13 File access structures, e.g. distributed indices arrangements of input from, or output to, record carriers G06F3/06
• CPC Class Codes: G06F 16/134 Distributed indices
• CPC Class Codes: G06F 16/22 Indexing; Data structures therefor; Storage structures
• CPC Class Codes: G06F 16/2272 Management thereof

Abstract

The present disclosure discloses an index constructing method, search method, device and system. The index constructing method includes: constructing data obtained in each preset time period into a primary index segment, respectively, and merging the constructed primary index segments into a primary index segment set after each preset time period is over; copying and merging each primary index segment in the primary index segment set into a corresponding large index segment, to obtain a large index segment set; and sending the primary index segments in the primary index segment set or the large index segments in the large index segment set to a search device to provide a search service. The present disclosure constructs the primary index segments on the basis of time, merges the constructed primary index segments into the large index segment, and provides the search service simultaneously with the primary index segments or the large index segments, thus, improving search speed.

Claims

1. An index constructing method comprising:

constructing data obtained in each preset time period into a primary index segment, respectively, and merging the constructed primary index segment into a primary index segment set after each preset time period is over;

copying each primary index segment in the primary index segment set and merging the copied primary index segments into a corresponding large index segment, to obtain a large index segment set; and

sending the primary index segments in the primary index segment set or the large index segments in the large index segment set to a search device to provide search service;

wherein the copying each primary index segment in the primary index segment set and merging the copied primary index segments into a corresponding large index segment specifically includes

copying each primary index segment in the primary index segment set in turn according to time sequence, and merging the copied primary index segments into the corresponding large index segment;

wherein the corresponding large index segment is a large index segment which is in the large index segment set and neighbors a free memory.

2. The method of claim 1, wherein after merging the constructed primary index segments into a corresponding large index segment, the method further includes:

every each preset period, deleting primary index segments which are constructed before the each preset period from the primary index segment set.

3. The method of claim 1, wherein after the copying each primary index segment in the primary index segment set and merging the copied primary index segments into a corresponding large index segment, to obtain a large index segment set, the method further includes:

backing up each large index segment in the large index segment set.

4. The method of claim 3, wherein each of the primary index segment and the large index segment includes a sequence number value and a sign of whether being complete;

when copying each primary index segment in the primary index segment set and merging the copied primary index segments into a corresponding large index segment, a sequence number value of the large index segment after merged is the larger sequence number value of a sequence number value of the primary index segment and a sequence number value of the large index segment when merging;

the sending the primary index segments in the primary index segment set or the large index segments in the large index segment set to a search device to provide search service specifically includes;

receiving an index segment application sent from the search device, the application carrying a sequence number value and a sign of whether being complete;

sending corresponding index segments to the search device according to the sequence number value and sign of whether being complete carried in the application, the corresponding index segments being primary index segments of the primary index segment set or large index segments of the large index segment set.

5. The method of claim 4, wherein the returning corresponding index segments to the search device according to the sequence number value and sign of whether being complete carried in the application, specifically includes:

if the sequence number value carried in the application is null, reading backed up index segments and sending the backed up index segments to the search device;

if the sequence number value carried in the application is non-null and the application carries a sign of being incomplete, returning an index segment with a sequence number value the same as the sequence number value carried in the application to the search device;

if the sequence number value carried in the application is non-null and the application carries a sign of being complete, returning an index segment with a sequence number value which is the next sequence number value of the sequence number value carried in the application to the search device.

6. An index constructing device comprising:

a processor and a non-transitory storage medium storing machine readable instructions that are executable by the processor to;

construct data obtained in each preset time period into a primary index segment, respectively, and merge the constructed primary index segment into a primary index segment set after each preset time period is over;

copy each primary index segment in the primary index segment set obtained and merge the copied primary index segments into a corresponding large index segment to obtain a large index segment set; and

send the primary index segments in the primary index segment set obtained by the constructing module or the large index segments in the large index segment set obtained to a search device to provide search service;

wherein when the processor performs the process of copying each primary index segment in the primary index segment set obtained and merge the copied primary index segments into a corresponding large index segment to obtain a large index segment set, the machine readable instructions are executable by the processor to

copy, in turn according to time sequence, each primary index segment in the primary index segment set obtained by the constructing module through merging, and merge the copied primary index segments into a corresponding large index segment which is a large index segment in the large index segment set and neighbors a free memory.

7. The device of claim 6, wherein the machine readable instructions are further executable by the processor to:

the constructed primary index segment is merged into the primary index segment set, every each preset period, delete primary index segments, which are constructed before the each preset period, from the primary index segment set.

8. The device of claim 6, wherein the machine readable instructions are further executable by the processor to:

each primary index segment in the primary index segment set obtained is copied and the copied primary index segments is merged into a corresponding large index segment to obtain a large index segment set, back up each large index segment in the large index segment set.

9. The device of claim 8, wherein each of the primary index segment constructed and the large index segment obtained through merging includes a sequence number value and a sign of whether being complete;

when each primary index segment in the primary index segment set obtained is copied

and the copied primary index segments is merged into a corresponding large index segment, a sequence number value of the large index segment after merged is the larger of a sequence number value of the primary index segment and a sequence number value of the large index segment when merging;

when the processor performs the process of sending the primary index segments in the primary index segment set obtained or the large index segments in the large index segment set obtained to a search device, the machine readable instructions are executable by the processor to

receive an index segment application sent from the search device, the application carrying a sequence number value and a sign of whether being complete, and

send corresponding index segments to the search device according to the sequence number value and sign of whether being complete carried in the application received, the corresponding index segments being primary index segments of the primary index segment set or large index segments of the large index segment set.

10. The device of claim 9, wherein,

when the processor performs the process of sending corresponding index segments to the search device according to the sequence number value and sign of whether being complete carried in the application received, the machine readable instructions are executable by the processor to:

if the sequence number value carried in the application received is null, read backed up index segments and send the backed up index segments to the search device;

if the sequence number value carried in the application received is non-null and the application carries a sign of being incomplete, return an index segment with a sequence number value the same as the sequence number value carried in the application to the search device;

if the sequence number value carried in the application received by the first receiving unit is non-null and the application carries a sign of being complete, return an index segment with a sequence number value which is the next sequence number value of the sequence number value carried in the application to the search device.

11. A search method comprising:

every each preset period, obtaining a first-level index segment from an index constructing device, and merging the obtained first-level index segment into a first-level index segment set;

copying each first-level index segment in the first-level index segment set and merging the copied first-level index segments into a corresponding second-level index segment to obtain a second-level index segment set;

providing search service according to the first-level index segments in the first-level index segment set and the second-level index segments in the second-level index segment set;

wherein each of the first-level index segment and the second-level index segment includes a sequence number value and a sign of whether being complete;

every each preset period, obtaining a first-level index segment from an index constructing device, specifically includes

every each preset period, sending an index segment application to the index constructing device, the application carrying a sequence number value and a sign of whether being complete;

the sequence number value being the largest sequence number value of those of already existed index segments or null;

receiving the index segment sent by the index constructing device according to the sequence number value and sign of whether being complete, and taking the received index segment as a first-level index segment;

when copying each first-level index segment in the first-level index segment set and merging the copied first-level index segments into a corresponding second-level index segment, a sequence number value of the second-level index segment after merged is the larger sequence number value of a sequence number value of the first-level index segment and a sequence number value of the second-level index segment when merging.

12. The method of claim 11, wherein the copying each first-level index segment in the first-level index segment set and merging the copied first-level index segments into a corresponding second-level index segment, specifically includes:

copying each first-level index segment in the first-level index segment set in turn according to time sequence and merging the copied first-level index segments into a corresponding second-level index segment;

wherein the corresponding second-level index segment is a second-level index segment which is in the second-level index segment set and neighbors a free memory.

13. A search device comprising:

a processor and a non-transitory storage medium storing machine readable instructions that are executable by the processor to;

every each preset period, obtain a first-level index segment from an index constructing device, and merge the obtained first-level index segment into a first-level index segment set;

copy each first-level index segment in the first-level index segment set obtained by the obtaining module, and merge the copied first-level index segments into a corresponding second-level index segment to obtain a second-level index segment set;

provide search service according to the first-level index segments in the first-level index segment set obtained by the obtaining module and the second-level index segments in the second-level index segment set obtained by the second merging module;

wherein when the processor performs the process of copying each first-level index segment in the first-level index segment set obtained by the obtaining module, and merge the copied first-level index segments into a corresponding second-level index segment to obtain a second-level index segment set, wherein the machine readable instructions are further executable by the processor to

copy each first-level index segment in the first-level index segment set in turn according to time sequence, and merge the copied first-level index segments into a corresponding second-level index segment;

the corresponding second-level index segment is a second-level index segment which is in the second-level index segment set and neighbors a free memory.

14. The device of claim 13, wherein each of the first-level index segment obtained by the obtaining module and the second-level index segment obtained a sequence number value and a sign of whether being complete;

when the processor performs the process of every each preset period, obtaining a first-level index segment from an index constructing device, and merging the obtained first-level index segment into a first-level index segment set, the machine readable instructions are executable by the processor to;

every each preset period, send an index segment application to the index constructing device, the application carrying a sequence number value and a sign of whether being complete;

receive the index segment sent by the index constructing device according to the sequence number value and sign of whether being complete sent by the second sending unit, and take the received index segment as a first-level index segment and merge the first-level index segment into a corresponding second-level index segment;

when each first-level index segment in the first-level index segment set obtained is copied and the copied first-level index segments is merged,

into the corresponding second-level index segment, a sequence number value of the second-level index segment after merged is the larger sequence number value of a sequence number value of the first-level index segment and a sequence number value of the second-level index segment when merging.