STORING METHOD AND APPARATUS FOR DATA AQUISITION

• US 20150269277A1
• Filed: 06/05/2015
• Published: 09/24/2015
• Est. Priority Date: 08/26/2013
• Status: Active Grant

• Current Assignee: Tencent Technology Company Limited (Tencent Holdings Limited)
• Original Assignee: Tencent Technology Company Limited (Tencent Holdings Limited)
• Inventors: FAN, CHENG TAO, LI, GONG WEI, QIU, YUE PENG, LIAO, JIAN KUI, ZHANG, MENG
• Granted Patent: US 9,977,836 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/2477 Temporal data queries
• CPC Class Codes: G06F 16/9017 using directory or table look-up use of a directory or look-up table in file systems G06F16/13
• CPC Class Codes: G06F 16/951 Indexing; Web crawling techniques

Abstract

Disclosed is a storing method for data acquisition, including: acquiring a collected data, and acquiring a generation time and a collection time for the collected data; obtaining an offset by computing a difference between the generation time and the collection time; and acquiring a default offset threshold, and determining whether the offset being less than the default offset threshold; if so, acquiring a centralized storage directory corresponding to the collected data, acquiring a generation time sub-directory corresponding to the generation time under the centralized storage directory, acquiring an offset sub-directory corresponding to the offset under the generation time sub-directory and storing the collected data in the offset sub-directory. The invention also provides a storing apparatus for data acquisition. The storing method and apparatus for data acquisition improve the data access efficiency.

Claims

1. A storing method for data acquisition, comprising the following steps:

acquiring a collected data, and acquiring a generation time and a collection time for the collected data;

obtaining an offset by computing a difference between the generation time and the collection time; and

acquiring a default offset threshold, and determining whether the offset being less than the default offset threshold;

if so, acquiring a centralized storage directory corresponding to the collected data, acquiring a generation time sub-directory corresponding to the generation time under the centralized storage directory, acquiring an offset sub-directory corresponding to the offset under the generation time sub-directory and storing the collected data in the offset sub-directory.

2. The method as claimed in claim 1, wherein after the step of determining whether the offset being less than the default offset threshold, the method comprises:

if the offset being greater than or equal to the offset threshold, acquiring a non-centralized storage directory corresponding to the collected data, acquiring a collection time sub-directory corresponding to the generation time under the non-centralized storage directory, and storing the collected data in the collection time sub-directory.

3. The method as claimed in claim 2, wherein the centralized storage directory and the non-centralized storage directory corresponding to the collected data is acquired through the following steps:

acquiring a data type of the collected data;

acquiring a type directory corresponding to the data type; and

acquiring the centralized storage directory/non-centralized storage directory under the type directory.

4. The method as claimed in claim 2, further comprising:

acquiring an inputted collection time keyword, and extracting a first input time;

in the centralized storage directory, acquiring a generation time sub-directory with a generation time differing from the first input time by less than a threshold offset, and the sum of the generation time of the corresponding generation time sub-directory and the offset of the corresponding offset dub-directory equal to the offset sub-directory of the first input time, accessing the collected data stored in the offset sub-directory; and

in the non-centralized storage directory, acquiring a collection time sub-directory with a collection time the same as the first input time less than a threshold offset, accessing the collected data stored in the collection time sub-directory.

5. The method as claimed in claim 2 further comprising:

acquiring an inputted generation time keyword, and extracting a second input time;

in the centralized storage directory, acquiring a generation time sub-directory with a generation time the same as the second input time, accessing the collected data stored in the generation time sub-directory and its offset sub-directory; and

in the non-centralized storage directory, traversing all the collection time sub-directories and accessing the collected data stored in the collection time sub-directory with generation time the same as the second input time.

6. The method as claimed in claim 2 further comprising:

traversing the collected data stored in the centralized storage directory and sub-directories, an non-centralized storage directory and sub-directories, accessing the generation time and collection time of the collected data, and computing the corresponding offset;

according to the following equation;

13. The method as claimed in claim 1, wherein the method is implemented in the form of software that is loaded in a computer-readable medium and is executable in a computer.

14. The method as claimed in claim 13, wherein the computer-readable medium comprises one of floppy disk, hard disk, CD, read-only memory, and random access memory.

7. A storing apparatus for data acquisition, comprising:

a data receiving module, for acquiring a collected data, and acquiring a generation time and a collection time for the collected data;

an offset computing module, for obtaining an offset by computing a difference between the generation time and the collection time; and

a data storing module, for acquiring a default offset threshold, and determining whether the offset being less than the default offset threshold;

if so, acquiring a centralized storage directory corresponding to the collected data, acquiring a generation time sub-directory corresponding to the generation time under the centralized storage directory, acquiring an offset sub-directory corresponding to the offset under the generation time sub-directory and storing the collected data in the offset sub-directory.

8. The apparatus as claimed in claim 7, wherein the data storing module is further used to acquire a non-centralized storage directory corresponding to the collected data, acquire a collection time sub-directory corresponding to the collection time under the non-centralized storage directory, and store the collected data in the collection time sub-directory.

9. The apparatus as claimed in claim 8, wherein the data storing module is further used to acquire a data type of the collected data;

acquire a type directory corresponding to the data type; and

acquire the centralized storage directory/non-centralized storage directory under the type directory.

10. The apparatus as claimed in claim 8, wherein the apparatus comprises a first access module, for acquiring an inputted collection time keyword, and extracting a first input time;

in the centralized storage directory, acquiring a generation time sub-directory with a generation time differing from the first input time by less than a threshold offset, and the sum of the generation time of the corresponding generation time sub-directory and the offset of the corresponding offset dub-directory equal to the offset sub-directory of the first input time, accessing the collected data stored in the offset sub-directory; and

in the non-centralized storage directory, acquiring a collection time sub-directory with a collection time the same as the first input time less than a threshold offset, accessing the collected data stored in the collection time sub-directory.

11. The apparatus as claimed in claim 8, wherein the apparatus further comprises a second access module, for acquiring an inputted generation time keyword, and extracting a second input time;

in the centralized storage directory, acquiring a generation time sub-directory with a generation time the same as the second input time, accessing the collected data stored in the generation time sub-directory and its offset sub-directory; and

in the non-centralized storage directory, traversing all the collection time sub-directories and accessing the collected data stored in the collection time sub-directory with generation time the same as the second input time.

12. The apparatus as claimed in claim 8, wherein the apparatus further comprises an offset threshold adapting module, for traversing the collected data stored in the centralized storage directory and sub-directories, a non-centralized storage directory and sub-directories, accessing the generation time and collection time of the collected data, and computing the corresponding offset;

according to the following equation;