SYSTEMS AND METHODS FOR STORING, UPDATING, SEARCHING, AND FILTERING TIME-SERIES DATASETS

• US 20170228405A1
• Filed: 02/09/2016
• Published: 08/10/2017
• Est. Priority Date: 02/09/2016
• Status: Active Grant

• Current Assignee: Moonshadow Mobile, Inc.
• Original Assignee: Moonshadow Mobile, Inc.
• Inventors: Alavi, David S., Ward, Roy W.
• Granted Patent: US 10,248,621 B2
• Time in Patent Office: Days
• CPC Class Codes: G06F 16/2228 Indexing structures
• CPC Class Codes: G06F 16/2379 Updates performed during online database operations; commit processing
• CPC Class Codes: G06F 16/2474 Sequence data queries, e.g. querying versioned data
• CPC Class Codes: G06F 16/2477 Temporal data queries
• CPC Class Codes: Y02A 90/10 Information and communication technologies [ICT] supporting adaptation to climate change, e.g. for weather forecasting or climate simulation

Abstract

A method includes generating from a time-series dataset multiple corresponding time-slice datasets. Each time-slice dataset has a corresponding time-slice time index and includes field-value data strings and associated field-value-time-index data strings, or pointers indicating the corresponding strings in an earlier time-slice dataset, that are the latest in the time-series dataset that are also earlier than the corresponding time-slice time index. A query of the time-series dataset for latest data records earlier than a given query time index is performed by using the time-slice datasets to reduce or eliminate the need to directly access or interrogate the time-series dataset.

Claims

1. A computer-implemented method comprising:

(a) automatically receiving at a computer system electronic indicia of a time-series dataset wherein

(i) for each one of multiple defined data fields, the time-series dataset includes one or more corresponding field-value (FV) data strings,

(ii) the time-series dataset includes multiple field-value-time-index (FVTI) data strings, and

(iii) each one of the FV data strings is associated with a corresponding one of the multiple FVTI data strings that indicates a time when information represented by that FV data string was acquired, measured, generated, or recorded;

(b) using one or more electronic processors of the computer system programmed therefor, automatically generating, using the electronic indicia of the time-series dataset, electronic indicia of multiple time-slice datasets, wherein

(i) each one of the multiple time-slice datasets corresponds to a designated time-slice time index (TSTI) that differs from the corresponding TSTI of at least one other of the multiple time-slice datasets,

(ii) for each one of multiple designated subsets of the multiple defined data fields, each time-slice dataset includes a corresponding time-slice data subset,

(iii) each time-slice data subset includes, for each data field of the corresponding designated subset of the multiple data fields, (A) either a corresponding single FV data string from the time-series dataset or a pointer indicating, either directly or through one or more intervening pointers, a corresponding FV data string in a corresponding time-slice data subset with an earlier TSTI, and (B) for the FV data string included or indicated in subpart (A), either the associated FVTI data string from the time-series dataset or a pointer indicating, either directly or through one or more intervening pointers, the corresponding associated FVTI data string in a corresponding time-slice data subset with an earlier TSTI, and

(iv) each FVTI data string included in, or indicated by a pointer of, each time-slice data subset represents a latest FVTI in the time-series dataset, for the associated FV data string, that is earlier than the TSTI of that time-slice data subset; and

(c) automatically storing in a computer-searchable format the electronic indicia generated in part (b) on one or more tangible, non-transitory computer-readable media of the computer system that are operatively coupled to one or more electronic processors of the computer system.

2. The computer-implemented method of claim 1 wherein any FVTI that indicates a time that is the same as a time indicated by a specified TSTI is included among FVTIs that are treated as being earlier than the specified TSTI.

3. The computer-implemented method of claim 1 wherein any FVTI that indicates a time that is the same as a time indicated by a specified TSTI is included among FVTIs that are treated as being later than the specified TSTI.

4. The computer-implemented method of claim 1 wherein each pointer in each time-slice data subset indicates directly a corresponding data string or pointer of a corresponding time-slice data subset in a next-earlier time-slice dataset.

5. The computer-implemented method of claim 1 wherein each pointer in each time-slice data subset indicates directly a corresponding data string of a corresponding time-slice data subset with a latest corresponding TSTI, among those time-slice data subsets that include a corresponding data string, that is earlier than the corresponding TSTI.

6. The computer-implemented method of claim 1 wherein, for at least one pointer of at least one time-slice data subset, having a first TSTI, (A) the at least one pointer indicates directly a corresponding data string or pointer of a corresponding time-slice data subset of an earlier time-slice dataset, having a second TSTI earlier than the first TSTI, and (B) the multiple time-slice datasets include at least one intervening time-slice dataset having an intervening TSTI earlier than the first TSTI and later than the second TSTI.

7. The computer-implemented method of claim 1 wherein each time-slice data subset includes, for each data field of the corresponding designated subset of data fields, either (i) an FV data string and the associated FVTI data string, or (ii) a pointer to a corresponding FV data string of a corresponding earlier time-slice data subset and a pointer to a corresponding FVTI data string of a corresponding earlier time-slice data subset.

8. The computer-implemented method of claim 7 wherein each time-slice data subset that includes one or more pointers includes only a single pointer indicating an entire corresponding earlier time-slice data subset.

9. The computer-implemented method of claim 1 wherein the multiple time-slice datasets include an earliest time-slice dataset corresponding to an earliest TSTI earlier than corresponding TSTIs of every other one of the multiple time-slice datasets, wherein the earliest TSTI is earlier than every FVTI of the time-series dataset and every time-slice data subset of the earliest time-slice dataset includes one or more data strings and no pointers.

10. The computer-implemented method of claim 1 wherein the multiple time-slice datasets include a latest time-slice dataset corresponding to a latest TSTI later than corresponding TSTIs of every other one of the multiple time-slice datasets, wherein the latest TSTI is later than every FVTI of the time-series dataset and every time-slice data subset of the latest time-slice dataset includes one or more pointers and no data strings.

11. A computer system comprising one or more electronic processors and one or more tangible, non-transitory computer-readable media each operatively coupled to one or more of the processors, wherein the computer system is structured, connected, and programmed to perform the method of claim 1.

12. A tangible, non-transitory computer-readable medium encoded with electronic indicia of instructions which, when applied to a computer system, cause the computer system to perform the method of claim 1.

13. A tangible, non-transitory computer-readable medium encoded with the electronic indicia of the multiple time-slice datasets generated by the method of claim 1.

14. The computer-implemented method of claim 1 further comprising:

(d) using one or more electronic processors of the computer system programmed therefor, automatically determining a latest TSTI occurring among the multiple time-slice datasets that is earlier than a new designated TSTI;

(e) using one or more electronic processors of the computer system programmed therefor, for each one of the multiple defined data fields, automatically identifying corresponding FVTI data strings indicating a latest FVTI of the time-series dataset that is later than the latest TSTI determined in part (d) and earlier than the new designated TSTI;

(f) using one or more electronic processors of the computer system programmed therefor, for each designated subset of the multiple data fields for which at least one corresponding latest FVTI data string is identified in part (e), automatically including, in a corresponding time-slice data subset of a new time-slice dataset, (i) each identified latest FVTI data string and the associated FV data string, and (ii) for each data field of the designated subset for which no FVTI data string is identified in part (e), one or more FV data strings, one or more FVTI data strings, or one or more pointers that indicate a latest FVTI in the time-series dataset, that is earlier than the new TSTI, and the associated FV data string;

(g) using one or more electronic processors of the computer system programmed therefor, for each designated subset of the multiple data fields for which no corresponding FVTI data string is identified in part (e), automatically including, in a corresponding time-slice data subset of the new time-slice dataset, one or more data strings or one or more pointers that collectively indicate, in the corresponding time-slice data subset with an earlier TSTI, the latest FVTI data strings earlier than the new TSTI and the associated FV data strings; and

(h) automatically generating, and automatically storing in the computer-searchable format on one or more tangible, non-transitory computer-readable media of the computer system that are operatively coupled to one or more electronic processors of the computer system, electronic indicia of the new time-slice dataset that includes the time-slice data subsets of parts (f) and (g) and corresponds to the new designated TSTI.

15. The computer-implemented method of claim 14 wherein part (f) includes, using one or more electronic processors of the computer system programmed therefor, for each designated subset of the multiple data fields for which at least one corresponding latest FVTI data string is identified in part (e), automatically including, in a corresponding time-slice data subset of a new time-slice dataset, for each one of the data fields of the designated subset, the corresponding FV data string and associated FVTI data string corresponding to a latest FVTI that is earlier than the new TSTI.

16. The computer-implemented method of claim 14 wherein the identification of part (e) includes automatically electronically querying the electronic indicia of the time-series dataset to identify corresponding FVTI data strings later than the latest TSTI determined in part (d) and earlier than the new designated TSTI.

17. The computer-implemented method of claim 16 wherein the identification of part (e) includes, for each one of the multiple defined data fields, using one or more electronic processors of the computer system programmed therefor, (A) determining an earliest TSTI among the time-slice datasets that is later than the new designated TSTI, and (B) for each field for which the corresponding time-slice data subset with the TSTI determined in part (A) includes a pointer, excluding that field from the electronic querying of the time-series dataset and identifying as the latest FVTI the corresponding FVTI indicated by the pointer.

18. The computer-implemented method of claim 16 wherein the identification of part (e) includes, for each one of the multiple defined data fields, using one or more electronic processors of the computer system programmed therefor, (A) determining an earliest TSTI among the time-slice datasets that is later than the new designated TSTI, and (B) for each field for which the corresponding time-slice data subset with the TSTI determined in part (A) includes or indicates with a pointer an FVTI data string earlier than the latest TSTI determined in part (d), excluding that field from the electronic querying of the time-series dataset and identifying as the latest TSTI the included or indicated FVTI data string.

19. The computer-implemented method of claim 16 wherein the identification of part (e) includes, for each one of the multiple defined data fields, using one or more electronic processors of the computer system programmed therefor, for each field for which a corresponding time-slice data subset, having a corresponding TSTI later than the new designated TSTI, includes or indicates with a pointer an FVTI data string earlier than the latest TSTI determined in part (d), excluding that field from the electronic querying of the time-series dataset and identifying as the latest TSTI the included or indicated FVTI data string.

20. The computer-implemented method of claim 14 further comprising:

(i) using one or more electronic processors of the computer system programmed therefor, for each designated subset of the multiple data fields for which at least one corresponding FVTI data string is identified in part (e), identifying one or more corresponding time-slice data subsets, with corresponding TSTIs later than the new designated TSTI, that include one or more pointers indicating corresponding FVTI data strings or associated FV data strings in corresponding time-slice data subsets with corresponding TSTIs earlier than the new designated TSTI;

(j) using one or more electronic processors of the computer system programmed therefor, for each time-slice data subset identified in part (i), automatically replacing the one or more corresponding pointers with one or more corresponding new pointers that indicate the corresponding FV or FVTI data string of the new time-slice dataset; and

(k) automatically updating, on one or more tangible, non-transitory computer-readable media of the computer system that are operationally coupled to one or more electronic processors of the computer system, electronic indicia of the replaced pointers of part (j).

21. A computer system comprising one or more electronic processors and one or more tangible, non-transitory computer-readable media each operatively coupled to one or more of the processors, wherein the computer system is structured, connected, and programmed to perform the method of claim 14.

22. A tangible, non-transitory computer-readable medium encoded with electronic indicia of instructions which, when applied to a computer system, cause the computer system to perform the method of claim 14.

23. A tangible, non-transitory computer-readable medium encoded with the electronic indicia of the multiple time-slice datasets generated by the method of claim 14.

24. The computer-implemented method of claim 1 further comprising:

(d) automatically receiving at the computer system electronic indicia of a new FV data string for a corresponding one of the defined data fields and a new associated FVTI data string indicating a new FVTI of a time when the new FV data string was acquired, measured, generated, or recorded;

(e) using one or more electronic processors of the computer system programmed therefor, automatically including the new FV and FVTI data strings in the time-series dataset; and

(f) using one or more electronic processors of the computer system programmed therefor, automatically generating, and automatically storing in the computer searchable format on one or more tangible, non-transitory computer-readable media of the computer system that are operationally coupled to one or more electronic processors of the computer system, electronic indicia of the new FV and FVTI data strings as part of the electronic indicia of the time-series dataset.

25. The computer-implemented method of claim 24 further comprising:

(g) using one or more electronic processors of the computer system programmed therefor, automatically identifying which one of the multiple designated subsets of the multiple data fields includes the data field of part (d) and identifying the time-slice data subset corresponding to that designated subset;

(h) using one or more electronic processors of the computer system programmed therefor, automatically determining an earliest TSTI that is later than the new FVTI;

(i) for each TSTI identified in part (h) that corresponds to a time-slice dataset having a pointer in the time-slice data subset identified in part (g) for the data field of part (d), using one or more electronic processors of the computer system programmed therefor, automatically replacing that pointer with the new FV data string and the associated new FVTI data string for the data field of part (d);

(j) using one or more electronic processors of the computer system programmed therefor, for each time-slice data subset that is identified in part (g), that corresponds to a TSTI later than the TSTI determined in part (h), and that includes for the field of part (d) an FVTI data string earlier than the new FVTI or a pointer indicating an FVTI data string earlier than the new FVTI, automatically replacing in that time-slice data subset the earlier FVTI data string, the associated FV data string, or one or more pointers thereto with the new FVTI data string, the associated new FV data string, or one or more pointers indicating those new data strings in the time-slice data subset of part (i);

(h) automatically generating, and automatically storing in the computer-searchable format on one or more tangible, non-transitory computer-readable media of the computer system that are operatively coupled to one or more electronic processors of the computer system, electronic indicia of the time-slice data subsets altered in parts (i) and (j).

26. The computer-implemented method of claim 24 further comprising:

(g) using one or more electronic processors of the computer system programmed therefor, automatically identifying which one of the multiple designated subsets of the multiple data fields includes the data field of part (d) and identifying the time-slice data subset corresponding to that designated subset;

(h) using one or more electronic processors of the computer system programmed therefor, automatically determining an earliest TSTI that is later than the new FVTI;

(i) using one or more electronic processors of the computer system programmed therefor, for each time-slice data subset that is identified in part (g), that corresponds to a TSTI later than the TSTI determined in part (h), and that includes for the field of part (d) an FVTI data string for an FVTI earlier than the new FVTI, automatically replacing in that time-slice data subset the earlier FVTI data string with the new FVTI data string and the earlier FV data string with the new FV data string;

(j) for each TSTI identified in part (h) that corresponds to a time-slice dataset having a pointer in the time-slice data subset identified in part (g), using one or more electronic processors of the computer system programmed therefor, automatically replacing that pointer with, for each one of the data fields of the designated subset identified in part (g), the corresponding FV data string and associated FVTI data string corresponding to a latest FVTI that is earlier than the TSTI identified in part (h), including the new FV data string and the associated new FVTI data string for the data field of part (d);

(k) using one or more electronic processors of the computer system programmed therefor, automatically identifying each corresponding time-slice data subset of each time-slice dataset, that corresponds to a TSTI later than the TSTI determined in part (h), that includes a pointer indicating a time-slice data subset in a time-slice dataset that corresponds to a TSTI earlier than the TSTI determined in part (h);

(l) for each time-slice data subset identified in part (k), using one or more electronic processors of the computer system programmed therefor, automatically replacing the corresponding pointer with a corresponding new pointer that indicates the corresponding time-slice data subset of the time-slice dataset corresponding to the TSTI determined in part (h); and

(m) automatically generating, and automatically storing in the computer-searchable format on one or more tangible, non-transitory computer-readable media of the computer system that are operatively coupled to one or more electronic processors of the computer system, electronic indicia of the time-slice data subsets altered in parts (i), (j), and (l).

27. A computer system comprising one or more electronic processors and one or more tangible, non-transitory computer-readable media each operatively coupled to one or more of the processors, wherein the computer system is structured, connected, and programmed to perform the method of claim 24.

28. A tangible, non-transitory computer-readable medium encoded with electronic indicia of instructions which, when applied to a computer system, cause the computer system to perform the method of claim 24.

29. A tangible, non-transitory computer-readable medium encoded with the electronic indicia of the multiple time-slice datasets generated by the method of claim 24.

30. A computer-implemented method for searching or filtering a time-series dataset:

(a) wherein (i) electronic indicia of the time-series dataset are stored in a computer-searchable format on one or more tangible, non-transitory computer-readable media of the computer system, (ii) for each one of multiple defined data fields, the time-series dataset includes one or more corresponding field-value (FV) data strings, (iii) the time-series dataset includes multiple field-value-time-index (FVTI) data strings, and (iv) each one of the FV data strings is associated with a corresponding one of the multiple FVTI data strings that indicates a time when information represented by that FV data string was acquired, measured, generated, or recorded; and

(b) wherein (i) electronic indicia of multiple time-slice datasets are stored in a computer-searchable format on one or more tangible, non-transitory computer-readable media of the computer system, (ii) each one of the multiple time-slice datasets corresponds to a designated time-slice time index (TSTI) that differs from the corresponding TSTI of at least one other of the multiple time-slice datasets, (iii) for each one of multiple designated subsets of the multiple defined data fields, each time-slice dataset includes a corresponding time-slice data subset, (iv) each time-slice data subset includes, for each data field of the corresponding designated subset of the multiple data fields, (A) either a corresponding single FV data string from the time-series dataset or a pointer indicating, either directly or through one or more intervening pointers, a corresponding FV data string in a corresponding time-slice data subset with an earlier TSTI, and (B) for the FV data string included or indicated in subpart (A), either the associated FVTI data string from the time-series dataset or a pointer indicating, either directly or through one or more intervening pointers, the corresponding associated FVTI data string in a corresponding time-slice data subset with an earlier TSTI, and (v) each FVTI data string included in, or indicated by a pointer of, each time-slice data subset represents a latest FVTI in the time-series dataset, for the associated FV data string, that is earlier than the TSTI of that time-slice data subset,

the method comprising;

(A) receiving at the computer system an electronic query for a list, tabulation, graph, display, or enumeration of FV data strings, of a queried subset of the multiple data fields specified in the query, having latest associated FVTI data strings earlier than a query time index (QTI);

(B) using one or more electronic processors of the computer system programmed therefor, for each field of the queried subset, automatically identifying a corresponding latest FVTI data string that is earlier than the QTI;

(C) using one or more electronic processors of the computer system programmed therefor, automatically electronically interrogating the FTVI data strings identified in part (B) or the FV data strings associated with the FTVI data strings identified in part (B);

(D) using one or more electronic processors, displays, or tangible, non-transitory computer-readable media of the computer system, listing, tabulating, graphing, displaying, or enumerating FV or FVTI data strings, among the FV or FVTI data strings interrogated in part (C), that satisfy one or more search or filter criteria included in the query of part (A).

31. The computer-implemented method of claim 30 wherein the identification of part (B) includes automatically electronically querying the electronic indicia of the time-series dataset to identify one or more corresponding latest FVTI data strings that are earlier than the QTI.

32. The computer-implemented invention of claim 31 further comprising, using one or more electronic processors of the computer system programmed therefor, (i) determining a latest TSTI among the time-slice datasets that is earlier than the QTI, and (ii) for each queried field for which no FVTI is identified in the time-series dataset that is later than the TSTI determined in part (i) and earlier than the QTI, excluding that field from the electronic querying of the time-series dataset and identifying as the latest FVTI data string an FVTI data string included in or indicated by a pointer of a corresponding time-slice data subset with the TSTI determined in part (i).

33. The computer-implemented method of claim 31 further comprising, using one or more electronic processors of the computer system programmed therefor, (i) automatically determining an earliest TSTI among the time-slice datasets that is later than the QTI, and (ii) for each queried field for which the corresponding time-slice data subset with the TSTI determined in part (i) includes a pointer indicating an FVTI data string, excluding that field from the electronic querying of the time-series dataset and identifying as the latest FVTI data string the corresponding FVTI data string indicated by the pointer.

34. The computer-implemented method of claim 31 further comprising, using one or more electronic processors of the computer system programmed therefor, (i) determining an earliest TSTI among the time-slice datasets that is later than the QTI, and (ii) for each queried field for which the corresponding time-slice data subset with the TSTI determined in part (i) includes or indicates with a pointer an FVTI data string earlier than the QTI, excluding that field from the electronic querying of the time-series dataset and identifying as the latest FTVI data string the included or indicated FVTI data string.

35. The computer-implemented method of claim 31 further comprising, using one or more electronic processors of the computer system programmed therefor, for each queried field for which a corresponding time-slice data subset, having a corresponding TSTI later than the QTI, includes or indicates with a pointer an FVTI data string earlier than the QTI, excluding that field from the electronic querying of the time-series dataset and identifying as the latest FTVI data string the included or indicated FVTI data string.

36. The computer-implemented method of claim 30 wherein any FVTI that indicates a time that is the same as a time indicated by the QTI is included among FVTIs that are treated as being earlier than the QTI, and any TSTI that indicates a time that is the same as a time indicated by the QTI is included among TSTIs that are treated as being earlier than the QTI.

37. The computer-implemented method of claim 30 wherein any FVTI that indicates a time that is the same as a time indicated by the QTI is included among FVTIs that are treated as being later than the QTI, and any TSTI that indicates a time that is the same as a time indicated by the QTI is included among TSTIs that are treated as being later than the QTI.

38. The computer-implemented method of claim 30 wherein any FVTI that indicates a time that is the same as a time indicated by the QTI is included among FVTIs that are treated as being earlier than the QTI, and any TSTI that indicates a time that is the same as a time indicated by the QTI is included among QTIs that are later than the TSTI.

39. The computer-implemented method of claim 30 wherein any FVTI that indicates a time that is the same as a time indicated by the QTI is included among FVTIs that are later than the QTI, and any TSTI that indicates a time that is the same as a time indicated by the QTI is included among TSTIs that are earlier than the TSTI.

40. The computer-implemented method of claim 30 wherein:

(i) the identification of part (B) includes automatically generating one or more additional time-slice datasets with corresponding additional TSTIs; and

(ii) the interrogation of part (C) includes automatically interrogating (1) FV data strings included in, or indicated by corresponding pointers of, the one or more additional time-slice datasets, or (2) FVTI data strings included in, or indicated by corresponding pointers of, the one or more additional time-slice datasets.

41. The computer-implemented method of claim 40 wherein the one or more additional time-slice datasets are generated without altering the multiple time-slice datasets.

42. The computer-implemented method of claim 40 wherein one of the one or more additional time-slice datasets has a corresponding additional TSTI that indicates a time indicated by the QTI.

43. The computer-implemented method of claim 40 further comprising:

(iii) receiving multiple different electronic queries of part (A) having the same QTI;

(iv) for each received query, automatically interrogating (1) FV data strings included in, or indicated by corresponding pointers of, the additional time-slice dataset, or (2) FVTI data strings included in, or indicated by corresponding pointers of, the additional time-slice dataset; and

(v) for each received query, listing, tabulating, graphing, displaying, or enumerating FV or FVTI data strings, among the FV or FVTI data strings interrogated in part (iv), that satisfy one or more search or filter criteria included in the corresponding query of part (iii).

44. The computer-implemented method of claim 43 further comprising deactivating the one or more additional time-slice datasets.

45. A computer system comprising one or more electronic processors and one or more tangible, non-transitory computer-readable media each operatively coupled to one or more of the processors, wherein the computer system is structured, connected, and programmed to perform the method of claim 30.

46. A tangible, non-transitory computer-readable medium encoded with electronic indicia of instructions which, when applied to a computer system, cause the computer system to perform the method of claim 30.