System and method for reducing data streaming and/or visualization network resource usage

• US 10,375,157 B2
• Filed: 12/27/2017
• Issued: 08/06/2019
• Est. Priority Date: 12/16/2016
• Status: Active Grant

• Current Assignee: Zoomdata, Inc. (Global Software, Inc.)
• Original Assignee: Zoomdata, Inc. (Global Software, Inc.)
• Inventors: Langseth, Justin, Farchtchi, Ruhollah, Luu, Quan Cat, Barrett, Matthew Robert, Rathore, Punit
• Primary Examiner(s): Jacobs, Lashonda T
• Application Number:
  US15/855,818
• Publication Number:
  US 20180176290A1
• Time in Patent Office: 587 Days
• CPC Class Codes: G06F 11/3006 where the computing system is distributed, e.g. networked systems, clusters, multiprocessor systems multiprogramming arrangements G06F9/46; allocation of resources G06F9/50
• CPC Class Codes: G06F 11/32 with visual or acoustical indication of the functioning of the machine
• CPC Class Codes: G06F 11/34 Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment
• CPC Class Codes: G06F 11/3433 for load management allocation of a server based on load conditions G06F9/505; load rebalancing G06F9/5083; redistributing the load in a network by a load balancer H04L67/1029
• CPC Class Codes: G06F 2201/81 Threshold
• CPC Class Codes: H04L 47/125 by balancing the load, e.g. traffic engineering
• CPC Class Codes: H04L 47/822 Collecting or measuring resource availability data
• CPC Class Codes: H04L 47/83 based on usage prediction
• CPC Class Codes: H04L 67/1001 for accessing one among a plurality of replicated servers
• CPC Class Codes: H04L 67/101 based on network conditions

Abstract

In some embodiments, data related to calculating a set of values may be obtained. The set of values may be approximated based on a subset of the related data. The approximated values may be stored at a first data storage and a second data storage that corresponds to a landing zone (via which a client device obtains at least some of the approximated values). The approximated values stored at the first data storage may be continuously updated based on further subsets of the related data such that the approximated values stored at the first data storage is updated at least a first number of times within a first time period. The approximated values stored at the second data storage may be continuously updated such that the approximated values stored at the second data storage is updated less than the first number of times within the first time period.

Claims

1. A method of reducing network resource usage, the method being implemented by a computer system that comprises one or more processors executing computer program instructions that, when executed, perform the method, the method comprising:

obtaining, based on one or more queries, data related to calculating a set of values;

approximating the set of values based on a subset of the related data;

causing the approximated set of values to be stored at a first server data storage and a second server data storage, the second server data storage corresponding to a landing zone via which a client device obtains at least some approximated values of the approximated set of values;

continuously updating, based on further subsets of the related data, the approximated set of values stored at the first server data storage such that the approximated set of values stored at the first server data storage is updated at least a first number of times within a first time period; and

continuously updating the approximated set of values stored at the second server data storage corresponding to the landing zone such that the approximated set of values stored at the second server data storage is updated less than the first number of times within the first time period,

wherein continuously updating the approximated set of values stored at the second server data storage comprises transmitting the approximated set of values stored at the first server data storage to the second server data storage to replace the approximated set of values stored at the second server data storage.

2. The method of claim 1, wherein the approximated set of values comprise approximations of what the values of the set of values would be had a complete set of data corresponding to the set of values been used to calculate the values of the set of values.

3. The method of claim 1, wherein continuously updating the approximated set of values stored at the second server data storage comprises periodically transmitting, during the first time period, a version of the approximated set of values stored at the first server data storage to the second server data storage to replace a version of the approximated set of values stored at the second server data storage, each of the periodically-transmitted versions being more recently updated than the respective replaced version of the approximated set of values stored at the second server data storage.

4. The method of claim 1, wherein obtaining the related data comprises continuously obtaining subsets of the related data based on the one or more queries during the first time period, the subset of the related data being obtained at a first time before the further subsets of the related data are obtained.

5. The method of claim 1, wherein continuously updating the approximated set of values stored at the first server data storage comprises (i) periodically updating the approximated set of values stored at the first server data storage during the first time period or (ii) updating the approximated set of values stored at the first server data storage in real-time during the first time period as the further subsets of the related data are being obtained.

6. The method of claim 1, further comprising:

obtaining, from the client device, a request for at least some values of the set of values; and

generating, based on the request, a plurality of queries for the related data,

wherein obtaining the related data comprises obtaining the related data based on the plurality of queries.

7. The method of claim 1, further comprising:

obtaining, from the client device, a request for at least some values of the set of values;

obtaining compatibility information associated with the client device; and

selecting, based on the compatibility information, the second server data storage for storage of versions of the approximated set of values, the second server data storage being selected from among a plurality of server data storages.

8. The method of claim 1, wherein the approximated set of values stored at the first server data storage is updated at a first update rate, and the approximated set of values stored at the second server data storage is updated at a second update rate different from the first update rate.

9. The method of claim 8, further comprising:

determining, based on a cost associated with writing to the second server data storage, the second update rate as an update rate for updating the approximated set of values stored at the second server data storage.

10. The method of claim 9, wherein the associated cost comprises a monetary cost for writing to the second server data storage.

11. A system comprising:

a computer system that comprises one or more processors programmed with computer program instructions that, when executed, cause the computer system to;

obtain, based on one or more queries, data related to calculating a set of values;

approximate the set of values based on a subset of the related data;

cause the approximated set of values to be stored at a first server data storage and a second server data storage, the second server data storage corresponding to a landing zone via which a client device obtains at least some approximated values of the approximated set of values;

continuously update, based on further subsets of the related data, the approximated set of values stored at the first server data storage such that the approximated set of values stored at the first server data storage is updated at least a first number of times within a first time period; and

continuously update the approximated set of values stored at the second server data storage corresponding to the landing zone such that the approximated set of values stored at the second server data storage is updated less than the first number of times within the first time period,

wherein continuously updating the approximated set of values stored at the second server data storage comprises transmitting the approximated set of values stored at the first server data storage to the second server data storage to replace the approximated set of values stored at the second server data storage.

12. The system of claim 11, wherein the approximated set of values comprise approximations of what the values of the set of values would be had a complete set of data corresponding to the set of values been used to calculate the values of the set of values.

13. The system of claim 11, wherein continuously updating the approximated set of values stored at the second server data storage comprises periodically transmitting, during the first time period, a version of the approximated set of values stored at the first server data storage to the second server data storage to replace a version of the approximated set of values stored at the second server data storage, each of the periodically-transmitted versions being more recently updated than the respective replaced version of the approximated set of values stored at the second server data storage.

14. The system of claim 11, wherein the computer system is caused to obtain the related data by continuously obtaining subsets of the related data based on the one or more queries during the first time period, the subset of the related data being obtained at a first time before the further subsets of the related data are obtained.

15. The system of claim 11, wherein continuously updating the approximated set of values stored at the first server data storage comprises (i) periodically updating the approximated set of values stored at the first server data storage during the first time period or (ii) updating the approximated set of values stored at the first server data storage in real-time during the first time period as the further subsets of the related data are being obtained.

16. The system of claim 11, wherein the computer system is caused to:

obtain, from the client device, a request for at least some values of the set of values;

generate, based on the request, a plurality of queries for the related data; and

obtain the related data by obtaining the related data based on the plurality of queries.

17. The system of claim 11, wherein the computer system is caused to:

obtain, from the client device, a request for at least some values of the set of values;

obtain compatibility information associated with the client device; and

select, based on the compatibility information, the second server data storage for storage of versions of the approximated set of values, the second server data storage being selected from among a plurality of server data storages.

18. The system of claim 11, wherein the approximated set of values stored at the first server data storage is updated at a first update rate, and the approximated set of values stored at the second server data storage is updated at a second update rate different from the first update rate.

19. The system of claim 18, wherein the computer system is caused to:

determine, based on a cost associated with writing to the second server data storage, the second update rate as an update rate for updating the approximated set of values stored at the second server data storage.

20. A method implemented by a computer system that comprises one or more processors executing computer program instructions that, when executed, perform the method, the method comprising:

obtaining, from a client device, a request for a set of values;

obtaining, based on the request, data related to calculating the set of values;

approximating the set of values based on a subset of the related data;

causing the approximated set of values to be stored at a first server data storage and a second server data storage, the second server data storage corresponding to a landing zone via which the client device obtains at least some approximated values of the approximated set of values;

continuously updating, based on further subsets of the related data, the approximated set of values stored at the first server data storage such that the approximated set of values stored at the first server data storage is updated at least a first number of times within a first time period; and

continuously updating the approximated set of values stored at the second server data storage corresponding to the landing zone such that the approximated set of values stored at the second server data storage is updated less than the first number of times within the first time period,

wherein continuously updating the approximated set of values stored at the second server data storage comprises periodically transmitting, during the first time period, a version of the approximated set of values stored at the first server data storage to the second server data storage to replace a version of the approximated set of values stored at the second server data storage, each of the periodically-transmitted versions being more recently updated than the respective replaced version of the approximated set of values stored at the second server data storage.