System and method for dynamically controlling sample rates and data flow in a networked measurement system by dynamic determination of statistical significance

• US 9,621,472 B1
• Filed: 03/07/2016
• Issued: 04/11/2017
• Est. Priority Date: 03/14/2013
• Status: Active Grant

• Current Assignee: Oracle America, Inc. (Oracle Corporation)
• Original Assignee: MOAT Incorporated (Oracle Corporation)
• Inventors: Gomez, Nikki K., Fichter, Daniel E., Tsoufakis, Christopher R., Rahman, Aniq, Goodhart, Jonah, Seiler, Michael Garrett, Agarwal, Suryansh
• Primary Examiner(s): Gilles, Jude Jean
• Application Number:
  US15/063,199
• Time in Patent Office: 400 Days
• Field of Search: 709224, 709229, 709239, 709242, 709246
• CPC Class Codes: H04L 43/02 Capturing of monitoring data
• CPC Class Codes: H04L 43/04 Processing captured monitoring data, e.g. for logfile generation
• CPC Class Codes: H04L 47/25 with rate being modified by the source upon detecting a change of network conditions

Abstract

A system and methods for dynamically controlling sample rates and data flow in a distributed networked environment by dynamic determination of statistical significance or characteristics for an unlimited number of data collection scripts concurrently executed on concurrently rendering web pages operating an unlimited number of advertisements. Consumer and media behaviors are sampled on all the different components of the distributed environment to gather information, which is transmitted to a downstream statistical analytics system. The system and methods are configured to balance the communication data flow and load among servers and browsers in this distributed networked environment that are engaged in viewing of online content including online content with one or more advertisements.

Claims

1. A method implemented by one or more servers coupled to a network, for dynamically adjusting sample rates of variables relating to attention by users to a webpage, the webpage displayed on a plurality of user devices concurrently connected, by the network, to a website displaying the webpage, the method comprising:

designating, by at least one server, a desired sample rate by determining one or more statistical characteristics of aggregated data derived from gathering sample data relating to attention by each of a plurality of users to online content on the webpage, wherein the online content is at least one of text, picture and video;

monitoring, by at least one server, aggregated data flows from the plurality of user devices to determine if current new information for particular online content is required for statistical accuracy, wherein the monitoring is at least in part by a sample data collection script placed in the plurality of user devices;

assessing the impact of the aggregated data flows, by at least one server, on a downstream analytic server; and

adjusting the aggregated data flows, by at least one server, by changing sample rate parameters for measurement scripts provided to the plurality of user devices.

2. The method of claim 1, wherein if the aggregated data flows are determined to be less than a given threshold relating to network and system capacity, an adjustment is effected to increase the aggregated data flows.

3. The method of claim 1, wherein if the aggregated data flows are determined to exceed a given threshold relating to network and system capacity, an adjustment is effected to at least one of reducing and maintaining the aggregated data flows.

4. The method of claim 1, wherein the aggregated data flows include data on content elements of the online content including at least one of an in-view time and in-view rate.

5. The method of claim 1, wherein the aggregated data flows include data reflecting at least one of consumer behavior and media behavior.

6. The method of claim 1, wherein the aggregated data flows include sampled data.

7. The method of claim 1, wherein the aggregated data flows include sample rates.

8. The method of claim 1, wherein the sample data collection script is configured to modify the sample rate based at least in part on at least one of 1) information obtained from the downstream analytics server, 2) a decision by the data collection script based on information obtained from the downstream analytics server, and 3) a predetermined number provided to the sample data collection script.

9. The method of claim 1, wherein the sample data collection script is configured to determine if sampling is required, by attempting to access a document provided by a content server, the document containing instructions and recommended sample rates, and if no document is returned, the sample data collection script is configured to use a default sample rate configured to program itself.

10. The method of claim 1, wherein the sample data collection script renders in at least one of a browser and application in each of the plurality of user devices and is configured with a capability to at least one of 1) stop and 2) not send data to a downstream analytic server upon receiving instructions from another computer.

11. A system including one or more servers coupled to a network, for dynamically adjusting sample rates of variables relating to attention by users to a webpage, the webpage displayed on a plurality of user devices concurrently connected, by the network, to a website displaying the webpage, the system comprising:

one or more processors in the one or more servers;

memory storing instructions that cause the one or more processors to;

designate a desired sample rate by determining one or more statistical characteristics of aggregated data derived from gathering sample data relating to attention by each of a plurality of users to online content on the webpage, wherein the online content is at least one of text, picture and video;

monitor aggregated data flows from the plurality of user devices to determine if current new information for particular online content is required for statistical accuracy, wherein the monitoring is at least in part by a sample data collection script placed in the plurality of user devices;

assess the impact of the aggregated data flows on a downstream analytic server; and

adjust the aggregated data flows by changing sample rate parameters for measurement scripts provided to the plurality of user devices.

12. The system of claim 11, wherein if the aggregated data flows are determined to be less than a given threshold relating to network and system capacity, an adjustment is effected to increase the aggregated data flows.

13. The system of claim 11, wherein if the aggregated data flows are determined to exceed a given threshold relating to network and system capacity, an adjustment is effected to at least one of reducing and maintaining the aggregated data flows.

14. The system of claim 11, wherein the aggregated data flows include data on content elements of the online content including at least one of an in-view time and in-view rate.

15. The system of claim 11, wherein the aggregated data flows include data reflecting at least one of consumer behavior and media behavior.

16. The system of claim 11, wherein the aggregated data flows include sampled data.

17. The system of claim 11, wherein the aggregated data flows include sample rates.

18. The system of claim 11, wherein the sample data collection script is configured to modify the sample rate based at least in part on at least one of 1) information obtained from the downstream analytics server, 2) a decision by the data collection script based on information obtained from the downstream analytics server, and 3) a predetermined number provided to the sample data collection script.

19. The system of claim 11, wherein the sample data collection script is configured to determine if sampling is required, by attempting to access a document provided by a content server, the document containing instructions and recommended sample rates, and if no document is returned, the sample data collection script is configured to use a default sample rate configured to program itself.

20. The system of claim 11, wherein the sample data collection script renders in at least one of a browser and application in each of the plurality of user devices and is configured with a capability to at least one of 1) stop and 2) not send data to a downstream analytic server upon receiving instructions from another computer.