×

PLUGGABLE FAULT DETECTION TESTS FOR DATA PIPELINES

  • US 20170337124A1
  • Filed: 08/08/2017
  • Published: 11/23/2017
  • Est. Priority Date: 09/14/2015
  • Status: Active Grant
First Claim
Patent Images

1. A method for detecting faults related to a data pipeline system, the method comprising:

  • at one or more computing devices comprising one or more processors and memory storing one or more computer programs executed by the one or more processors to perform the method, performing operations comprising;

    receiving a plugin comprising one or more instructions representing a test to perform on the data pipeline system and one or more configuration points;

    wherein the data pipeline system is configured to receive source data from one or more data sources and configured to apply one or more transformations to the source data to produce transformed data before storage of the transformed data in one or more data sinks;

    receiving, via a first graphical user interface, one or more settings corresponding to the one or more configuration points;

    receiving test data from the data pipeline system, wherein the test data comprises a metric reflecting an amount of the transformed data after the one or more transformations;

    determining to run the test defined by the plugin on the data pipeline system including executing the one or more instructions of the plugin based on the one or more settings for the one or more configuration points and the test data, wherein a result of executing the one or more instructions includes at least a test result status indicator;

    wherein the test result status indicator is based, at least in part, on the result of executing the one or more instructions including determining whether the amount of the transformed data is below a threshold amount of data; and

    causing display of a second graphical user interface that presents at least the test result status indicator.

View all claims
  • 7 Assignments
Timeline View
Assignment View
    ×
    ×