System and method for large scale data processing of source data
First Claim
1. A computer system for processing large scale source data, comprising:
- a hardware monitor processor configured to monitor a stream of source data received at the computer system from a variety of sources of sensor data from one or more aircraft sensors and determine a data type for each source data in the stream of source data;
a master conversion database configured with definitions and a database query function and a comparator that determines if data contained in the stream of source data is of a known data type or an unknown data type based on a comparison with the definitions, wherein the unknown data type is from a new data source that has not been previously recorded;
a hardware translation processor configured to translate the stream of source data into a stream of formatted data based on one or more of definitions for the source data;
a hardware data conversion processor configured to configure a data definitions database with a new definition to detect the unknown data type and merge the new definition with the master conversion database;
a hardware vital data processor configured to input the stream of formatted data contained in the stream of source data into a dataset database by using an algorithm that identifies vital data using a conversion data map as a key, a data characteristic that identifies vital data using one of a plurality of characteristics of the source data, or a data signature that identifies vital data using a signature of the source data, and to process a trigger function, which detects formatted data associated with a trigger event associated with a physical trigger event that is representative of a physical system that is operating outside of a normal range and outputs, to the dataset database, event data as a vital data parameter that is out of tolerance, the event data being tagged to produce a tagged event data having a tag associated with the source data and the trigger event and retrieves and stores surrounding data associated with the trigger event and having a predetermined relationship to the trigger event to the dataset database; and
a hardware data analytics processor configured to perform one or more of diagnosis, introspection, prediction and prognosis analytics based on the tagged event data and the surrounding data.
1 Assignment
0 Petitions
Accused Products
Abstract
A system and method for processing source data, which includes a translation processor configured on a server to translate a stream of source data received at the server into a stream of formatted data types based on one or more of parameter definitions for the source data and new parameter information for the source data having an unknown data type. The source data can be received at the server from multiple sources and the data format may not be consistent from one source to another. An analytics processor on the server can be configured to operate on the out-of-tolerance data type to perform one or more of trend data analytics, associated data analytics and preventative action analytics.
11 Citations
20 Claims
-
1. A computer system for processing large scale source data, comprising:
-
a hardware monitor processor configured to monitor a stream of source data received at the computer system from a variety of sources of sensor data from one or more aircraft sensors and determine a data type for each source data in the stream of source data; a master conversion database configured with definitions and a database query function and a comparator that determines if data contained in the stream of source data is of a known data type or an unknown data type based on a comparison with the definitions, wherein the unknown data type is from a new data source that has not been previously recorded; a hardware translation processor configured to translate the stream of source data into a stream of formatted data based on one or more of definitions for the source data; a hardware data conversion processor configured to configure a data definitions database with a new definition to detect the unknown data type and merge the new definition with the master conversion database; a hardware vital data processor configured to input the stream of formatted data contained in the stream of source data into a dataset database by using an algorithm that identifies vital data using a conversion data map as a key, a data characteristic that identifies vital data using one of a plurality of characteristics of the source data, or a data signature that identifies vital data using a signature of the source data, and to process a trigger function, which detects formatted data associated with a trigger event associated with a physical trigger event that is representative of a physical system that is operating outside of a normal range and outputs, to the dataset database, event data as a vital data parameter that is out of tolerance, the event data being tagged to produce a tagged event data having a tag associated with the source data and the trigger event and retrieves and stores surrounding data associated with the trigger event and having a predetermined relationship to the trigger event to the dataset database; and a hardware data analytics processor configured to perform one or more of diagnosis, introspection, prediction and prognosis analytics based on the tagged event data and the surrounding data. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10)
-
-
11. A computer-implemented method for processing source data, comprising:
-
monitoring, with a hardware monitor processor, a stream of source data received at a computer system from a variety of sources of sensor data from one or more aircraft sensors and determining a data type for each source data in the stream of source data; configuring a master conversion database with definitions and a database query function and a comparator that determines if data contained in the stream of source data is of a known data type or an unknown data type based on a comparison with the definitions, wherein the unknown data type is from a new data source that has not been previously recorded; translating, at the computer system with a hardware translation processor, the stream of source data into a stream of formatted data based on the master conversion database and a data definitions database for the source data with known and unknown data; detecting, with a hardware data conversion processor at a computer server, the unknown data type and configuring the data definitions database with a new definition to detect the unknown data type detecting, with a hardware vital data processor at the computer server using an algorithm that identifies vital data using a conversion data map as a key, a data characteristic that identifies vital data using one of a plurality of characteristics of the source data, or a data signature that identifies vital data using a signature of the source data, data associated with a trigger event associated with a physical trigger event that is representative of a physical system that is operating outside of a normal range and outputting, to a dataset database, event data as a vital data parameter that is out of tolerance, the event data being tagged to produce a tagged event data having a tag associated with source data and the trigger event and retrieving and storing surrounding data associated with the trigger event to the dataset database; and performing, on the data type, one or more of trend data analytics, associated data analytics and preventative action analytics. - View Dependent Claims (12, 13, 14, 15, 16, 17, 18, 19, 20)
-
Specification