Systems, methods, and computer program products to ingest, process, and output large data
First Claim
Patent Images
1. A method, comprising:
- receiving a file comprising a header, the file including a plurality of portions, each of the portions corresponding to a respective characteristic of a hardware or software component in a deployed system;
classifying the file as actionable in response to examining the header and discerning therefrom that the file corresponds to an error on a deployed system;
classifying the file as non-actionable in response to examining the header and discerning therefrom that the file corresponds to a periodic report from a deployed system;
breaking the file into a plurality of sections, each of the sections corresponding to a respective portion of the file;
for each section, adding first metadata to uniquely identify the file and provide a name for the section; and
distributing the sections to a plurality of container files.
1 Assignment
0 Petitions
Accused Products
Abstract
A method for ingesting data, the method comprising receiving a file including a plurality of portions, each of the portions corresponding to a respective characteristic of a hardware or software component in a deployed system; breaking the file into a plurality of sections, each of the sections corresponding to a respective portion of the file; for each section, adding first metadata to uniquely identify the file and provide a name for the section; and distributing the sections to a plurality of container files.
-
Citations
18 Claims
-
1. A method, comprising:
-
receiving a file comprising a header, the file including a plurality of portions, each of the portions corresponding to a respective characteristic of a hardware or software component in a deployed system; classifying the file as actionable in response to examining the header and discerning therefrom that the file corresponds to an error on a deployed system; classifying the file as non-actionable in response to examining the header and discerning therefrom that the file corresponds to a periodic report from a deployed system; breaking the file into a plurality of sections, each of the sections corresponding to a respective portion of the file; for each section, adding first metadata to uniquely identify the file and provide a name for the section; and distributing the sections to a plurality of container files. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8)
-
-
9. A system comprising:
-
a storage system; and an ingestion server in communication with the storage system, the ingestion server executing code to; receive a system information file comprising a header over a network from a remote, deployed system, the system information file including a plurality of portions, wherein each portion describes a respective characteristic of a hardware or software component of the deployed system; classify the system information file as actionable in response to examining the header and discerning therefrom that the system information file corresponds to an error on a deployed system; classify the system information file as non-actionable in response to examining the header and discerning therefrom that the system information file corresponds to a periodic report from a deployed system; divide the system information file into a plurality of sections, each of the sections corresponding to a respective portion of the system information file; within each section, add a unique identifier of the system information file and a name of the section; store the plurality of sections to a plurality of container files in the storage system, each of the sections being added as a key value pair, wherein a key includes the unique identifier of the system information file and a name of a respective section. - View Dependent Claims (10, 11, 12, 13)
-
-
14. A computer readable medium tangibly recording computer program logic comprising a plurality of instructions, that when executed, cause a system to:
-
parse a file comprising a header into a plurality of sections, wherein the file includes multiple portions, wherein each of the portions comprises information directed to a respective characteristic of a deployed system, further wherein each of the sections corresponds to a respective portion; classify the file as actionable in response to examining the header and discerning therefrom that the file corresponds to an error on the deployed system; classify the file as non-actionable in response to examining the header and discerning therefrom that the file corresponds to a periodic report from the deployed system; and distribute the sections among a plurality of container files in a distributed storage system by storing each section as a key value pair, each respective key including a unique identifier of the file and a name of a respective section. - View Dependent Claims (15, 16, 17, 18)
-
Specification