MACHINE TO MACHINE DATA AGGREGATOR

• US 20160179849A1
• Filed: 12/22/2014
• Published: 06/23/2016
• Est. Priority Date: 12/22/2014
• Status: Active Application

• Current Assignee: Verizon Patent and Licensing Incorporated (Verizon Communications Inc.)
• Original Assignee: Verizon Patent and Licensing Incorporated (Verizon Communications Inc.)
• Inventors: Dubois, Jean F., Moran, Patrick J.
• Granted Patent: US 10,275,476 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/211 Schema design and management

Abstract

A computer system may include data aggregator logic configured to ingest a data item from a data source via an aggregation socket, wherein the aggregation socket is configured to ingest data items of a particular data type; identify a schema associated with the aggregation socket; convert the data item into a common data format using the identified schema; store the converted data item in a common data format storage associated with the computer device; and provide the stored data item to a data utilization system. The computer system may further maintain and record provenance and reputation models associated with data items stored in the common data format storage.

Claims

1. A method, performed by a computer device, the method comprising:

ingesting, by the computer device, a data item from a data source via an aggregation socket, wherein the aggregation socket is configured to ingest data items of a particular data type;

identifying, by the computer device, a schema associated with the aggregation socket;

converting, by the computer device, the data item into a common data format using the identified schema;

storing, by the computer device, the converted data item in a common data format storage associated with the computer device; and

providing, by the computer device, the stored data item to a data utilization system.

2. The method of claim 1, further comprising:

ingesting another data item from another data source via another aggregation socket, wherein the other aggregation socket is configured to ingest data items of another data type that is different from the particular data type;

identifying another schema associated with the other aggregation socket;

converting the other data item into the common data format using the other identified schema; and

storing the converted other data item in the common data format storage.

3. The method of claim 1, further comprising:

identifying a data processing module associated with the identified schema; and

processing the data item using the identified data processing module.

4. The method of claim 3, wherein the data processing module includes a Resource Description Framework tagging module, and wherein processing the data item using the identified processing module includes:

adding one or more Resource Description Framework tags to the data item based on the identified schema.

5. The method of claim 1, further comprising:

notifying a provenance engine that the data item has been stored in the common data format storage, wherein the provenance engine is configured to record information relating to events associated with the data item.

6. The method of claim 5, further comprising:

detecting an event associated with the data item;

generating a provenance record associated with the detected event; and

storing one or more provenance parameters associated with the detected event in the generated provenance record.

7. The method of claim 6, wherein the one or more provenance parameters include at least one of:

information identifying a type of event associated with the detected event;

information identifying an entity accessing or modifying the data item;

information identifying a time and date associated with the event;

information identifying a physical or network location associated with the event;

information identifying a cause of the event;

or

information identifying a system state associated with the event.

8. The method of claim 1, further comprising:

determining a reputation score associated with the data source; and

assigning the determined reputation score to the data item.

9. The method of claim 8, further comprising:

determining that a particular entity, associated with a particular reputation score, has requested to access or modify the data item; and

modifying the reputation score associated with the data source based on the particular reputation score associated with the particular entity.

10. The method of claim 1, wherein storing the converted data item in the common data format storage includes:

storing the converted data item in a compact binary format.

11. The method of claim 1, further comprising:

generating the schema;

associating a field of use with the generated schema;

associating an originating entity with the generated schema; and

associating the aggregation socket with the generated schema.

12. A computer system comprising:

data aggregator logic configured to;

ingest a data item from a data source via an aggregation socket, wherein the aggregation socket is configured to ingest data items of a particular data type;

identify a schema associated with the aggregation socket;

convert the data item into a common data format using the identified schema;

store the converted data item in a common data format storage associated with the computer system; and

provide the stored data item to a data utilization system.

13. The computer system of claim 12, wherein the data aggregator logic is further configured to:

ingest another data item from another data source via another aggregation socket, wherein the other aggregation socket is configured to ingest data items of another data type that is different from the particular data type;

identify another schema associated with the other aggregation socket;

convert the other data item into the common data format using the other identified schema; and

store the converted other data item in the common data format storage.

14. The computer system of claim 12, wherein the data aggregator logic is further configured to:

identify a data processing module associated with the identified schema; and

process the data item using the identified data processing module.

15. The computer system of claim 12, further comprising:

provenance engine logic configured to;

detect an event associated with the data item;

generate a provenance record associated with the detected event; and

store one or more provenance parameters associated with the detected event in the generated provenance record.

16. The computer system of claim 15, wherein the one or more provenance parameters include at least one of:

information identifying a type of event associated with the detected event;

information identifying an entity accessing or modifying the data item;

information identifying a time and date associated with the event;

information identifying information identifying a physical or network location associated with the event;

information identifying a cause of the event;

or

information identifying a system state associated with the event.

17. The computer system of claim 12, further comprising:

reputation engine logic configured to;

determine a reputation score associated with the data source; and

assign the determined reputation score to the data item.

18. The computer system of claim 17, wherein the reputation engine logic is further configured to:

determine that a particular entity, associated with a particular reputation score, has requested to access or modify the data item; and

modify the reputation score associated with the data source based on the particular reputation score associated with the particular entity.

19. The computer system of claim 12, wherein the data aggregator logic is further configured to:

generate the schema;

associate a field of use with the generated schema;

associate an originating entity with the generated schema; and

associate the aggregation socket with the generated schema.

20. A non-transitory computer-readable memory device storing instructions executable by a processor, the non-transitory computer-readable memory device comprising:

one or more instructions to ingest a data item from a data source via an aggregation socket, wherein the aggregation socket is configured to ingest data items of a particular data type;

one or more instructions to identify a schema associated with the aggregation socket;

one or more instructions to convert the data item into a common data format using the identified schema;

one or more instructions to store the converted data item in a common data format storage;

one or more instructions to provide the stored data item to a data utilization system;

one or more instructions to detect an event associated with the data item;

one or more instructions to generate a provenance record associated with the detected event; and

one or more instructions to store one or more provenance parameters associated with the detected event in the generated provenance record.