Enterprise data processing

• US 9,547,682 B2
• Filed: 08/20/2013
• Issued: 01/17/2017
• Est. Priority Date: 08/22/2012
• Status: Active Grant

• Current Assignee: Bitvore Corporation
• Original Assignee: Bitvore Corporation
• Inventors: Chaney, Alan, Cover, Clay, Bolcer, Greg
• Primary Examiner(s): Corrielus, Jean M
• Application Number:
  US13/971,115
• Publication Number:
  US 20140059056A1
• Time in Patent Office: 1,246 Days
• Field of Search: 707/749, 707/736
• US Class Current: 1/1
• CPC Class Codes: G06F 16/23 Updating
• CPC Class Codes: G06F 16/24578 using ranking
• CPC Class Codes: G06F 16/256 in federated or virtual databases
• CPC Class Codes: G06F 16/27 Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
• CPC Class Codes: G06F 16/31 Indexing; Data structures therefor; Storage structures
• CPC Class Codes: G06F 16/9535 Search customisation based on user profiles and personalisation

Abstract

An enterprise data processing module and method are described herein. The enterprise data processing module comprises at least one collector and at least one analyzer. The collectors may be operable to collect data pieces from a plurality of data sources. The analyzers may be operable to analyze the collected data pieces to determine cross-source relationships that exist between the data pieces collected from the plurality of sources. The analyzed data pieces may be stored in one or more big-data databases as blocks of data according to the cross-source relationships.

Claims

1. An enterprise data processing module, comprising:

a non-transitory computer readable medium storing a sequence of instructions;

a memory storing one or more big-data databases; and

an analysis engine operable to execute the sequence of instructions to;

collect a plurality of data pieces from a plurality of data sources, analyze the plurality of data pieces to determine a cross-source relationship, wherein the data pieces are stored in the one or more big-data databases as blocks of data according to the cross-source relationship, wherein the cross-source relationship comprises a plurality of dimensions, each dimension corresponding to a different data characteristic, and

generating a weighted combination of the plurality of dimensions of the cross-source relationship, each metric of a plurality of metrics corresponding to a unique dimension of the plurality of dimensions, the weighted combination being a single composite weight that combines the plurality of metrics, wherein the cross-source relationship comprises a degree of correlation that is determined by a correlation intensity algorithm, and

wherein the correlation intensity algorithm determines a level of similarity with respect to the number of unique concepts in each data piece.

2. The enterprise data processing module of claim 1, wherein the enterprise data processing module comprises:

a user interface operable to receive a request from a user to assign one or more weights to the plurality of dimensions of the cross-source relationship.

3. The enterprise data processing module of claim 2, wherein information from the cross-source relationship comprises conclusion data that supports a schema.

4. The enterprise data processing module of claim 3, wherein if the user has permission to access information from the cross-source relationship, the request is processed to return the conclusion data without extracting all underlying data required to compute the requested conclusion data.

5. The enterprise data processing module of claim 1, wherein the correlation intensity algorithm determines a level of similarity with respect to a complexity of the data pieces.

6. The enterprise data processing module of claim 1, wherein the correlation intensity algorithm determines a level of similarity with respect to a size of the data pieces.

7. The enterprise data processing module of claim 1, wherein the correlation intensity algorithm determines a level of similarity with respect to a spam score of each data piece.

8. The enterprise data processing module of claim 1, wherein the correlation intensity algorithm determines a level of similarity with respect to a readability score of each data piece.

9. A method for operating an enterprise data processing module, the enterprise data processing module comprising a memory, an analysis engine, and a non-transitory computer readable medium storing a sequence of instructions, the method comprising:

collecting data pieces into the memory from a plurality of data sources;

determining a cross-source relationship that exists between data pieces collected from different sources of the plurality of sources, the determining being performed by the analysis engine, wherein the cross-source relationship comprises a plurality of dimensions, each dimension corresponding to a different data characteristic;

assigning one or more weights to each dimension of the plurality of dimensions of the cross-source relationship, the assigning being performed by the analysis engine;

generating conclusion data that is based on the request from the user, the data pieces and the cross-source relationship, the conclusion data being a single composite weight that combines the one or more weights from each dimension of the plurality of dimensions of the cross-source relationship, the generating being performed by the analysis engine;

generating one or more data globs, each data glob including the data pieces, the cross-source relationship and one or more access rules, the generating being performed by the analysis engine; and

storing the one or more data globs in one or more big-data databases in a memory,

wherein determining a cross-source relationship comprises determining a degree of correlation according to a correlation intensity algorithm, and

wherein the correlation intensity algorithm determines a level of similarity with respect to the number of unique concepts in each data piece.

10. The method of claim 9, wherein the method comprises:

receiving a request from a user to interact with a data glob stored in the one or more big-data databases.

11. The method of claim 10, wherein information from the cross-source relationship comprises conclusion data that supports a schema.

12. The method of claim 10, wherein if the user has permission to access information from the cross-source relationship, the method comprises processing the request to return the conclusion data without extracting all underlying data required to compute the requested conclusion data.

13. The enterprise data processing module of claim 9, wherein the correlation intensity algorithm determines a level of similarity with respect to a complexity of the data pieces.

14. The enterprise data processing module of claim 9, wherein the correlation intensity algorithm determines a level of similarity with respect to a size of the data pieces.

15. The enterprise data processing module of claim 9, wherein the correlation intensity algorithm determines a level of similarity with respect to a spam score of each data piece.

16. The enterprise data processing module of claim 9, wherein the correlation intensity algorithm determines a level of similarity with respect to a readability score of each data piece.