DATA RELATIONSHIPS STORAGE PLATFORM

• US 20140059017A1
• Filed: 08/20/2013
• Published: 02/27/2014
• Est. Priority Date: 08/22/2012
• Status: Active Grant

• Current Assignee: Bitvore Corporation
• Original Assignee: Bitvore Corporation
• Inventors: Bolcer, Greg, Chaney, Alan, Cover, Clay
• Granted Patent: US 9,594,823 B2
• Time in Patent Office: Days
• US Class Current: 707/692
• CPC Class Codes: G06F 16/22 Indexing; Data structures therefor; Storage structures
• CPC Class Codes: G06F 16/2365 Ensuring data consistency and integrity
• CPC Class Codes: G06F 16/25 Integrating or interfacing systems involving database management systems
• CPC Class Codes: G06F 16/284 Relational databases
• CPC Class Codes: G06F 16/288 Entity relationship models
• CPC Class Codes: G06F 16/95 Retrieval from the web
• CPC Class Codes: G06F 16/951 Indexing; Web crawling techniques
• CPC Class Codes: G06F 7/08 Sorting, i.e. grouping record carriers in numerical or other ordered sequence according to the classification of at least some of the information they carry by merging two or more sets of carriers in ordered sequence G06F7/16

Abstract

A data relationships storage platform for analysis of one or more data sources is described herein. A data processing system may be communicatively coupled to one or more data sources and one or more big-data databases. One or more collectors may collect data pieces from the one or more data sources. One or more analyzer may analyze the collected data pieces to determine whether one or more relationships exist between the collected data pieces. The analysis results in one or more data globs that include one or more of the data pieces and relationship information, such as tags. The tagged data globs may be communicated to and stored in one or more big-data databases.

Claims

1. A data relationships storage platform, comprising:

a data processing system communicatively coupled to one or more data sources and one or more big-data databases,

wherein the data processing system is programmed to;

collect data pieces from the one or more data sources;

analyze the collected data pieces to determine whether one or more relationships exist between the collected data pieces;

create one or more data globs that include one or more of the data pieces and relationship information; and

communicate one or more data globs to the one or more big-data databases so that the big-data databases can store the data globs.

2. The data relationships storage platform of claim 1, wherein the data processing system includes:

one or more collector modules that perform the collecting, where at least one collector module is designated to collect data pieces from each data source;

one or more analyzer modules that perform the analyzing and the creation of the data globs, where the analyzer modules use an intensity algorithm to determine the degree of correlation between data pieces; and

one or more data services that manage the communication of the data globs to the big-data databases.

3. The data relationships storage platform of claim 2, wherein the one or more collectors each de-normalize the data pieces they collect.

4. The data relationships storage platform of claim 2, wherein the data processing system includes a statistics module that tracks one or more of the following:

number of collectors, number of data pieces received, and/or number of data globs created.

5. The data relationships storage platform of claim 2, wherein the one or more analyzers each tag incoming data pieces to aid in later searching of the big-data databases.

6. The data relationships storage platform of claim 1, wherein relationships between data include one or more of:

Hierarchical, Network, Relational, Entity-Relationship, Anchor Model, Dimensional, Multi-value, Object and Key-Value.

7. The data relationships storage platform of claim 1, wherein each data piece represents a message with one or more of the following fields:

source, sender, timestamp, subject, intended recipients, actual recipients and metadata.

8. The data relationships storage platform of claim 1, wherein each data piece is associated with one or more profiles, where each profile may be a sender, a recipient and/or an observer.

9. The data relationships storage platform of claim 1, wherein the data processing system is programmed to identify related source-profiles in order to determine a single profile for each unique person.

22. The data relationships storage platform of claim 1, wherein the data processing system is programmed to deduplicate collected data pieces according to a level of similarity the collected data pieces have with stored information associated with one or more data globs.

24. The data relationships storage platform of claim 1, wherein the relationship information comprises one or more editable tags, each tag is designated as being visible to a single user, visible to several users, or visible throughout a domain.

10. A data relationships storage platform, comprising:

a big-data database communicatively coupled to a data processing system that is communicatively coupled to one or more data sources,

wherein the data processing system communicates one or more data globs to the big-data database so that the big-data database can store the data globs, and

wherein the data globs are generated by the data processing system by collecting data pieces from the one or more data sources, analyzing the collected data pieces to determine whether one or more relationships exist between the collected data pieces, and creating the one or more data globs out of the one or more of the data pieces and relationship information.

11. The data relationships storage platform of claim 10, wherein the big-data database keys, indexes and sorts the data globs when the big-data database stores the data globs.

12. The data relationships storage platform of claim 10, wherein the big-data database tags the data globs when it stores the data globs such that the data globs may be searched and/or compared.

13. The data relationships storage platform of claim 10, wherein the big-data database stores the data globs as one or more of the following:

unstructured data, semi-structured data, or structured data.

14. The data relationships storage platform of claim 10, wherein the big-data database is operable to be searched by a user, where the search may be based on one or more of the following:

content of data pieces in data globs, tags, and relationships.

15. The data relationships storage platform of claim 10, wherein the big-data database uses a fingerprinting system to ensure that duplicate copies of the same data piece are not stored in the big-data databases.

16. The data relationships storage platform of claim 10, wherein the big-data database includes one or more of the following big data tools:

Hadoop, Hbase or Elastic Search.

17. The data relationships storage platform of claim 10, wherein the big-data database communicates with one or more of the following:

a query and analysis module;

a big data analytics module; and

/or

one or more custom applications that allow users to interface with the big-data database.

18. The data relationships storage platform of claim 10, wherein the big-data database communicates with one or more applications that allow users to interface with the big-data database, wherein the applications are either first part (associated with the big-data database) or third party (not associated with the big-data database).

19. The data relationships storage platform of claim 18, wherein one or more of the applications uses one or more APIs associated with the big-data database to communicate with the big-data database.

20. The data relationships storage platform of claim 10, wherein the big-data database organizes stored data globs by row keys.

21. The data relationships storage platform of claim 10, wherein the big-data database analyzes the data globs to determine one or more sentiment scores.

23. The data relationships storage platform of claim 10, wherein analyzing the collected data pieces includes deduplicating collected data pieces according to a level of similarity the collected data pieces have with stored information associated with data globs in the big-data database.

25. The data relationships storage platform of claim 10, wherein the relationship information comprises one or more editable tags, each tag is designated as being visible to a single user, visible to several users, or visible throughout a domain.