Modeling big data

• US 9,361,320 B1
• Filed: 09/30/2011
• Issued: 06/07/2016
• Est. Priority Date: 09/30/2011
• Status: Active Grant

• Current Assignee: Emc IP Holding Company LLC (Dell Technologies Inc.)
• Original Assignee: EMC Corporation (Dell Technologies Inc.)
• Inventors: Vijendra, Sudhir, Florissi, Patricia G. S.
• Primary Examiner(s): Perveen, Rehana
• Assistant Examiner(s): Hoffler, Raheem
• Application Number:
  US13/249,330
• Time in Patent Office: 1,712 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: G06F 16/20 of structured data, e.g. relational data

Abstract

A method, apparatus, and computer implemented method for modeling a Big Data dataset, the method comprising creating non-specific representations of the Big Data dataset by representing, as objects in a computer model, non-specific representations including metaInformation, DataSet, BigData and Properties representations and creating non-specific representations of Properties, wherein at least one of the representations are selected from the group consisting of Analytical, size, volume, and structural.

Claims

1. A computer implemented method for modeling a Big Data dataset, the method comprising:

creating representations of the Big Data dataset by representing, as objects in a computer model, the representations include metaInformation, DataSet, BigData and Properties representations;

wherein at least one of the representations is enabled to represent unstructured data;

wherein unstructured data is unable to be fixed in a database field;

wherein at least one of the representations of the Big Data represents the hierarchy of the data Big Data Dataset; and

creating representations of Properties by decoupling attributes of the Big Data dataset, wherein at least one of the representations are selected from the group consisting of Analytical, size, volume, and structural;

wherein model further maps the big data dataset to resources available to analyze the big data dataset.

2. The method of claim 1 further comprising creating representations of meta Information, wherein at least one of the representations of metainformation is selected from the group consisting of metaclassification, metadatafolder, and metadatacontent.

3. The method of claim 1 further comprising extending the representations by creating further representations as objects in a computer model for the Big Data dataset being modeled.

4. The method of claim 3 further wherein the extending comprises adding parameters and attributes specific to the given Big Data dataset to metaInformation, DataSet, BigData and Properties representations.

5. The method of claim 1 further comprising further extending the representations by creating additional representations based on the created representations.

6. The method of claim 1 further comprising:

creating a distribution of the big data set across nodes through the use of a name node server;

distributing the big data set to according to the distribution to each node of the nodes;

wherein the distribution of the big dataset is enabled to include distribution of unstructured data;

performing analysis on the big data set using the nodes;

wherein performed analysis includes performing analysis on unstructured data when included in the distribution of the big data dataset; and

combining the analysis of each node of the nodes at the name node server.

7. The method of claim 6 wherein the analysis includes performing an analysis of the unstructured data of the big data set.

8. The method of claim 7 wherein at least one of the representations in the model represents the resources used to analyze the big data dataset.

9. The method of claim 3 further comprising populating the created representations with data from the Big Data dataset.

10. A computer program product for use in replication comprising:

a non-transitory computer readable medium encoded with computer executable program code for migration of data, the code configured to enable the execution of;

creating representations of the Big Data dataset by representing, as objects in a computer model, the representations include metaInformation, DataSet, BigData and Properties representations;

wherein at least one of the representations is enabled to represent unstructured data;

wherein unstructured data is unable to be fixed in a database field;

wherein at least one of the representations of the Big Data represents the hierarchy of the data Big Data Dataset; and

creating representations of Properties by decoupling attributes of the Big Data dataset, wherein at least one of the representations are selected from the group consisting of Analytical, size, volume, and structural;

wherein model further maps the big data dataset to resources available to analyze the big data dataset.

11. The program product of claim 10 wherein the executable program code is further configured for execution of creating representations of meta Information, wherein at least one of the representations of metainformation is selected from the group consisting of metaclassification, metadatafolder, and metadatacontent.

12. The program product of claim 10 wherein the executable program code is further configured for execution of extending the representations by creating further representations as objects in a computer model for the Big Data dataset being modeled.

13. The program product of claim 10 wherein the extending comprises adding parameters and attributes specific to the given Big Data dataset to metaInformation, DataSet, BigData and Properties representations.

14. The program product of claim 10 wherein the executable program code is further configured for execution of extending the representations by creating additional representations based on the created representations.

15. The program product of claim 10 wherein the executable program code is further configured for execution of populating the created representations with data from the Big Data dataset.

17. The system of claim 14 wherein the computer-executable program logic is further configured to enable execution across the one or more processors of:

enabling creation of representations of meta Information, wherein at least one of the representations of metainformation is selected from the group consisting of metaclassification, metadatafolder, and metadatacontent.

18. The system of claim 13 wherein the computer-executable program logic is further configured to to enable execution across the one or more processors of:

enabling extension of the representations by creating further representations as objects in a computer model for the Big Data dataset being modeled.

16. An system comprising:

one or more processors; and

computer-executable logic operating in memory, wherein the computer-executable program logic is configured to enable execution across the one or more processors of;

enabling creation of representations of the Big Data dataset by representing, as objects in a computer model, the representations include metaInformation, DataSet, BigData and Properties representations;

wherein at least one of the representations is enabled to represent unstructured data;

wherein unstructured data is unable to be fixed in a database field;

wherein at least one of the representations of the Big Data represents the hierarchy of the data Big Data Dataset; and

enabling creation of representations of Properties by decoupling attributes of the Big Data dataset, wherein at least one of the representations are selected from the group consisting of Analytical, size, volume, and structural;

wherein model further maps the big data dataset to resources available to analyze the big data dataset.

19. The system of claim 16 wherein the extending comprises adding parameters and attributes specific to the given Big Data dataset to metaInformation, DataSet, BigData and Properties representations.

20. The system of claim 16 wherein the computer-executable program logic is further configured to enable execution across the one or more processors of:

enabling extension of the representations by creating additional representations based on the created representations.

21. The system of claim 16 wherein the computer-executable program logic is further configured to to enable execution across the one or more processors of:

enabling the created representations to be populated with data from the Big Data dataset.