Conformed dimensional data gravity wells

• US 9,229,932 B2
• Filed: 01/02/2013
• Issued: 01/05/2016
• Est. Priority Date: 01/02/2013
• Status: Expired due to Fees

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Adams, Samuel S., Friedlander, Robert R., Kraemer, James R., Linton, Jeb R.
• Primary Examiner(s): Ngo, Chuong D
• Application Number:
  US13/732,567
• Publication Number:
  US 20140188960A1
• Time in Patent Office: 1,098 Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/00 Information retrieval; Database structures therefor; File system structures therefor
• CPC Class Codes: G06F 16/215 Improving data quality; Data cleansing, e.g. de-duplication, removing invalid entries or correcting typographical errors
• CPC Class Codes: G06F 16/24575 using context
• CPC Class Codes: G06F 16/93 Document management systems
• CPC Class Codes: G06Q 30/00 Commerce
• CPC Class Codes: G06Q 30/0201 Market modelling; Market analysis; Collecting market data

Abstract

A processor-implemented method, system, and/or computer program product defines multiple dimensional data gravity wells on a conformed dimensional data gravity wells membrane. Non-dimensional data objects are associated with dimension objects to define conformed dimensional objects. The conformed dimensional objects are parsed into an n-tuple that includes a pointer to one of the non-dimensional data objects, a probability that a non-dimensional data object has been associated with a correct dimension object, and a weighting factor of importance of the conformed dimensional object. A virtual mass of each parsed conformed dimensional object is calculated, in order to define a shape of multiple dimensional data gravity wells that are created when conformed dimensional objects are pulled into each of the dimensional data gravity well frameworks on a conformed dimensional data gravity wells membrane.

Claims

1. A processor-implemented method of defining multiple conformed dimensional data gravity wells on a conformed dimensional data gravity wells membrane, the processor-implemented method comprising:

receiving, by a processor, a data stream of non-dimensional data objects;

applying, by the processor, a dimension object to one of the non-dimensional data objects to define a conformed dimensional object;

parsing, by the processor, the conformed dimensional object into an n-tuple, wherein the n-tuple comprises a pointer to said one of the non-dimensional data objects, a probability that said one of the non-dimensional data objects has been associated with a correct dimensional label, a probability that said one of the non-dimensional data objects is uncorrupted, and a weighting factor of importance of the conformed dimensional object;

calculating, by the processor, a virtual mass of a parsed conformed dimensional object, wherein the virtual mass of the parsed conformed dimensional object is derived from a formula of;

P(C)×

Wt(S),

where P(C) is the probability that

     1) said one of the non-dimensional data objects has been associated with the correct dimensional label,

     2) said one of the non-dimensional data objects is uncorrupted, and

     3) the said one of the non-dimensional data objects has come from a data source whose data has been predetermined to be appropriate for storage in a particular dimensional data gravity well; and

where Wt(S) is the weighting factor of importance of the conformed dimensional object;

creating, by the processor, multiple dimensional data gravity well frameworks on a conformed dimensional data gravity wells membrane, wherein each of the multiple dimensional data gravity well frameworks comprises at least one dimension object, and wherein the conformed dimensional data gravity wells membrane is a virtual mathematical membrane that is capable of supporting multiple dimensional data gravity wells;

transmitting, by the processor, multiple parsed conformed dimensional objects as a streaming data flow to the conformed dimensional data gravity wells membrane;

defining, by the processor, multiple conformed dimensional data gravity wells according to the virtual mass of multiple parsed conformed dimensional objects that are pulled into each of the dimensional data gravity well frameworks; and

sorting, by one or more processors, the multiple parsed conformed dimensional objects from the streaming data flow by selectively pulling each of the multiple parsed conformed dimensional objects into the particular dimensional data gravity well in response to values from its n-tuple matching said at least one dimension object in said particular dimensional data gravity well.

2. The processor-implemented method of claim 1, further comprising:

graphically displaying the multiple dimensional data gravity wells according to a combined virtual mass of the multiple parsed conformed dimensional objects, wherein a first dimensional data gravity well holds a more virtually massive combination of parsed conformed dimensional objects than a second dimensional data gravity well, and wherein the first dimensional data gravity well extends farther away from the dimensional data gravity wells membrane than the second dimensional data gravity well.

3. The processor-implemented method of claim 1, further comprising:

determining, by the processor, a likelihood that a particular conformed dimensional object is pulled into an appropriate dimensional data gravity well according to a Bayesian probability formula of;

4. The processor-implemented method of claim 1, wherein the weighting factor of importance of the conformed dimensional object is based on how important the conformed dimensional object is to a particular project.

5. The processor-implemented method of claim 1, further comprising:

determining that said one of the non-dimensional data objects is uncorrupted by determining that said one of the non-dimensional data objects is not a fragment of an original data object.

6. The processor-implemented method of claim 1, further comprising:

graphically representing, by the processor, said at least one dimension object on a wall of said particular dimensional data gravity well.

7. The processor-implemented method of claim 1, further comprising:

determining, by the processor, an age of each of the multiple parsed conformed dimensional objects that have been pulled into the particular dimensional data gravity well; and

removing from the particular dimensional data gravity well any parsed conformed dimensional object that is older than a predetermined age.

8. A computer program product for defining multiple dimensional data gravity wells on a dimensional data gravity wells membrane, the computer program product comprising a non-transitory computer readable storage medium having program code embodied therewith, the program code readable and executable by a processor to perform a method comprising:

receiving a data stream of non-dimensional data objects;

applying a dimension object to one of the non-dimensional data objects to define a conformed dimensional object;

parsing the conformed dimensional object into an n-tuple, wherein the n-tuple comprises a pointer to said one of the non-dimensional data objects, a probability that said one of the non-dimensional data objects has been associated with a correct dimensional label, a probability that said one of the non-dimensional data objects is uncorrupted, and a weighting factor of importance of the conformed dimensional object;

calculating a virtual mass of a parsed conformed dimensional object, wherein the virtual mass of the parsed conformed dimensional object is derived from a formula of;

P(C)×

Wt(S),

where P(C) is the probability that

     1) said one of the non-dimensional data objects has been associated with the correct dimensional label,

     2) said one of the non-dimensional data objects is uncorrupted, and

     3) the said one of the non-dimensional data objects has come from a data source whose data has been predetermined to be appropriate for storage in a particular dimensional data gravity well; and

where Wt(S) is the weighting factor of importance of the conformed dimensional object;

creating multiple dimensional data gravity well frameworks on a conformed dimensional data gravity wells membrane, wherein each of the multiple dimensional data gravity well frameworks comprises at least one dimension object, and wherein the conformed dimensional data gravity wells membrane is a virtual mathematical membrane that is capable of supporting multiple dimensional data gravity wells;

transmitting multiple parsed conformed dimensional objects as a streaming data flow to the conformed dimensional data gravity wells membrane;

defining multiple conformed dimensional data gravity wells according to the virtual mass of multiple parsed conformed dimensional objects that are pulled into each of the dimensional data gravity well frameworks; and

sorting the multiple parsed conformed dimensional objects from the streaming data flow by selectively pulling each of the multiple parsed conformed dimensional objects into the particular dimensional data gravity well in response to values from its n-tuple matching said at least one dimension object in said particular dimensional data gravity well.

9. The computer program product of claim 8, further comprising program code that is readable and executable by the processor to:

graphically display the multiple dimensional data gravity wells according to a combined virtual mass of the multiple parsed conformed dimensional objects, wherein a first dimensional data gravity well holds a more virtually massive combination of parsed conformed dimensional objects than a second dimensional data gravity well, and wherein the first dimensional data gravity well extends farther away from the dimensional data gravity wells membrane than the second dimensional data gravity well.

10. The computer program product of claim 8, further comprising program code that is readable and executable by the processor to:

determine a likelihood that a particular conformed dimensional object is pulled into an appropriate dimensional data gravity well according to a Bayesian probability formula of;

11. The computer program product of claim 8, wherein the weighting factor of importance of the conformed dimensional object is based on how important the conformed dimensional object is to a particular project.

12. The computer program product of claim 8, further comprising program code that is readable and executable by the processor to:

determining that said one of the non-dimensional data objects is uncorrupted by determining that said one of the non-dimensional data objects is not a fragment of an original data object.

13. The computer program product of claim 8, further comprising program code that is readable and executable by the processor to:

graphically represent said at least one dimension object on a wall of said particular dimensional data gravity well.

14. The computer program product of claim 8, further comprising program code that is readable and executable by the processor to:

determine an age of each of the multiple parsed conformed dimensional objects that have been pulled into the particular dimensional data gravity well; and

remove from the particular dimensional data gravity well any parsed conformed dimensional object that is older than a predetermined age.

15. A computer system comprising:

a processor, a computer readable memory, and a computer readable storage medium;

first program instructions to receive a data stream of non-dimensional data objects;

second program instructions to apply a dimension object to one of the non-dimensional data objects to define a conformed dimensional object;

third program instructions to parse the conformed dimensional object into an n-tuple, wherein the n-tuple comprises a pointer to said one of the non-dimensional data objects, a probability that said one of the non-dimensional data objects has been associated with a correct dimensional label, a probability that said one of the non-dimensional data objects is uncorrupted, and a weighting factor of importance of the conformed dimensional object;

fourth program instructions to calculate a virtual mass of a parsed conformed dimensional object, wherein the virtual mass of the parsed conformed dimensional object is derived from a formula of;

P(C)×

Wt(S),

where P(C) is the probability that

     1) said one of the non-dimensional data objects has been associated with the correct dimensional label,

     2) said one of the non-dimensional data objects is uncorrupted, and

     3) the said one of the non-dimensional data objects has come from a data source whose data has been predetermined to be appropriate for storage in a particular dimensional data gravity well; and

where Wt(S) is the weighting factor of importance of the conformed dimensional object;

fifth program instructions to create multiple dimensional data gravity well frameworks on a conformed dimensional data gravity wells membrane, wherein each of the multiple dimensional data gravity well frameworks comprises at least one dimension object, and wherein the conformed dimensional data gravity wells membrane is a virtual mathematical membrane that is capable of supporting multiple dimensional data gravity wells;

sixth program instructions to transmit multiple parsed conformed dimensional objects as a streaming data flow to the conformed dimensional data gravity wells membrane;

seventh program instructions to define multiple dimensional data gravity wells according to the virtual mass of multiple parsed conformed dimensional objects that are pulled into each of the dimensional data gravity well frameworks; and

eighth program instructions to sort the multiple parsed conformed dimensional objects from the streaming data flow by selectively pulling each of the multiple parsed conformed dimensional objects into the particular dimensional data gravity well in response to values from its n-tuple matching said at least one dimension object in said particular dimensional data gravity well; and

wherein

the first, second, third, fourth, fifth, sixth, seventh, and eighth program instructions are stored on the computer readable storage medium for execution by the processor via the computer readable memory.

16. The computer system of claim 15, further comprising:

ninth program instructions to graphically display the multiple dimensional data gravity wells according to a combined mass of the multiple parsed conformed dimensional objects, wherein a first dimensional data gravity well holds a more massive combination of parsed conformed dimensional objects than a second dimensional data gravity well, and wherein the first dimensional data gravity well extends farther away from the dimensional data gravity wells membrane than the second dimensional data gravity well; and

wherein

the ninth program instructions are stored on the computer readable storage medium for execution by the processor via the computer readable memory.

17. The computer system of claim 15, further comprising:

ninth program instructions to determine a likelihood that a particular conformed dimensional object is pulled into an appropriate dimensional data gravity well according to a Bayesian probability formula of;

18. The computer system of claim 15, further comprising:

ninth program instructions to determine that said one of the non-dimensional data objects is uncorrupted by determining that said one of the non-dimensional data objects is not a fragment of an original data object; and

wherein

the ninth program instructions are stored on the computer readable storage medium for execution by the processor via the computer readable memory.

19. The computer system of claim 15, further comprising:

ninth program instructions to graphically represent said at least one dimension object on a wall of said particular dimensional data gravity well; and

wherein

the ninth program instructions are stored on the computer readable storage medium for execution by the processor via the computer readable memory.

20. The computer system of claim 15, further comprising:

ninth program instructions to determine an age of each of the multiple parsed conformed dimensional objects that have been pulled into the particular dimensional data gravity well; and

tenth program instructions to remove from the particular dimensional data gravity well any parsed conformed dimensional object that is older than a predetermined age; and

wherein

the ninth and tenth program instructions are stored on the computer readable storage medium for execution by the processor via the computer readable memory.