Population of context-based data gravity wells

• US 9,348,794 B2
• Filed: 05/17/2013
• Issued: 05/24/2016
• Est. Priority Date: 05/17/2013
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Friedlander, Robert R., Kraemer, James R., Ungar, David M.
• Primary Examiner(s): Gofman, Alex
• Assistant Examiner(s): Gurmu, Muluemebet
• Application Number:
  US13/896,506
• Publication Number:
  US 20140344292A1
• Time in Patent Office: 1,103 Days
• Field of Search: 707/752
• US Class Current: 1/1
• CPC Class Codes: G06F 16/24573 using data annotations, e.g. user-defined metadata
• CPC Class Codes: G06F 16/24575 using context
• CPC Class Codes: G06F 16/248 Presentation of query results
• CPC Class Codes: G06F 17/10 Complex mathematical operations function generation by table look-up G06F1/03; evaluation of elementary functions by calculation G06F7/544

Abstract

A method and/or system sorts data into data gravity wells on a data gravity wells membrane. A hashing logic executes instructions to convert raw data into a first logical address and first payload data, wherein the first logical address describes metadata about the first payload data. A hardware XOR unit compares the first logical address to a second logical address to derive a Hamming distance between the first and second logical addresses, wherein the second logical address is for a second payload data. A hardware data vector generator creates a data vector for the second payload data, wherein the data vector comprises the Hamming distance between the first and second logical addresses. A hardware data vector sorter then sorts data vectors into specific hardware data gravity wells on a data gravity wells membrane according to the Hamming distance stored in the data vector.

Claims

1. A method for sorting data into data gravity wells on a data gravity wells membrane, the method comprising:

converting, by a hashing logic, raw data into a first logical address and first payload data, wherein the first logical address describes metadata about the first payload data;

comparing, by a hardware exclusive OR (XOR) unit, the first logical address to a second logical address to derive a Hamming distance between the first and second logical addresses, wherein the second logical address is for a second payload data;

creating, by a hardware data vector generator, a data vector for the second payload data, wherein the data vector comprises the Hamming distance between the first and second logical addresses;

sorting, by a hardware data vector sorter, data vectors into specific data gravity wells on a data gravity wells membrane according to the Hamming distance stored in the data vector, wherein the data gravity wells membrane is a mathematical framework that

     1) performs to provide a virtual environment in which multiple context-based data gravity wells exist;

     2) populates the multiple context-based data gravity wells with synthetic context-based objects; and

     3) performs to display the multiple context-based data gravity wells on a display;

applying, by one or more processors, a context object to a non-contextual data object, wherein the non-contextual data object is a component of the raw data, wherein the non-contextual data object ambiguously relates to multiple subject-matters, and wherein the context object provides a context that identifies a specific subject-matter, from the multiple subject-matters, of the non-contextual data object;

incorporating, by one or more processors, the context object and the non-contextual data object into the data vector for the second payload data; and

sorting, by the hardware data vector sorter, the second payload data into specific data gravity wells on the data gravity wells membrane according to the context objects and the non-contextual data objects.

2. The method of claim 1, wherein the first and second payload data quantitatively describe a commercial transaction.

3. The method of claim 1, wherein the first and second payload data qualitatively describe a commercial transaction.

4. The method of claim 1, wherein the first and second payload data qualitatively describe an entity.

5. The method of claim 1, wherein the hashing logic comprises one or more processors executing the instructions to convert the raw data into the first logical address and first payload data.

6. The method of claim 1, further comprising:

calculating, by one or more processors, a virtual mass of a parsed synthetic context-based object, wherein the parsed synthetic context-based object comprises the context object, the non-contextual data object, and the Hamming distance, and wherein the virtual mass of the parsed synthetic context-based object is derived from a formula of;

(P(C)+P(S))×

Wt(S),

where P(C) is the probability that the non-contextual data object has been associated with the correct context object, wherein P(S) is the probability that the Hamming distance has been associated with the correct parsed synthetic context-based object, and where Wt(S) is the weighting factor of importance of the parsed synthetic context-based object.

7. The method of claim 1, further comprising:

determining, by one or more processors, which logical addresses describe a same type of data according to a cutoff value for the Hamming distance based on historical experience, wherein the cutoff value is a maximum Hamming distance that describes a predetermined level of probability that two logical addresses describe a same type of data payload; and

fine tuning, by one or more processors, a probability that the two logical addresses describe the same type of payload data a Bayesian probability formula, where A represents an event that two logical addresses both contain same significant bits that describe a same attribute of payload data stored at the two logical addresses, where B represents an event that the Hamming distance between two logical addresses is less than a predetermined number of bit differences, and wherein the Bayesian probability formula is;

8. A computer program product for sorting data into data gravity wells on a data gravity wells membrane, the computer program product comprising:

a non-transitory computer readable storage medium;

first program instructions to convert raw data into a first logical address and first payload data, wherein the first logical address describes metadata about the first payload data;

second program instructions to compare the first logical address to a second logical address to derive a Hamming distance between the first and second logical addresses, wherein the second logical address is for a second payload data, wherein the first and second payload data qualitatively describe a commercial transaction;

third program instructions to create a data vector for the second payload data, wherein the data vector comprises the Hamming distance between the first and second logical addresses;

fourth program instructions to sort data vectors into specific data gravity wells on a data gravity wells membrane according to the Hamming distance stored in the data vector, wherein the data gravity wells membrane is a mathematical framework that

     1) performs to provide a virtual environment in which multiple context-based data gravity wells exist;

     2) populates the multiple context-based data gravity wells with synthetic context-based objects; and

     3) performs to display the multiple context-based data gravity wells on a display;

fifth program instructions to apply a context object to a non-contextual data object, wherein the non-contextual data object is a component of the raw data, wherein the non-contextual data object ambiguously relates to multiple subject-matters, and wherein the context object provides a context that identifies a specific subject-matter, from the multiple subject-matters, of the non-contextual data object;

sixth program instructions to incorporate the context object and the non-contextual data object into the data vector for the second payload data; and

seventh program instructions to sort, by the hardware data vector sorter, the second payload data into specific data gravity wells on the data gravity wells membrane according to the context objects and the non-contextual data objects; and

wherein

the first, second, third, fourth, fifth, sixth, and seventh program instructions are stored on the non-transitory computer readable storage medium.

9. The computer program product of claim 8, further comprising:

eighth program instructions to apply a context object to a non-contextual data object, wherein the non-contextual data object is a component of the raw data, wherein the non-contextual data object ambiguously relates to multiple subject-matters, and wherein the context object provides a context that identifies a specific subject-matter, from the multiple subject-matters, of the non-contextual data object;

ninth program instructions to incorporate the context object and the non-contextual data object to a data vector for the second payload data; and

tenth program instructions to sort the second payload data into specific data gravity wells on the data gravity wells membrane according to the context objects and the non-contextual data objects; and

wherein

the eighth, ninth, and tenth program instructions are stored on the non-transitory computer readable storage medium.

10. The computer program product of claim 8, further comprising:

eighth program instructions to determine which logical addresses describe a same type of data according to a cutoff value for the Hamming distance based on historical experience, wherein the cutoff value is a maximum Hamming distance that describes a predetermined level of probability that two logical addresses describe a same type of data payload; and

ninth program instructions to fine tune the probability that the two logical addresses describe the same type of payload data a Bayesian probability formula, where A represents an event that two logical addresses both contain same significant bits that describe a same attribute of payload data stored at the two logical addresses, where B represents an event that the Hamming distance between two logical addresses is less than a predetermined number of bit differences, and wherein the Bayesian probability formula is;

11. A computer program product for sorting data into data gravity wells on a data gravity wells membrane, the computer program product comprising:

a non-transitory computer readable storage medium;

first program instructions to convert raw data into a first logical address and first payload data, wherein the first logical address describes metadata about the first payload data;

second program instructions to compare the first logical address to a second logical address to derive a Hamming distance between the first and second logical addresses, wherein the second logical address is for a second payload data, wherein the first and second payload data qualitatively describe an entity;

third program instructions to create a data vector for the second payload data, wherein the data vector comprises the Hamming distance between the first and second logical addresses;

fourth program instructions to sort data vectors into specific data gravity wells on a data gravity wells membrane according to the Hamming distance stored in the data vector, wherein the data gravity wells membrane is a mathematical framework that

     1) performs to provide a virtual environment in which multiple context-based data gravity wells exist;

     2) populates the multiple context-based data gravity wells with synthetic context-based objects; and

     3) performs to display the multiple context-based data gravity wells on a display;

fifth program instructions to apply a context object to a non-contextual data object, wherein the non-contextual data object is a component of the raw data, wherein the non-contextual data object ambiguously relates to multiple subject-matters, and wherein the context object provides a context that identifies a specific subject-matter, from the multiple subject-matters, of the non-contextual data object;

sixth program instructions to incorporate the context object and the non-contextual data object into the data vector for the second payload data; and

seventh program instructions to sort, by the hardware data vector sorter, the second payload data into specific data gravity wells on the data gravity wells membrane according to the context objects and the non-contextual data objects; and

wherein

the first, second, third, fourth, fifth, sixth, and seventh program instructions are stored on the non-transitory computer readable storage medium.