METHOD AND SYSTEM FOR DATA EXCHANGE AMONG DATA SOURCES

• US 20080244008A1
• Filed: 03/28/2008
• Published: 10/02/2008
• Est. Priority Date: 03/29/2007
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: Initiate Systems, Inc. (International Business Machines Corporation)
• Inventors: Schumacher, Scott, Wilkinson, David, Moseley, Martin E.
• Granted Patent: US 8,429,220 B2
• Time in Patent Office: Days
• US Class Current: 709/205
• CPC Class Codes: G06F 16/2471 Distributed queries
• CPC Class Codes: H04L 67/02 based on web technology, e.g. hypertext transfer protocol [HTTP]
• CPC Class Codes: H04L 67/104 Peer-to-peer [P2P] networks
• CPC Class Codes: H04L 67/1065 Discovery involving distributed pre-established resource-based relationships among peers, e.g. based on distributed hash tables [DHT] pre-configuration of logical or physical connections H04L67/1053
• CPC Class Codes: H04L 67/56 Provisioning of proxy services store-and-forward switching systems in data switching networks H04L12/54
• CPC Class Codes: H04L 67/567 Integrating service provisioning from a plurality of service providers

Abstract

Systems and methods for joining results in loosely collaborative data exchanges which include a plurality of nodes in communication with each other wherein a node is constrained from sharing payload data regarding a first subject, is allowed to share matching data regarding the first subject, and is further constrained to be separate from the other nodes. In some embodiments, a method includes receiving a set of virtual results from the constrained node including the matching data and excluding the payload data. The method also includes receiving results from the other nodes and determining whether any of the results correspond to the same subject. The method also includes, when any of the results correspond to the same subject, joining the corresponding portions in a hub separate from the constrained node. The joined results can be output.

Claims

1. A method comprising:

in a data exchange including a plurality of nodes in communication with each other wherein;

a node constrains itself from sharing payload data regarding a first subject, allows itself to share matching data regarding the first subject, and further constrains itself to be separate from the other nodes;

receiving a set of virtual results from the constrained node including at least some of the matching data and excluding the payload data;

receiving a set of virtual results from one of the other nodes;

determining whether any portions of the results correspond to a same subject;

when any portion of the results correspond to the same subject, joining the corresponding portions in a hub; and

outputting the joined portions of the results.

2. The method of claim 1 further comprising querying the plurality of nodes including the constrained node using a common query wherein the results are sent in response to the common query.

3. The method of claim 1 further comprising satisfying a user selected confidence level associated with the results.

4. The method of claim 3 further comprising:

adjusting the confidence level; and

in real-time, querying the plurality of nodes including the constrained node using a common query wherein the sets of results are a first sets of results, the set of virtual results from the constrained source is a first set of virtual results, and the same subject is a first same subject;

in real-time, receiving a second sets of results including a second set of results from the constrained node;

determining whether any portions of the second results correspond to a second same subject;

when any portions of the second results correspond to the second same subject, joining the corresponding portions of the second results.

5. The method of claim 1 further comprising guaranteeing a false positive rate associated with the results.

6. The method of claim 5 further comprising guaranteeing a false negative rate associated with the results.

7. The method of claim 1 further comprising notifying the plurality of nodes of a discrepancy associated with the joined portions.

8. The method of claim 7 further comprising adjusting the joined portions to account for the discrepancy.

9. The method of claim 8 further comprising allowing the nodes to request the adjusted joined portions.

10. The method of claim 8 further comprising sending the adjusted joined portions to the plurality of nodes.

11. The method of claim 1 wherein the joining is a probabilistic joining.

12. The method of claim 1 further comprising normalizing the results before the determining whether any portions of the results correspond to a same subject.

13. A computer readable medium comprising instructions executable by a machine which when executed cause the machine to:

in a data exchange including a plurality of nodes in communication with each other wherein;

a node constrains itself from sharing payload data regarding a first subject, allows itself to share matching data regarding the first subject, and further constrains itself to be separate from the other nodes;

receive a set of virtual results from the constrained node including at least some of the matching data and excluding the payload data;

receive a set of virtual results from one of the other nodes;

determine whether any portions of the results correspond to a same subject;

when any portion of the results correspond to the same subject, join the corresponding portions in a hub; and

output the joined portions of the results.

14. The computer readable medium of claim 13 wherein the instructions are further executable to cause the machine to satisfy a user selected confidence level associated with the results.

15. The computer readable medium of claim 13 wherein the instructions are further executable to cause the machine to:

adjust the confidence level; and

in real-time, query the plurality of nodes including the constrained node using a common query wherein the sets of results are a first sets of results, the set of virtual results from the constrained source is a first set of virtual results, and the same subject is a first same subject;

in real-time, receive a second sets of results including a second set of results from the constrained node;

determine whether any portions of the second results correspond to a second same subject;

when any portions of the second results correspond to the second same subject, join the corresponding portions of the second results.

16. The computer readable medium of claim 13 wherein the joining is a probabilistic joining.

17. The computer readable medium of claim 13 wherein the instructions are further executable to cause the machine to normalize the results before the determining whether any portions of the results correspond to a same subject.

18. The computer readable medium of claim 13 wherein the instructions are further executable to cause the machine to guarantee a false positive rate and to guarantee a false negative rate associated with the results.

19. The computer readable medium of claim 13 wherein the joining is a probabilistic joining.

20. A system comprising:

a data exchange including a plurality of nodes in communication with each other wherein;

a node constrains itself from sharing payload data regarding a first subject, allows itself to share matching data regarding the first subject, and further constrains itself to be separate from the other nodes;

a hub in communication with the nodes and including;

a processor;

a display; and

a computer readable medium comprising instructions executable by a machine which when executed cause the machine to;

receive a set of virtual results from the constrained node including at least some of the matching data and excluding the payload data;

receive a set of virtual results from one of the other nodes;

determine whether any portions of the results correspond to a same subject;

when any portion of the results correspond to the same subject, join the corresponding portions; and

output the joined portions of the results an the display, the processor being in communication with the computer readable medium and the display.