System and method for distributed privacy preserving data mining

• US 8,650,213 B2
• Filed: 05/23/2007
• Issued: 02/11/2014
• Est. Priority Date: 07/16/2004
• Status: Expired due to Fees

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Aggarwal, Charu C., Yu, Philip Shi-Lung
• Primary Examiner(s): Vital, Pierre
• Assistant Examiner(s): Raab, Christopher J
• Application Number:
  US11/752,708
• Publication Number:
  US 20100268734A1
• Time in Patent Office: 2,456 Days
• Field of Search: 705/51, 705/65, 707/776
• US Class Current: 707/776
• CPC Class Codes: G06F 16/2465 Query processing support for facilitating data mining operations in structured databases
• CPC Class Codes: G06F 21/6245 Protecting personal data, e.g. for financial or medical purposes
• CPC Class Codes: G06F 2216/03 Data mining
• CPC Class Codes: Y10S 707/99931 Database or file accessing
• CPC Class Codes: Y10S 707/99932 Access augmentation or optimizing

Abstract

Distributed privacy preserving data mining techniques are provided. A first entity of a plurality of entities in a distributed computing environment exchanges summary information with a second entity of the plurality of entities via a privacy-preserving data sharing protocol such that the privacy of the summary information is preserved, the summary information associated with an entity relating to data stored at the entity. The first entity may then mine data based on at least the summary information obtained from the second entity via the privacy-preserving data sharing protocol. The first entity may obtain, from the second entity via the privacy-preserving data sharing protocol, information relating to the number of transactions in which a particular itemset occurs and/or information relating to the number of transactions in which a particular rule is satisfied.

Claims

1. A method of data mining in a privacy-preserving manner in a distributed computing environment including a plurality of entities, comprising the steps of:

a first entity of the plurality of entities exchanging summary information with a second entity of the plurality of entities via a privacy-preserving data sharing protocol such that the privacy of the summary information is preserved, the summary information associated with an entity relating to data stored at the entity; and

the first entity mining data based on at least the summary information obtained from the second entity via the privacy-preserving data sharing protocol;

wherein the summary information exchanging step comprises;

the first and second entities each generating a random number;

in a first round, the first entity and the second entity adding their random numbers to a global count, in a given order, to generate an overall global count, wherein a current count value that an entity receives from a previous entity in the given order is the global count; and

in a second round, the first entity and second entity adding a first value and a second value, respectively, to the overall global count, in the given order, the first and second values representing private data of the first and second entities.

2. The method of claim 1, wherein the summary information exchanging step further comprises the first entity obtaining, from the second entity via the privacy-preserving data sharing protocol, information relating to the number of transactions in which a particular itemset occurs.

3. The method of claim 1, wherein the summary information exchanging step further comprises the first entity obtaining, from the second entity via the privacy-preserving data sharing protocol, information relating to the number of transactions in which a particular rule is satisfied.

4. The method of claim 1, wherein the summary information exchanging step further comprises the first entity subtracting the random number from the global count and transmitting the global count to the second entity.

5. The method of claim 1, wherein the summary information exchanging step further comprises the first entity exchanging summary information with two or more of the plurality of entities and the first entity mining data based on the summary information obtained from the two or more entities.

6. The method of claim 5, wherein the summary information exchanging step further comprises the first entity exchanging summary information with the two or more entities, wherein the summary information relates to a limited subset of items.

7. The method of claim 6, wherein the summary information exchanging step further comprises the first entity defining the limited subset of items for which summary information is to be exchanged.

8. The method of claim 7, wherein the summary information exchanging step further comprises the first entity determining participating entities for each itemset for which summary information is to be exchanged.

9. The method of claim 8, wherein the summary information exchanging step further comprises the first entity transmitting summary information only to a participating entity for a particular itemset.

10. The method of claim 1, further comprising the step of the first entity discarding itemsets having a number of potential participants below a particular threshold value.

11. The method of claim 1, further comprising the step of the first entity generating one or more association rules from one or more itemsets.

12. Apparatus associated with a first entity in a distributed computing environment, including a plurality of entities, for data mining in a privacy-preserving manner, comprising:

a memory; and

at least one processor coupled to the memory and operative to;

(i) exchange summary information with a second entity of the plurality of entities via a privacy-preserving data sharing protocol such that the privacy of the summary information is preserved, the summary information associated with an entity relating to data stored at the entity; and

(ii) mine data based on at least the summary information obtained from the second entity via the privacy-preserving data sharing protocol;

wherein the summary information exchanging operation comprises;

generating a random number by the first entity;

in a first round, the first entity adding its random number to a global count and transmitting the global count to the second entity, and the second entity adding a second random number to the global count, wherein the first and second entities add their random numbers to the global count, in a given order, to generate an overall global count, wherein a current count value that an entity receives from a previous entity in the given order is the global count; and

in a second round, the first entity and second entity adding a first value and a second value, respectively, to the overall global count, in the given order, the first and second values representing private data of the first and second entities.

13. The apparatus of claim 12, wherein the summary information exchanging operation further comprises obtaining, from the second entity via the privacy-preserving data sharing protocol, information relating to the number of transactions in which a particular itemset occurs.

14. The apparatus of claim 12, wherein the summary information exchanging operation further comprises obtaining, from the second entity via the privacy-preserving data sharing protocol, information relating to the number of transactions in which a particular rule is satisfied.

15. The apparatus of claim 12, wherein the summary information exchanging operation further comprises subtracting the random number from the global count and transmitting the global count to the second entity.

16. The apparatus of claim 12, wherein the summary information exchanging operation further comprises exchanging summary information with two or more of the plurality of entities and mining data based on the summary information obtained from the two or more entities.

17. An article of manufacture for use with a first entity in a distributed computing environment, including a plurality of entities, the article of manufacture comprising one or more programs which when executed by a computer, implement a method for data mining in a privacy-preserving manner comprising the steps of:

the first entity exchanging summary information with a second entity of the plurality of entities via a privacy-preserving data sharing protocol such that the privacy of the summary information is preserved, the summary information associated with an entity relating to data stored at the entity; and

the first entity mining data based on at least the summary information obtained from the second entity via the privacy-preserving data sharing protocol;

wherein the summary information exchanging step comprises;

the first and second entities each generating a random number;

in a first round, the first entity and the second entity adding their random numbers to a global count, in a given order, to generate an overall global count, wherein a current count value that an entity receives from a previous entity in the given order is the global count; and

in a second round, the first entity and second entity adding a first value and a second value, respectively, to the overall global count, in the given order, the first and second values representing private data of the first and second entities.