Method and system for detecting undesired inferences from documents

• US 20080243825A1
• Filed: 03/28/2007
• Published: 10/02/2008
• Est. Priority Date: 03/28/2007
• Status: Active Grant

• Current Assignee: Xerox Corporation (Xerox Holdings Corp.)
• Original Assignee: Palo Alto Research Center, Inc. (Xerox Holdings Corp.)
• Inventors: Staddon, Jessica N., Golle, Philippe J.P., Zimny, Bryce D.
• Granted Patent: US 7,720,783 B2
• Time in Patent Office: Days
• US Class Current: 707/5
• CPC Class Codes: G06F 16/332 Query formulation
• CPC Class Codes: G06F 21/6245 Protecting personal data, e.g. for financial or medical purposes
• CPC Class Codes: G16H 10/60 for patient-specific data, e.g. for electronic patient records
• CPC Class Codes: G16Z 99/00 Subject matter not provided for in other main groups of this subclass

Abstract

One embodiment of the present invention provides a system that detects inferences from documents. During operation, the system receives one or more documents and extracts a first set of knowledge relevant to the documents. The system further formulates one or more queries to one or more reference corpora based on the first set of knowledge. The system then extracts a second set of knowledge from results received in response to the queries. Additionally, the system produces a mapping relationship between at least one document and a piece of the second set of knowledge which is not within the first set of knowledge, the mapping relationship indicating an inference from the documents.

Claims

1. A method for detecting inferences from documents, the method comprising:

receiving one or more documents;

extracting a first set of knowledge relevant to the documents;

formulating one or more queries to one or more reference corpora based on the first set of knowledge;

extracting a second set of knowledge from results received in response to the queries; and

producing a mapping relationship between at least one document and a piece of the second set of knowledge which is not within the first set of knowledge, the mapping relationship indicating an inference from the documents.

2. The method of claim 1, wherein extracting the first set of knowledge relevant to the document comprises deriving a set of words or phrases relevant to each document.

3. The method of claim 2, wherein deriving the set of words or phrases further comprises determining a term-frequency inverse-document-frequency (TF.IDF) weight for a word or phrase contained in the document.

4. The method of claim 1, wherein extracting the first set of knowledge comprises extracting a set of words or phrases from each document;

and

wherein formulating the queries comprises constructing single-word queries, multi-word queries, or both from the extracted words or phrases.

5. The method of claim 4, wherein constructing the queries further comprises applying one or more pre-determined logical formulas to the extracted words or phrases.

6. The method of claim 4, wherein extracting a set of words or phrases from each document comprises extracting a pre-determined number of words or phrases from the document.

7. The method of claim 1, further comprising retrieving a pre-determined number of results for each query.

8. The method of claim 1, further comprising receiving a set of sensitive knowledge relevant to the documents;

wherein the piece of the second set of knowledge mapped to the document is also within the set of sensitive knowledge; and

wherein producing the mapping relationship comprises determining an intersection between the set of sensitive knowledge and the second set of knowledge.

9. The method of claim 1, wherein producing the mapping relationship comprises presenting one or more words or phrases from the documents, which words or phrases correspond to the first set of knowledge, and one or more sensitive words or phrases extracted from the query results.

10. The method of claim 1, further comprising:

determining a ratio of;

the number of results returned by a first query based on one or more words or phrases from the documents and one or

more sensitive words or phrases, to

the number of results returned by a second query based on one or more words or phrases from the documents; and

determining an inference from the one or more words or phrases used to generate the first query based on the size of the ratio.

11. The method of claim 10, further comprising receiving the one or more sensitive words or phrases.

12. The method of claim 1, further comprising:

selecting the one or more reference corpora based on the documents, an intended audience, or both.

13. The method of claim 1, wherein the inference is an undesired inference which can be extracted from a union of the document and the corpus and which cannot be extracted from the document or the corpus alone.

14. A computer system for detecting inferences from documents, the computer system comprising:

a processor;

a memory;

a receiving mechanism configured to receive one or more documents;

a first knowledge extraction mechanism configured to extract a first set of knowledge relevant to the documents;

a query formulation mechanism configured to formulate one or more queries to one or more reference corpora based on the first set of knowledge;

a second knowledge extraction mechanism configured to extract a second set of knowledge from results received in response to the queries; and

a mapping mechanism configured to produce a mapping relationship between at least one document and a piece of the second set of knowledge which is not within the first set of knowledge, the mapping relationship indicating an inference from the documents.

15. The computer system of claim 14, wherein while extracting the first set of knowledge relevant to the document, the first knowledge extraction mechanism is configured to derive a set of words or phrases relevant to each document.

16. The computer system of claim 15, wherein while deriving the set of words or phrases, the first knowledge extraction mechanism is further configured to determine a term-frequency inverse-document-frequency (TF.IDF) weight for a word or phrase contained in the document.

17. The computer system of claim 14, wherein while extracting the first set of knowledge, the first knowledge extraction mechanism is configured to extract a set of words or phrases from each document;

and

wherein while formulating the queries, the query formulation mechanism is configured to construct single-word queries, multi-word queries, or both from the extracted words or phrases.

18. The computer system of claim 17, wherein while constructing the queries, the query formulation mechanism is further configured to apply one or more pre-determined logical formulas to the extracted words or phrases.

19. The computer system of claim 17, wherein while extracting a set of words or phrases from each document, the first knowledge extraction mechanism is configured to extract a pre-determined number of words or phrases from the document.

20. The computer system of claim 14, further comprising a retrieval mechanism configured to retrieve a pre-determined number of results for each query.

21. The computer system of claim 14,

wherein the receiving mechanism is further configured to receive a set of sensitive knowledge relevant to the documents;

wherein the piece of the second set of knowledge mapped to the document is also within the set of sensitive knowledge; and

wherein while producing the mapping relationship, the mapping mechanism is configured to determine an intersection between the set of sensitive knowledge and the second set of knowledge.

22. The computer system of claim 14, wherein while producing the mapping relationship, the mapping mechanism is configured to present one or more words or phrases from the documents, which words or phrases correspond to the first set of knowledge, and one or more sensitive words or phrases extracted from the query results.

23. The computer system of claim 14, further comprising:

a ranking mechanism configured to determine a ratio of;

the number of results returned by a first query based on one or more words or phrases from the documents and one or more sensitive words or phrases, to

the number of results returned by a second query based on

one or more words or phrases from the documents; and

a decision mechanism configured to determine an inference from the one or more words or phrases used to generate the first query based on the size of the ratio.

24. The computer system of claim 23, wherein the receiving mechanism is further configured to receive the one or more sensitive words or phrases.

25. The computer system of claim 14, further comprising:

a reference selection mechanism configured to select the one or more reference corpora based on the documents, an intended audience, or both.

26. The computer system of claim 14, wherein the inference is an undesired inference which can be extracted from a union of the document and the corpus and which cannot be extracted from the document or the corpus alone.

27. A computer-readable storage medium storing instructions that when executed by a computer cause the computer to perform a method for detecting inferences from documents, the method comprising:

receiving one or more documents;

extracting a first set of knowledge relevant to the documents;

formulating one or more queries to one or more reference corpora based on the first set of knowledge;

extracting a second set of knowledge from results received in response to the queries; and

producing a mapping relationship between at least one document and a piece of the second set of knowledge which is not within the first set of knowledge, the mapping relationship indicating an inference from the documents.