System and method for social inference based on distributed social sensor system

• US 8,620,916 B2
• Filed: 03/09/2012
• Issued: 12/31/2013
• Est. Priority Date: 05/09/2008
• Status: Expired due to Fees

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Lin, Ching-Yung, Rekesh, Dmitry A.
• Primary Examiner(s): HO, BINH VAN
• Application Number:
  US13/416,320
• Publication Number:
  US 20120173720A1
• Time in Patent Office: 662 Days
• Field of Search: 707/736
• US Class Current: 707/736
• CPC Class Codes: G06Q 99/00 Subject matter not provided for in other groups of this subclass

Abstract

A method (and system) for data acquisition includes downloading a user'"'"'s sent materials from a communication data repository, analyzing the sent materials and extracting data portions that are authored by the user, generating statistical values from the extracted data, transmitting the generated statistical values to one or multiple repositories, receiving the generated statistical values on one or multiple server machines, and aggregating statistical values of multiple users.

Claims

1. A method of data acquisition, said method comprising:

downloading a user'"'"'s sent materials from a communication data repository;

analyzing the sent materials and extracting data portions that are authored by the user;

generating statistical values from the extracted data;

transmitting the generated statistical values to one or multiple repositories;

receiving the generated statistical values on one or multiple server machines; and

aggregating statistical values of multiple users,

wherein said aggregating statistical values of multiple users comprises inferring personal expertise of each user who transmits the generated statistical values from the user'"'"'s extracted data.

2. The method according claim 1, wherein said downloading a user'"'"'s sent materials uses a scheduler to periodically download data from one or multiple remote servers.

3. The method according claim 1, wherein said downloading a user'"'"'s sent materials uses a user interface to allow the user to manually initiate downloading data from one or multiple remote servers.

4. The method according claim 1, wherein said generating statistical values uses text analysis to extract statistics of words or concatenation of words written by the user in the sent materials.

5. The method according claim 1, wherein the words comprise a stem of words derived from the words written by the user.

6. The method according to claim 1, wherein said aggregating statistical values of multiple users comprises:

inferring a personal social network of each user who transmits the generated statistical values from the user'"'"'s extracted data; and

combining multiple users'"'"' personal social networks to form one or plural combined social networks that include multiple users.

7. The method according to claim 1, wherein said aggregating statistical values of multiple users:

further comprises combining multiple users'"'"' personal expertise inference to form one or plural repositories of combined expertise inferences that include multiple users.

8. The method according to claim 7, wherein said inferring personal expertise represents a list of words or a list of phrases, associated with weights, to indicate how familiar a user is with the words or phrases.

9. The method according to claim 1, further comprising reading a list of privacy rules to allow users to exclude certain messages, paragraphs, sentences, or words from being extracted,

wherein said reading a list of privacy rules comprises using a user interface to allow a user to manually edit a personal preference list specifying the types of messages to be excluded, the types of paragraphs to be excluded, the types of sentences to be excluded or a set of words to be excluded.

10. The method according to claim 1, wherein said aggregating statistical values of multiple users comprises aggregating statistical values of multiple users to construct one or plural aggregated social networks, expertise inference, or social networks and expertise inference of multiple people including only users or both users and non-users, which comprises:

inferring the personal social network of each user who transmits the generated statistical values from the user'"'"'s explicitly extracted data;

providing a user interface to allow a user to modify the inferred personal social network; and

combining multiple users'"'"' inferred personal social networks to form at least one combined social network that includes multiple users.

11. The method according to claim 1, wherein said aggregating statistical values of multiple users comprises aggregating statistical values of multiple users to construct one or plural aggregated social networks, expertise inference, or social networks and expertise inference of multiple people including only users or both users and non-users, which comprises:

inferring the personal social network of each user who transmits the generated statistical values from the user'"'"'s explicitly extracted data;

combining multiple users'"'"' transmitted data;

inferring non-users'"'"' personal social networks based on combined transmitted data;

providing a user interface to allow a user or a non-user to modify the inferred personal social network; and

forming at least one combined social network that includes multiple users and multiple non-users with or without modification.

12. The method according to claim 9, wherein said reading a list of privacy rules comprises using data mining or data classification methods to classify messages or sentences into one of plural categories to decide the types of message,

wherein a message, a sentence, or a paragraph can be belong to only one type or multiple types with confidence values.

14. The method according to claim 1, wherein said inferring personal expertise comprises applying a collaborative filtering/link analysis algorithm configured to make unbiased, intelligent inferences among a large number of people based on only data contributed by a small number of people.

13. A distributed social sensor system implemented method for social network inference or expertise location, as executed by a processor, comprising:

installing a software program residing on an individual user'"'"'s machine for downloading the user'"'"'s own sent materials from a communication data repository;

analyzing the downloaded materials and extracting the data portions that are explicitly authored by the user;

generating statistical values, as executed by the processor, from the explicitly extracted data;

transmitting the generated statistical values to one or multiple social sensor server repositories;

installing a software program residing on one or multiple social sensor server repository machines to receive the statistical values of multiple users; and

aggregating the statistical values of multiple users to construct one or plural aggregated social networks, expertise inference, or social networks and expertise inference of multiple people including only users or both users and non-users,

wherein said aggregating statistical values of multiple users comprises inferring personal expertise of each user who transmits the generated statistical values from the user'"'"'s extracted data.