SKILL EXTRACTION SYSTEM

• US 20140081928A1
• Filed: 11/06/2013
• Published: 03/20/2014
• Est. Priority Date: 01/27/2011
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: LinkedIn Corporation (Microsoft Corporation)
• Inventors: Skomoroch, Peter N., Hayes, Matthew T., Patil, Dhanurjay A.S., Gupta, Abhishek
• Granted Patent: US 10,354,017 B2
• Time in Patent Office: Days
• US Class Current: 707/692
• CPC Class Codes: G06F 16/285 Clustering or classification
• CPC Class Codes: G06F 16/335 Filtering based on additional data, e.g. user or group profiles filtering in web context G06F16/9535, G06F16/9536
• CPC Class Codes: G06F 16/35 Clustering; Classification
• CPC Class Codes: G06F 16/355 Class or cluster creation or modification
• CPC Class Codes: G06F 16/9535 Search customisation based on user profiles and personalisation
• CPC Class Codes: G06Q 10/06398 Performance of employee with respect to a job function
• CPC Class Codes: G06Q 30/02 Marketing; Price estimation or determination; Fundraising
• CPC Class Codes: G06Q 30/0269 based on user profile or attribute
• CPC Class Codes: G06Q 50/01 Social networking

Abstract

In an example, disclosed is a machine automated method of identifying a set of skills. In some examples, the method includes extracting a plurality of skill seed phrases from a plurality of member profiles of a social networking site, creating a plurality of disambiguated skill seed phrases by disambiguating the plurality of skill seed phrases using one or more computer processors, and de-duplicating the plurality of disambiguated skill seed phrases to create a plurality of de-duplicated skill seed phrases.

Claims

1-27. -27. (canceled)

28. A computer-implemented method comprising:

causing one or more computer processors to execute instructions, the instructions causing the one or more computer processors to perform the operations of;

extracting a plurality of skill seed phrases from a skills section of a plurality of member profiles of a social networking service;

disambiguating the plurality of skill seed phrases to create a plurality of disambiguated skill seed phrases;

de-duplicating the plurality of disambiguated skill seed phrases to create a plurality of de-duplicated skill seed phrases, the de-duplicated skill seed phrases identifying a plurality of skills; and

wherein disambiguating the plurality of skill seed phrases comprises;

clustering the plurality of skill seed phrases based on a number of co-occurrences of respective pairs of the plurality of skill seed phrases in respective member profiles of the plurality of member profiles.

29. The method of claim 28, wherein extracting the plurality of skill seed phrases comprises:

tokenizing the skills section of the plurality of member profiles into a plurality of tokens; and

analyzing frequency information of the tokens to determine the plurality of skill seed phrases.

30. The method of claim 29, wherein extracting the plurality of skill seed phrases further comprises:

removing skill seed phrases that do not correspond with actual skills

31. The method of claim 28 wherein the one or more computer processors comprise a computing cluster and the method is performed using a parallel and distributed process.

32. The method of claim 31, wherein the clustering is done using an expectation maximum method.

33. The method of claim 28, further comprising:

calculating attributes about the plurality of disambiguated skill seed phrases and storing the attributes in association with the plurality of disambiguated skill seed phrases.

34. The method of claim 33, wherein gathering attributes about the plurality of disambiguated skill phrases comprises computing a top industry of each of the plurality of disambiguated skill phrases based upon an industry listed in member profiles in which each skill seed phrase was found.

35. The method of claim 28, wherein de-duplicating the plurality of disambiguated skill seed phrases comprises:

calculating a plurality of internet search queries, at least one for each of the plurality of disambiguated skill seed phrases, the internet search queries, when executed, returning a list of internet web pages;

for each of the plurality of internet search queries, submitting to a crowd sourcing application, over a network, a job for which the crowd sourcing application returns a specific internet web page selected from the list of internet web pages that is returned from each of the plurality of the internet search queries, the specific internet web page representing an interpretation of a meaning of the disambiguated skill seed phrase corresponding to each internet search query; and

using the plurality of returned specific internet web pages to determine which of the plurality of disambiguated skill seed phrases identify identical skills

36. The method of claim 35, further comprising:

submitting more than one job for each of the plurality of internet search queries and using an algorithm to select among the returned specific internet web pages to determine which of the returned specific internet web pages for each internet search query is used to determine which of the plurality of disambiguated skill seed phrases identify the identical skills

37. A system comprising:

one or more computer processors configured to include;

an extraction module configured to extract a plurality of skill seed phrases from a skills section of a plurality of member profiles of a social networking service;

a disambiguation module configured to disambiguate the plurality of skill seed phrases to create a plurality of disambiguated skill seed phrases;

a de-duplication module configured to de-duplicate the plurality of disambiguated skill seed phrases to create a plurality of de-duplicated skill seed phrases, the de-duplicated skill seed phrases identifying a plurality of skills; and

wherein the disambiguation module is configured to de-duplicate the plurality of disambiguated skill seed phrases by being configured to at least;

cluster the plurality of skill seed phrases based on a number of co-occurrences of respective pairs of the plurality of skill seed phrases in respective member profiles of the plurality of member profiles.

38. The system of claim 37, wherein the extraction module is configured to extract the plurality of skill seed phrases by being configured to at least:

tokenize the skills section of the plurality of member profiles into a plurality of tokens; and

analyze frequency information of the tokens to determine the plurality of skill seed phrases.

39. The system of claim 38, wherein the extraction module is configured to extract the plurality of skill seed phrases by being configured to at least:

remove skill seed phrases that do not correspond with actual skills

40. The system of claim 37 wherein the one or more computer processors comprise a computing cluster and the modules are configured to perform their operations using a parallel and distributed process.

41. The system of claim 40, wherein the disambiguation module is configured to cluster using an expectation maximum method.

42. The system of claim 37, wherein the disambiguation module is configured to calculate attributes about the plurality of disambiguated skill seed phrases and store the attributes in association with the plurality of disambiguated skill seed phrases.

43. The system of claim 42, wherein the disambiguation module is configured to calculate attributes about the plurality of disambiguated skill phrases by at least being configured to compute a top industry of each of the plurality of disambiguated skill phrases based upon an industry listed in member profiles in which each skill seed phrase was found.

44. The method of claim 37, wherein the de-duplication module is configured to de-duplicate the plurality of disambiguated skill seed phrases by being configured to at least:

calculate a plurality of internet search queries, at least one for each of the plurality of disambiguated skill seed phrases, the internet search queries, when executed, returning a list of internet web pages;

for each of the plurality of internet search queries, submit to a crowd sourcing application, over a network, a job for which the crowd sourcing application returns a specific internet web page selected from the list of internet web pages that is returned from each of the plurality of the internet search queries, the specific internet web page representing an interpretation of a meaning of the disambiguated skill seed phrase corresponding to each internet search query; and

use the plurality of returned specific internet web pages to determine which of the plurality of disambiguated skill seed phrases identify identical skills

45. The system of claim 44, wherein the de-duplication module is configured to de-duplicate the plurality of disambiguated skill seed phrases by being configured to at least:

submit more than one job for each of the plurality of internet search queries and use an algorithm to select among the returned specific internet web pages to determine which of the returned specific internet web pages for each internet search query is used to determine which of the plurality of disambiguated skill seed phrases identify the identical skills

46. A machine readable medium that stores instructions which when performed by a machine, cause the machine to perform operations comprising:

extracting a plurality of skill seed phrases from a skills section of a plurality of member profiles of a social networking service;

disambiguating the plurality of skill seed phrases to create a plurality of disambiguated skill seed phrases;

de-duplicating the plurality of disambiguated skill seed phrases to create a plurality of de-duplicated skill seed phrases, the de-duplicated skill seed phrases identifying a plurality of skills; and

wherein de-duplicating the plurality of disambiguated skill seed phrases comprises;

clustering the plurality of skill seed phrases based on a number of co-occurrences of respective pairs of the plurality of skill seed phrases in respective member profiles of the plurality of member profiles.

47. The machine-readable medium of claim 46, wherein the instructions for extracting the plurality of skill seed phrases comprise instructions, which when performed by the machine, cause the machine to perform the operations comprising:

tokenizing the skills section of the plurality of member profiles into a plurality of tokens; and

analyzing frequency information of the tokens to determine the plurality of skill seed phrases.

48. The method of claim 47, wherein the instructions for extracting the plurality of skill seed phrases comprise instructions, which when performed by the machine, cause the machine to perform the operations comprising:

removing skill seed phrases that do not correspond with actual skills

49. The method of claim 46, wherein the instructions for clustering comprise instructions, which when performed by the machine, cause the machine to perform the operations comprising:

using an expectation maximum method.

50. The method of claim 46, wherein the instructions comprise instructions, which when performed by the machine, cause the machine to perform the operations of:

calculating attributes about the plurality of disambiguated skill seed phrases and storing the attributes in association with the plurality of disambiguated skill seed phrases.

51. The method of claim 50, wherein the instructions for gathering attributes about the plurality of disambiguated skill phrases comprises instructions, which when performed by the machine, cause the machine to perform the operations of:

computing a top industry of each of the plurality of disambiguated skill phrases based upon an industry listed in member profiles in which each skill seed phrase was found.

52. The method of claim 46, wherein the instructions for de-duplicating the plurality of disambiguated skill seed phrases comprises instructions, which when performed by the machine, cause the machine to perform the operations of:

calculating a plurality of internet search queries, at least one for each of the plurality of disambiguated skill seed phrases, the internet search queries, when executed, returning a list of internet web pages;

for each of the plurality of internet search queries, submitting to a crowd sourcing application, over a network, a job for which the crowd sourcing application returns a specific internet web page selected from the list of internet web pages that is returned from each of the plurality of the internet search queries, the specific internet web page representing an interpretation of a meaning of the disambiguated skill seed phrase corresponding to each internet search query; and

using the plurality of returned specific internet web pages to determine which of the plurality of disambiguated skill seed phrases identify identical skills

53. The method of claim 52, wherein the instructions include instructions, which when performed by the machine, cause the machine to perform operations comprising:

submitting more than one job for each of the plurality of internet search queries and using an algorithm to select among the returned specific internet web pages to determine which of the returned specific internet web pages for each internet search query is used to determine which of the plurality of disambiguated skill seed phrases identify the identical skills.