×

SYSTEM AND METHOD FOR LEARNING WORD EMBEDDINGS USING NEURAL LANGUAGE MODELS

  • US 20150095017A1
  • Filed: 11/08/2013
  • Published: 04/02/2015
  • Est. Priority Date: 09/27/2013
  • Status: Abandoned Application
First Claim
Patent Images

1. A method of learning natural language word associations using a neural network architecture, comprising processor implemented steps of:

  • storing data defining a word dictionary comprising words identified from training data consisting a plurality of sequences of associated words;

    selecting a predefined number of data samples from the training data, the selected data samples defining positive examples of word associations;

    generating a predefined number of negative samples for each selected data sample, the negative samples defining negative examples of word associations, wherein the number of negative samples generated for each data sample is a statistically small proportion of the number of words in the word dictionary; and

    training a neural language model using said data samples and said generated negative samples.

View all claims
  • 6 Assignments
Timeline View
Assignment View
    ×
    ×