System and method for sentiment-based text classification and relevancy ranking

• US 20100262454A1
• Filed: 04/09/2009
• Published: 10/14/2010
• Est. Priority Date: 04/09/2009
• Status: Active Grant

• Current Assignee: MarketChorus, Inc.
• Original Assignee: Squawkspot, Inc.
• Inventors: Goldstein, Lawrence N., Sommer, Matthew S.
• Granted Patent: US 8,166,032 B2
• Time in Patent Office: Days
• US Class Current: 705/10
• CPC Class Codes: G06F 16/355 Class or cluster creation or modification
• CPC Class Codes: G06Q 30/02 Marketing; Price estimation or determination; Fundraising

Abstract

The sentimental significance of a group of historical documents related to a topic is assessed with respect to change in an extrinsic metric for the topic. A unique sentiment binding label is included to the content of actions documents that are determined to have sentimental significance and the group of documents is inserted into a historical document sentiment vector space for the topic. Action areas in the vector space are defined from the locations of action documents and singular sentiment vector may be created that describes the cumulative action area. Newly published documents are sentiment-scored by semantically comparing them to documents in the space and/or to the singular sentiment vector. The sentiment scores for the newly published documents are supplemented by human sentiment assessment of the documents and a sentiment time decay factor is applied to the supplemented sentiment score of each newly published documents. User queries are received and a set of sentiment-ranked documents is returned with the highest age-adjusted sentiment scores.

Claims

1. A computer implemented method of assessing human sentiment from a group of documents, each document in the group of documents having a plurality of terms and being digitally represented in a computer, said method comprising:

receiving a group of documents, each document in the group of documents comprising a context of a plurality of terms and all documents in the group of documents representative of a particular topic;

constructing a document sentiment vector space from the group of documents, wherein construction of the document sentiment vector space comprises;

assessing sentimentality of each document in the group of documents toward the topic;

identifying sentimentally significant documents in the group of documents with heightened sentimentality toward the particular topic; and

labeling sentimentally significant documents by including a unique sentiment binding term in the context of the plurality of terms;

representing each document in the group of documents in the document sentiment vector space;

defining a region of sentimental significance in the document sentiment vector space based on an occurrence of document representations for sentimentally significant documents with the unique sentiment binding term;

receiving a query string; and

assessing sentimentality of the query string by comparing a representation of the query string for semantic similarity to the region of sentimental significance in the document sentiment vector space.

2. The method of claim 1, wherein assessing sentimentality of each document in the group of documents toward the particular topic further comprises:

receiving a sentiment term meaning model for defining sentimental meanings of terms;

sentiment scoring the sentiment of each document in the group of documents based on the sentiment term meaning model and the plurality of terms in the respective document in the group of documents;

wherein identifying sentimentally significant documents in the group of documents with heightened sentimentality toward the particular topic further comprises;

receiving an action sentiment score indicative of sentimental significance; and

comparing the sentiment score of each document in the group of documents to the action sentiment score.

3. The method of claim 1, wherein assessing sentimentality of each document in the group of documents toward the particular topic further comprises:

deriving a publication date for each document in the group of documents;

electing an extrinsic metric for the particular topic for assessing sentimentality toward the topic, said extrinsic metric being related to an affirmative and intentional human action with a value of the extrinsic metric being indicative of said human action;

receiving extrinsic metric historical data for each document in the group of documents proximate to a respective publication date for each document;

examining the extrinsic metric historical data for each document proximate to the respective publication date over a timeframe of influence for changes in the value of the extrinsic metric, wherein the timeframe of influence is a predetermined time period in which a context of a document influences humans to undertake an affirmative and intentional human action resulting in a change in the value of the extrinsic metric;

wherein identifying sentimentally significant documents in the group of documents with heightened sentimentality toward the particular topic further comprises;

receiving a sentiment value for a change in the extrinsic metric historical data, the sentiment value being indicative of sentimental significance; and

comparing the sentiment value to changes in the value of the extrinsic metric over the timeframe of influence for each document in the group.

4. The method of claim 3, wherein the particular topic is one of a person, occupation, athlete, entertainer, politician, humanitarian, political party, product, film, equity, cause, finance, complaint, patent, sport'"'"'s team and country.

5. The method of claim 3, wherein the particular topic is an equity and the extrinsic metric is one of the selling price, change in selling price, ratio of the change in selling price to an average price, sales volume, change in sales volume and ratio of the change in sales volume to an average volume.

6. The method of claim 3, wherein constructing a document sentiment vector space from the group of document further comprises:

creating a term-by-document matrix of all terms occurring in the group of documents; and

decomposing the term-by-document matrix into a term-by-concepts matrix and a documents-by-concepts matrix.

7. The method of claim 6, wherein defining a region of sentimental significance in the document sentiment vector space further comprises:

creating a singular sentiment vector from a product of document vectors from the documents-by-concepts matrix representing sentimentally significant documents.

8. The method of claim 6, wherein defining a region of sentimental significance in the document sentiment vector space further comprises:

creating a binding term vector from term vector in the term-by-concepts matrix representing the binding term.

9. The method of claim 6, wherein defining a region of sentimental significance in the document sentiment vector space further comprises:

creating an action document vector for each document vector from the documents-by-concepts matrix representing a sentimentally significant document.

10. The method of claim 9, wherein assessing sentimentality of the query string by comparing a representation of the query string for semantic similarity to the region of sentimental significance in the document sentiment vector space further comprises:

selecting an action document vector most semantically similar to the query string for assessing sentimentality of the query string.

11. The method of claim 3, wherein the query string is a term and assessing sentimentality of a query string by comparing a representation of the query string for semantic similarity to the region of sentimental significance in the document sentiment vector space further comprises:

selecting a query term vector from the term-by-concepts matrix for the query string as the representation of the query string; and

comparing the query term vector for semantic similarity to the region of sentimental significance in the document sentiment vector space.

12. The method of claim 3, wherein the query string is a plurality of terms and assessing sentimentality of a query string by comparing a representation of the query string for semantic similarity to the region of sentimental significance in the document sentiment vector space further comprises:

creating a query term vector as the representation of the query string for the query string from a vector sum of query term vectors from the term-by-concepts matrix, for each of the plurality of terms occurring in the query string; and

comparing the query term vector for semantic similarity to the region of sentimental significance in the document sentiment vector space.

13. The method of claim 3, wherein the query string is a document having a document publication date and comprises of a plurality of document terms and assessing sentimentality of a query string by comparing a representation of the query string for semantic similarity to the region of sentimental significance in the document sentiment vector space further comprises:

creating a query term vector as the representation of the query string for the query string from a vector sum of query term vectors from the term-by-concepts matrix, for each of the plurality of terms co-occurring in the query string and the term-by-concepts matrix; and

comparing the query term vector for semantic similarity to the region of sentimental significance in the document sentiment vector space.

14. The method of claim 13, further comprises:

quantizing a sentiment score for the sentimental significance of the query string to the particular topic based on the semantic similarity of the representation of the query string to the region of sentimental significance in the document sentiment vector space, wherein said sentiment score being indicative of the sentimental significance of the contemporaneous publication toward the particular topic.

15. The method of claim 14, wherein the document is a contemporaneous publication representative of the particular topic, said contemporaneous publication having a contemporaneous publication date and comprising a context of a plurality of publication terms, wherein said sentiment score being indicative of the sentimental significance of the contemporaneous publication toward the particular topic.

16. The method of claim 15, further comprises:

receiving a second query string comprising a second contemporaneous publication representative of the particular topic, said second contemporaneous publication having a second contemporaneous publication date and comprising a second context of a second plurality of publication terms;

assessing sentimentality of the second contemporaneous publication by comparing a representation of the second query string for semantic similarity to the region of sentimental significance in the document sentiment vector space; and

quantizing a second sentiment score for the sentimental significance of the second query string to the particular topic based on the semantic similarity of the representation of the second query string to the region of sentimental significance in the document sentiment vector space, wherein said second sentiment score being indicative of the sentimental significance of the second contemporaneous publication toward the particular topic.

17. The method of claim 16, further comprises:

sentiment ranking the contemporaneous publication and second contemporaneous publication based on their respective sentiment score and second sentiment score.

18. The method of claim 17, wherein defining a region of sentimental significance in the document sentiment vector space further comprises:

creating a singular sentiment vector from a product of document vectors from the documents-by-concepts matrix representing sentimentally significant documents.

19. The method of claim 17, wherein defining a region of sentimental significance in the document sentiment vector space further comprises:

creating a binding term vector from term vector in the term-by-concepts matrix representing the binding term.

20. The method of claim 17, wherein defining a region of sentimental significance in the document sentiment vector space further comprises:

creating an action document vector for each document vector from the documents-by-concepts matrix representing a sentimentally significant document.

21. The method of claim 20, wherein assessing sentimentality of the query string by comparing a representation of the query string for semantic similarity to the region of sentimental significance in the document sentiment vector space further comprises:

selecting an action document vector most semantically similar to the query string for assessing sentimentality of the query string.

22. The method of claim 14, further comprises:

receiving a sentiment time decay factor for publications, wherein the sentiment time decay factor reflects a limited timeframe of influence of publications on the extrinsic metric relative to a publication date;

finding an age sentiment score for the contemporaneous publication by applying the sentiment time decay factor to the sentiment score for age relative to the contemporaneous publication date;

finding a second age sentiment score for the second contemporaneous publication by applying the sentiment time decay factor to the second sentiment score for age relative to the second contemporaneous publication date; and

sentiment ranking the contemporaneous publication and second contemporaneous publication based on their respective age sentiment score and second age sentiment score.

23. The method of claim 22, wherein defining a region of sentimental significance in the document sentiment vector space further comprises:

creating a singular sentiment vector from a product of document vectors from the documents-by-concepts matrix representing sentimentally significant documents.

24. The method of claim 22, wherein defining a region of sentimental significance in the document sentiment vector space further comprises:

creating a binding term vector from term vector in the term-by-concepts matrix representing the binding term.

25. The method of claim 22, wherein defining a region of sentimental significance in the document sentiment vector space further comprises:

creating an action document vector for each document vector from the documents-by-concepts matrix representing a sentimentally significant document.

26. The method of claim 25, wherein assessing sentimentality of the query string by comparing a representation of the query string for semantic similarity to the region of sentimental significance in the document sentiment vector space further comprises:

selecting an action document vector most semantically similar to the query string for assessing sentimentality of the query string.

27. The method of claim 16, further comprises:

receiving a trusted group sentiment score for the contemporaneous publication, said trusted group sentiment score being indicative of the sentiment of a trusted group of humans toward the particular topic with respect to the contemporaneous publication;

receiving a second trusted group sentiment score for the second contemporaneous publication, said second trusted group sentiment score being indicative of the sentiment of the trusted group of humans toward the particular topic with respect to the second contemporaneous publication;

finding a cumulative sentiment score for the contemporaneous publication from the sentiment score and the trusted group sentiment score; and

finding a second cumulative sentiment score for the second contemporaneous publication from the sentiment score and the trusted group sentiment score;

receiving a sentiment time decay factor for publications, wherein the sentiment time decay factor reflects a limited timeframe of influence of the publications on the extrinsic metric relative to a publication date;

finding an age sentiment score for the contemporaneous publication by applying the sentiment time decay factor to the cumulative sentiment score for age relative to the contemporaneous publication date;

finding a second age sentiment score for the second contemporaneous publication by applying the sentiment time decay factor to the second cumulative sentiment score for age relative to the second contemporaneous publication date; and

sentiment ranking the contemporaneous publication and second contemporaneous publication based on their respective age sentiment score and second age sentiment score.

28. The method of claim 16, further comprises:

receiving a global community sentiment score for the contemporaneous publication, said global community sentiment score being indicative of the sentiment of a global community of humans toward the particular topic with respect to the contemporaneous publication;

receiving a second global community sentiment score for the second contemporaneous publication, said second global community sentiment score being indicative of the sentiment of the trusted group of humans toward the particular topic with respect to the second contemporaneous publication;

receiving a trusted group sentiment score for the contemporaneous publication, said trusted group sentiment score being indicative of the sentiment of a trusted group of humans toward the particular topic with respect to the contemporaneous publication;

receiving a second trusted group sentiment score for the second contemporaneous publication, said second trusted group sentiment score being indicative of the sentiment of the trusted group of humans toward the particular topic with respect to the second contemporaneous publication;

finding a cumulative sentiment score for the contemporaneous publication relative to the sentiment score, the trusted group sentiment score and the global community sentiment score; and

finding a second cumulative sentiment score for the second contemporaneous publication relative to the sentiment score, the trusted group sentiment score, and the second global community sentiment score;

receiving a sentiment time decay factor for publications, wherein the sentiment time decay factor reflects a limited timeframe of influence of the publications on the extrinsic metric relative to a publication date;

finding an age sentiment score for the contemporaneous publication by applying the sentiment time decay factor to the cumulative sentiment score for age relative to the contemporaneous publication date;

finding a second age sentiment score for the second contemporaneous publication by applying the sentiment time decay factor to the second cumulative sentiment score for age relative to the second contemporaneous publication date; and

sentiment ranking the contemporaneous publication and second contemporaneous publication based on their respective age sentiment score and second age sentiment score.

29. The method of claim 28, wherein defining a region of sentimental significance in the document sentiment vector space further comprises:

creating a singular sentiment vector from a product of document vectors from the documents-by-concepts matrix representing sentimentally significant documents.

30. The method of claim 28, wherein defining a region of sentimental significance in the document sentiment vector space further comprises:

creating a binding term vector from term vector in the term-by-concepts matrix representing the binding term.

31. The method of claim 28, wherein defining a region of sentimental significance in the document sentiment vector space further comprises:

creating a binding term vector from term vector in the term-by-concepts matrix representing the binding term.

32. The method of claim 31, wherein assessing sentimentality of the query string by comparing a representation of the query string for semantic similarity to the region of sentimental significance in the document sentiment vector space further comprises:

selecting an action document vector most semantically similar to the query string for assessing sentimentality of the query string.

33. The method of claim 3, wherein assessing sentimentality of a query string by comparing a representation of the query string for semantic similarity to the region of sentimental significance in the document sentiment vector space further comprises:

finding a dot product of the representation of the query string and the region of sentimental significance.

34. The method of claim 3, wherein deriving a publication date for each document in the group of documents further comprises finding a explicit publication date associated with each document in the group, inferring a publication date, implying a publication date, and assuming a publication date.