Systems and methods for word offensiveness processing using aggregated offensive word filters

• US 8,868,408 B2
• Filed: 07/12/2013
• Issued: 10/21/2014
• Est. Priority Date: 01/29/2010
• Status: Active Grant

• Current Assignee: Ipar LLC
• Original Assignee: Ipar LLC
• Inventors: Spears, Joseph L.
• Primary Examiner(s): GUERRA-ERAZO, EDGAR X
• Application Number:
  US13/940,375
• Publication Number:
  US 20130304456A1
• Time in Patent Office: 466 Days
• Field of Search: 704/1, 704/4, 704/9, 704/10, 704/270, 704/270.1, 704/275
• US Class Current: 704/9
• CPC Class Codes: G06F 16/9535 Search customisation based on user profiles and personalisation
• CPC Class Codes: G06F 40/40 Processing or translation of natural language natural language analysis G06F40/20; semantic analysis G06F40/30

Abstract

Computer-implemented systems and methods are provided for identifying language that would be considered obscene or otherwise offensive to a user or proprietor of a system. A first plurality of offensive words are received, and a second plurality of offensive words are received. A string of words are received, where one or more detected offensive words are selected from the string of words that matches words from the first plurality of offensive words or the second plurality of offensive words. The string of words is processed based upon the detection of offensive words in the string of words.

Claims

1. A method, comprising:

receiving, using one or more processors, a first plurality of offensive words, the first plurality of offensive words being associated with a first category of offensive words;

receiving, using one or more processors, a second plurality of offensive words, the second plurality of offensive words being associated with a second category of offensive words;

receiving, using one or more processors, a user preference identifying a plurality of categories of words that should be filtered, wherein the plurality of categories includes the first category and the second category;

based on the user preference, generating, using one or more processors, a consolidated list of offensive words for the user that includes the first plurality of offensive words and the second plurality of offensive words;

receiving, using one or more processors, a string of words, wherein one or more detected offensive words is selected from the string of words that matches words from the consolidated list that includes the first plurality of offensive words or the second plurality of offensive words; and

processing the string of words, using one or more processors, based upon the detection of offensive words in the string of words.

2. The method of claim 1, wherein each word in the first plurality of words, each word in the second plurality of words and each word in the string of words comprises an abbreviation, a single word, a phrase, or a sentence.

3. The method of claim 1, wherein the first plurality of offensive words and the second plurality of offensive words are wholly unique and independent of one another, or comprise a joined subset where some words appear in both the first plurality of offensive words and the second plurality of offensive words concurrently.

4. The method of claim 1, wherein the first plurality of offensive words is provided by a first source and the second plurality of offensive words is provided by a second source, wherein the first source is different than the second source.

5. The method of claim 4, wherein the first source or the second source comprises a user, a service administrator, a third party, a government institution having jurisdictional authority for a user, a non-governmental institution with which the user is associated or any combination thereof.

6. The method of claim 1, wherein each offensive word in the first plurality of offensive words is associated with a severity score identifying offensiveness of that word;

wherein each offensive word in the second plurality of offensive words is associated with a severity score identifying offensiveness of that word;

an offensive word appearing in both the first plurality of offensive words and the second plurality of offensive words has an adjusted severity score based on the offensive word'"'"'s severity score within each of the first plurality of offensive words and the second plurality of offensive words;

wherein detection of an offensive word from the string of words is based upon a greatest offensiveness scores of matching offensive words from within each plurality of offensive words; and

wherein detection of an offensive word is based upon the greatest of the severity scores exceeding an offensiveness threshold value.

7. The method of claim 6, wherein the severity score of words in each plurality of offensive words is provided by a different source.

8. The method of claim 7, wherein the source of the severity scores of words in the first plurality of offensive words or the second plurality of offensive words is a user, a service administrator, a third party, a government institution having jurisdictional authority for a user, a non-governmental institution with which the user is associated, or any combination thereof.

9. The method of claim 6, wherein the greatest offensiveness score is one of:

a smallest value offensiveness score calculated in comparing each of the plurality of offensive words with a candidate word from the string of words;

or

a largest value offensiveness score calculated in comparing each of the plurality of offensive words with a candidate word from the string of words.

10. The method of claim 6, wherein the offensiveness threshold value is a value set by a user, a service administrator, a third party, a government institution having jurisdictional authority for a user, a non-governmental institution with which the user is associated, or any combination thereof.

11. The method of claim 6, wherein the offensiveness threshold value is derived using a function that is computed using values provided by a user, a service administrator, a third party, a government institution having jurisdictional authority over a user, a non-governmental institution with which the user is associated, or any combination thereof.

12. The method of claim 1, wherein the string of words is input from a user to a service;

and

the input from the user to the service is rejected if an offensive word is detected in the string of words.

13. The method of claim 1, wherein the string of words is output to a user from a service;

and

the output to the user is modified if an offensive word is detected in the string of words.

14. The method of claim 13, wherein modification of the output comprises one of the group consisting of:

deleting the string of words such that the string of words is not displayed to the user;

deleting the offensive word from the string of words such that the offensive words within the string of words is not displayed to the user;

censoring the string of words such that the string of words is not displayed to the user; and

censoring the offensive word from the string of words such that the offensive words within the string of words is not displayed to the user.

15. The method of claim 1, wherein the string of words is input from an input user to a service and output to an output user from the service;

wherein the input from the user is rejected if an offensive word is detected that matches an offensive word within the first plurality of offensive words; and

the output to the second user is modified if an offensive word is detected that matches an offensive word in within the second plurality of offensive words.

16. The method of claim 15, wherein the input user and the output user are different users or the same user.

17. A system, comprising:

a data processor;

a computer-readable memory encoded with instructions for commanding the data processor to perform steps including;

receiving a first plurality of offensive words, the first plurality of offensive words being associated with a first category of offensive words;

receiving a second plurality of offensive words, the second plurality of offensive words being associated with a second category of offensive words;

receiving a user preference identifying a plurality of categories of words that should be filtered, wherein the plurality of categories includes the first category and the second category;

based on the user preference, generating a consolidated list of offensive words for the user that includes the first plurality of offensive words and the second plurality of offensive words;

receiving a string of words, wherein one or more detected offensive words is selected from the string of words that matches words from the consolidated list that includes the first plurality of offensive words or the second plurality of offensive words; and

processing the string of words based upon the detection of offensive words in the string of words.

18. The system of claim 17, wherein each word in the first plurality of words, each word in the second plurality of words and each word in the string of words comprises an abbreviation, a single word, a phrase, or a sentence.

19. The system of claim 17, wherein the first plurality of offensive words and the second plurality of offensive words are wholly unique and independent of one another, or comprise a joined subset where some words appear in both the first plurality of offensive words and the second plurality of offensive words concurrently.

20. The system of claim 17, wherein the first plurality of offensive words is provided by a first source and the second plurality of offensive words is provided by a second source, wherein the first source is different than the second source.

21. The system of claim 20, wherein the first source or the second source comprises a user, a service administrator, a third party, a government institution having jurisdictional authority for a user, a non-governmental institution with which the user is associated or any combination thereof.

22. The system of claim 17, wherein each offensive word in the first plurality of offensive words is associated with a severity score identifying offensiveness of that word;

wherein each offensive word in the second plurality of offensive words is associated with a severity score identifying offensiveness of that word;

an offensive word appearing in both the first plurality of offensive words and the second plurality of offensive words has an adjusted severity score based on the offensive word'"'"'s severity score within each of the first plurality of offensive words and the second plurality of offensive words;

wherein detection of an offensive word from the string of words is based upon a greatest offensiveness scores of matching offensive words from within each plurality of offensive words; and

wherein detection of an offensive word is based upon the greatest of the severity scores exceeding an offensiveness threshold value.

23. The system of claim 22, wherein the severity score of words in each plurality of offensive words is provided by a different source.

24. The system of claim 23, wherein the source of the severity scores of words in the first plurality of offensive words or the second plurality of offensive words is a user, a service administrator, a third party, a government institution having jurisdictional authority for a user, a non-governmental institution with which the user is associated, or any combination thereof.

25. The system of claim 22, wherein the greatest offensiveness score is one of:

a smallest value offensiveness score calculated in comparing each of the plurality of offensive words with a candidate word from the string of words;

or

a largest value offensiveness score calculated in comparing each of the plurality of offensive words with a candidate word from the string of words.

26. The system of claim 22, wherein the offensiveness threshold value is a value set by a user, a service administrator, a third party, a government institution having jurisdictional authority for a user, a non-governmental institution with which the user is associated, or any combination thereof.

27. The system of claim 22, wherein the offensiveness threshold value is derived using a function that is computed using values provided by a user, a service administrator, a third party, a government institution having jurisdictional authority over a user, a non-governmental institution with which the user is associated, or any combination thereof.

28. The system of claim 17, wherein the string of words is input from a user to a service;

and

the input from the user to the service is rejected if an offensive word is detected in the string of words.

29. The system of claim 17, wherein the string of words is output to a user from a service;

and

the output to the user is modified if an offensive word is detected in the string of words.

30. The system of claim 29, wherein modification of the output comprises one of the group consisting of:

deleting the string of words such that the string of words is not displayed to the user;

deleting the offensive word from the string of words such that the offensive words within the string of words is not displayed to the user;

censoring the string of words such that the string of words is not displayed to the user; and

censoring the offensive word from the string of words such that the offensive words within the string of words is not displayed to the user.

31. The system of claim 17, wherein the string of words is input from an input user to a service and output to an output user from the service;

wherein the input from the user is rejected if an offensive word is detected that matches an offensive word within the first plurality of offensive words; and

the output to the second user is modified if an offensive word is detected that matches an offensive word in within the second plurality of offensive words.

32. The system of claim 31, wherein the input user and the output user are different users or the same user.

33. A method, comprising:

receiving, using one or more processors, a first plurality of offensive words, wherein each of the first plurality of offensive words is associated with a first offensiveness score;

receiving, using one or more processors, a second plurality of offensive words, wherein each of the second plurality of offensive words is associated with a second offensiveness score;

receiving, using one or more processors, a string of words, wherein a potentially offensive word is selected from the string of words that matches a word from the first plurality of offensive words or the second plurality of offensive words;

determining an offensiveness score for the potentially offensive word, using one or more processors, based on a maximum of a first offensiveness score and a second offensiveness score for the potentially offensive word;

processing the string of words, using one or more processors to mitigate the potentially offensive word when the offensiveness score meets an offensiveness threshold value.

34. A method, comprising:

receiving, using one or more processors, a first plurality of offensive words, wherein each of the first plurality of offensive words is associated with a first offensiveness score;

receiving, using one or more processors, a string of words;

determining a distance measurement between a potentially offensive word in the string of words and an offensive word in the first plurality of offensive words, wherein the distance measurement is based on a spelling difference between the potentially offensive word and the offensive word in the first plurality of offensive words;

determining an offensiveness score for the potentially offensive word based on the distance measurement and the first offensiveness score associated with the offensive word in the first plurality of offensive words;

processing the string of words, using one or more processors to mitigate the potentially offensive word when the offensiveness score meets an offensiveness threshold value.

35. The method of claim 34, wherein the offensiveness score is determined based on a product of the distance measurement and the first offensiveness score associated with the offensive word in the first plurality of offensive words.