Method and apparatus for processing text information

• US 10,387,460 B2
• Filed: 06/08/2016
• Issued: 08/20/2019
• Est. Priority Date: 01/06/2014
• Status: Active Grant

• Current Assignee: Tencent Technology Company Limited (Tencent Holdings Limited)
• Original Assignee: Tencent Technology Company Limited (Tencent Holdings Limited)
• Inventors: Chen, Shengrong
• Primary Examiner(s): Ruiz, Angelica
• Application Number:
  US15/176,364
• Publication Number:
  US 20160321353A1
• Time in Patent Office: 1,168 Days
• CPC Class Codes: G06F 16/313 Selection or weighting of terms for indexing
• CPC Class Codes: G06F 16/328 Management therefor
• CPC Class Codes: G06F 40/103 Formatting, i.e. changing of presentation of documents automatic justification G06F40/189; automatic line break hyphenation G06F40/191
• CPC Class Codes: G06F 40/126 Character encoding
• CPC Class Codes: G06F 40/216 using statistical methods
• CPC Class Codes: G06Q 10/107 Computer-aided management of electronic mailing [e-mailing]

Abstract

The present application relates to a A method for processing text information is provided, the method including: obtaining text information and extracting text characters contained in the text information; extracting, from the text characters, target characters satisfying a predetermined rule; calculating a filtering index of the text information according to the target characters; and when the filtering index meets a predetermined condition, executing an operation corresponding to the predetermined condition on the text information. In addition, an apparatus for processing text information is further provided. The method and apparatus for processing text information can improve the accuracy and efficiency of filtering out junk text information.

Claims

1. A method for processing text information, comprising:

obtaining, by a terminal, text information and extracting, by the terminal, text characters contained in the text information;

extracting, by the terminal, from the text characters, target characters satisfying a predetermined rule;

calculating, by the terminal, a filtering index of the text information according to the target characters;

when the filtering index meets a predetermined condition, executing, by the terminal, an operation corresponding to the predetermined condition on the text information;

wherein the step of calculating, by the terminal, the filtering index of the text information according to the target characters comprises;

separately converting the text characters and the target characters into characters in a given encoding form; and

calculating a ratio of a total number of bytes of the converted target characters to a total number of bytes of remaining characters in the converted text characters excluding the converted target characters, and using the ratio as the filtering index of the text information; and

wherein, when the filtering index meets the predetermined condition, executing, by the terminal, the operation corresponding to the predetermined condition on the text information comprises;

analyzing a magnitude relationship between the filtering index and a preset numerical range, and assigning a corresponding weight value to the filtering index according to an analysis result and a preset weight table, and

when a value obtained after assigning the corresponding weight value to the filtering index according to the analysis result and the preset weight table meets the predetermined condition, executing, by the terminal, the operation corresponding to the predetermined condition on the text information comprises.

2. The method according to claim 1, wherein the step of extracting, by the terminal, from the text characters, target characters satisfying a predetermined rule comprises:

matching the extracted text characters one by one with interfering information characters recorded in a preset interfering character dictionary table, and using characters that are in the text characters and match the interfering information characters as the target characters.

3. The method according to claim 1, wherein the step of, when the filtering index meets a predetermined condition, executing, by the terminal, an operation corresponding to the predetermined condition on the text information further comprises:

when the filtering index falls within a preset numerical range, determining that the text information is junk text information, and executing an operation corresponding to the predetermined condition on the text information.

4. The method according to claim 3, wherein the method further comprises:

when the filtering index does not fall within the preset numerical range, analyzing, by the terminal, the filtering index to determine whether the filtering index is greater than a maximum value of the preset numerical range or the filtering index is less than a minimum value of the preset numerical range, and assigning, by the terminal, a corresponding weight value to the filtering index according to an analysis result and the preset weight table;

analyzing, by the terminal, the text characters to determine whether the text characters contain characters matching preset target keywords and analyzing, by the terminal, the situation of the characters that are contained in the text characters and match the target keywords, and assigning, by the terminal, a corresponding weight value to an analysis result according to the preset weight table;

obtaining, by the terminal, a user identifier of a sender of the text information, matching, by the terminal, the user identifier with user identifiers in a preset blacklist and whitelist, and assigning, by the terminal, a corresponding weight value to a matching result according to the preset weight table;

obtaining, by the terminal, respective base values of the filtering index, the analysis result, and the matching result, and performing, by the terminal, a weighting operation on the respective base values, the weight value corresponding to the filtering index, the weight value corresponding to the analysis result, and the weight value corresponding to the matching result; and

when a value obtained after the weighting operation is greater than a preset numerical value, determining, by the terminal, that the text information is the junk text information, and executing, by the terminal, the corresponding operation on the text information.

6. The method according to claim 1, wherein the operation corresponding to the predetermined condition comprises:

intercepting or deleting the text information, or giving a prompt in a preset prompting manner.

7. The method according to claim 1, wherein the given encoding form is an 8-bit Unicode transformation format (UTF-8) encoding form.

5. A method for processing text information, the method comprising:

obtaining, by a terminal, text information and extracting, by the terminal, text characters contained in the text information;

extracting, by the terminal, from the text characters, target characters satisfying a predetermined rule;

calculating, by the terminal, a filtering index of the text information according to the target characters;

when the filtering index meets a predetermined condition, executing, by the terminal, an operation corresponding to the predetermined condition on the text information;

wherein the calculating, by the terminal, the filtering index of the text information according to the target characters comprises;

separately converting the text characters and the target characters into characters in a given encoding form; and

calculating a ratio of a total number of bytes of the converted target characters to a total number of bytes of remaining characters in the converted text characters excluding the converted target characters, and using the ratio as the filtering index of the text information; and

wherein, when the filtering index meets a predetermined condition, the executing, by the terminal, the operation corresponding to the predetermined condition on the text information comprises;

analyzing a magnitude relationship between the filtering index and a preset numerical range, and assigning a corresponding weight value to the filtering index according to an analysis result and a preset weight table;

analyzing the text characters to determine whether the text characters contain characters matching preset target keywords and analyzing the situation of the characters that are contained in the text characters and match the target keywords, and assigning a corresponding weight value to an analysis result according to the preset weight table;

obtaining a user identifier of a sender of the text information, matching the user identifier with user identifiers in a preset blacklist and whitelist, and assigning a corresponding weight value to a matching result according to the preset weight table; and

obtaining respective base values of the filtering index, the analysis result, and the matching result, and performing a weighting operation on the respective base values, the weight value corresponding to the filtering index, the weight value corresponding to the analysis result, and the weight value corresponding to the matching result; and

when a value obtained after the weighting operation is greater than a preset numerical value, determining that the text information is the junk text information, and executing the corresponding operation on the text information.

8. An apparatus for processing text information, comprising:

a memory storing instructions; and

a processor in communication with the memory, wherein, when the processor executes the instructions, the processor is configured to cause the apparatus to;

obtain text information and extract text characters contained in the text information;

extract, from the text characters, target characters satisfying a predetermined rule;

calculate a filtering index of the text information according to the target characters;

when the calculated filtering index meets a predetermined condition, execute an operation corresponding to the predetermined condition on the text information;

wherein, when the processor is configured to cause the apparatus to calculate the filtering index of the text information according to the target characters, the processor is configured to cause the apparatus to separately convert the text characters and the target characters into characters in a given encoding form; and

calculate a ratio of a total number of bytes of the converted target characters to a total number of bytes of remaining characters in the converted text characters excluding the converted target characters, and use the ratio as the filtering index of the text information; and

wherein, when the processor is configured to cause the apparatus to execute the operation corresponding to the predetermined condition on the text information, the processor is configured to cause the apparatus to;

analyze a magnitude relationship between the filtering index and a preset numerical range, and assign a corresponding weight value to the filtering index according to an analysis result and a preset weight table, and

when a value obtained after assigning the corresponding weight value to the filtering index according to the analysis result and the preset weight table meets the predetermined condition, execute the operation corresponding to the predetermined condition on the text information comprises.

9. The apparatus according to claim 8, wherein, when the processor is configured to cause the apparatus to extract, from the text characters, target characters satisfying a predetermined rule, the processor is configured to cause the apparatus to match the extracted text characters one by one with interfering information characters recorded in a preset interfering character dictionary table, and use characters that are in the text characters and match the interfering information characters as the target characters.

10. The apparatus according to claim 8, wherein, when the processor is configured to cause the apparatus to execute the operation corresponding to the predetermined condition on the text information, the processor is configured to further cause the apparatus to:

when the filtering index falls within a preset numerical range, determine that the text information is junk text information, and execute an operation corresponding to the predetermined condition on the text information.

11. The apparatus according to claim 8, wherein, when the processor executes the instructions, the processor is configured to further cause the apparatus to:

analyze a magnitude relationship between the filtering index and the preset numerical range, and assign a corresponding weight value to the filtering index according to an analysis result and a preset weight table;

analyze the text characters to determine whether the text characters contain characters matching preset target keywords and analyze the situation of the characters that are contained in the text characters and match the target keywords, and assign a corresponding weight value to an analysis result according to the preset weight table;

obtain a user identifier of a sender of the text information, match the user identifier with user identifiers in a preset blacklist and whitelist, and assign a corresponding weight value to a matching result according to the preset weight table;

obtain respective base values of the filtering index, the analysis result, and the matching result, and perform a weighting operation on the respective base values, the weight value corresponding to the filtering index, the weight value corresponding to the analysis result, and the weight value corresponding to the matching result; and

when a value obtained after the weighting operation is greater than a preset numerical value, determine that the text information is the junk text information, and execute the corresponding operation on the text information.

12. The apparatus according to claim 10, wherein, when the processor executes the instructions, the processor is configured to further cause the apparatus to:

when the filtering index does not fall within a preset numerical range, analyze the filtering index to determine whether the filtering index is greater than a maximum value of the preset numerical range or the filtering index is less than a minimum value of the preset numerical range, and assign a corresponding weight value to the filtering index according to an analysis result and a preset weight table;

analyze the text characters to determine whether the text characters contain characters matching preset target keywords and analyze the situation of the characters that are contained in the text characters and match the target keywords, and assign a corresponding weight value to an analysis result according to the preset weight table;

obtain a user identifier of a sender of the text information, match the user identifier with user identifiers in a preset blacklist and whitelist, and assign a corresponding weight value to a matching result according to the preset weight table;

obtain respective base values of the filtering index, the analysis result, and the matching result, and perform a weighting operation on the respective base values, the weight value corresponding to the filtering index, the weight value corresponding to the analysis result, and the weight value corresponding to the matching result; and

when a value obtained after the weighting operation is greater than a preset numerical value, determine that the text information is the junk text information, and execute the corresponding operation on the text information.

13. The apparatus according to claim 8, wherein the operation corresponding to the predetermined condition comprises:

intercepting or deleting the text information, or giving a prompt in a preset prompting manner.

14. The apparatus according to claim 8, wherein the given encoding form is an 8-bit Unicode transformation format (UTF-8) encoding form.