DATA PROCESSING METHOD, PRESENTATION METHOD, AND CORRESPONDING APPARATUSES

• US 20140019121A1
• Filed: 07/16/2013
• Published: 01/16/2014
• Est. Priority Date: 07/12/2012
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Bao, Sheng Hua, Chen, Jian, Liu, Wen, Qin, Yong, Shi, Qin, Su, Zhong, Zhang, Shi Lei
• Granted Patent: US 9,158,753 B2
• Time in Patent Office: Days
• US Class Current: 704/9
• CPC Class Codes: G06F 40/20 Natural language analysis semantic analysis of natural language G06F40/30
• CPC Class Codes: G06F 40/279 Recognition of textual entities
• CPC Class Codes: G10L 15/18 using natural language modelling
• CPC Class Codes: G10L 15/187 Phonemic context, e.g. pronunciation rules, phonotactical constraints or phoneme n-grams
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue

Abstract

A data processing method includes obtaining text information corresponding to a presented content, the presented content comprising a plurality of areas; performing text analysis on the text information to obtain a first keyword sequence, the first keyword sequence including area keywords associated with at least one area of the plurality of areas; obtaining speech information related to the presented content, the speech information at least comprising a current speech segment; and using a first model network to perform analysis on the current speech segment to determine the area corresponding to the current speech segment, wherein the first model network comprises the first keyword sequence.

Claims

1. An apparatus for data processing, comprising:

a text obtaining module configured to obtain text information corresponding to a presented content, the presented content comprising a plurality of areas;

a text analysis module configured to perform text analysis on the text information to obtain a first keyword sequence, the first keyword sequence including area keywords associated with at least one area of the plurality of areas;

a speech obtaining module configured to obtain speech information related to the presented content, the speech information at least comprising a current speech segment;

a first speech analysis module configured to use a first model network to perform analysis on the current speech segment to determine the area corresponding to the current speech segment, wherein the first model network comprises the first keyword sequence.

2. The apparatus according to claim 1, wherein the first speech analysis module comprises:

a first confidence submodule configured to obtain a confidence degree of at least one area keyword in the first keyword sequence, wherein the higher similarity an area keyword has with respect to the current speech segment, the higher confidence degree is obtained for the area keyword;

an area determining submodule configured to determine, if a sixth condition is met, that the area corresponding to the current speech segment is an area associated with an area keyword involved in the sixth condition;

wherein the sixth condition comprises at least one of the following;

that a confidence degree of an area keyword reaches a seventeenth threshold;

that all confidence degrees of multiple area keywords associated with a same area reach an eighteenth threshold;

that a sum of confidence degrees of multiple area keywords associated with a same area reaches a nineteenth threshold.

3. The apparatus according to claim 2, wherein the first model network further comprises a first phoneme sequence;

wherein the first speech analysis module further comprises;

a first phoneme submodule configured to obtain at least one phoneme adjacent to the current speech segment based on the first phoneme sequence;

a first similarity determining submodule configured to determine a pronunciation similarity between the at least one phoneme and corresponding text information of the at least one area keyword, the corresponding text information of the at least one area keyword comprising a context of the at least one area keyword in the text information;

a first adjustment submodule configured to increase the confidence degree of the area keyword with the pronunciation similarity reaching a twentieth threshold if the pronunciation similarity between the at least one phoneme and the corresponding text information of the at least one area keyword reaches the twentieth threshold.

4. The apparatus according to claim 1, further comprising:

a keyword module configured to obtain a plurality of second keyword sequences, at least one of the second keyword sequences corresponding to at least one area of the plurality of areas and at least one of the second keyword sequences comprising at least one keyword;

a second speech analysis module configured to use the second model network to perform analysis on the current speech segment to determine a keyword corresponding to the current speech segment, wherein the second model network comprises the second keyword sequences.

5. The apparatus according to claim 4,

wherein the second model network further comprises a second phoneme sequence;

wherein the second speech analysis module comprises;

a second phoneme submodule configured to obtain at least one phoneme adjacent to the current speech segment based on the second phoneme sequence;

a second confidence submodule configured to obtain a confidence degree of at least one keyword in the second keyword sequence, wherein the higher similarity a keyword has with respect to the current speech segment, the higher confidence degree is obtained for the keyword;

a candidate determining module configured to determine, if a confidence degree of at least one keyword reaches a twenty-first threshold, the keyword with the confidence degree reaching the twenty-first threshold to be a candidate keyword;

a second similarity determining submodule configured to determine a pronunciation similarity between the at least one phoneme and corresponding text information of the candidate keyword, the corresponding text information of the candidate keyword comprising a context of the candidate keyword in the text information;

a keyword determining submodule configured to determine, if the pronunciation similarity between the at least one phoneme and one piece of the corresponding text information of the candidate keyword reaches a twenty-second threshold, that the keyword corresponding to the current speech segment is the keyword of which the context is the text information with the pronunciation similarity reaching the twenty-second threshold.

6. An apparatus for presentation, comprising:

a text obtaining module configured to obtain text information corresponding to a presented content, wherein the presented content comprises a plurality of areas;

a text analysis module configured to perform text analysis on the text information to obtain a plurality of second keyword sequences, wherein at least one of the second keyword sequences corresponds to at least one area of the plurality of areas, and at least one of the second keyword sequences comprises at least one keyword;

a speech obtaining module configured to obtain speech information related to the presented content, the speech information at least comprising a current speech segment;

a first confidence submodule configured to obtain a confidence degree of at least one keyword in at least one of the second keyword sequences, wherein the higher similarity a keyword has with respect to the current speech segment, the higher confidence degree is obtained for the keyword;

a second confidence module configured to obtain a confidence degree of the second keyword sequence corresponding to the current area of the plurality of areas based on the confidence degree of the keyword;

a jump module configured to jump away from the current area in response to the confidence degree of the second keyword sequence corresponding to the current area being less than a twenty-third threshold.