INPUT METHOD, DEVICE, APPARATUS, AND STORAGE MEDIUM

• US 20200135205A1
• Filed: 08/30/2019
• Published: 04/30/2020
• Est. Priority Date: 10/24/2018
• Status: Active Grant

• Current Assignee: Beijing Xiaomi Mobile Software Co., Ltd. (Xiaomi Corp.)
• Original Assignee: Beijing Xiaomi Mobile Software Co., Ltd. (Xiaomi Corp.)
• Inventors: TAN, Jiefu, CHEN, Senhua, LI, Dan, REN, Xinyi
• Granted Patent: US 11,335,348 B2
• Time in Patent Office: Days
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G06F 40/20 Natural language analysis semantic analysis of natural language G06F40/30
• CPC Class Codes: G10L 15/083 Recognition networks G10L15/142, G10L15/16 take precedence
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence
• CPC Class Codes: G10L 2015/088 Word spotting
• CPC Class Codes: G10L 25/54 for retrieval
• CPC Class Codes: G10L 25/63 for estimating an emotional state

Abstract

The disclosure relates to a method, device, apparatus, and storage medium. The method includes recognizing voice data inputted by a user; obtaining a voice text corresponding to the voice data; obtaining, based on the voice text, a text to-be-input corresponding to the voice data, wherein the text to-be-input includes a plurality of words constituting a phrase or a sentence; and displaying the text to-be-input in an input textbox of an input interface.

Claims

1. An method, comprising:

recognizing voice data inputted by a user;

obtaining a voice text corresponding to the voice data;

obtaining, based on the voice text, a text to-be-input corresponding to the voice data, wherein the text to-be-input includes a plurality of words constituting a phrase or a sentence; and

displaying the text to-be-input in an input textbox of an input interface.

2. The method according to claim 1, wherein obtaining the text to-be-input comprises:

determining, based on the voice text and corresponding relationships between different voice texts and target texts, whether the corresponding relationships include a target text that matches the voice text;

when the corresponding relationships include the target text that matches the voice text, designating the target text as the text to-be-input; and

when the corresponding relationships do not include the target text that matches the voice text, designating the voice text as the text to-be-input.

3. The method according to claim 2, wherein determining whether the corresponding relationships include the target text that matches the voice text comprises:

using the voice text and the corresponding relationships between the different voice texts and the target texts as an input of a matching algorithm to obtain an output of the matching algorithm; and

determining, based on the output of the matching algorithm, whether the corresponding relationships include the target text that matches the voice text.

4. The method according to claim 3, further comprising:

determining, based on the voice data, non-voice text information of the voice data; and

selecting the matching algorithm corresponding to the voice data from a set of matching algorithms based on the non-voice text information,

wherein using the voice text and the corresponding relationships between the different voice texts and the target texts as the input of the matching algorithm to obtain the output of the matching algorithm comprises using the voice text and the corresponding relationships between the different voice texts and the target texts as the input of the matching algorithm corresponding to the voice data, to obtain the output of the matching algorithm.

5. The method according to claim 4, wherein the non-voice text information comprises at least one of emotion information, gender information, or age information.

6. The method according to claim 3, the method further comprising:

obtaining state information of a terminal to which the user inputs the voice data,

wherein using the voice text and the corresponding relationships between the different voice texts and the target texts as the input of the matching algorithm, to obtain the output of the matching algorithm comprises using the state information of the terminal, the voice text, and the corresponding relationships between the different voice texts and the target texts as the input of the matching algorithm, to obtain the output of the matching algorithm.

7. A terminal, comprising:

a processor; and

a memory configured to store computer instructions executable by the processor,

wherein the processor is configured to;

recognize voice data inputted by a user;

obtain a voice text corresponding to the voice data;

obtain, based on the voice text, a text to-be-input corresponding to the voice data, wherein the text to-be-input includes a plurality of words constituting a phrase or a sentence; and

display the text to-be-input in an input textbox of an input interface.

8. The terminal according to claim 7, wherein, when obtaining the text to-be-input, the processor is further configured to:

determine, based on the voice text and corresponding relationships between different voice texts and target texts, whether the corresponding relationships include a target text that matches the voice text;

when the corresponding relationships include the target text that matches the voice text, designate the target text as the text to-be-input; and

when the corresponding relationships do not include the target text that matches the voice text, designate the voice text as the text to-be-input.

9. The terminal according to claim 8, wherein, when determining whether the corresponding relationships include the target text that matches the voice text, the processor is further configured to:

use the voice text and the corresponding relationships between the different voice texts and the target texts as an input of a matching algorithm to obtain an output of the matching algorithm; and

determine, based on the output of the matching algorithm, whether the corresponding relationships include the target text that matches the voice text.

10. The terminal according to claim 9, wherein the processor is further configured to:

determine, based on the voice data, non-voice text information of the voice data; and

select the matching algorithm corresponding to the voice data from a set of matching algorithms based on the non-voice text information,

wherein, when using the voice text and the corresponding relationships between the different voice texts and the target texts as the input of the matching algorithm to obtain the output of the matching algorithm, the processor is further configured to use the voice text and the corresponding relationships between the different voice texts and the target texts as the input of the matching algorithm corresponding to the voice data, to obtain the output of the matching algorithm.

11. The terminal according to claim 10, wherein the non-voice text information comprises at least one of emotion information, gender information, or age information.

12. The terminal according to claim 11, wherein the processor is further configured to:

obtain state information of a terminal to which the user inputs the voice data,

wherein, when using the voice text and the corresponding relationships between the different voice texts and the target texts as the input of the matching algorithm, to obtain the output of the matching algorithm, the processor is further configured to use the state information of the terminal, the voice text, and the corresponding relationships between the different voice texts and the target texts as the input of the matching algorithm, to obtain the output of the matching algorithm.

13. A non-transitory computer-readable storage medium storing instructions that, when executed by one or more processors of a terminal, cause the terminal to:

recognize voice data inputted by a user;

obtain a voice text corresponding to the voice data;

obtain, based on the voice text, a text to-be-input corresponding to the voice data, wherein the text to-be-input includes a plurality of words constituting a phrase or a sentence; and

display the text to-be-input in an input textbox of an input interface.

14. The non-transitory computer-readable storage medium according to claim 13, wherein, when obtaining the text to-be-input, the instructions further cause the terminal to:

determine, based on the voice text and corresponding relationships between different voice texts and target texts, whether the corresponding relationships include a target text that matches the voice text;

when the corresponding relationships include the target text that matches the voice text, designate the target text as the text to-be-input; and

when the corresponding relationships do not include the target text that matches the voice text, designate the voice text as the text to-be-input.

15. The non-transitory computer-readable storage medium according to claim 14, wherein, when determining whether the corresponding relationships include the target text that matches the voice text, the instructions further cause the terminal to:

use the voice text and the corresponding relationships between the different voice texts and the target texts as an input of a matching algorithm to obtain an output of the matching algorithm; and

determine, based on the output of the matching algorithm, whether the corresponding relationships include the target text that matches the voice text.

16. The non-transitory computer-readable storage medium according to claim 15, wherein the instructions further cause the terminal to:

determine, based on the voice data, non-voice text information of the voice data; and

select the matching algorithm corresponding to the voice data from a set of matching algorithms according to the non-voice text information,

wherein, when using the voice text and the corresponding relationships between the different voice texts and the target texts as the input of the matching algorithm to obtain the output of the matching algorithm, the instructions further cause the terminal to use the voice text and the corresponding relationships between the different voice texts and the target texts as the input of the matching algorithm corresponding to the voice data, to obtain the output of the matching algorithm.

17. The non-transitory computer-readable storage medium according to claim 16, wherein the non-voice text information comprises at least one of emotion information, gender information, or age information.

18. The non-transitory computer-readable storage medium according to claim 15, wherein the instructions further cause the terminal to:

obtain state information of a terminal to which the user inputs the voice data;

,

wherein, when using the voice text and the corresponding relationships between the different voice texts and the target texts as the input of the matching algorithm, to obtain the output of the matching algorithm, the instructions further cause the terminal to use the state information of the terminal, the voice text, and the corresponding relationships between the different voice texts and the target texts as the input of the matching algorithm, to obtain the output of the matching algorithm.