Method and device for voice recognition training

• US 9,875,744 B2
• Filed: 03/23/2017
• Issued: 01/23/2018
• Est. Priority Date: 07/23/2013
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Technology Holdings LLC (Alphabet Inc.)
• Inventors: Gunn, Michael E., Bekkerman, Boris, Jasiuk, Mark A., Kamdar, Pratik M., Sierawski, Jeffrey A.
• Primary Examiner(s): He, Jialong
• Application Number:
  US15/467,028
• Publication Number:
  US 20170194007A1
• Time in Patent Office: 306 Days
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G10L 15/063 Training
• CPC Class Codes: G10L 15/20 Speech recognition techniques specially adapted for robustness in adverse environments, e.g. in noise, of stress induced speech G10L21/02 takes precedence
• CPC Class Codes: G10L 17/04 Training, enrolment or model building
• CPC Class Codes: G10L 17/20 Pattern transformations or operations aimed at increasing system robustness, e.g. against channel noise or different working conditions
• CPC Class Codes: G10L 2015/0638 Interactive procedures
• CPC Class Codes: G10L 25/84 for discriminating voice from noise
• CPC Class Codes: H04W 88/02 Terminal devices

Abstract

A method on a mobile device for voice recognition training is described. A voice training mode is entered. A voice training sample for a user of the mobile device is recorded. The voice training mode is interrupted to enter a noise indicator mode based on a sample background noise level for the voice training sample and a sample background noise type for the voice training sample. The voice training mode is returned to from the noise indicator mode when the user provides a continuation input that indicates a current background noise level meets an indicator threshold value.

Claims

1. A computer-implemented method comprising:

providing, by a mobile computing device, a first user interface indicating that (i) a background noise indicator mode is active, and (ii) a background noise loudness satisfies a loudness threshold or a background noise variance satisfies a variance threshold, the first user interface including a disabled continuation indicator;

upon determining that the background noise loudness no longer satisfies the loudness threshold or the background noise variance no longer satisfies the variance threshold, enabling, by the mobile computing device, the disabled continuation indicator include on the first user interface; and

in response to receiving data indicating a selection of the enabled continuation indicator, providing, by the mobile computing device, a second user interface indicating that (i) a voice training mode is active, and (ii) a voice training sample is to be spoken by a user.

2. The method of claim 1, wherein the first user interface includes a dial-type interface and a needle that indicates a level of the background noise.

3. The method of claim 1, wherein the first user interface does not indicate that (i) the voice training mode is active, and (ii) the voice training sample is to be spoken by the user.

4. The method of claim 1, wherein the second user interface does not indicate that (i) the background noise indicator mode is active, and (ii) the background noise loudness satisfies the loudness threshold or the background noise variance satisfies the variance threshold.

5. The method of claim 1, wherein the loudness threshold is based on the background noise variance.

6. The method of claim 1, comprising:

after providing the second user interface and before the voice training sample is spoken by the user, automatically providing, by the mobile computing device, the first user interface based on the background noise loudness satisfying the loudness threshold or the background noise variance satisfying the variance threshold.

7. A system comprising:

one or more computers and one or more storage devices storing instructions that are operable, when executed by the one or more computers, to cause the one or more computers to perform operations comprising;

providing, by a mobile computing device, a first user interface indicating that (i) a background noise indicator mode is active, and (ii) a background noise loudness satisfies a loudness threshold or a background noise variance satisfies a variance threshold, the first user interface including a disabled continuation indicator;

upon determining that the background noise loudness no longer satisfies the loudness threshold or the background noise variance no longer satisfies the variance threshold, enabling, by the mobile computing device, the disabled continuation indicator include on the first user interface; and

in response to receiving data indicating a selection of the enabled continuation indicator, providing, by the mobile computing device, a second user interface indicating that (i) a voice training mode is active, and (ii) a voice training sample is to be spoken by a user.

8. The system of claim 7, wherein the first user interface includes a dial-type interface and a needle that indicates a level of the background noise.

9. The system of claim 7, wherein the first user interface does not indicate that (i) the voice training mode is active, and (ii) the voice training sample is to be spoken by the user.

10. The system of claim 7, wherein the second user interface does not indicate that (i) the background noise indicator mode is active, and (ii) the background noise loudness satisfies the loudness threshold or the background noise variance satisfies the variance threshold.

11. The system of claim 7, wherein the loudness threshold is based on the background noise variance.

12. The system of claim 7, wherein the operations further comprise:

after providing the second user interface and before the voice training sample is spoken by the user, automatically providing, by the mobile computing device, the first user interface based on the background noise loudness satisfying the loudness threshold or the background noise variance satisfying the variance threshold.

13. A non-transitory computer-readable medium storing software comprising instructions executable by one or more computers which, upon such execution, cause the one or more computers to perform operations comprising:

providing, by a mobile computing device, a first user interface indicating that (i) a background noise indicator mode is active, and (ii) a background noise loudness satisfies a loudness threshold or a background noise variance satisfies a variance threshold, the first user interface including a disabled continuation indicator;

upon determining that the background noise loudness no longer satisfies the loudness threshold or the background noise variance no longer satisfies the variance threshold, enabling, by the mobile computing device, the disabled continuation indicator include on the first user interface; and

in response to receiving data indicating a selection of the enabled continuation indicator, providing, by the mobile computing device, a second user interface indicating that (i) a voice training mode is active, and (ii) a voice training sample is to be spoken by a user.

14. The medium of claim 13, wherein the first user interface includes a dial-type interface and a needle that indicates a level of the background noise.

15. The medium of claim 13, wherein the first user interface does not indicate that (i) the voice training mode is active, and (ii) the voice training sample is to be spoken by the user.

16. The medium of claim 13, wherein the second user interface does not indicate that (i) the background noise indicator mode is active, and (ii) the background noise loudness satisfies the loudness threshold or the background noise variance satisfies the variance threshold.

17. The medium of claim 13, wherein the operations further comprise:

after providing the second user interface and before the voice training sample is spoken by the user, automatically providing, by the mobile computing device, the first user interface based on the background noise loudness satisfying the loudness threshold or the background noise variance satisfying the variance threshold.

18. The medium of claim 13, wherein the loudness threshold is based on the background noise variance.