GESTURE-BASED CUES FOR AN AUTOMATIC SPEECH RECOGNITION SYSTEM

• US 20150302851A1
• Filed: 04/18/2014
• Published: 10/22/2015
• Est. Priority Date: 04/18/2014
• Status: Active Grant

• Current Assignee: General Motors LLC (General Motors Company)
• Original Assignee: General Motors LLC (General Motors Company)
• Inventors: Talwar, Gaurav, Zhao, Xufang
• Granted Patent: US 9,881,609 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G10L 15/24 Speech recognition using non-acoustical features
• CPC Class Codes: G10L 2015/226 using non-speech characteristics

Abstract

A method of recognizing continuous digits uttered by a speaker using an automatic speech recognition (ASR) system includes receiving continuous digits via a microphone as speech from a user; detecting that recognition of one or more of the continuous digits falls below a predetermined confidence threshold; prompting the user to identify the continuous digits using a body gesture; detecting the body gesture made by the user; and identifying one or more of the continuous digits based on the body gesture.

Claims

1. A method of recognizing continuous digits using an automatic speech recognition (ASR) system, comprising the steps of:

(a) receiving continuous digits via a microphone as speech from a user;

(b) detecting that recognition of one or more of the continuous digits falls below a predetermined confidence threshold;

(c) prompting the user to identify the continuous digits using a body gesture;

(d) detecting the body gesture made by the user; and

(e) identifying one or more of the continuous digits based on the body gesture.

2. The method of claim 1, further comprising the step of receiving speech in a tonal language.

3. The method of claim 1, further comprising the step of detecting the body gesture using a display or a camera.

4. The method of claim 1, further comprising the step of detecting the quantity of the continuous digits using the body gesture.

5. The method of claim 1, further comprising the step of detecting the identity of the continuous digits using the body gesture.

6. The method of claim 1, further comprising the step of storing the identified continuous digits with the received speech.

7. The method of claim 1, wherein the speech is received as part of dialing a telephone number.

8. The method of claim 1, wherein the speech is received as part of changing a radio station or providing navigation services.

9. The method of claim 1, further comprising the step of assigning a body gesture to speech associated with one or more continuous digits.

10. A method of recognizing continuous digits using an automatic speech recognition (ASR) system, comprising the steps of:

(a) receiving continuous digits via a vehicle microphone as speech from a user;

(b) detecting that recognition of one or more of the continuous digits falls below a predetermined confidence threshold using the ASR system of a vehicle;

(c) prompting the user to identify the continuous digits using a body gesture;

(d) detecting the body gesture using an in-vehicle camera or display; and

(e) identifying one or more of the continuous digits based on the body gesture.

11. The method of claim 10, further comprising the step of receiving the speech in a tonal language.

12. The method of claim 10, further comprising the step of detecting the quantity of the continuous digits using the body gesture.

13. The method of claim 10, further comprising the step of detecting the identity of the continuous digits using the body gesture.

14. The method of claim 10, further comprising the step of storing the identified continuous digits with the received speech.

15. The method of claim 10, wherein the continuous digits are received as part of dialing a telephone number.

16. The method of claim 10, wherein the continuous digits are received as part of changing a radio station or providing navigation services.

17. The method of claim 10, further comprising the step of assigning a body gesture to speech associated with one or more continuous digits.