CENTRALIZED SPEECH LOGGER ANALYSIS

• US 20140067392A1
• Filed: 09/05/2012
• Published: 03/06/2014
• Est. Priority Date: 09/05/2012
• Status: Active Grant

• Current Assignee: GM Global Technology Operations LLC (General Motors Company)
• Original Assignee: GM Global Technology Operations LLC (General Motors Company)
• Inventors: Burke, Denis R., Gurovich, Danilo, Rudman, Daniel E., Fry, Keith A., McCutchen, Shane M., Carnevale, Marco T., Gupta, Mukesh
• Granted Patent: US 9,583,100 B2
• Time in Patent Office: Days
• US Class Current: 704/236
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G10L 15/30 Distributed recognition, e.g. in client-server systems, for mobile phones or network applications
• CPC Class Codes: G10L 2015/228 of application context

Abstract

A method of providing hands-free services using a mobile device having wireless access to computer-based services includes receiving speech in a vehicle from a vehicle occupant; recording the speech using a mobile device; transmitting the recorded speech from the mobile device to a cloud speech service; receiving automatic speech recognition (ASR) results from the cloud speech service at the mobile device; and comparing the recorded speech with the received ASR results at the mobile device to identify one or more error conditions.

Claims

1. A method of providing hands-free services using a mobile device having wireless access to computer-based services, the method comprising:

(a) receiving speech in a vehicle from a vehicle occupant;

(b) recording the speech using a mobile device;

(c) transmitting the recorded speech from the mobile device to a cloud speech service;

(d) receiving automatic speech recognition (ASR) results from the cloud speech service at the mobile device; and

(e) comparing the recorded speech with the received ASR results at the mobile device to identify one or more error conditions.

2. The method of claim 1, further comprising the step of receiving speech using an audio interface at the vehicle, wherein the audio interface is communicatively linked to directly to the mobile device via a short-range wireless connection.

3. The method of claim 1, further comprising the step of storing the recorded speech at the mobile device for a predetermined amount of time.

4. The method of claim 1, further comprising the step of receiving a verbal response from the vehicle occupant that triggers the comparing in step (e).

5. The method of claim 1, further comprising the step of receiving a grammar from the cloud speech service along with the ASR results.

6. The method of claim 1, further comprising the step of performing local speech recognition on the recorded speech.

7. The method of claim 6, further comprising the step of performing local speech recognition using a local speech recognition grammar.

8. The method of claim 7, further comprising the step of optimizing the local speech recognition grammar using information gathered from a local environment or the vehicle occupant.

9. The method of claim 7, further comprising the step of recursively updating the local speech recognition grammar.

10. The method of claim 1, further comprising the step of sending the results of the comparison to a central facility.

11. The method of claim 1, further comprising the step of creating a log of the identified error conditions.

12. The method of claim 1, further comprising the steps of:

receiving error conditions from a plurality of mobile devices at the central facility and generating an aggregate log based on the received error conditions.

13. A method of providing hands-free services using a mobile device having wireless access to computer-based services, the method comprising:

(a) receiving speech at a mobile device from a vehicle occupant via a short-range communication connection;

(b) transmitting the received speech from the mobile device to a cloud speech service;

(c) receiving automatic speech recognition (ASR) results from the cloud speech service;

(d) determining that the received ASR results include one or more incorrectly identified speech terms;

(e) performing local speech recognition on the received speech;

(f) comparing the local speech recognition with the ASR results to detect when the local speech recognition correctly identified the incorrectly identified speech terms in response to the determination in step (e); and

(g) sending the results of the comparison in step (f) to a central facility.

14. The method of claim 13, further comprising the step of receiving a grammar from the cloud speech service along with the ASR results.

15. The method of claim 13, further comprising the step of performing local speech recognition using a local speech recognition grammar.

16. The method of claim 13, further comprising the step of creating a log of the determination in step (d).

17. The method of claim 13, further comprising the steps of:

receiving the results of step (g) from a plurality of mobile devices and generating an aggregate log based on those results.

18. A method of providing hands-free services using a mobile device having wireless access to computer-based services, the method comprising:

(a) receiving speech from a vehicle occupant at an audio interface in a vehicle;

(b) sending the received speech from the vehicle to a mobile device via a short-range communication connection;

(c) recording the received speech at the mobile device;

(d) transmitting the recorded speech from the mobile device to a cloud speech service, wherein the recorded speech includes an indication to the cloud speech service that the recorded speech originated in the vehicle;

(e) receiving automatic speech recognition (ASR) results from the cloud speech service;

(f) determining that the received ASR results include one or more speech terms that have been incorrectly identified;

(g) performing local speech recognition on the recorded speech using an automatic speech recognition (ASR) system resident on the mobile device in response to step (f);

(h) comparing the local speech recognition with the ASR results to detect instances when the local speech recognition correctly identified the incorrectly identified speech terms; and

(i) maintaining a log of the incorrectly identified speech terms, the instances when the local speech recognition correctly identified the incorrectly identified speech terms, or both.

19. The method of claim 18, further comprising the step of receiving a grammar from the cloud speech service along with the ASR results.

20. The method of claim 18, further comprising the step of performing local speech recognition using a local speech recognition grammar.