Communication system and method between an on-vehicle voice recognition system and an off-vehicle voice recognition system

• US 10,269,348 B2
• Filed: 02/28/2017
• Issued: 04/23/2019
• Est. Priority Date: 06/24/2010
• Status: Active Grant

• Current Assignee: Honda Motor Co., Ltd. (Honda Motor Company)
• Original Assignee: Honda Motor Co., Ltd. (Honda Motor Company)
• Inventors: Huang, Ritchie, Vaghefinazari, Pedram, Yamamoto, Stuart
• Primary Examiner(s): Guerra-Erazo, Edgar X
• Application Number:
  US15/445,514
• Publication Number:
  US 20170169825A1
• Time in Patent Office: 784 Days
• Field of Search: 704233, 704235, 704243, 704246, 704270, 7042701, 704275, 704277, 704278
• CPC Class Codes: G10L 15/01 Assessment or evaluation of speech recognition systems
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G10L 15/30 Distributed recognition, e.g. in client-server systems, for mobile phones or network applications
• CPC Class Codes: G10L 17/22 Interactive procedures; Man-machine interfaces
• CPC Class Codes: G10L 2015/223 Execution procedure of a spoken command
• CPC Class Codes: G10L 2015/228 of application context
• CPC Class Codes: G10L 21/06 Transformation of speech into a non-audible representation, e.g. speech visualisation or speech processing for tactile aids G10L15/26 takes precedence
• CPC Class Codes: G10L 25/72 for transmitting results of analysis

Abstract

A vehicle based system and method for receiving voice inputs and determining whether to perform a voice recognition analysis using in-vehicle resources or resources external to the vehicle.

Claims

1. A computer-implemented method in a vehicle, comprising:

receiving, via a microphone, a user voice input for at least generating a voice recognition result;

determining to process the user voice input using a system external to the vehicle based at least upon one or more characteristics of the user voice input;

determining a connectivity issue related to a connection between the vehicle and the system external to the vehicle;

storing, based on determining the connectivity issue, the user voice input at the vehicle while the connectivity issue persists; and

when it is determined that the connectivity issue no longer exists, providing the user voice input to the system external to the vehicle;

receiving, from the system external to the vehicle, the voice recognition result; and

performing, based on receiving the voice recognition result, a command on the vehicle, wherein the command is associated with the voice recognition result.

2. The method of claim 1, wherein storing the user voice input is further based in part on determining that the user voice input includes one or more commands unknown to a voice recognition system on the vehicle.

3. The method of claim 1, wherein storing the user voice input is further based in part on detecting that the voice recognition result of the user voice input corresponds to information unavailable within the vehicle.

4. The method of claim 1, wherein determining to process the user voice input using the system external to the vehicle is based at least in part on detecting that the one or more characteristics of the user voice input exceeds a first selected threshold value associated with the one or more characteristics.

5. The method of claim 4, wherein the one or more characteristics of the user voice input includes a voice type, frequency, speed, prosody, intelligibility, tone, pitch, size, direction, volume, or duration of the user voice input.

6. The method of claim 1, wherein determining to process the user voice input using the system external to the vehicle is further based at least in part on determining that a confidence value for an in-vehicle voice recognition result generated for the user voice input by an in-vehicle voice recognition system does not achieve a threshold.

7. The method of claim 1, wherein determining to process the user voice input using the system external to the vehicle is further based at least in part on determining that an in-vehicle voice recognition result generated for the user voice input by an in-vehicle voice recognition system indicates a request for information unavailable within the vehicle.

8. A system in a vehicle, comprising:

a microphone configured to receive a user voice input for at least generating a voice recognition result;

a memory for storing instructions related to generating the voice recognition result;

a communications unit configure for providing the user voice input to an external system that is external to the vehicle; and

at least one processor configured for;

determining to process the user voice input using the external system based at least upon one or more characteristics of the user voice input;

determining a connectivity issue related to a connection, via the communications unit, between the vehicle and the external system;

storing, in the memory and based on determining the connectivity issue, the user voice input while the connectivity issue persists; and

when it is determined that the connectivity issue no longer exists, providing the user voice input to the external system;

receiving, from the external system, the voice recognition result; and

performing, based on receiving the voice recognition result, a command on the vehicle, wherein the command is associated with the voice recognition result.

9. The system of claim 8, wherein storing the user voice input is further based in part on determining that the user voice input includes one or more commands unknown to a voice recognition system on the vehicle.

10. The system of claim 8, wherein storing the user voice input is further based in part on detecting that the voice recognition result of the user voice input corresponds to information unavailable within the vehicle.

11. The system of claim 8, wherein determining to process the user voice input using the external system is based at least in part on detecting that the one or more characteristics of the user voice input exceeds a first selected threshold value associated with the one or more characteristics.

12. The system of claim 11, wherein the one or more characteristics of the user voice input includes a voice type, frequency, speed, prosody, intelligibility, tone, pitch, size, direction, volume, or duration of the user voice input.

13. The system of claim 8, wherein determining to process the user voice input using the external system is further based at least in part on determining that a confidence value for an in-vehicle voice recognition result generated for the user voice input by an in-vehicle voice recognition system does not achieve a threshold.

14. The system of claim 8, wherein determining to process the user voice input using the external system is further based at least in part on determining that an in-vehicle voice recognition result generated for the user voice input by an in-vehicle voice recognition system indicates a request for information unavailable within the vehicle.

15. An apparatus for processing user voice input in a vehicle, comprising:

a memory; and

at least one processor coupled to the memory and configured for;

receiving, via a microphone, a user voice input for at least generating a voice recognition result;

determining to process the user voice input using a system external to the vehicle based at least upon one or more characteristics of the user voice input;

determining a connectivity issue related to a connection between the vehicle and the system external to the vehicle;

storing, in the memory and based on determining the connectivity issue, the user voice input while the connectivity issue persists; and

when it is determined that the connectivity issue no longer exists, providing the user voice input to the system external to the vehicle;

receiving, from the system external to the vehicle, the voice recognition result; and

performing, based on receiving the voice recognition result, a command on the vehicle, wherein the command is associated with the voice recognition result.

16. The apparatus of claim 15, wherein storing the user voice input is further based in part on determining that the user voice input includes one or more commands unknown to a voice recognition system on the vehicle.

17. The apparatus of claim 15, wherein storing the user voice input is further based in part on detecting that the voice recognition result of the user voice input corresponds to information unavailable within the vehicle.

18. The apparatus of claim 15, wherein determining to process the user voice input using the system external to the vehicle is based at least in part on detecting that the one or more characteristics of the user voice input exceeds a first selected threshold value associated with the one or more characteristics.

19. The apparatus of claim 18, wherein the one or more characteristics of the user voice input includes a voice type, frequency, speed, prosody, intelligibility, tone, pitch, size, direction, volume, or duration of the user voice input.

20. The apparatus of claim 15, wherein determining to process the user voice input using the system external to the vehicle is further based at least in part on determining that a confidence value for an in-vehicle voice recognition result generated for the user voice input by an in-vehicle voice recognition system does not achieve a threshold.