System And Method For Incorporating Gesture And Voice Recognition Into A Single System
0 Assignments
0 Petitions
Accused Products
Abstract
A system and method for combining two separate types of human machine interfaces, e.g., a voice signal and a gesture signal, performing voice recognition to a voice signal and gesture recognition to the gesture signal. Based on a confidence determination using the voice recognition result and the gesture recognition result the system can, for example, immediately perform the command/request, request confirmation of the command/request or determine that the command/request was not identified.
20 Citations
37 Claims
-
1. (canceled)
-
2. (canceled)
-
3. (canceled)
-
4. (canceled)
-
5. (canceled)
-
6. (canceled)
-
7. (canceled)
-
8. (canceled)
-
9. (canceled)
-
10. (canceled)
-
11. (canceled)
-
12. (canceled)
-
13. (canceled)
-
14. (canceled)
-
15. (canceled)
-
16. (canceled)
-
17. (canceled)
-
18. A computer based method for executing a command in a vehicle, comprising the steps of:
-
receiving a voice signal; receiving a gesture signal; performing a voice recognition procedure to generate a first voice recognition (VR) score representing a likelihood that the voice signal corresponds to a first command and to generate a second VR score representing a likelihood that the voice signal corresponds to a second command; performing a gesture recognition procedure to generate a first gesture recognition (GR) score representing a likelihood that the gesture signal corresponds to said first command, and to generate a second GR score representing a likelihood that the gesture signal corresponds to said second command; determining a selected command, said selected command being one of the first command or the second command, based upon the first and second VR scores and said first and second GR scores; and executing, in a vehicle, said selected command. - View Dependent Claims (19, 20)
-
-
21. A computer based method for executing a command in a vehicle, comprising the steps of:
-
receiving a voice signal; receiving a gesture signal; performing a voice recognition procedure to generate a first voice recognition (VR) score representing a likelihood that the voice signal corresponds to a first command and to generate a second VR score representing a likelihood that the voice signal corresponds to a second command; performing a gesture recognition procedure to generate a first gesture recognition (GR) score representing a likelihood that the gesture signal corresponds to said first command, and to generate a second GR score representing a likelihood that the gesture signal corresponds to said second command; determining a selected command, said selected command being one of the first command or the second command, based upon said first VR score and said second GR score; and executing, in a vehicle, said selected command. - View Dependent Claims (22, 23, 24, 25, 26, 27)
-
-
28. A non-transitory computer readable medium comprising computer executable code which when executed by a computer performs the steps of:
-
receiving a voice signal; receiving a gesture signal; performing a voice recognition procedure to generate a first voice recognition (VR) score representing a likelihood that the voice signal corresponds to a first command and to generate a second VR score representing a likelihood that the voice signal corresponds to a second command; performing a gesture recognition procedure to generate a first gesture recognition (GR) score representing a likelihood that the gesture signal corresponds to said first command, and to generate a second GR score representing a likelihood that the gesture signal corresponds to said second command; determining a selected command, said selected command being one of the first command or the second command, based upon the first and second VR scores and said first and second GR scores; and executing, in a vehicle, said selected command. - View Dependent Claims (29, 30)
-
-
31. A non-transitory computer readable medium comprising computer executable code which when executed by a computer performs the steps of:
-
receiving a voice signal; receiving a gesture signal; performing a voice recognition procedure to generate a first voice recognition (VR) score representing a likelihood that the voice signal corresponds to a first command and to generate a second VR score representing a likelihood that the voice signal corresponds to a second command; performing a gesture recognition procedure to generate a first gesture recognition (GR) score representing a likelihood that the gesture signal corresponds to said first command, and to generate a second GR score representing a likelihood that the gesture signal corresponds to said second command; determining a selected command, said selected command being one of the first command or the second command, based upon said first VR score and said second GR score; and executing, in a vehicle, said selected command. - View Dependent Claims (32, 33, 34, 35, 36, 37)
-
Specification