System and method for handling a spoken user request

• US 9,916,831 B2
• Filed: 12/01/2014
• Issued: 03/13/2018
• Est. Priority Date: 05/30/2014
• Status: Active Grant

• Current Assignee: Direct Cursus Technology LLC
• Original Assignee: Yandex Europe AG (Yandex N.V.)
• Inventors: Panin, Alexander Gennadievich
• Primary Examiner(s): MCFADDEN, SUSAN IRIS
• Application Number:
  US15/109,729
• Publication Number:
  US 20160379636A1
• Time in Patent Office: 1,198 Days
• Field of Search: 704235
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence
• CPC Class Codes: G10L 15/32 Multiple recognisers used in sequence or in parallel; Score combination systems therefor, e.g. voting systems
• CPC Class Codes: G10L 2015/223 Execution procedure of a spoken command
• CPC Class Codes: H04M 11/10 with dictation recording and playback systems

Abstract

A method and an electronic device for handling a spoken user request of a user, executable by each one of at least two applications installed on the electronic device, comprising determining that the spoken user request corresponds to an action executable by an other one of the at least two of the applications; and causing execution of the action by the other one of the at least two of the applications. A method and an electronic device for handling a spoken user request received from a user of the electronic device, comprising detecting reception of a spoken user request by a first application; transferring the spoken user request to the second application by the first application; determining, by the second application, that the spoken user request corresponds to an action executable by a third application; and causing, by the second application, execution of the action by the third application.

Claims

1. A computer-implemented method for handling a spoken user request received from a user of an electronic device comprising a processor configured to execute applications, the method executable by each one of at least two of the applications, each one of the at least two applications executing a speech-to-text instructions module on the electronic device, each one of the two applications aware of actions executable by others of the at least two of the applications, the method comprising:

processing, by a first speech-to-text module of one of the at least two of the applications of the electronic device, an audio representation of the spoken user request to obtain a first text representation of the spoken user request;

determining by the first speech-to-text module of one of the at least two of the applications of the electronic device, based on its awareness of actions executable by others of the at least two of the applications that the first text representation of the spoken user request corresponds to an action better suited to be executable by an other one of the at least two of the applications;

transferring at least part of the first text representation of the spoken user request to the other one of the at least two of the applications by the one of the at least two of the applications, the at least part of the first text representation of the spoken user request comprising an audio representation of the spoken user request;

processing, by a second speech-to-text module of the other one of the at least two of the applications the at least part of the first text representation of the spoken user request comprising the audio representation of the spoken user request to obtain a second text representation of the spoken user request;

determining, by the second speech-to-text module of the other one of the at least two of the application, that the second text representation of the spoken user request corresponds to the action; and

causing execution of the action by the other one of the at least two of the applications.

2. The method of claim 1, wherein said causing processing of the audio representation of the spoken user request to obtain the first text representation and the second text representation of the spoken user request comprises causing execution of speech-to-text program instructions included in a software library installed on the electronic device.

3. An electronic device for handling a spoken user request received from a user, the electronic device comprising:

a processor; and

a memory operatively coupled to the processor and storing applications, each one of at least two of the applications comprising a speech-to-text instructions module on the electronic device, each one of the two applications aware of actions executable by others of the at least two of the applications and each one of the two applications comprising program instructions executable by the processor to cause the processor to;

process, using a first speech-to-text module of one of the at least two of the applications of the electronic device, an audio representation of the spoken user request to obtain a first text representation of the spoken user request;

determine, using the first speech-to-text module of one of the at least two of the applications of the electronic device, based on its awareness of actions executable by others of the at least two of the applications, that the first text representation of the spoken user request corresponds to an action better suited to be executable by another one of the at least two applications;

transfer at least part of the first text representation of the spoken user request to the other one of the at least two of the applications using the one of the at least two of the applications, the spoken user request comprising an audio representation of the spoken user request;

process, using a second speech-to-text module of the other one of the at least two of the applications, the at least part of the first text representation of the spoken user request comprising the audio representation of the spoken user request to obtain a second text representation of the spoken user request;

determine, using the second speech-to-text module of the other one of the at least two of the applications that the second text representation of the spoken user request corresponds to the action; and

cause execution of the action using the other one of the at least two applications.

4. A computer-implemented method for handling a spoken user request received from a user of an electronic device comprising a processor configured to execute applications, each one of at least three applications executing a speech-to-text instructions module on the electronic device, each one of the three applications aware of actions executable by other of the at least three of the applications, the method comprising:

detecting reception of an audio representation of the spoken user request by a first application;

determining, by the first application, that the spoken user request corresponds to an action better suited to be handled by a second application;

transferring the spoken user request comprising an audio representation of the spoken user request to the second application by the first application;

processing, by the second application, the audio representation of the spoken user request to obtain a text representation of the spoken user request;

determining, by a second speech-to-text module of the second application, based on its awareness of actions executable by others of the applications, that the spoken user request comprising the audio representation of the spoken user request corresponds to an action better suited to be executable by a third application;

transferring at least part of the text representation of the spoken user request to the third application, the at least part of the text representation of the spoken user request comprising the audio representation of the spoken user request;

determining, by the third speech-to-text module of the third application, that the spoken user request corresponds to the action; and

causing execution of the action by the third application.

5. The method of claim 4, wherein the first application and the third application are a same application.

6. The method of claim 4, wherein the third application is an application other than the first application.