Dynamic speech recognition and transcription among users having heterogeneous protocols

• US 8,498,871 B2
• Filed: 05/24/2011
• Issued: 07/30/2013
• Est. Priority Date: 11/27/2001
• Status: Expired due to Term

• Current Assignee: Advanced Voice Recognition Systems, Inc.
• Original Assignee: Advanced Voice Recognition Systems, Inc.
• Inventors: Miglietta, Joseph H., Davis, Michael K.
• Primary Examiner(s): Chawan, Vijay B
• Application Number:
  US13/115,105
• Publication Number:
  US 20110224981A1
• Time in Patent Office: 798 Days
• Field of Search: 704/235, 704/270, 704/270.1, 704/9, 704/243, 704/254, 704/10, 704/272, 704/252, 704/257, 709/228, 709/230, 719/328
• US Class Current: 704/270.1
• CPC Class Codes: G06F 16/685 using automatically derived transcript of audio data, e.g. lyrics speech recognition G10L15/00
• CPC Class Codes: G06F 40/40 Processing or translation of natural language natural language analysis G06F40/20; semantic analysis G06F40/30
• CPC Class Codes: G10L 15/20 Speech recognition techniques specially adapted for robustness in adverse environments, e.g. in noise, of stress induced speech G10L21/02 takes precedence
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence
• CPC Class Codes: G10L 15/30 Distributed recognition, e.g. in client-server systems, for mobile phones or network applications
• CPC Class Codes: H04M 3/4938 comprising a voice browser which renders and interprets, e.g. VoiceXML

Abstract

A system for facilitating free form dictation, including directed dictation and constrained recognition and/or structured transcription among users having heterogeneous protocols for generating, transcribing, and exchanging recognized and transcribed speech. The system includes a system transaction manager having a “system protocol,” to receive a speech information request from an authorized user. The speech information request is generated using a user interface capable of bi-directional communication with the system transaction manager and supporting dictation applications. A speech recognition and/or transcription engine (ASR), in communication with the systems transaction manager, receives the speech information request generates a transcribed response, and transmits the response to the system transaction manager. The system transaction manager routes the response to one or more of the users. In another embodiment, the system employs a virtual sound driver for streaming free form dictation to any ASR.

Claims

1. A system for facilitating free form dictation and constrained speech recognition and/or structured transcription among users having heterogeneous system protocols the system comprising:

at least one system transaction manager using a uniform system protocol, adapted to receive a verified streamed speech information request from at least one user employing a first user legacy protocol, and configured to route a response to one or more users employing a second user legacy protocol, the speech information request comprised of free form dictation of spoken text and commands and the response comprised of a transcription of spoken text;

a user interface capable of bi-directional communication with the system transaction manager and supporting dictation applications, including prompts to direct user dictation in response to user system protocol commands and system transaction manager commands the user interface being in bi-directional communication with the systems transaction manager; and

,

at least one speech recognition and/or transcription engine communicating with the system systems transaction manager wherein the speech recognition and/or transcription engine is configured to receive the speech information request containing spoken text and commands for constrained speech recognition transmitted by the systems transaction manager, to generate structured transcription in response to the speech information request, and to transmit the response comprised of structured transcription to the system transaction manager.

2. The system of claim 1 further comprising an application service adapter configured to provide bi-directional translation between the first user legacy protocol and the uniform system protocol and between the second user legacy protocol and the uniform system protocol.

3. The system of claim 1 further comprising a buffer in communication with the system transaction manager for receiving selected portions of the speech information request and retaining such portions in response to embedded and systems transaction manager commands and for transmitting the retained portions to a system component, including the speech recognition and/or transcription engine on command.

4. The system of claim 1 further comprising a virtual sound driver in communication with the systems transaction manager and the speech recognition and/or transcription engine for streaming a free form dictation speech information request to the speech recognition and/or transcription engine wherein the virtual sound driver outputs the speech information request in a data format, which compatible with the speech recognition and/or transcription engine input format, regardless of the actual originating source format.

5. The system of claim 1 wherein said first user legacy protocol is the same as or different than the second user legacy protocol.

6. The system of claim 1 wherein the speech information request comprises previously transcribed formatted spoken text.

7. The system of claim 1 wherein the free form dictation is directed dictation and the dictation applications, including prompts, are administered and directed by the system.

8. The system of claim 1 wherein the application service adapter includes (i) a first user application service adapter, the first user application service adapter communicating with the at least one of the users that employ the first user legacy protocol and with the systems transaction manager, and (ii) a second user application service adapter, the second user application service adapter communicating with the one or more users that employ the second user legacy protocol and with the systems transaction manager, and providing the one or more users with the response.

9. A system for facilitating directed dictation and constrained speech recognition and/or structured transcription among users having heterogeneous system protocols the system comprising:

at least one system transaction manager using a uniform system protocol, adapted to receive a verified streamed speech information request from at least one user employing a first user legacy protocol, and configured to route a response to one or more users employing a second user legacy protocol, the speech information request comprised of free form dictation of spoken text and commands and the response comprised of a transcription of spoken text;

a user interface capable of bi-directional communication with the system transaction manager and supporting dictation applications, including prompts to direct user dictation in response to user system protocol commands and system transaction manager commands, the user interface being in bi-directional communication with the system transaction manager and wherein the dictation applications including prompts are administered and directed by the system;

at least one speech recognition and/or transcription engine communicating with the system systems transaction manager wherein the speech recognition and/or transcription engine is configured to receive the speech information request containing spoken text and commands for constrained speech recognition transmitted by the systems transaction manager, to generate structured transcription in response to the speech information request, and to transmit the response comprised of structured transcription to the system transaction manager;

at least one buffer in communication with the systems transaction manager for receiving selected portions of the speech information request and retaining such portions in response to embedded and systems transaction manager commands and for transmitting the retained portions to a system component. including the speech recognition and/or transcription engine on command;

a virtual sound driver in communication with the system transaction manager and the speech recognition and/or transcription engine for streaming a free formed dictation speech information request to the speech recognition and/or transcription engine wherein the virtual sound driver outputs the speech information request in a data format which compatible with the speech recognition and/or transcription engine input format;

regardless of the actual originating source format; and

,

an application service adapter configured to provide bi-directional translation between the first user legacy protocol and the uniform system protocol and between the second user legacy protocol and the uniform system protocol.

10. A method of providing transcribed spoken text among users, the method comprising:

generating a speech information request using a user interface device capable of bi-directional communication with the system transaction manager and supporting dictation applications including prompts to direct user dictation in response to user system protocol commands and system transaction manager commands, the user interface being in bi-directional communication with the systems transaction manager wherein the speech information request is comprised of spoken text obtained through a first user legacy protocol;

transmitting the speech information request to a speech recognition and/or transcription engine via a Systems Transaction Manager, the Systems Transaction Manager using a uniform system protocol;

generating a response to the speech information request using the speech recognition and/or transcription engine, the response comprised of a transcription

sending the response to a user via the system transaction manager; and

providing the user with a transcription of the spoken text that is compatible with a second user legacy protocol that is different than the first legacy protocol;

wherein the transmitting step and the sending step includes translating between the first user legacy protocol and the uniform system protocol and between the second user legacy protocol and the uniform system protocol, respectively.

11. The method of claim 10 wherein the transmitting step includes using a buffer in communication with the system transaction manager for receiving selected portions of the speech information request and retaining such portions in response to embedded and systems transaction manager commands and for transmitting the retained portions to a system component, including the speech recognition and/or transcription engine on command.

12. The method of claim 10 wherein the transmitting step includes using a virtual sound driver in communication with the system transaction manager and the speech recognition and/or transcription engine for streaming a free form dictation speech information request to the speech recognition and/or transcription engine wherein the virtual sound driver outputs the speech information request in a data format which is compatible with the speech recognition and/or transcription engine input format, regardless of the actual originating source format.

13. The method of claim 10 wherein the translation is provided by an application service adapter.

14. The method of claim 13 wherein the application service adapter is selected from a user application service adapter, a user service adapter, an speech recognition and/or transcription engine application service adapter, a speech service adapter, and combinations thereof.

15. The method of claim 10 wherein said first user legacy protocol is the same as or different than the second user legacy protocol.

16. The method of claim 10 wherein the speech information request comprises previously transcribed formatted spoken text.

17. The method of claim 10 wherein said first user legacy protocol is the same as or different than the second user legacy protocol.