Dynamically extending the speech prompts of a multimodal application

• US 8,521,534 B2
• Filed: 09/12/2012
• Issued: 08/27/2013
• Est. Priority Date: 06/24/2009
• Status: Expired due to Fees

• Current Assignee: Nuance Communications, Inc. (Microsoft Corporation)
• Original Assignee: Nuance Communications, Inc. (Microsoft Corporation)
• Inventors: Agapi, Ciprian, Bodin, William K., Cross, Charles W. Jr.
• Primary Examiner(s): Abebe, Daniel D
• Application Number:
  US13/612,014
• Publication Number:
  US 20130018658A1
• Time in Patent Office: 349 Days
• Field of Search: 704/270, 704/275, 715/728
• US Class Current: 704/270
• CPC Class Codes: G10L 13/00 Speech synthesis; Text to speech systems
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: H04M 2201/40 using speech recognition
• CPC Class Codes: H04M 3/42204 Arrangements at the exchange for service or number selection by voice at the terminal H04M1/27

Abstract

A prompt generation engine operates to dynamically extend prompts of a multimodal application. The prompt generation engine receives a media file having a metadata container. The prompt generation engine operates on a multimodal device that supports a voice mode and a non-voice mode for interacting with the multimodal device. The prompt generation engine retrieves from the metadata container a speech prompt related to content stored in the media file for inclusion in the multimodal application. The prompt generation engine modifies the multimodal application to include the speech prompt.

Claims

1. A method of dynamically extending the speech prompts of a multimodal application, the method comprising:

receiving, by a prompt generation engine, a media file having a metadata container, wherein the prompt generation engine operates on a multimodal device that supports a voice mode and a non-voice mode for interacting with the multimodal device;

retrieving, by the prompt generation engine from the metadata container, a speech prompt related to content stored in the media file for inclusion in the multimodal application; and

modifying, by the prompt generation engine, the multimodal application to include the speech prompt.

2. The method of claim 1 wherein retrieving, by the prompt generation engine, from the metadata container a speech prompt related to content stored in the media file for inclusion in the multimodal application further comprises retrieving a text string prompt for execution by a text to speech engine.

3. The method of claim 1 wherein retrieving, by the prompt generation engine, from the metadata container a speech prompt related to content stored in the media file for inclusion in the multimodal application further comprises retrieving an audio prompt to be played by the multimodal device.

4. The method of claim 1 wherein retrieving, by the prompt generation engine, from the metadata container a speech prompt related to content stored in the media file for inclusion in the multimodal application further comprises identifying a tag for prompts in the metadata container.

5. The method of claim 4 wherein identifying a tag for prompts in the metadata container further comprises identifying a frame for prompts in an ID3 container of an MPEG media file.

6. The method of claim 1 wherein modifying, by the prompt generation engine, the multimodal application to include the speech prompt further comprises updating a prompt document with the retrieved speech prompt.

7. A multimodal device that supports multiple modes for interacting with the multimodal device, the multimodal device comprising:

a computer processor;

a computer memory operatively coupled to the computer processor, the computer memory having disposed within it computer program instructions configured to;

receive a media file having a metadata container;

retrieve, from the metadata container, a speech prompt related to content stored in the media file for inclusion in a multimodal application; and

modify the multimodal application to include the speech prompt.

8. The multimodal device of claim 7 wherein computer program instructions configured to retrieve, from the metadata container, a speech prompt related to content stored in the media file for inclusion in the multimodal application further comprise computer program instructions configured to retrieve a text string prompt for execution by a text to speech engine.

9. The multimodal device of claim 7 wherein computer program instructions configured to retrieve, from the metadata container, a speech prompt related to content stored in the media file for inclusion in the multimodal application further comprise computer program instructions configured to retrieve an audio prompt to be played by the multimodal device.

10. The multimodal device of claim 7 wherein computer program instructions configured to retrieve, from the metadata container, a speech prompt related to content stored in the media file for inclusion in the multimodal application further comprise computer program instructions configured to identify a tag for prompts in the metadata container.

11. The multimodal device of claim 10 wherein computer program instructions configured to identify a tag for prompts in the metadata container further comprise computer program instructions configured to identify a frame for prompts in an ID3 container of an MPEG media file.

12. The multimodal device of claim 7 wherein computer program instructions configured to modify the multimodal application to include the speech prompt further comprise computer program instructions configured to update a prompt document with the retrieved speech prompt.

13. A computer program product for dynamically extending speech prompts of a multimodal application, the computer program product comprising:

a recordable media having computer program instructions stored therein, the computer program instructions configured to;

receive a media file having a metadata container;

retrieve, from the metadata container, a speech prompt related to content stored in the media file for inclusion in the multimodal application; and

modify the multimodal application to include the speech prompt.

14. The computer program product of claim 13 wherein computer program instructions configured to retrieve, from the metadata container, a speech prompt related to content stored in the media file for inclusion in the multimodal application further comprise computer program instructions configured to retrieve a text string prompt for execution by a text to speech engine.

15. The computer program product of claim 13 wherein computer program instructions configured to retrieve, from the metadata container, a speech prompt related to content stored in the media file for inclusion in the multimodal application further comprise computer program instructions configured to retrieve an audio prompt to be played by the multimodal device.

16. The computer program product of claim 13 wherein computer program instructions configured to retrieve, from the metadata container, a speech prompt related to content stored in the media file for inclusion in the multimodal application further comprise computer program instructions configured to identify a tag for prompts in the metadata container.

17. The computer program product of claim 16 wherein computer program instructions configured to identify a tag for prompts in the metadata container further comprise computer program instructions configured to identify a frame for prompts in an ID3 container of an MPEG media file.

18. The computer program product of claim 13 wherein computer program instructions configured to modify the multimodal application to include the speech prompt further comprise computer program instructions configured to update a prompt document with the retrieved speech prompt.