Enhancing media playback with speech recognition

• US 8,478,592 B2
• Filed: 07/28/2008
• Issued: 07/02/2013
• Est. Priority Date: 07/08/2008
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Nuance Communications, Inc. (Microsoft Corporation)
• Inventors: Patel, Paritosh D.
• Primary Examiner(s): Desir, Pierre-Louis
• Assistant Examiner(s): Sharma, Neeraj
• Application Number:
  US12/180,583
• Publication Number:
  US 20100010814A1
• Time in Patent Office: 1,800 Days
• Field of Search: 704/260, 704/257
• US Class Current: 704/257
• CPC Class Codes: G10L 15/19 Grammatical context, e.g. disambiguation of the recognition hypotheses based on word sequence rules
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G10L 2015/228 of application context

Abstract

A method for enhancing a media file to enable speech-recognition of spoken navigation commands can be provided. The method can include receiving a plurality of textual items based on subject matter of the media file and generating a grammar for each textual item, thereby generating a plurality of grammars for use by a speech recognition engine. The method can further include associating a time stamp with each grammar, wherein a time stamp indicates a location in the media file of a textual item corresponding with a grammar. The method can further include associating the plurality of grammars with the media file, such that speech recognized by the speech recognition engine is associated with a corresponding location in the media file.

Claims

1. A method for enhancing a media file to enable speech-recognition of spoken navigation commands, comprising:

receiving a plurality of textual items relating to the subject matter of the media file;

generating at least one grammar comprising one or more grammar entries, wherein the one or more grammar entries comprise grammar entries that are generated for at least some of the plurality of the textual items, and comprise a word or word sequence recognizable by a speech recognition engine;

for each of the grammar entries corresponding to content in the media file, determining one or more time stamps for the grammar entry, each time stamp indicating a location in the media file of content corresponding to the grammar entry; and

via a computer processor, locating content in the media file during playback of the media file by

(a) receiving speech input from a user,

(b) recognizing the speech input using the speech recognition engine and the at least one grammar to produce a speech recognition result corresponding at least in part to a recognized grammar entry of the at least one grammar, and

(c) identifying one or more locations in the media file by identifying the one or more time stamps determined for the recognized grammar entry and the current time position of the media file at playback when the user input is received, wherein upon identifying the location in the media file a media controller navigates to the time stamp identified and presents the media file to the user at the identified timestamp location.

2. The method of claim 1, wherein the step of receiving a plurality of textual items further comprises:

receiving textual data provided by a computer via a data connection and generating a plurality of textual items based on the textual data.

3. The method of claim 1, wherein the step of receiving a plurality of textual items further comprises:

receiving textual data provided by a user via a user input device and generating a plurality of textual items based on the textual data.

4. The method of claim 3, wherein the step of receiving a plurality of textual items further comprises:

receiving textual data that has been organized into categories based on content of the textual items.

5. The method of claim 1, further comprising:

storing the at least one grammar and the media file on removable media.

6. The method of claim 1, further comprising:

storing the at least one grammar in a remote location on a network;

embedding a link in a media file to the remote location of the at least one grammar; and

storing the media file on removable media.

7. A non-transitory computer-readable storage medium storing computer usable program code for enhancing a media file to enable speech-recognition of spoken navigation commands, comprising:

computer usable program code for receiving a plurality of textual items relating to the subject matter of the media file;

computer usable program code for generating at least one grammar one or more grammar entries, wherein the one or more grammar entries comprise grammar entries that are generated for at least some of the plurality of the textual items and comprise a word or word sequence recognizable by a speech recognition engine;

computer usable program code for, for each of the grammar entries corresponding to content in the media file, determining one or more time stamps for the grammar entry, each time stamp indicating a location in the media file of content corresponding to the grammar entry; and

computer usable program code for locating content in the media file during playback of the media file by

(a) receiving speech input from a user,

(b) recognizing the speech input using the speech recognition engine and the at least one grammar to produce a speech recognition result corresponding at least in part to a recognized grammar entry of the at least one grammar, and

(c) identifying one or more locations in the media file by identifying the one or more time stamps determined for the recognized grammar entry and the current time position of the media file at playback when the user input is received, wherein upon identifying the location in the media file a media controller navigates to the time stamp identified and presents the media file to the user at the identified timestamp location.

8. The non-transitory computer-readable storage medium of claim 7, wherein the computer usable program code for receiving a plurality of textual items further comprises:

computer usable program code for receiving textual data provided by a computer via a data connection and generating a plurality of textual items based on the textual data.

9. The non-transitory computer-readable storage medium of claim 7, wherein the computer usable program code for receiving a plurality of textual items further comprises:

computer usable program code for receiving textual data provided by a user via a user input device and generating a plurality of textual items based on the textual data.

10. The non-transitory computer-readable storage medium of claim 9, wherein the computer usable program code for receiving a plurality of textual items further comprises:

computer usable program code for receiving textual data that has been organized into categories based on content of the textual items.

11. The non-transitory computer-readable storage medium of claim 7, further comprising:

computer usable program code for storing the at least one grammar and the media file on removable media.

12. The non-transitory computer-readable storage medium of claim 7, further comprising:

computer usable program code for storing the at least one grammar in a remote location on a network;

computer usable program code for embedding a link in a media file to the remote location of the at least one grammar; and

computer usable program code for storing the media file on removable media.

13. A computer system for enhancing a media file to enable speech-recognition of spoken navigation commands, comprising:

a processor configured for;

receiving a plurality of textual items relating to the subject matter of the media file;

generating at least one grammar comprising one or more grammar entries, wherein the one or more grammar entries comprise grammar entries that are generated for at least some of the plurality of the textual items and comprise word or word sequence recognizable by a speech recognition engine;

receiving speech input from a user; and

recognizing the speech input using the speech recognition engine and the at least one grammar to produce a speech recognition result corresponding at least in part to a recognized grammar entry of the at least one grammar; and

a repository for storing;

a grammar file including the at least one grammar, wherein one or more time stamps are determined for each of the grammar entries that correspond to content in the media file, and wherein each time stamp indicates a location in the media file of content corresponding to the grammar entry; and

a link for locating content in the media file during playback of the media file by identifying one or more locations in the media file by identifying the one or more time stamps determined for the selected recognized grammar entry and the current time position of the media file at playback when the user input is received, wherein upon identifying the location in the media file a media controller navigates to the time stamp identified and presents the media file to the user at the identified timestamp location.

14. The computer system of claim 13, wherein each textual item comprises text describing events of the media file.

15. The computer system of claim 14, wherein the media file comprises a video file.

16. The computer system of claim 15, wherein a time stamp includes an hour, minute and second indicator.

17. The computer system of claim 13, further comprising removable media for storing the grammar file and the media file.

18. The computer system of claim 13, further comprising removable media for storing the media file including a link to a remote location of the grammar file.