A/V CONTENT EDITING

• US 20080177536A1
• Filed: 01/24/2007
• Published: 07/24/2008
• Est. Priority Date: 01/24/2007
• Status: Abandoned Application

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Acero, Alex, Nguyen, Patrick, Nelson, Patrick, Mahajan, Milind, Weare, Christopher, Clement, Manuel, Sherwani, Adil
• Application Number:
  US11/626,726
• Publication Number:
  US 20080177536A1
• Time in Patent Office: Days
• US Class Current: 704/235
• CPC Class Codes: G06F 16/685 using automatically derived transcript of audio data, e.g. lyrics speech recognition G10L15/00
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence
• CPC Class Codes: G11B 27/034 on discs G11B27/036, G11B27/038 take precedence
• CPC Class Codes: G11B 27/10 Indexing; Addressing; Timing or synchronising; Measuring tape travel

Abstract

A/V content creation, editing and publishing is disclosed. Speech recognition can be performed on the A/V content to identify words therein and form a transcript of the words. The transcript can be aligned with the associated A/V content and displayed to allow selective editing of the transcript and associated A/V content. Keywords and a summary for the transcript can also be identified for use in publishing the A/V content.

Claims

1. A method, comprising:

accessing audio content that includes speech from at least one person;

recognizing words in the speech and converting the words to text;

displaying the text;

receiving an indication to modify the text that is displayed; and

modifying the audio content as a function of the indication.

2. The method of claim 1 and further comprising:

aligning the text with associated portions of the audio content and identifying word boundaries in the audio content based on the alignment.

3. The method of claim 2 wherein the indication is to remove text and wherein the audio is removed based on the word boundaries.

4. The method of claim 2 wherein the indication is to move text and wherein the audio is moved based on the indication and boundaries.

5. The method of claim 1 and further comprising:

automatically detecting undesirable audio in the audio content.

6. The method of claim 1 and further comprising:

receiving a search request indicative of a word in the text; and

displaying text and text adjacent thereto based on the search request.

7. The method of claim 1 and further comprising:

identifying pauses in the audio content and removing the pauses from the audio content.

8. The method of claim 1 and further comprising:

assembling the audio content and the text in a media file; and

publishing the media file across a computer network.

9. A method, comprising:

accessing audio content that includes speech from at least one person;

recognizing words in the speech and converting the words to text using a speech recognizer;

displaying the text

receiving an indication to edit the text that is displayed;

modifying other portions of the text as a function of the indication; and

editing the audio content as a function of the text.

10. The method of claim 9 and further comprising:

receiving a second indication to edit the text that is displayed; and

modifying the audio content as a function of the second indication.

11. The method of claim 9 and further comprising:

providing a list of potential words for a portion of speech in the audio content based on recognizing words.

12. The method of claim 9 and further comprising:

modifying the speech recognizer based on the indication.

13. The method of claim 9 and further comprising:

receiving a search request corresponding to a word; and

displaying the text and text adjacent to the word.

14. The method of claim 9 and further comprising:

detecting undesirable audio in the audio content.

15. The method of claim 9 and further comprising:

processing the text to identify a keyword and summary as a function of words in the text.

16. A system, comprising:

an audio scene analyzer adapted to access audio content and identify speech contained therein;

a speech recognizer adapted to receive the speech and recognize words from the speech and output a transcript indicative thereof;

a user interface adapted to display the text and receive an indication of modifying the text; and

an editor adapted to receive the indication and edit the audio content based on the indication.

17. The system of claim 16 wherein the speech recognizer is further adapted to identify word boundaries in the speech and align the transcript with the word boundaries.

18. The system of claim 16 wherein the user interface is adapted to display video content and audio waveforms associated with the audio content.

19. The system of claim 16 wherein the editor is adapted to assemble the audio content and transcript into a media file.

20. The system of claim 16 wherein the audio scene analyzer is adapted to separate the speech into multiple speech segments that are processed by the speech recognizer in parallel using multiple processing elements.