SPEECH SUBSTITUTION OF A REAL-TIME MULTIMEDIA PRESENTATION

• US 20120105719A1
• Filed: 10/29/2010
• Published: 05/03/2012
• Est. Priority Date: 10/29/2010
• Status: Abandoned Application

• Current Assignee: LSI Corporation (Broadcom, Inc.)
• Original Assignee: LSI Corporation (Broadcom, Inc.)
• Inventors: Fratti, Roger A., Hollien, Cathy L.
• Application Number:
  US12/915,089
• Publication Number:
  US 20120105719A1
• Time in Patent Office: Days
• US Class Current: 348/462
• CPC Class Codes: H04N 21/8106 involving special audio data, e.g. different tracks for different languages

Abstract

Disclosed are a method, an apparatus and/or system of speech substitution of a real-time multimedia presentation on an output device. In one embodiment, a method includes processing a multimedia signal of a multimedia presentation, using a processor. The multimedia signal includes a video signal and an audio signal, such that the audio signal is substitutable with another audio signal based on a preference of a user. The method also includes substituting the audio signal with another audio signal based on the preference of the user. Additionally, the method includes permitting a selection of a voice profile during a real-time event based on a response to a request through a client device of the user.

Claims

1. A method comprising:

processing a multimedia signal of a multimedia presentation, using a processor, wherein the multimedia signal comprises a video signal and an audio signal, such that the audio signal is substitutable with another audio signal based on a preference of a user;

substituting the audio signal with the another audio signal based on the preference of the user;

permitting a selection of a voice profile during a real-time event based on a response to a request through a client device of the user;

creating the another audio signal based on the voice profile, wherein the voice profile is selected by the user;

delaying an output of the video signal to an output device of the user such that the video signal is synchronized with the another audio signal; and

processing the video signal and the another audio signal based on the voice profile such that the multimedia presentation is created based on the preference of the user.

2. The method of claim 1 wherein:

the voice profile is a voice font that has been programmed;

the voice font comprises a library of a speech; and

the library of the speech comprises at least one of a canned speech, a part of the speech of an individual of the voice profile, the speech of an impersonator of the individual of the voice profile, and the speech of a live commentator.

3. The method of claim 2 further comprising:

creating a text file based on the audio signal through a transcription of the speech of the audio signal;

creating the another audio signal based on the text file and the voice profile; and

substituting the audio signal with the another audio signal such that the audio signal is replaced with the another audio signal.

4. The method of claim 3 further comprising:

buffering the video signal such that the video signal is delayed;

delaying the video signal such that a conversion of the audio signal to the text file and the conversion of the text file to the another audio signal is completed during a delay of the video signal; and

synchronizing the another audio signal and the video through a delay of the video signal such that the another audio signal is matched with the video signal.

5. The method of claim 4 further comprising:

processing the audio signal such that a background noise is reduced; and

reducing the background noise such that a quality of the speech is increased.

6. The method of claim 5 further comprising:

creating the another audio signal based on the voice profile from the library of the speech, wherein the speech is one of a commentator speech, a celebrity speech, a foreign language speech, an impersonator speech, and a newscaster speech.

7. The method of claim 6 further comprising:

separating the audio signal and the video signal from the multimedia signal;

extracting the speech from the audio signal; and

coupling the another audio signal and the video signal such that the another audio signal and the video signal are synchronized.

8. The method of claim 7:

wherein the real-time event is a sporting event;

wherein the video signal is an image of the sporting event;

wherein the audio signal is the speech of a commentator of the sporting event;

wherein the another audio signal is the speech of another commentator;

wherein the speech of the another commentator is based on the voice profile; and

wherein the voice profile is based on the selection of the user.

9. The method of claim 7 further comprising:

translating the text file into a foreign language when the voice profile that is selected is a foreign language speaker; and

creating the another audio signal comprising the foreign language speech.

10. The method of claim 1 in the form of a machine-readable medium embodying a set of instructions that, when executed by a machine, cause the machine to perform the method of claim 1.

11. A method comprising:

obtaining video data together with first audio data, the first audio data including original speech data;

converting the original speech data to text data;

using a processor and without human intervention,

converting the text data to user-selected speech data,

combining a video data together with the user-selected speech data, and

providing the video data together with second audio data to be presented to a user, the second audio data including the user-selected speech data in place of the original speech data.

12. The method of claim 11, wherein:

the converting of the text data to the user-selected speech data includes obtaining a speech identifier from the user and using the speech identifier to convert the text data to the user-selected speech data.

13. The method of claim 12, wherein:

the speech identifier identifies at least one a user-selected person, a user-selected character, a user-selected accent, and a user-selected language, and wherein the user-selected speech data includes a vocalization of the text data characterized by the at least one of the user-selected person, the user-selected character, the user-selected accent, and the user-selected language.

14. The method of claim 13, wherein:

the converting of the original speech data to the text data includes transcribing the original speech data into transcription data, and the converting of the text data to the user-selected speech data includes

accessing a plurality of digital audio files associated with the at least one of the user-selected person, the user-selected character, the user-selected accent, and the user-selected language and the text data

arranging the plurality of digital audio files in a user selected speech data based on the transcription data.

15. The method of claim 11, wherein:

the converting of the original speech data to the text data includes processing the first audio data to isolate background noise from the original speech data so as to minimize error in a conversion of the original speech data to the text data.

16. The method of claim 11, wherein:

the combining of the video data together with the user-selected speech data is preceded by buffering the video data while converting the original speech data to the text data and converting the text data to the user-selected speech data.

17. A system comprising:

an output device to display a multimedia presentation;

a processor to process a multimedia signal of the multimedia presentation, wherein the multimedia signal comprises a video signal and an audio signal, such that the audio signal is substituted with another audio signal based on a preference of a user; and

a client device to permit a selection of a voice profile during a real-time event such that the another audio signal is based on the voice profile.

18. The system of claim 17 wherein:

the processor to substitute the audio signal with the another audio signal based on the preference of the user.

19. The system of claim 18 wherein:

the processor to delay an output of the video signal to the output device of the user such that the video signal is synchronized with the another audio signal.

20. The system of claim 19 wherein:

the processor to process the video signal and the another audio signal based on the voice profile such that the multimedia presentation is created based on the preference of the user.