Method and apparatus for providing an animated display with translated speech
First Claim
1. A method comprising:
- capturing speech in a first language being uttered by a person having a face;
detecting alteration of at least a part of the face, other than a movement of a mouth, and correlating such alteration to specific words in the speech to provide detected alterations converting the speech into text;
translating the text into a second language that is different from the first language to provide translated speech;
rendering the translated speech audible to provide audiblized translated speech;
while rendering the translated speech audible, substantially synchronously providing a display of at least an animated representation of the face wherein;
the face has a mouth that moves synchronously with the audiblized translated speech; and
the face has at least one other part that is altered synchronously with the detected alteration;
such that the at least animated representation of the face presents a mouth that moves in substantial accord with the audiblized translated speech and at least one part of the face that is altered in substantive accord with facial alterations as evinced by the person when uttering the speech.
4 Assignments
0 Petitions
Accused Products
Abstract
A first language to second language translator (11) converts text comprising a message in a first language into text representing that message in a second language. A text to speech transducer (12) then synthesizes an audiblized version of the text in the second language. An animated display driver (14) creates a corresponding display (15) of an image (16) that includes a mouth (17) that moves appropriately and synchronously with respect to the audiblized second language. In other embodiments, other facial features can be animated as well. Such animation can be random and unrelated to the appearance of the original speaker. Or, such animation can accurately represent at least some alterations to facial features of the original speaker while speaking. In some embodiments, the facial features can be altered by correlating specific detected alterations with specific corresponding substantive content in the original message and the translated text.
193 Citations
15 Claims
-
1. A method comprising:
-
capturing speech in a first language being uttered by a person having a face;
detecting alteration of at least a part of the face, other than a movement of a mouth, and correlating such alteration to specific words in the speech to provide detected alterations converting the speech into text;
translating the text into a second language that is different from the first language to provide translated speech;
rendering the translated speech audible to provide audiblized translated speech;
while rendering the translated speech audible, substantially synchronously providing a display of at least an animated representation of the face wherein;
the face has a mouth that moves synchronously with the audiblized translated speech; and
the face has at least one other part that is altered synchronously with the detected alteration;
such that the at least animated representation of the face presents a mouth that moves in substantial accord with the audiblized translated speech and at least one part of the face that is altered in substantive accord with facial alterations as evinced by the person when uttering the speech. - View Dependent Claims (2, 3, 4, 5, 6, 7)
-
-
8. A method comprising:
-
capturing speech in a first language being uttered by a person having a face;
detecting alteration of at least a part of the face, other than a movement of a mouth, and correlating such alteration to specific words in the speech to provide detected alterations converting the speech into text;
translating the text into a second language that is different from the first language to provide translated speech;
rendering the translated speech audible to provide audiblized translated speech;
while rendering the translated speech audible, providing a display of at least an animated representation of a second face wherein;
the second face has a mouth that moves synchronously with the audiblized translated speech; and
the second face has at least one other part that is altered synchronously with the detected alteration;
such that the animated representation of the second face presents a mouth that moves in substantial accord with the audiblized translated speech and the at least one other part of the second face is altered in substantive accord with facial alterations as evinced by the person when uttering the speech and in correlation to specific words in the audiblized translated speech having substantive content that substantially matches the specific words in the speech to which the facial alterations are correlated. - View Dependent Claims (9, 10, 11, 12, 13, 15)
-
-
14. The method of claim wherein rendering the translated speech audible includes selecting from amongst a plurality of synthesized speech voices.
Specification