Conversational interface agent
First Claim
Patent Images
1. A computer readable medium having instructions, which when executed on a computer provide a user interface, the instructions comprising:
- a speech synthesizer receiving input for synthesis and providing an audio output signal; and
a video rendering module receiving information related to the audio output signal, the video rendering module rendering a representation of a talking head having a talking state with mouth movements in accordance with the audio output signal and a waiting state with movements in accordance with listening, and wherein the video rendering module renders a sequence of video frames having the talking head, and wherein the video rendering module also transforms affine parameters to physical movements of the talking head for each frame.
1 Assignment
0 Petitions
Accused Products
Abstract
A video rewrite technique for rendering a talking head or agent completely simulates a conversation by including a waiting or listening state. Smooth transitions are provided to and from a talking state.
-
Citations
23 Claims
-
1. A computer readable medium having instructions, which when executed on a computer provide a user interface, the instructions comprising:
-
a speech synthesizer receiving input for synthesis and providing an audio output signal; and
a video rendering module receiving information related to the audio output signal, the video rendering module rendering a representation of a talking head having a talking state with mouth movements in accordance with the audio output signal and a waiting state with movements in accordance with listening, and wherein the video rendering module renders a sequence of video frames having the talking head, and wherein the video rendering module also transforms affine parameters to physical movements of the talking head for each frame. - View Dependent Claims (3, 5, 7, 8, 9, 11, 13, 14, 15)
-
-
2. (canceled)
-
4. (canceled)
-
6. (canceled)
-
10. (canceled)
-
12. (canceled)
-
16. (canceled)
-
17. A computer-implemented method for generating a talking head on a computer display to simulate a conversation, the method comprising:
-
continuously rendering a sequence of video frames of a talking head with each frame having mouth characteristics indicative of a non-talking state;
tracking movements of the talking head throughout the sequence of video frames;
outputting a voice audio;
selectively adding a corresponding mouth position to selected frames of the video sequence as a function of the voice audio and tracked movements of the talking head; and
wherein tracking movements includes transforming affine parameters to physical movements of the talking head for each frame.
-
- 18. (canceled)
-
19. (canceled)
-
23. (canceled)
Specification