Method of providing sign language animation to a monitor and process therefor
First Claim
1. A method of displaying, on a monitor having a display screen, a sign language animation of a speech component of an audio/video signal while simultaneously displaying, on the monitor display screen, a visual image corresponding to a video component of the audio/video signal, comprising the steps of:
- mapping the speech component to a sign language animation model to generate animation model parameters corresponding to sign language images;
generating an animation signal from said animation model parameters by using a processor connected to the monitor; and
rendering, from said animation signal, an animation image on a portion of the monitor, said animation image containing sign language gestures corresponding to the speech component of the audio/video signal.
2 Assignments
0 Petitions
Accused Products
Abstract
A system and method for generating an animation video signal of sign language gestures corresponding to words in an audio/video signal for display on a monitor screen. A speech component is isolated from the audio/video signal and the spoken words in the speech signal are recognized. The spoken words are then used to identify sign language gestures which are mapped onto an animation model for generating an animation signal. The animation signal is used to animate a character icon stored in the monitor to display sign language gestures corresponding to the words of the speech signal.
-
Citations
24 Claims
-
1. A method of displaying, on a monitor having a display screen, a sign language animation of a speech component of an audio/video signal while simultaneously displaying, on the monitor display screen, a visual image corresponding to a video component of the audio/video signal, comprising the steps of:
-
mapping the speech component to a sign language animation model to generate animation model parameters corresponding to sign language images;
generating an animation signal from said animation model parameters by using a processor connected to the monitor; and
rendering, from said animation signal, an animation image on a portion of the monitor, said animation image containing sign language gestures corresponding to the speech component of the audio/video signal. - View Dependent Claims (3, 4, 5, 6, 7, 8, 9, 10)
-
-
2. The method of claim 2, further comprising the step of receiving, before performing said mapping step, the audio/video signal at the monitor, and isolating the speech component from the audio/video signal, wherein said isolating step is performed by the processor.
-
11. A method of displaying, on a monitor having a display screen, a sign language animation of a speech component of an audio/video signal while simultaneously displaying, on the monitor display screen, a visual image corresponding to a video component of the audio/video signal, comprising the steps of:
-
isolating the speech component from an audio component of the audio/video signal;
identifying words represented by the isolated speech component;
mapping the identified words to a sign language animation model to generate animation model parameters corresponding to sign language images;
transmitting the audio/video signal and the animation model parameters to the monitor;
receiving the transmitted audio/video signal at the monitor;
generating an animation signal from said animation model parameters by using a processor connected to the monitor;
displaying a video component of the audio/video signal on the monitor display screen; and
rendering, from said animation signal, an animation image on a portion of the monitor display screen, said animation image containing sign language gestures corresponding to the speech component of the audio/video signal. - View Dependent Claims (12, 13, 14, 15, 16, 18, 19, 20, 21)
-
-
17. A system for producing an animation image on a monitor display screen to display, to a viewer of the monitor, sign language gestures corresponding to a speech signal derived from an audio signal component of an audio/video signal, the system comprising:
-
a transmitter for transmitting the audio/video signal to the monitor;
a receiver connected to the monitor for receiving the transmitted signal;
a memory connected to the monitor for storing sign language animation model parameters corresponding to at least one animation character icon;
a processor connected to the receiver and to the memory for isolating the speech signal from the audio signal component of the transmitted audio/video signal, the processor comprising means for identifying words represented by the isolated speech signal and means for mapping the identified words to the sign language animation model parameters for generating an animation signal; and
means for rendering the animation image on the monitor using the animation signal to animate the at least one animation character icon.
-
-
22. A system for producing an animation image on a monitor display screen to display, to a viewer of the monitor, sign language gestures corresponding to a speech signal derived from an audio signal component of an audio/video signal, the system comprising:
-
a transmitter processor for isolating the speech signal from the audio signal component of the audio/video signal, the processor comprising means for identifying words represented by the isolated speech signal and means for mapping the identified words to a sign language animation model for generating animation model parameters corresponding to sign language images;
a transmitter for transmitting the audio/video signal and the animation model parameters to the monitor;
a receiver connected to the monitor for receiving the transmitted signal and animation model parameters;
a memory connected to the monitor for storing an animation model of at least one animation character icon;
a receiver processor for generating an animation signal from the animation model parameters for animating the at least one character icon; and
means for rendering the animation image on the monitor using the animation signal to animate the at least one animation character icon. - View Dependent Claims (23, 24)
-
Specification