Sign language education system and program therefor

• US 20030191779A1
• Filed: 02/26/2003
• Published: 10/09/2003
• Est. Priority Date: 04/05/2002
• Status: Abandoned Application

• Current Assignee: Hitachi, Ltd.
• Original Assignee: Hitachi, Ltd.
• Inventors: Takeuchi, Masaru, Sagawa, Hirohiko
• Application Number:
  US10/372,801
• Publication Number:
  US 20030191779A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G09B 21/00 Teaching, or communicating with, the blind, deaf or mute audible presentation of material to be studied G09B5/04; devices or methods for replacing direct visual or auditory perception by another kind of perception A61F9/08, A61F11/04; audible indication of meter readings or of colour G01D7/12; watches for blind persons G04B25/02; speech analysis, speech recognition G10L; sound-recording or reproducing, per se G11B

Abstract

An effective sign language learning system enables a learner to practice learner'"'"'s sign language acts while sequentially confirming learner'"'"'s sign language acts and model sign language acts one at a time. Two adjacent characteristic points are extracted that each represent an end of an act from sign language act data to produce a model sign language animation image. Two adjacent characteristic points are sensed from input learner'"'"'s act data. The learner'"'"'s sign language act data is compared to the sign language act data to produce the model sign language animation image between the adjacent characteristic points. If the difference between the data is in an acceptable range, similar processing is performed on sign language act data between next adjacent characteristic points. A type of display of the sign language animation image may be changed according to a result of the evaluation.

Claims

1. A program for realizing a sign language education system in a computer that includes means for inputting a sign language learner'"'"'s act information, means for controlling the processing of the input act information, a memory, and a display, the memory having recorded model information comprising information on model sign languages, the program causing the control means to control the steps of:

extracting a first and a second characteristic point each representing an end of an act from the model information;

obtaining the learner'"'"'s act information through the input means, producing a sign language animation image from the act information and displaying the sign language animation image on the display;

producing a sign language animation image from the model information and displaying the sign language animation image on the display;

determining whether or not the act information is at a position of the first characteristic point;

determining whether or not the act information is at a position of the second characteristic point;

calculating a difference in locus between the model information and the act information ranging from the first characteristic point to the second one when the act information is at the position of the second characteristic point; and

continuing the above processing by handling the second characteristic as the first characteristic point and a next characteristic point extracted from the model information as the second characteristic point when the difference in locus is smaller than a predetermined value, and repeating the above processing by using the first and second characteristic points when the difference is greater than the predetermined value.

2. The program according to clam 1, wherein before a flow of all the steps mentioned above, the control means is caused to control the steps of:

inputting sign language learner'"'"'s act information for a plurality of frames from the input means;

calculating an act speed from the inputted act information; and

changing speed parameters of the model information based on the calculated speed.

3. The program according to claim 2, wherein the step of changing the speed parameters of the model information comprises changing the speed parameters so that a speed of the learner'"'"'s act information is greater than a speed of the model information.

4. The program according to clam 1, wherein said step of producing and displaying a sign language animation image from the model information comprises repeatedly displaying the sign language animation image produced from the model information between the first and second characteristic points when the model information is different from the act information between the first characteristic point and the second one by more than a predetermined value.

5. A program for realizing a sign language education system in a computer that comprises a memory, control means for controlling the processing of information to be recorded on the information recording means, and a display, the memory stores a learner'"'"'s act information and model information comprising information on a model sign language,

said program causing the control means to perform the steps of:

accessing the model information and the act information;

calculating a difference between these informations;

determining a type of displaying each frame based on a result of the calculation;

producing a sign language animation image from the model information and the act information; and

displaying the sign language animation image in the determined type of display on the display.

6. The program according to claim 5, wherein:

the memory stores a plurality of comments beforehand; and

said program comprising the steps of;

selecting a comment corresponding to the result of the calculation; and

displaying the selected comment on the display.

7. A sign language education system that includes means for inputting a sign language learner'"'"'s act information, means for controlling the processing of the input act information, a memory, and a display, the memory stores model information comprising information on model sign languages, the control means controlling the steps of:

extracting a first and a second characteristic point each representing an end of an act from the model information;

obtaining the learner'"'"'s act information through the input means, producing a sign language animation image from the act information and displaying the sign language animation image on the display;

producing a sign language animation image from the model information and displaying the sign language animation image on the display;

determining whether or not the act information is at a position of the first characteristic point;

determining whether or not the act information is at a position of the second characteristic point;

calculating a difference in locus between the model information and the act information ranging from the first characteristic point to the second one when the act information is at the position of the second characteristic point; and

continuing the above processing by handling the second characteristic as the first characteristic point and a next characteristic point extracted from the model information as the second characteristic point when the difference in locus is smaller than a predetermined value, and repeating the above processing by using the first and second characteristic points when the difference is greater than the predetermined value.

8. A sign language educational system comprising:

a display;

a memory recording a learner'"'"'s act information and model information comprising information on a model sign language;

means for reading the model information and the act information from the information storage means and calculating a difference between these informations;

means for determining a type of displaying each frame based on a result of the calculation;

means for producing a sign language animation image from the model information and the act information; and

means for displaying the sign language animation image in the determined type of displaying on said display.