Sign language generation apparatus and sign language translation apparatus

• US 5,953,693 A
• Filed: 05/09/1997
• Issued: 09/14/1999
• Est. Priority Date: 02/25/1993
• Status: Expired due to Fees

• Current Assignee: Hitachi, Ltd.
• Original Assignee: Hitachi, Ltd.
• Inventors: Oohira, Eiji, Sagara, Kazuhiko, Sakiyama, Tomoko, Abe, Masahiro, Inoue, Kiyoshi, Obuchi, Yasunari, Sagawa, Hirohiko, Ohki, Masaru, Toda, Yuji
• Primary Examiner(s): Thomas, Joseph
• Application Number:
  US08/854,093
• Time in Patent Office: 858 Days
• Field of Search: 704/3, 704/7, 704/8, 704/10, 704/270, 704/271, 704/275, 434/169, 434/156, 434/159, 434/160, 434/161, 434/167, 707/532, 707/535, 707/536, 345/425, 345/419, 345/326, 345/339, 345/333, 345/473, 345/949, 345/956, 382/100, 340/825.19, 702/153
• US Class Current: 704/3
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G09B 21/009 Teaching or communicating with deaf persons G09B21/04 takes precedence; deaf and dumb persons G09B21/00

Abstract

A sign language interpretation apparatus for performing sign language recognition and sign language generation generates easily read sign language computer graphics (CG) animation by preparing sign language word CG patterns on the basis of actual motion of the hand through the use of a glove type sensor to generate natural sign language CG animation, and by applying correction to the sign language word CG patterns. Further, in the sign language interpretation apparatus, results of translation of inputted sign language or voice language are confirmed and modified easily by the individual input persons, whereby results of translation of the inputted sign language or voice language are displayed in a combined form desired by the user to realize smooth communication. Also, candidates obtained as a result of translation are all displayed and can be selected easily by the input person with a device such as a mouse. Further, when a polysemous word is available, the word is displayed while being changed in its display form, and other expressions are confirmed and modified with the mouse.

Claims

1. A sign language generation apparatus comprising:

sign language word computer graphics pattern storage means for storing sign language words in the form of computer graphics patterns, said sign language words constituting time series data representative of motion of the hand and fingers; and

means for generating a human body model in the form of computer graphics which performs sign language by determining hand position and direction based on said computer graphics patterns of corresponding sign language words from said sign language word computer graphics pattern storage means, and calculating elbow position from said hand position in accordance with constraint conditions determined by said hand position and shoulder position of said human body model.

2. A sign language generation apparatus according to claim 1, wherein said constraint conditions are at least one of the following:

(a) the elbow position lies on a plane containing a position of the hand and positions of the right and left shoulders of a human body model, and (b) the elbow position does not go toward the body beyond a line connecting the position of the shoulder and the position of the hand, and the elbow position is calculated from the hand position.

3. A sign language generation apparatus according to claim 1, further comprising:

a glove type sensor;

means for inputting a voice language;

language processing means for translating an inputted sentence in voice language into a series of sign language words; and

means for displaying said human body model performing sign languages three-dimensionally,

wherein said glove type sensor picks up said time series data representative of motion of the hand and fingers; and

said means for generating a human body model retrieves said computer graphics patterns in accordance with the sign language word series of said language processing means.

4. A sign language generation apparatus according to claim 3,

wherein said sign language computer graphics generating means corrects data indicative of angles of finger joints picked up by said glove type sensor in correspondence to fundamental patterns of the shape of fingers.

5. A sign language generation apparatus according to claim 3, further comprising glove type sensor interface means for sampling time series data, indicative of the position and direction of the hand and angles of finger joints, by an amount for one sign language word effected by a person wearing said glove type sensor, and storing the data in said sign language word computer graphics pattern storage means while applying a title to each sign language word.