Sign language editing apparatus

• US 5,990,878 A
• Filed: 05/16/1996
• Issued: 11/23/1999
• Est. Priority Date: 05/18/1995
• Status: Expired due to Fees

• Current Assignee: Hitachi, Ltd.
• Original Assignee: Hitachi, Ltd.
• Inventors: Sagawa, Hirohiko, Sakiyama, Tomoko, Ikeda, Hisashi, Kaneko, Youichi, Ohki, Masaru
• Primary Examiner(s): Zimmerman, Mark K.
• Assistant Examiner(s): GOOD JOHNSON, MOTILEWA
• Application Number:
  US08/648,703
• Time in Patent Office: 1,286 Days
• Field of Search: 345/156, 345/122, 345/473-475, 345/302, 395/173-175, 395/806, 395/807, 395/949-960, 395/753, 707/532
• US Class Current: 715/236
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/014 Hand-worn input/output arrangements, e.g. data gloves
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06T 13/00 Animation
• CPC Class Codes: G06T 2200/24 involving graphical user interfaces [GUIs]
• CPC Class Codes: G09B 21/009 Teaching or communicating with deaf persons G09B21/04 takes precedence; deaf and dumb persons G09B21/00

Abstract

A sign language editing apparatus includes a glove-type sensor for converting movement of fingers in the sign language into an electrical signal to produce time series data of sign language words, a sign language word data editing device for adding predetermined additional data to the time series data inputted from the glove-type sensor to process the time series data, a sign language word dictionary for storing the time series data of sign language words processed by the sign language word data editing device, a sign language sentence data editing device for reading out the time series data of sign language words stored in the sign language word dictionary in accordance with the predetermined characters inputted from the input unit and adding predetermined additional information to the time series data of sign language words to produce time series data of sign language sentence, a sign language animation synthesizing device inputted with the time series data of sign language sentence produced by the sign language sentence data editing device to produce sign language animation expressing movement of the sign language, and a display unit for displaying the sign language animation produced by the sign language animation synthesizing device.

Claims

1. A sign language animation editing apparatus comprising:

a glove-type sensor for converting hand movement of in the sign language into an electrical signal to produce sign language word data which is a time series of n-dimensional vectors including data of finger shapes, hand directions and hand positions;

a sign language word data editing device for adding additional data to the sign language word data inputted from said glove-type sensor to generate sign language word animation data;

a sign language word dictionary for storing said sign language words animation data generated by said sign language word data editing device;

input means for inputting predetermined characters and operations corresponding to the apparatus;

a sign language sentence data editing device for reading out said sign language word animation data to generate sign language sentence animation data by correcting and adding predetermined additional information;

a sign language animation synthesizing device for generating sign language animation; and

a display unit for displaying the sign language animation produced by said sign language synthesizing device.

2. A sign language animation editing apparatus according to claim 1, further comprising a sign language sentence dictionary for storing said sign language sentence animation data generated by said sign language sentence data editing device and wherein said sign language sentence data editing apparatus reads out sign language sentence animation data stored in said sign language sentence dictionary to produce a new sign language animation data when generating a sign language sentence in accordance with characters inputted from said input means.

3. A sign language animation editing apparatus according to claim 1, wherein an output of said sign language word data editing device is connected to said sign language animation synthesizing device so that animation of the sign language word animation data produced by said sign language word data editing device is carried out on said display unit.

4. A sign language animation editing apparatus according to claim 1, wherein said sign language word data editing device includes:

means for performing fine correction with respect to position of hands, direction of hands, shape of fingers and position of elbow to the sign language word data in accordance with instructions inputted from said input means so that hand movement is corrected to be able to view the hand movement naturally as the sign language,

means for reading out one or more registered sign language word data,

means for adding non-manual information in accordance with instructions inputted from said input means to said read-out sign language word data to produce the sign language animation word data, and

means for storing said sign language word animation data in said sign language word dictionary.

5. A sign language animation editing apparatus according to claim 4, wherein said non-manual information includes the shape of mouth, expression and gesture.

6. A sign language animation editing apparatus according to claim 5, comprising:

means for reading out the sign language word animation data stored in said sign language word dictionary to combine in accordance with sign language word animation data inputted from said input means;

means for carrying out correction and addition of information of hand movement and non-manual information varied according to sentence, concerned with any one of each sign language word among combined animation data, or over a plurality of sign language words, or a part of sign language word, according to operations inputted from said input means; and

means for displaying the information of hand movement or non-manual information corrected or added on a display as the sign language animation in real time, and for carrying out correction or addition of hand movement or non-manual information interactively with reference to displayed sign language animation.

7. A sign language animation editing apparatus according to claim 6, wherein said means for preparing the sign language sentence animation data adds the mouth shape, the expression and the gesture over a plurality of sign language animation word data when the sign language sentence animation data is expressed exactly in accordance with the instructions inputted by said input means.

8. A sign language animation editing apparatus according to claim 6, wherein said sign language sentence editing device changes hand movement continuously smoothly in accordance with time range concerned with sign language word animation data and instructions of correcting method of hand movement inputted by said input means.

9. A sign language animation editing apparatus according to claim 6, wherein said sign language sentence data editing device changes sign language sentence animation data and instructions of selecting hand movement or non-manual information which is the object of the change inputted by said input means.

10. A sign language animation editing apparatus according to claim 6, comprising means for inserting a pause between the sign language word animation data in accordance with designation of a mark representative of a pause between the sign language words and a length thereof inputted from said input means to intonate the animation expressing the sign language.

11. A sign language animation editing apparatus according to claim 6, comprising means to change a size of space occupied by loci of the hand movement in animation data in accordance with the designated expansion and contraction ratio and a time range in sign language word animation data or sign language sentence animation data inputted from said input means.

12. A sign language animation editing apparatus according to claim 5, said sign language word data editing device and sign language sentence data editing device add the data concerning the shape of mouth to the sign language word animation data or sign language sentence animation data by selecting the data concerning the shape of mouth from previously registered samples in accordance with instructions by said input means.

13. A sign language animation editing apparatus according to claim 12, wherein said sign language word data editing device and sign language sentence date editing device can add the mouth shape data to the head of time range of each sign language word animation data or plurality of sign language word animation data, the whole time range uniformly, the middle of the time range or the end of the time range.

14. A sign language animation editing apparatus according to claim 5, wherein said sign language word data editing device and sign language sentence data editing device add the data concerning facial expression to the sign language word animation data or sign language sentence animation data by selecting the data concerning facial expression from previously registered samples in accordance with instructions inputted from said input means.

15. A sign language animation editing apparatus according to claim 5, wherein said sign language word data editing device and sign language sentence data editing device add the data concerning non-manual gesture like head movement to the sign language word animation data or sign language sentence animation data by selecting the data concerning non-manual gesture from previously registered samples in accordance with instructions inputted from said input means.