Emotion expressing device

• US 20010042057A1
• Filed: 01/24/2001
• Published: 11/15/2001
• Est. Priority Date: 01/25/2000
• Status: Abandoned Application

• Current Assignee: NEC Corporation
• Original Assignee: NEC Corporation
• Inventors: Ikebe, Ryohji, Hirai, Sanae
• Application Number:
  US09/767,686
• Publication Number:
  US 20010042057A1
• Time in Patent Office: Days
• US Class Current: 706/11
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06N 3/004 Artificial life, i.e. computing arrangements simulating life

Abstract

The emotion expressing device comprises an emotion creating device for deciding an emotion, a sound creating device for creating a sound for representing the emotion, an emotional interactive statement creating device for creating words for representing the emotion, a movement creating device for creating a movement for representing the emotion, an expression creating device for creating an expression for representing the emotion, and an expression information integrating device for performing the layout processing and the output synchronization processing in output of the created sound, words, movement, and expression.

Claims

1. An emotion expressing device comprising:

an emotion creating device for deciding and supplying an emotion parameter of an artificial agent;

an expression information integrating device for performing layout processing and output synchronization processing in sound and image output according to a multimedia scenario; and

further comprising at least one of

a sound creating device for creating a sound for representing emotion based on the emotion parameter supplied from said emotion creating device, an emotional interactive statement creating device for creating words for representing emotion based on the emotion parameter, and a movement creating device for creating movements for representing emotion based on the emotion parameter.

2. An emotion expressing device as set forth in

claim 1

, further comprising

an expression creating device for creating an expression for representing emotion based on the emotion parameter supplied from said emotion creating device.

3. An emotion expressing device as set forth in

claim 1

, in which

said sound creating device includes

a sound database for previously storing a plurality of sounds for representing emotions as sound data, and

a sound selecting device for retrieving a sound corresponding to an input emotion parameter from said sound database.

4. An emotion expressing device as set forth in

claim 1

, further comprising

an expression creating device for creating an expression for representing emotion based on the emotion parameter supplied from said emotion creating device, in which

said sound creating device includes

a sound database for previously storing a plurality of sounds for representing emotions as sound data, and

a sound selecting device for retrieving a sound corresponding to an input emotion parameter from said sound database.

5. An emotion expressing device as set forth in

claim 1

, in which

said sound creating device includes

a reference sound database for storing a reference sound to be subjected to waveform processing,

a waveform edit parameter creating device for supplying a waveform edit parameter depending on an input emotion parameter, and

a waveform processing device for performing amplitude envelope processing, pitch envelope processing, and effect processing of a reference sound stored in said sound reference database, according to the waveform edit parameter supplied from said waveform edit parameter creating device.

6. An emotion expressing device as set forth in

claim 1

, further comprising

an expression creating device for creating an expression for representing emotion based on the emotion parameter supplied from said emotion creating device, in which

said sound creating device includes

a reference sound database for storing a reference sound to be subjected to waveform processing,

a waveform edit parameter creating device for supplying a waveform edit parameter depending on an input emotion parameter, and

a waveform processing device for performing amplitude envelope processing, pitch envelope processing, and effect processing of a reference sound stored in said sound reference database, according to the waveform edit parameter supplied from said waveform edit parameter creating device.

7. An emotion expressing device as set forth in

claim 1

, in which

said emotional interactive statement creating device includes at least one of

an emotional word creating device for creating an emotional word corresponding to an input emotion parameter and an interactive statement conversion device for converting an input interactive statement into an emotional interactive statement based on the emotion parameter.

8. An emotion expressing device as set forth in

claim 1

, further comprising

an expression creating device for creating an expression for representing emotion based on the emotion parameter supplied from said emotion creating device, in which

said emotional interactive statement creating device includes at least one of

an emotional word creating device for creating an emotional word corresponding to an input emotion parameter and an interactive statement conversion device for converting an input interactive statement into an emotional interactive statement based on the emotion parameter.

9. An emotion expressing device as set forth in

claim 1

, in which

said emotional interactive statement creating device includes

an emotional word creating device for creating an emotional word corresponding to an input emotion parameter,

an interactive statement conversion device for converting an input interactive statement into an emotional interactive statement based on the emotion parameter, and

a words creating device for creating words in combination of an emotional word supplied from said emotional word creating device and an emotional interactive statement supplied from said interactive statement conversion device.

10. An emotion expressing device as set forth in

claim 1

, further comprising

an expression creating device for creating an expression for representing emotion based on the emotion parameter supplied from said emotion creating device, in which

said emotional interactive statement creating device includes

an emotional word creating device for creating an emotional word corresponding to an input emotion parameter,

an interactive statement conversion device for converting an input interactive statement into an emotional interactive statement based on an emotion parameter, and

a words creating device for creating words in combination of an emotional word supplied from said emotional word creating device and an emotional interactive statement supplied from said interactive statement conversion device.

11. An emotion expressing device as set forth in

claim 1

, in which

said expression information integrating device

receives an emotion parameter, selects a multimedia scenario corresponding to the input emotion parameter from a plurality of multimedia scenarios prepared in advance, and according to the selected multimedia scenario, performs layout processing and output synchronization processing in sound and image output.

12. An emotion expressing device as set forth in

claim 1

, further comprising

an expression creating device for creating an expression for representing emotion based on the emotion parameter supplied from said emotion creating device, in which

said expression information integrating device receives an emotion parameter, selects a multimedia scenario corresponding to the input emotion parameter from a plurality of multimedia scenarios prepared in advance, and according to the selected multimedia scenario, performs layout processing and output synchronization processing in sound and image output.

13. An emotion expressing device as set forth in

claim 1

, comprising

an emotion judging device for judging an emotion included in an input interactive statement and supplying the same as an emotion parameter, instead of said emotion creating device.

14. An emotion expressing device as set forth in

claim 1

, comprising

an emotion judging device for judging an emotion included in an input interactive statement and supplying the same as an emotion parameter, instead of said emotion creating device,

said emotion judging device further including

a keyword extracting device for extracting keywords included in an input interactive statement,

a keyword-emotion parameter correspondence table with each emotion parameter recorded correspondingly to each keyword, and

a keyword-emotion parameter conversion device for supplying an emotion parameter recorded in said keyword-emotion parameter correspondence table correspondingly to a keyword extracted by said keyword extracting device.

15. A computer readable memory for storing an emotion expressing program for expressing emotions of a virtual pseudo creature by controlling a computer,

the emotion expressing program comprising:

a step of performing emotion creating processing for deciding and supplying an emotion parameter of an artificial agent;

a step of performing expression information integrating processing for performing layout processing and output synchronization processing in sound and image output according to a multimedia scenario; and

a step of performing at least one of sound creating processing for creating a sound for representing emotion based on the emotion parameter supplied through said emotion creating processing, emotional interactive statement creating processing for creating words for representing emotion based on the emotion parameter, and movement creating processing for creating movements for representing emotion based on the emotion parameter.

16. A computer readable memory for storing an emotion expressing program as set forth in

claim 15

,

the emotion expressing program comprising

a step of performing expression creating processing for creating an expression for representing emotion based on the emotion parameter supplied through said emotion creating processing.

17. A computer readable memory for storing an emotion expressing program as set forth in

claim 15

,

said sound creating processing of the emotion expressing program includes

sound selecting processing for retrieving a sound corresponding to an input emotion parameter from said sound database which previously stores a plurality of sounds for representing emotions as sound data.

18. A computer readable memory for storing an emotion expressing program as set forth in

claim 15

,

the emotion expressing program comprising

a step of performing expression creating processing for creating an expression for representing emotion based on the emotion parameter supplied through said emotion creating processing,

said sound creating processing including

sound selecting processing for retrieving a sound corresponding to an input emotion parameter from said sound database which previously stores a plurality of sounds for representing emotions as sound data.

19. A computer readable memory for storing an emotion

expressing program as set forth in

claim 15

,

said sound creating processing of the emotion expressing program including

waveform edit parameter creating processing for supplying a waveform edit parameter depending on an input emotion parameter, and

waveform edit processing for performing amplitude envelope processing, pitch envelope processing, and effect processing of a reference sound stored in said sound reference database which stores reference sounds to be subjected to waveform edit, according to the waveform edit parameter supplied through said waveform edit parameter creating processing.

20. A computer readable memory for storing an emotion expressing program as set forth in

claim 15

,

the emotion expressing program comprising

a step of performing expression creating processing for creating an expression for representing emotion based on the emotion parameter supplied through said emotion creating processing,

said sound creating processing of the emotion expressing program including

waveform edit parameter creating processing for supplying a waveform edit parameter depending on an input emotion parameter, and

waveform edit processing for performing amplitude envelope processing, pitch envelope processing, and effect processing of a reference sound stored in said sound reference database which stores reference sounds to be subjected to waveform edit, according to the waveform edit parameter supplied through said waveform edit parameter creating processing.

21. A computer readable memory for storing an emotion expressing program as set forth in

claim 15

,

said emotional interactive statement creating processing of the emotion expressing program including at least one of

emotional word creating processing for creating an emotional word corresponding to an input emotion parameter and interactive statement conversion processing for converting an input interactive statement into an emotional interactive statement based on the emotion parameter.

22. A computer readable memory for storing an emotion expressing program as set forth in

claim 15

,

the emotion expressing program comprising

a step of performing expression creating processing for creating an expression for representing emotion based on the emotion parameter supplied through said emotion creating processing,

said emotional interactive statement creating processing of the emotion expressing program including at least one of

emotional word creating processing for creating an emotional word corresponding to an input emotion parameter and interactive statement conversion processing for converting an input interactive statement into an emotional interactive statement based on the emotion parameter.

23. A computer readable memory for storing an emotion expressing program as set forth in

claim 15

,

said emotional interactive statement creating processing of the emotion expressing program including

emotional word creating processing for creating an emotional word corresponding to an input emotion parameter,

interactive statement conversion processing for converting an input interactive statement into an emotional interactive statement based on the emotion parameter, and

words creating processing for creating words in combination of an emotional word supplied through said emotional word creating processing and an emotional interactive statement supplied through said interactive statement conversion processing.

24. A computer readable memory for storing an emotion expressing program as set forth in

claim 15

,

the emotion expressing program comprising

a step of performing expression creating processing for creating an expression for representing emotion based on the emotion parameter supplied through said emotion creating processing,

said emotional interactive statement creating processing of the emotion expressing program including

emotional word creating processing for creating an emotional word corresponding to an input emotion parameter,

interactive statement conversion processing for converting an input interactive statement into an emotional interactive statement based on the emotion parameter, and

words creating processing for creating words in combination of an emotional word supplied through said emotional word creating processing and an emotional interactive statement supplied through said interactive statement conversion processing.

25. A computer readable memory for storing an emotion expressing program as set forth in

claim 15

,

said expression information integrating processing of the emotion expressing program including

a step of receiving an emotion parameter, selecting a multimedia scenario corresponding to the input emotion parameter from a plurality of multimedia scenarios prepared in advance, and according to the selected multimedia scenario, performing layout processing and output synchronization processing in sound and image output.

26. A computer readable memory for storing an emotion expressing program as set forth in

claim 15

,

the emotion expressing program comprising

a step of performing expression creating processing for creating an expression for representing emotion based on the emotion parameter supplied through said emotion creating processing,

said expression information integrating processing of the emotion expressing program including

a step of receiving an emotion parameter, selecting a multimedia scenario corresponding to the input emotion parameter from a plurality of multimedia scenarios prepared in advance, and according to the selected multimedia scenario, performing layout processing and output synchronization processing in sound and image output.

27. A computer readable memory for storing an emotion expressing program as set forth in

claim 15

,

the emotion expressing program comprising

a step of performing emotion judging processing for judging an emotion included in an input interactive statement and supplying the same as an emotion parameter, instead of said emotion creating processing.

28. A computer readable memory for storing an emotion expressing program as set forth in

claim 15

,

the emotion expressing program comprising

a step of performing emotion judging processing for judging an emotion included in an input interactive statement and supplying the same as an emotion parameter, instead of said emotion creating processing,

said emotion judging processing further including

keyword extracting processing for extracting keywords included in an input interactive statement, and

keyword-emotion parameter conversion processing for supplying an emotion parameter recorded in said keyword-emotion parameter correspondence table with each emotion parameter recorded correspondingly to each keyword, in accordance with the keyword extracted by said keyword extracting processing.