IMAGE PROCESSING DEVICE, ANIMATION DISPLAY METHOD AND COMPUTER READABLE MEDIUM

• US 20170270701A1
• Filed: 12/22/2016
• Published: 09/21/2017
• Est. Priority Date: 03/16/2016
• Status: Active Grant

• Current Assignee: Casio Computer Company Limited
• Original Assignee: Casio Computer Company Limited
• Inventors: OKANIWA, Shoichi, NEGISHI, Hiroaki, MORIYA, Shigekatsu, KANDA, Hirokazu
• Granted Patent: US 10,304,439 B2
• Time in Patent Office: Days
• CPC Class Codes: G06F 40/268 Morphological analysis
• CPC Class Codes: G06F 40/289 Phrasal analysis, e.g. finite state techniques or chunking
• CPC Class Codes: G06F 40/35 Discourse or dialogue representation
• CPC Class Codes: G06F 40/47 Machine-assisted translation, e.g. using translation memory
• CPC Class Codes: G06T 13/00 Animation
• CPC Class Codes: G06T 13/40 of characters, e.g. humans, animals or virtual beings
• CPC Class Codes: G10L 13/08 Text analysis or generation of parameters for speech synthesis out of text, e.g. grapheme to phoneme translation, prosody generation or stress or intonation determination
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence
• CPC Class Codes: G10L 2021/105 Synthesis of the lips movements from speech, e.g. for talking heads

Abstract

An image processing device includes a controller and a display. The controller adds an expression to a displayed face image in accordance with an audio when the audio is output. Further, the controller generates an animation in which a mouth contained in the face image with the expression moves in sync with the audio. The display displays the generated animation.

Claims

1. An image processing device comprising:

a controller which adds an expression to a displayed face image in accordance with an audio when the audio is output, and generates an animation in which a mouth contained in the face image with the expression moves in sync with the audio; and

a display which displays the generated animation.

2. The image processing device according to claim 1, wherein the controller adds the expression to the face image which is displayed when the audio corresponding to first text data is output.

3. The image processing device according to claim 2, wherein the controller determines the expression for a first sentence or clause contained in the first text data, and adds the determined expression to the face image which is displayed when the audio corresponding to the first sentence or clause is output.

4. The image processing device according to claim 3, wherein the controller obtains information on an expression correlated in advance with a word or phrase in the first sentence or clause contained in the first text data, and determines, on the basis of the obtained information, the expression for the first sentence or clause contained in the first text data.

5. The image processing device according to claim 3, wherein the controller (i) translates the first sentence or clause contained in the first text data into second text data of a language which is different from a language of the first text data, (ii) adds the expression determined for the first sentence or clause contained in the first text data to the face image which is displayed when the audio corresponding to a second sentence or clause contained in the second text data corresponding to the first sentence or clause is output, and (iii) generates the animation in which the mouth contained in the face image with the expression moves in sync with the audio corresponding to the second text data.

6. An animation display method comprising:

adding an expression to a displayed face image in accordance with an audio when the audio is output;

generating an animation in which a mouth contained in the face image with the expression moves in sync with the audio; and

displaying the generated animation.

7. A computer readable medium storing a program to cause a computer to perform:

an expression adding process of adding an expression to a displayed face image in accordance with an audio when the audio is output;

a generating process of generating an animation in which a mouth contained in the face image with the expression moves in sync with the audio; and

a displaying process of displaying the generated animation.