ANIMATION SYSTEM AND METHODS FOR GENERATING ANIMATION BASED ON TEXT-BASED DATA AND USER INFORMATION

• US 20100302254A1
• Filed: 04/16/2010
• Published: 12/02/2010
• Est. Priority Date: 05/28/2009
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: MIN, Wook Hee, Kang, Bo Gyeong
• Granted Patent: US 9,665,563 B2
• Time in Patent Office: Days
• US Class Current: 345/473
• CPC Class Codes: G06F 40/109 Font handling; Temporal or kinetic typography
• CPC Class Codes: G06F 40/30 Semantic analysis
• CPC Class Codes: G06T 13/80 2D [Two Dimensional] animation, e.g. using sprites

Abstract

Animation devices and a method that may output text-based data as an animation, are provided. The device may be a terminal, such as a mobile phone, a computer, and the like. The animation device may extract one or more emotions corresponding to a result obtained by analyzing text-based data. The emotion may be based on user relationship information managed by a user of the device. The device may select an action corresponding to the emotion from a reference database, and combine the text-based data with the emotion and action to generate an animation script. The device may generate a graphic in which a character is moved based on the action information, the emotion information, and the text-based data.

Claims

1. An animation script generating device, comprising:

an emotion extraction unit configured to extract, from a reference database, an emotion based on analyzing text-based data and corresponding user relationship information;

a selection unit configured to select an action based on the extracted emotion; and

a script generation unit configured to combine the text-based data with the emotion and action to generate an animation script.

2. The animation script generating device of claim 1, wherein the text-based data comprises at least one of a Short Message Service (SMS) message, a text scenario comprising contents to be generated as moving pictures, an instant message, a text memo of a Social Network Service (SNS), and a text-based e-mail.

3. The animation script generating device of claim 1, wherein the user relationship information indicates a relationship or an intimacy degree between a generator of the text-based data and a receiver of the text-based data.

4. The animation script generating device of claim 1, further comprising:

a natural language processing unit configured to process words included in the text-based data based on the analyzed text-based data,

wherein the emotion extraction unit is further configured to;

identify a character corresponding to the generator of the text-based data, and

extract, from the reference database, the emotion corresponding to one or more words of the text-based data and the user relationship information.

5. The animation script generating device of claim 1, further comprising:

an external data processing unit configured to generate a background image using at least one of sending time information of the text-based data, receiving time information of the text-based data, current time information, and weather information,

wherein the script generation unit is further configured to generate the animation script comprising the background image.

6. The animation script generating device of claim 1, wherein the reference database comprises:

a user profile database configured to store mapping information of the user relationship to information corresponding to the generator of the text-based data and mapping information of a character corresponding to the receiver of the text-based data;

an emotional vocabulary dictionary database configured to store mapping information of an emotion corresponding to vocabulary and the user relationship information;

an emotional inference rule database configured to store mapping information of an emotion corresponding to one or more words of the text based data and the user relationship information; and

an action rule database configured to store mapping information of an action corresponding to a user emotion and/or the user relationship information.

7. The animation script generating device of claim 6, wherein the emotion extraction unit is further configured to:

identify, in the user profile database, the character corresponding to the generator of the text-based data and the user relationship information;

identify, in the emotional vocabulary dictionary database, an emotion corresponding to the vocabulary and the user relationship information;

identify, in the emotional inference rule database, an inferred emotion corresponding to the one or more words of the text-based data and the user relationship information; and

combine the emotion and the inferred emotion to extract at least one user emotion.

8. The animation script generating device of claim 6, wherein the action selection unit is further configured to select, from the action rule database, the action corresponding to the at least one user emotion and the user relationship information.

9. The animation script generating device of claim 6, wherein the reference database further comprises:

a production database configured to store mapping information of a camera work corresponding to at least one of the user relationship information, the at least one user emotion, the character, the action, and mapping information of a background sound.

10. The animation script generating device of claim 9, further comprising:

a producing unit configured to identify the camera work and the background sound, in the production database, based on at least one of the user relationship information, the at least one user emotion, the character, and the action,

wherein the script generation unit is further configured to generate the animation script using the camera work comprising the background sound.

12. The animation outputting device of claim 10, wherein the text-based data comprises at least one of a SMS message, a text scenario comprising contents to be generated as moving pictures, an instant message, a text memo of a SNS, and a text-based e-mail.

11. An animation outputting device, comprising:

an analyzing unit configured to analyze information included in an animation script to identify emotional information, character, action information, and text-based data;

a graphic generation unit configured to generate a graphic in which the character moves based on the action information; and

an animation generation unit configured to output the generated graphic as an animation.

13. The animation outputting device of claim 11, wherein the graphic generating unit is further configured to generate the graphic comprising a text of the text-based data.

14. The animation outputting device of claim 11, further comprising:

an audio processing unit configured to output the text-based data as a voice in which an intonation or a tone is applied according to the emotional information,

wherein the animation generation unit is further configured to combine the generated graphic and the voice to output an animation.

15. The animation outputting device of claim 11, further comprising:

an audio processing unit configured to output the background sound when the script analyzing unit verifies the background sound from the animation script,

wherein the animation generation unit is further configured to combine the generated graphic and the background sound to output an animation.

16. A receiving terminal, comprising:

a reference database configured to store user relationship information, character information, and emotional information; and

an animation script generating device configured to;

extract an emotion based on analyzing received text-based data and corresponding user relationship information, to select an action corresponding to the emotion; and

combine the text-based data with the emotion and the action to generate an animation script.

17. The receiving terminal of claim 16, wherein the text-based data comprises at least one of a SMS message, a text scenario comprising contents to be generated as moving pictures, an instant message, a text memo of a SNS, and a text-based e-mail.

18. The receiving terminal of claim 16, wherein the user relationship information indicates a relationship or intimacy degree between a generator of the text-based data and a receiver of the text-based data.

19. The receiving terminal of claim 16, further comprising an animation outputting device configured to analyze the animation script to output an animation.

20. The receiving terminal of claim 16, wherein the reference database comprises:

a user profile database configured to store mapping information of the user relationship information corresponding to the generator of the text-based data and mapping information of a character corresponding to the receiver of the text-based data;

an emotional vocabulary dictionary database configured to store mapping information of an emotion corresponding to vocabulary and the user relationship information;

an emotional inference rule database configured to store mapping information of an emotion corresponding to one or more words of the text-based data and the user relationship information; and

an action rule database configured to store mapping information of an action corresponding to a user emotion and the user relationship information.

21. The receiving terminal of claim 20, wherein the animation script generating device comprises:

a natural language processing unit configured to process words included in the text-based data based on the result obtained by analyzing the text-based data;

an emotion extraction unit configured to;

identify, in the user profile database, the character corresponding to the generator of the text-based data and the user relationship information;

identify, in the emotional vocabulary dictionary database, an emotion corresponding to the vocabulary and the user relationship information;

identify, in the emotional inference rule database, an inferred emotion corresponding to the one or more words of the text-based data and the user relationship information; and

combine the emotion and the inferred emotion to extract at least one user emotion;

an action selection unit configured to verify, from the action rule database, the action corresponding to the at least one user emotion and the user relationship information; and

a script generation unit configured to combine the text-based data with the at least one user emotion and action to generate an animation script.

22. The receiving terminal of claim 20, wherein the animation script generating device further comprises:

an external data processing unit configured to generate a background image using at least one of sending time information of the text-based data, receiving time information of the text-based data, current time information, and weather information,

wherein the script generation unit is further configured to generate the animation script comprising the background image.

23. The receiving terminal of claim 20, wherein the reference database further comprises:

a production database configured to;

store mapping information of a camera work corresponding to at least one of the user relationship information, the at least one user emotion, the character, and the action; and

store mapping information of a background sound.

24. The receiving terminal of claim 23, wherein the animation script generating device further comprises:

a producing unit configured to verify the corresponding camera work and the background sound, in the production database, using at least one of the user relationship information, the at least one user emotion, the character, and the action,

wherein the script generation unit is further configured to generate the animation script using the camera work comprising the background sound.

25. A sending terminal, comprising:

a reference database configured to store user relationship information, character information, and emotional information; and

an animation script generating device configured to;

extract an emotion based on analyzing text-based data intended to be sent and corresponding user relationship information;

select an action corresponding to the emotion;

combine the text-based data with the emotion and the action to generate an animation script; and

send the generated animation script to a receiving terminal.

26. The sending terminal of claim 25, wherein the text-based data comprises at least one of a SMS message, a text scenario comprising contents to be generated as moving pictures, an instant message, a text memo of a SNS, and a text-based e-mail.

27. The sending terminal of claim 25, wherein the user relationship information indicates a relationship or intimacy degree between a generator and a receiver of the text-based data.

28. The sending terminal of claim 25, wherein the reference database comprises:

a user profile database configured to store mapping information of the user relationship information corresponding to the generator of the text-based data and mapping information of a character corresponding to the receiver of the text-based data;

an emotional vocabulary dictionary database configured to store mapping information of an emotion corresponding to vocabulary and the user relationship information;

an emotional inference rule database configured to store mapping information of an emotion corresponding to one or more words of the text-based data and the user relationship information; and

an action rule database configured to store mapping information of an action corresponding to a user emotion and the user relationship information.

29. The sending terminal of claim of claim 28, wherein the animation script generating device comprises:

a natural language processing unit configured to process an emotion of words included in the text-based data based on the result obtained by analyzing the text-based data;

an emotion extraction unit configured to;

identify, in the user profile database, the character corresponding to the generator of the text-based data and the user relationship information;

identify, in the emotional vocabulary dictionary database, an emotion corresponding to the vocabulary and the user relationship information;

identify, in the emotional inference rule database, an inferred emotion corresponding to the one or more words of the text-based data and the user relationship information; and

combine the emotion and the inferred emotion to extract at least one user emotion;

an action selection unit configured to verify, from the action rule database, the action corresponding to the at least one user emotion and the user relationship information; and

a script generation unit configured to combine the text-based data with the at least one user emotion and action to generate an animation script.

30. The sending terminal of claim 28, wherein the animation script generating device further comprises:

an external data processing unit configured to generate a background image using at least one of sending time information of the text-based data, receiving time information of the text-based data, current time information, and weather information,

wherein the script generation unit is further configured to generate the animation script comprising the background image.

31. The sending terminal of claim 28, wherein the reference database further comprises:

a production database configured to store mapping information of a camera work corresponding to at least one of the user relationship information, the at least one user emotion, the character, the action, and mapping information of a background sound.

32. The sending terminal of claim 31, wherein the animation script generating device further comprises:

a producing unit configured to verify corresponding camera work and the background sound, in the production database, using at least one of the user relationship information, the at least one user emotion, the character, and the action,

wherein the script generation unit is further configured to generate the animation script using the camera work comprising the background sound.

33. A mobile terminal for generating an animation based on text-based data, the mobile terminal comprising:

an emotion extraction unit configured to extract an emotion from text-based data generated by a first user;

a selection unit configured to select at least one of a motion and a gesture, the motion and/or the gesture being based on relationship information of the first user and the extracted emotion; and

a script generation unit configured to combine the emotion and at least one of the motion and the gesture, to generate an animation script.

34. A sending terminal, comprising:

a reference database configured to store user relationship information of one or more users, character information, and emotional information; and

an animation script generating device configured to;

receive text-based data from a sending terminal;

extract an emotion based on analyzing text-based data and corresponding user relationship information;

select an action based on the extracted emotion;

combine the text-based data with the emotion and the action to generate an animation script; and

send the generated animation script to a receiving terminal.

35. An animation script generating method, comprising:

extracting, a reference database, an emotion based on analyzing text-based data, and corresponding user relationship information;

selecting an action from the reference database based on the extracted emotion; and

combining the text-based data with the emotion and action to generate an animation script.

36. An animation outputting method, comprising:

analyzing information included in an animation script to identify emotional information, character, action information, and text-based data;

generating a graphic in which the character moves based on the action information; and

outputting the generated graphic as an animation.