Animation system and methods for generating animation based on text-based data and user information

• US 9,665,563 B2
• Filed: 04/16/2010
• Issued: 05/30/2017
• Est. Priority Date: 05/28/2009
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Min, Wook Hee, Kang, Bo Gyeong
• Primary Examiner(s): Wu, Sing-Wai
• Application Number:
  US12/762,258
• Publication Number:
  US 20100302254A1
• Time in Patent Office: 2,601 Days
• CPC Class Codes: G06F 40/109 Font handling; Temporal or kinetic typography
• CPC Class Codes: G06F 40/30 Semantic analysis
• CPC Class Codes: G06T 13/80 2D [Two Dimensional] animation, e.g. using sprites

Abstract

Animation devices and a method that may output text-based data as an animation, are provided. The device may be a terminal, such as a mobile phone, a computer, and the like. The animation device may extract one or more emotions corresponding to a result obtained by analyzing text-based data. The emotion may be based on user relationship information managed by a user of the device. The device may select an action corresponding to the emotion from a reference database, and combine the text-based data with the emotion and action to generate an animation script. The device may generate a graphic in which a character is moved based on the action information, the emotion information, and the text-based data.

Claims

1. An animation script generating device, comprising:

a processor configured to execute instructions for an emotion extractor configured to identify, from a user profile database, a character corresponding to a generator of text-based data and user relationship information, the text-based data being analyzed to identify words, sentence elements, or any combination thereof in the text-based data, and the user relationship information indicating a relationship between the generator of the text-based data and a receiver of the text-based data, and extract a user emotion based on the text-based data and the user relationship information;

a selector configured to select an action based on the extracted user emotion; and

a script generator configured to generate an animation script by combining the text-based data with the extracted user emotion and the action, the generated animation script being configured for an input to a terminal that uses an animation outputting device to generate an animation based on the generated animation script,

wherein the animation script is generated using a reference database, the reference database comprising a production database configured to store mapping information of at least one of a camera work and a background sound.

2. The animation script generating device of claim 1, wherein the text-based data comprises at least one of a Short Message Service (SMS) message, a text scenario comprising contents to be generated as moving pictures, an instant message, a text memo of a Social Network Service (SNS), and a text-based e-mail.

3. The animation script generating device of claim 1, further comprising:

a natural language processor configured to process words included in the text-based data based on the analyzed text-based data.

4. The animation script generating device of claim 1, further comprising:

an external data processor configured to generate a background image using at least one of transmittal time information of the text-based data, reception time information of the text-based data, current time information, and weather information,

wherein the script generator is further configured to generate the animation script comprising the background image.

5. The animation script generating device of claim 1, wherein the user profile database configured to store mapping information of the user relationship information corresponding to the generator of the text-based data and mapping information of a character corresponding to the receiver of the text-based data.

6. The animation script generating device of claim 1, wherein the selector is further configured to select, from the action rule database, the action based on the extracted emotion and the user relationship information.

7. The animation script generating device of claim 1, wherein at least one of the camera work and the background sound, correspond to at least one of the user relationship information, the extracted emotion, the character, the action, or any combination thereof.

8. The animation script generating device of claim 7, further comprising:

an information producer configured to identify at least one of the camera work, or the background sound, in the production database, based on at least one of the user relationship information, the extracted emotion, the character, the action, or any combination thereof,

wherein the script generator is further configured to generate the animation script using at least one of the camera work, and the background sound.

9. The animation script generating device of claim 1, wherein the user relationship information comprises the relationship and an intimacy degree between the generator of the text-based data and the receiver of the text-based data.

10. The animation script generating device of claim 1, wherein the emotion extractor is further configured to extract the emotion based on a predetermined physiological feature of the generator of the text-based data.

11. The animation script generating device of claim 1, wherein the emotion extractor is configured to:

identify, from an emotional vocabulary dictionary database, an emotion based on the text- based data and the user relationship information,

identify, from an emotional inference rule database, an inferred emotion based on the text- based data and the user relationship information, and

extract the user emotion using at least one of the emotion and the inferred emotion.

12. The animation script generating device of claim 1, wherein the user relationship information is pre-stored in the user profile database, and

wherein the animation script is generated using a reference database, the reference database comprising at least one of:

an emotional vocabulary dictionary database configured to store mapping information of the emotion corresponding to the text-based data and the user relationship information;

an emotional inference rule database configured to store mapping information of the inferred emotion corresponding to the text-based data and the user relationship information; and

an action rule database configured to store mapping information of an action corresponding to at least one of the extracted emotion and the user relationship information.

13. An animation outputting device, comprising:

an analyzer configured to analyze information included in an animation script to identify emotional information, a character corresponding to a generator of text-based data, action information, and the text-based data, the animation script configured as having been generated by identifying an emotion based on an analysis of the text-based data and user relationship information indicating a relationship between the generator of the text-based data and a receiver of the text-based data;

a graphic generator configured to generate a graphic in which the character moves based on the action information;

an audio processor configured to output the text-based data as a voice in which an intonation or a tone is applied based on the emotional information; and

an animation generator configured to output the generated graphic in a terminal that comprises the animation outputting device and an animation script generating device that generates the animation script, and configured to combine and output the generated graphic and the voice as an animation,

wherein the animation script is configured as having been generated using a reference database, the reference database comprising a production database configured to store mapping information of at least one of a camera work and a background.

14. The animation outputting device of claim 13, wherein the text-based data comprises at least one of a SMS message, a text scenario including contents to be generated as moving pictures, an instant message, a text memo of a SNS, and a text-based e-mail.

15. The animation outputting device of claim 13, wherein the graphic generator is further configured to generate the graphic comprising a text of the text-based data.

16. The animation outputting device of claim 13, further comprising:

an audio processor configured to output a background sound in response to the analyzer identifying the background sound from the animation script,

wherein the animation generator is further configured to combine the generated graphic and the background sound to output the animation.

17. The animation outputting device of claim 13, wherein the generation of the graphic in which the character moves based on the action information is performed at the same time as the outputting of the text-based as the voice in which the intonation or the tone is applied.

18. A receiving terminal, comprising:

a processor configured to execute instructions to store user relationship information, character information, and emotional information for a reference database in a memory;

an animation script generator configured to

analyze text-based data to identify words, sentence elements, or any combination thereof in the text-based data,

identify, from a user profile database, the user relationship information indicating a relationship between a generator of the text-based data and a receiver of the text-based data,

extract a user emotion based on the text-based data and the user relationship information,

select an action based on the extracted user emotion, and

generate an animation script by combining the text-based data with the extracted emotion and the action; and

an animation generator configured to generate an animation based on the generated animation script to a display,

wherein the reference database comprising a production database configured to store mapping information of at least one of a camera work and a background sound.

19. The receiving terminal of claim 18, wherein the text-based data comprises at least one of a SMS message, a text scenario comprising contents to be generated as moving pictures, an instant message, a text memo of a SNS, and a text-based e-mail.

20. The receiving terminal of claim 18, wherein the animation generator is further configured to analyze the animation script to output the animation to a display.

21. The receiving terminal of claim 18, wherein the user profile database configured to store mapping information of the user relationship information corresponding to the generator of the text-based data and mapping information of a character corresponding to the receiver of the text-based data.

22. The receiving terminal of claim 18, wherein the animation script generator further comprises:

an external data processor configured to generate a background image using at least one of transmittal time information of the text-based data, reception time information of the text-based data, current time information, and weather information,

wherein a script generator is configured to generate the animation script comprising the background image.

23. The receiving terminal of claim 22, wherein the external data processor is further configured to generate the background image using at least two of the transmittal time of the text-based data, the reception time information of the text-based data, the current time information, and the weather information.

24. The receiving terminal of claim 18,

wherein at least one of the camera work and the background sound correspond to at least one of the user relationship information, the extracted emotion, the character, the action, or any combination thereof.

25. The receiving terminal of claim 24, wherein the animation script generator generating device further comprises:

an information producer configured to verify at least one of the camera work, or the background sound, in the production database, using at least one of the user relationship information, the extracted emotion, the character, the action, or any combination thereof; and

a script generator configured to generate the animation script using at least one of the camera work and the background sound.

26. The receiving terminal of claim 18, wherein the user relationship information classified from the point of view of the receiving terminal.

27. A sending terminal, comprising:

a processor configured to store user relationship information, character information, and emotional information for a reference database in a memory;

an animation script generator configured to

analyze text-based data to identify words, sentence elements, or any combination thereof in the text-based data,

identify, from a user profile database, the user relationship information indicating a relationship between a generator of the text-based data and a receiver of the text-based data,

extract a user emotion based on the text-based data and the user relationship information,

select an action based on the extracted emotion;

generate an animation script by combining the text-based data with the extracted emotion and the action; and

an animation generator configured to generate an animation based on the generated animation script to a display,

wherein the reference database comprising a production database configured to store mapping information of at least one of a camera work and a background sound.

28. The sending terminal of claim 27, wherein the text-based data comprises at least one of a SMS message, a text scenario comprising contents to be generated as moving pictures, an instant message, a text memo of a SNS, and a text-based e-mail.

29. The sending terminal of claim 27, wherein the user profile database configured to store mapping information of the user relationship information corresponding to the generator of the text-based data and mapping information of a character corresponding to the receiver of the text-based data.

30. The sending terminal of claim 27, wherein the animation script generator further comprises:

an external data processor configured to generate a background image using at least one of sending time information of the text-based data, receiving time information of the text-based data, current time information, and weather information,

wherein a script generator is configured to generate the animation script comprising the background image.

31. The sending terminal of claim 27,

wherein at least one of the camera work and the background sound, correspond to at least one of the user relationship information, the extracted emotion, the character, the action, or any combination thereof.

32. The sending terminal of claim 31, wherein the animation script generator further comprises:

an information producer configured to verify at least one of the camera work or the background sound, in the production database, using at least one of the user relationship information, the extracted emotion, the character, the action, or any combination thereof; and

a script generator configured to generate the animation script using at least one of the camera work and the background sound.

33. The sending terminal of claim 27, wherein the user relationship information classified from a point of view of the sending terminal.

34. The sending terminal of claim 27, wherein the user relationship information classified from a point of view of the sending terminal that is different from a user relationship information classified from a point of view of a receiving terminal.

35. A mobile terminal configured to generate an animation based on text-based data, the mobile terminal comprising:

a processor configured to execute instructions for an emotion extractor configured to

identify, from a user profile database, relationship information indicating a relationship between a generator of the text-based data and a receiver of the text-based data, the text-based data being analyzed to identify words, sentence elements or any combination thereof in the text-based data,

extract a user emotion based on the text-based data and the user relationship information;

a selector configured to select an action based on the extracted user emotion;

a script generator configured to generate an animation script by combining the text-based data with the extracted emotion and the action; and

an animation outputting device configured to generate an animation based on the generated animation script,

wherein the animation script is generated using a reference database, the reference database comprising a production database configured to store mapping information of at least one of a camera work and a background sound.

36. An animation script generating method, comprising:

analyzing text-based data to identify words, sentence elements, or any combination thereof in the text-based data;

identifying, from a user profile database, user relationship information indicating a relationship between a generator of the text-based data and a receiver of the text-based data;

extracting a user emotion based on the text-based data and the user relationship information;

selecting an action from a reference database based on the extracted emotion; and

generating an animation script by combining the text-based data with the extracted emotion and the action for an input in a terminal including an animation outputting device that generates an animation based on the generated animation script,

wherein the animation script is generated using a reference database, the reference database comprising a production database configured to store mapping information of at least one of a camera work and a background sound.

37. An animation outputting method in a terminal, comprising:

analyzing information included in an animation script, generated by an animation script generating device of the terminal, to identify emotional information, a character corresponding to a generator of text-based data, action information, and the text-based data, the animation script being generated by identifying an emotion based on an analysis of the text-based data and user relationship information indicating a relationship between the generator of the text- based data and a receiver of the text-based data;

generating a graphic, by an animation outputting device of the terminal, in which the character moves based on the action information;

outputting the text-based data as a voice in which an intonation or a tone is applied based on the emotional information, the emotional information being identified based on the user relationship information; and

outputting the generated graphic as an animation to a display of the terminal,

wherein the outputting of the generated graphic as the animation comprises combining the generated graphic and the voice to output the animation, and

wherein the animation script is generated using a reference database, the reference database comprising a production database configured to store mapping information of at least one of a camera work and a background.