Document animation system

• US 7,412,389 B2
• Filed: 03/02/2005
• Issued: 08/12/2008
• Est. Priority Date: 03/02/2005
• Status: Expired due to Fees

• Current Assignee: George L. Yang
• Original Assignee: George L. Yang
• Inventors: Yang, George L.
• Primary Examiner(s): MCFADDEN, SUSAN IRIS
• Application Number:
  US11/071,097
• Publication Number:
  US 20060197764A1
• Time in Patent Office: 1,259 Days
• Field of Search: 704/260, 345/473
• US Class Current: 704/260
• CPC Class Codes: G06T 13/80 2D [Two Dimensional] animation, e.g. using sprites

Abstract

An animating system converts a text-based document into a sequence of animating pictures for helping a user to understand better and faster. First, the system provides interfaces for a user to build various object models, specify default rules for these object models, and construct the references for meanings and actions. Second, the system will analyze the document, extract desired information, identify various objects, and organize information. Then the system will create objects from corresponding object models and provide interfaces to modify default values and default rules and define specific values and specific rules. Further, the system will identify the meanings of words and phrases. Furthermore, the system will identify, interpolate, synchronize, and dispatch events. Finally, the system provides interface for the user to track events and particular objects.

Claims

1. A system for converting a text-based document into an animating cartoon to provide a user information in images and sounds, wherein said document describes objects and events generated by said objects, said system comprising:

means for generating organized information by extracting information from said document, organizing information, and saving information in a structure;

means for identifying said objects from said organized information;

means for creating virtual objects corresponding to said objects;

means for identifying said events from said organized information;

means for creating virtual events according to said virtual objects and said events; and

means for dispatching said virtual events.

2. The system in claim 1, wherein means for generating organized information from said document comprises means for identifying speech parts and sentence structures in said document, means for identify document type of said document, means for extracting information according to said document type, means for extracting background information, means for extracting user information, and means for saving information in said structure, said structure comprising a plurality of said properties for each structure, said properties associating with a plurality of rules for performing operations related to said properties and further comprising sub-structures that comprise sub-properties and their associated rules.

3. The system in claim 1, having a reference dictionary, said reference dictionary comprising a plurality of words with each word associating with a plurality of meanings and with each meanings classified into a plurality of categories and containing reference rules for recognizing each category, said system further comprising means for identifying meaning of a word and means for synchronizing said virtual events,

wherein said means for identifying meaning of a word comprises means for displaying, searching, and modifying said reference dictionary, means for applying said reference rules on said word to identify its category;

and

wherein said means for synchronizing said virtual events comprises means for organizing and adjusting said virtual events according to chronological order, means for organizing and adjusting said virtual events according to spatial order, means for defining event synchronization rules, means for applying said event synchronization rules, and means for displaying and adjusting event sequences.

4. The system in claim 1, said system connecting to a database and Internet, wherein said means for identifying said objects comprises means for finding different names for each object, means for linking different names for a same object to said same object, means for sorting said objects, means for specifying an object identification rule, means for extracting information specifically for said object from said document, said database, and Internet according to said object identification rules;

and

wherein said means for creating virtual objects comprises means for building an object model, means for creating an virtual object from said object model, means for associating said virtual object with default values and default rules inherited from said object model, means for adding new values and new rules, and means for specifying said virtual object with information extracted from said document, said database, and Internet.

5. The system in claim 1, wherein said means for identifying said events comprises means for recognizing verbs and verb structures, means for distinguishing action and non-action descriptions, means for defining an event identification rule, means for applying said event identification rule, and means for associating said event to corresponding action description.

6. The system in claim 1, further comprising:

means for displaying and modifying said organized information;

means for defining and modifying an auxiliary virtual object;

means for defining and modifying an auxiliary virtual event;

means for interpolating said virtual events by creating an intermediate virtual event to smooth a transition between two adjacent virtual events;

means for tracking a virtual event by providing first interface for said user to track text, voice, and image; and

means for tracking a virtual object by providing second interface for said user to select said virtual object, track status of said virtual object, and display said status.

7. The system in claim 1 further comprising means for selecting, modifying, debugging, and testing rules, wherein each rule is in a format selected from a group consisting of independent program, subroutine, function, macro, script, regular expression, matched pattern, and example for controlling how to extract information, identify objects, organize information, associate information with corresponding procedures, initialize objects, identify meaning, identify events, interpolate events, display information, and tack events, said means comprising means for displaying said rules and specifying priorities on said rules, means for passing arguments and parameters among different rules and utility procedures, and means for providing editing and debugging environment.

8. The system in claim 1, wherein said means for dispatching said virtual events comprises creating images and generating sounds according to the relative positions of said virtual objects and said user.

9. A system for generating animation presentation from a text document for a user, said document containing information about an object and an event related to said object, said system comprising:

a dictionary module for separating each word and each phrase included in a dictionary into different meanings, for categorizing each meaning into a plurality of categories, and linking each category with a corresponding action description;

a structure analysis module for generating organized information by performing structure analysis, collecting information, and organizing information in a structure;

an object identification module for identifying said object according to said organized information and said dictionary;

an object instantiation module for creating a virtual object by identifying an object type of said object and filling said virtual object with default information and default behavior related to said object type and with information specified in said document about said object;

an event generation module for identifying said event by recognizing actions associated with said event according to said organized information and said dictionary, describing said event in image, sound, and text according to corresponding action description in said dictionary and said organized information, and arranging an event schedule according to sequence of said event and; and

a viewing module for said user to watch said animation presentation from different aspects.

10. The system in claim 9, said system providing interfaces to define rules to perform corresponding tasks, said dictionary having patterns for identifying different meanings associated with a word, said system further comprising:

a relation identification module for identifying relation among objects according to various predefined relation identification rules;

a meaning identification module by identifying features that said word is used and comparing said features with patterns saved in said dictionary;

an image synthesizer for synthesizing image by loading a image saved in said system, creating image according to a relative position of said object and said user; and

an voice synthesizer for synthesizing sound by specifying each speaker'"'"'s voice features and special voice characteristic and creating sound according to related text; and

an event modifier for modifying, inserting, deleting, copying, moving, grouping, ungrouping, expanding, and compressing said event;

whereby said image synthesizer and said voice synthesizer will generate image and voice for said animation presentation.

11. The system in claim 9, further comprising:

an event synchronizer for making a plurality of virtual events synchronized by making said plurality of virtual events aligned up in spatial and time domain for image, sound, and text;

an event tracking module for tracking a virtual event by providing interface for said user to specify features to be tracked in image, text, and voice, and to manipulating how to display said event; and

an object status module for said user to track the status of said virtual object by providing an interface for said user to specify said object and displaying related events associated with said objects.

12. The system in claim 9, further comprising:

a playscript module for generating a playscript from said document according to rules for generating playscript;

a dialogue module for identifying a conversation in said document, converting a written statement to a verbal sentence, and generating dialogue text for a dialogue; and

a caption generation module for generating a caption by identifying important issues and extracting information from said important issues according to rules for generating caption;

whereby said user can modify said playscript to specify special pronunciation requirement on said playscript; and

whereby said system will combine said dialogue text, said caption, and said image to generate a new image for presentation.

13. The system in claim 9, further comprising:

an voice edit module for modifying sound by providing an interface for said user to modify sound associated with said object and a particular sentence;

a setup module for setting up various default settings by providing an interface for said user to set up default values of each setting, default procedures of each task, default procedure sequence;

a preprocess module for preprocessing said document by scanning a paper-based document into an electrical document, converting an image document into text-base document, and separating figures, formulas, and tables from texts;

a structure modification module for said user to modify said structure, said object, said meaning, and said event by providing a proper interface and help for said user to modify said structure, said object, said meanings, and said event; and

a database management module for managing said structure, collected information, and various rules saved in said system.

14. The system in claim 9, wherein said viewing module comprises means for generating images for a different viewing position, means for recording, playing, pausing, stopping, fast forward, fast backward, zooming in, zooming out, searching, analyzing and help, means for tracking event, and means for checking dictionary, structure, and object;

and

wherein said structure analysis module comprises means for identifying a document type, means for loading a default structure template associated with the document type, means for creating said structures from said structure template, means for modifying said structure by providing interface to display said structure, change structure specific rules, display a tag template, create a tag from said tag template, associate said tag with said structure, means for extracting information from input document, saving related information into a corresponding tag, and specifying access methods, and means for building relations among a plurality of tags in said structure and among a plurality of structures.

15. A system for creating a virtual teaching environment for a student from a text-based document comprising:

means for identifying important issues from said document;

means for building a virtual teacher, said virtual teacher being an auxiliary object associating with various properties and handling criterions;

means for building a virtual lecture hall, said virtual hall being another auxiliary object associating with various features found in a particular classroom;

means for creating events according to said important issues, said virtual teacher, and said virtual lecture hall; and

means for displaying said events.

16. The system in claim 15, wherein said means for identifying important issues from said document comprising means for identifying a subject, a section, and a topic, means for identifying a concept, means for identifying a theorem, means for identifying a formula, means for identifying a table, means for identifying an example, means for identifying a figure, means for identifying a demonstrations, and means for identifying a particular feature;

wherein said means for building a virtual teacher comprises means for building appearance of said virtual teacher, means for defining a general approach for said virtual teacher, means for adding more features to said virtual teacher for a particular subject, a particular topic, and a particular session, means for specifying verbal features, gestures features, and emphasizing method of said teacher; and

wherein said means for building a virtual lecture hall comprises displaying various interfaces, creating an object from an object template, shaping said object, resizing said object, relocating said object, and specifying properties to said object.

17. The system in claim 15, wherein said means for building a virtual teacher comprises means for building said virtual teacher from a teacher model, means for creating said virtual teacher by specifying appearance, speaking features, and behavior features, means for creating said virtual teacher for a specific subject and specific topic, means for displaying said virtual teacher, and means for modifying said virtual teacher.

18. The system in claim 15, further comprising means for building a teaching plan, said plan being a blueprint of major events associating with said important issues and comprising a plurality of predefined event procedures, wherein said event procedures are for generating a sequence of closely related events for various purposes, said means comprising means for finding a teaching plan model, means for creating said teaching plan from said teaching plan model, means for identifying order of said important issues, means for creating said teaching plan according to said order, means for displaying said important issues and their related issues, means for selecting an important issue, means for linking said important issue to a corresponding event procedure, and means for modify said teaching plan, whereby said means for arranging events organizes said events according to said teaching plan, said important issues, said virtual teacher, and said virtual lecture hall.

19. The system in claim 15, further comprising means for dispatching events, said means comprising means for creating images for objects in said virtual lecture hall in a format selected from a group consisting of two dimensional format and three-dimensional format, means for recreating images upon said student changing viewing position and viewing mode, and means for creating voice, whereby said means for displaying said events generates images and sounds according to related position of said student and said object.

20. The system in claim 15, said system having a database and connecting to Internet, further comprising:

means for performing structure analysis and saving information in a structure, said structure having a plurality of properties for holding corresponding information;

means for changing viewing mode;

means for inserting an auxiliary event, said auxiliary event being an extra event created for making image smooth and natural;

means for capturing and analyzing feedback from said student, adjusting a teaching plan to create an updated teaching plan, and dispatching events according to said updated teaching plan;

means for recording a teaching session, replaying said teaching session, and searching for a particular event;

means for displaying information in said structure in a proper display form, searching for related information from said structure, said database, and said Internet, and modifying said structure;

means for said students to make a comment and associate said comment with a corresponding property; and

means for said student to establish links among said structure, other structures, and their sub-structures.