METHOD AND SYSTEM FOR CREATING MULTIMEDIA PRESENTATION PROTOTYPES

• US 20150278181A1
• Filed: 10/28/2013
• Published: 10/01/2015
• Est. Priority Date: 10/30/2012
• Status: Active Grant

• Current Assignee: Sergey Anatoljevich Gevlich
• Original Assignee: Sergey Anatoljevich Gevlich
• Inventors: Gevlich, Sergey Anatoljevich
• Granted Patent: US 10,423,716 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 3/04817 using icons graphical or visual programming using iconic symbols G06F8/34
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 40/131 Fragmentation of text files, e.g. creating reusable text-blocks; Linking to fragments, e.g. using XInclude; Namespaces
• CPC Class Codes: G06F 40/169 Annotation, e.g. comment data or footnotes

Abstract

A method and system for creating multimedia prototype presentations use the linear compression or stretching of playback speed record of creating and editing graphic images, which does not lead to degradation of quality perception. When using manually created drafts, schemes and drawings as graphic images of the presentation, the playback of record of their creating and editing process can be sped up or slowed down in a broad time range without losing quality perception of the visual content. The synchronization of the audio and the video track is made by a linear compression or stretching playback speed record of creating and editing the graphic images until the playback duration of the frame visual content and the duration of its sound match.

Claims

1. A computer-implemented method for creating multimedia presentations prototypes, the method comprising:

determining an order of frames,

using a processor of a computing device, defining textual and visual content of the frames and an order of transition between the frames;

preparing a composition of a text content, a visual content and an audio track content of a multimedia presentation and combining the contents into a multimedia file,

wherein combining of the contents comprises;

(a) preparing a single coherent presentation text and entering it into the computing device;

(b) splitting the presentation text into fragments corresponding to presentation frames;

(c) placing a marker of a text markup between all neighboring frames;

(d) recording an audio track with a verbal voice content of the presentation;

(e) splitting the audio track into the frames;

(f) creating visual imagery of the frames and for each frame of the presentation;

(i) creating and editing graphic figures of the frames; and

(ii) recording a visual representation of all actions of creating and editing the figures;

(g) configuring a presentation prototype by creating a configuration file for each frame by determining a playback duration of the frame and by making a uniform time scaling of a visual representation of creating and editing of the figures of frame visual imagery until a duration of a frame visual representation and a duration of a frame audio content match;

(h) determining frame visualization data comprising an aspect ratio, resolution, color, transparency and FPS;

playing back simultaneously a frame audio track and a time scaled visual representation of creating and editing the graphic figures of the frame and recording a resulting mix of sound and animation into a configuration file of the frame;

playing back the configuration file of the frame on a screen and evaluating the configuration file;

combining the configuration files of the frames with a required order of frames sequence into a single configuration multimedia file of the presentation;

saving the configuration file of the presentation in a format allowing for future editing of the text, the sound and the visual imagery of the frames in the next work session; and

converting the configuration file of the presentation into a video-file without a possibility of future editing of the text, the sound and images of the frames.

2. The method of claim 1, further comprising making required corrections of the text, the sound and the visual imagery of the frames in a work session and repeatedly configuring the presentation prototype based on evaluation results.

3. The method of claim 1, wherein the presentation text is inserted into the computing device by any of:

loading prepared text from an external source;

entering the text using an on-screen keyboard; and

inserting the text verbally via a microphone with an automatic words recognition and a manual correction of unrecognized fragments.

4. The method of claim 1, further comprising marking up an audio track of a verbal voice content of the presentation, including the steps of:

displaying the text and the audio frames synchronized at a particular moment in time visually presented as segments corresponding to the frames of the presentation, so that visual representation of the text, bars or edges of the frames for which the audio track has already been marked up into frames is visually different from the presentation of the text, bars or edges of the frames for which the audio track has not yet been marked up; and

displaying a visual border of the text content of the presentation corresponding to splitting frames into the frames with marked up and not marked up audio content so that a visual location of the border on a screen stays constant as a result of scrolling of the frame bars in a process of marking up;

inserting a marker of an audio track markup where synchronization of one frame ends and synchronization of another frame begins in case of a manual markup; and

automatically matching recognized words to texts of the frames and automatically markup the audio track in case of an automatic speech recognition.

5. The method of claim 1, further comprising creation and editing graphic figures of a frame by:

loading graphic figures and images from an external source;

recording a video by a camera integrated into the computing device and to inserting pictures and videos into a visual imagery of the frame;

automatically detecting drawn figures and correcting their geometry, wherein a duration of creating and editing graphic figures is equal to a duration of creating and editing originally created graphic figures excluding an actual time for automatic correction and reviewing suggested versions;

attaching indicating lines and captions to the figures and automatically move matching lines and text along with figures when moving them in a course of editing;

setting a transition mode between visual imageries of two adjacent frames;

playing back a fragment of the audio track of a current frame in order to check creation of visual imagery of the frame; and

testing an animation of an already created part of the visual imagery of the frame in order to check the creation of the visual imagery of the frame.

6. The method of claim 1, further comprising creating a configuration file of the frame for synchronization of animation with audio, wherein a time of visual representation of creating and editing graphic figures of the frame visual imagery is determined:

from a start marker of the frame sound on the audio track to the end marker of the frame sound; and

from the start of an actual sound of the first word of the frame text to the end of a sounding of a last word of the frame text,

wherein additional pauses are inserted before the start of the sound of the first word of the first frame and after ending of the sounding of the last word of the last frame.

7. The method of claim 1, further comprising correction of the text, sound and visual imagery of the frames by:

splitting a text of the frame by the text markup marker into two fragments corresponding to two new frames;

determining which one of the two new created frames has the visual imagery of an original frame;

creating visual imagery for the second frame created;

deleting markers of text markup and audio track of the frames, if there is no visual imagery found in the frame;

deleting marker of the text markup and the audio track of the frames and attaching the visual imagery to the resulting integrated frame, if the visual imagery is present only in one of the integrated frames; and

if there is no imagery present in both integrated frames;

deleting the markers of the text markup and the audio track of the frames;

creating the resulting audio track by consecutive connection of two original audio tracks keeping their original sequence; and

creating resulting visual imagery by consecutive connection of two original visual imageries keeping their original sequence and a frame rate of the original frames.

8. The method of claim 1, further comprising correcting markup of the frame audio track by:

determining two adjacent frames and location of a marker of the audio track markup to be corrected;

displaying an image of the audio track with a sound end marker;

playing back continuous consistent sounds of both frames and simultaneously displaying a time line with a locator of a current position of the marker of the audio track markup;

moving the locator of the marker of audio track markup on time line right or left after listening to an end of one frame and beginning of the following one; and

checking result after moving to playback audio of the track from time mark N seconds to a new position of marker of audio track markup, where N is from 0 to 4 seconds.

9. The method of claim 1, further comprising executing a transition between visual images of two adjacent frames when creating a new frame by:

saving the image of the previous frame without changes as a start image of a new frame;

erasing the image of the previous frame completely;

erasing the entire image of the previous frame by moving an eraser tool on a screen;

erasing the image of the previous frame up to a background image;

erasing a part of a screen field by the eraser tool horizontally;

erasing chosen elements of the image of the previous frame;

restoring a final image of the frame before the previous one;

rotating a visual field of the previous frame;

opening a clean space for creating figures of the new frame and leaving in sight a small part of the image of the previous frame;

minimizing into an icon the resulting image of the previous frame and placing the icon on the screen field of the new frame;

minimizing the resulting image of the previous frame and leaving it on the screen field of the new frame; and

extending the resulting image of the previous frame and leaving the part visible within the frame edges on the screen field of the new frame.

10. A computing device for creating multimedia presentations prototypes comprising:

a touch screen display having a sensor for detecting position of a finger touch,

an on-screen keyboard,

a built-in microphone,

a built-in speaker,

a data processing unit connected to the display, to the keyboard, to the microphone and to the speaker and configured to receive, process and output signals and data,

wherein the computing device is configured;

to process, when displayed on the screen text is touched, positions of the finger touch as a command and location for splitting the displayed text edges into text fragments and for forming data structures in a computing device memory corresponding to specified fragments implemented as frames;

to split a recorded audio track into audio slices connected to the text frames;

to record a process of drawing figures by a user'"'"'s finger touch on the display and connect them with the text frames;

to scale proportionally on the display playback time of a drawing process upon the user'"'"'s finger touch; and

to display on the screen the recorded process of figures drawing corresponding to matching text frames on a time scale equal to a sound duration of audio fragments corresponding to the text frames with a simultaneous playback of the audio fragments.

11. The computing device of claim 10, wherein the data processing unit is configured to:

automatically detect verbal text pronunciation;

automatically divide the recorded audio track into audio fragments and connect these audio fragments with the matching text frames; and

automatically detect drawn graphic figures and select their smoothed out and regular-shaped equivalents from an image library.

12. The computing device of claim 10, wherein upon detecting a touch on different areas of the touch screen, the computing device switches to corresponding modes of operation,

wherein:

a computing device on-screen mode of an operation selection panel is presented in a form of a bar divided into field-buttons with icons of computing device operation modes, wherein when the field-buttons are pressed on, they expand lengthwise and sub-buttons available in these modes of operations of the computing device appear; and

wherein;

a computing device mode of the operations selection panel is located in an upper section of the screen across the entire width and is provided with the fields-buttons “

Presentation management”

, “

Text editing”

, “

Sound editing”

, and “

Graphic editing”

;

a work field of an active operation mode is displayed under the selection panel on the computing device screen;

at startup of the computing device, if a processed multimedia presentations prototype is not selected, the computing device switches to the “

Presentation management”

mode and the icons available for review or editing of the presentations prototypes with captions are displayed in a work field; and

if the prototype is selected at launch, the computing device switches to the “

Text editing”

mode of the selected prototype, thus the text of the prototype is displayed in the work field.

13. The computing device of claim 10, wherein the field-button “

Presentation management”

contains sub-buttons “

Create presentation”

, “

Open presentation for editing”

, “

Launch demonstration of presentation”

, “

Delete presentation”

, “

Save presentation as” and

wherein the icons of the presentation prototypes with captions are displayed in the work field.

14. The computing device of claim 10, wherein the field-button “

Text editing”

contains sub-buttons “

Text import”

, “

Text verbal dictation with recognition”

, “

Text input from on-screen keyboard”

, “

Insert the marker of the frame text edge.”

15. The computing device of claim 10, wherein the field-button “

Sound editing”

contains sub-buttons “

Import sound from file and markup sound into words”

, “

Record sound from microphone and markup sound into words”

, wherein the text of the prototype is split into segments corresponding to fragments of the presentation and is displayed in the work field, so that a text part of the presentation for which an audio track is already marked up into fragments is different from a part for which markup is not done yet.

16. The computing device of claim 10, wherein the field-button “

Graphic editing”

contains sub-buttons “

Turn on/turn off figures automatic recognition mode”

, “

Turn on/turn off text narrator”

, “

Move forward/back through frames”

, wherein an image sheet, tools and a palette for creating and editing graphic images of a current frame is displayed in the work field.

17. The computing device of claim 10, wherein upon pressing on the “

Sound editing”

button, the icons of graphic images corresponding to the frames are displayed in the segments of a the work field along with the text.

18. The computing device of claim 17, wherein when the segments of the work field are pressed on, a pronounceable or a recognizable text is attached to the frame text displayed in a current segment of the work field.

19. The computing device of claim 17, wherein a sub-button “

Move forward/back through frames”

for the frame starting from the second is implemented in a form of two buttons “

Scroll forward/back” and

“

Select the look of transition between frames”

, wherein when the button “

Select the look of transition between frames”

is pressed, a list of the selection of the transition mode is displayed as a set of the buttons;

“

Save frame image as starting image of the next frame”

, “

Erase frame image entirely and instantly”

, “

Erase frame image entirely with delay”

, “

Erase frame image entirely with eraser tool”

, “

Erase frame image up to background”

, “

Erase part of frame image with eraser tool”

, “

Erase selected elements of frame image”

, “

Restore final image of the frame before the previous”

, “

Move (rotate) the image opening blank space to create figures of a new frame and leaving in sight a small part of the previous frame image”

, “

Minimize frame image placing the icon on the field of a new frame”

, “

Shrink frame image and leave it on the field of a new frame”

, “

Expand frame image and leave it on the field of a new frame”

.

20. A method of using a computing device for creation of multimedia presentations prototypes with keyboard, microphone, speaker and screen where the control and selection of computing device operation modes buttons and a work field of data processing are displayed on the screen, wherein:

after launching, the computing device is switched to the presentation management mode;

upon pressing on create presentation button, the computing device is switched to creation of the presentation mode, wherein the presentation is created by;

naming the presentation;

creating a text part of the presentation by;

importing a text from an external file;

inputting a text from an on-screen keyboard;

a verbal text input with an automatic recognition;

placing the text into a work filed of the computing device screen;

inserting markers of frame text edge, wherein the text displayed in the work field is rendered inside the markers of the frames text edges; and

upon pressing on a sound editing button, the computing device switches to a sound editing mode of the presentation, wherein a sounds is imported form an external file or recorded from the microphone; and

wherein;

text of audio frames synchronized at a particular moment is presented as segments corresponding to the frames of the presentation, so a visual representation of the text, bars or edges of the frames for which the audio track has already been marked up into fragments is different from a presentation of a text, bars or edges of the frames for which the audio track has not been marked up yet; and

a visual border of a text content of the presentation corresponds to split frames with marked up and not marked up audio contents so that location of the border on the screen stays constant as a result of scrolling of the frame bars in a process of marking up.