METHOD AND SYSTEM FOR GENERATING ANIMATED ART EFFECTS ON STATIC IMAGES

• US 20130141439A1
• Filed: 11/30/2012
• Published: 06/06/2013
• Est. Priority Date: 12/01/2011
• Status: Abandoned Application

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: SAFONOV, Ilia, SONG, Min-suk, SURNENI, Gnana Sekhar, KRYZHANOVSKY, Konstantin, VILKIN, Alexey
• Application Number:
  US13/691,165
• Publication Number:
  US 20130141439A1
• Time in Patent Office: Days
• US Class Current: 345/473
• CPC Class Codes: G06T 13/80 2D [Two Dimensional] animation, e.g. using sprites

Abstract

A method and system for generating animated art effects while viewing static images, where the appearance of effects depends upon on the content of an image and parameters of accompanying sound is provided. The method of generating animated art effects on static images, based on the static image and accompanying sound feature analysis, includes storing an original static image; detecting areas of interest on the original static image and computing features of the areas of interest; creating visual objects of art effects according to the features detected in the areas of interest; detecting features of an accompanying sound; modifying parameters of visual objects in accordance with the features of the accompanying sound; and generating a frame of an animation including the original static image with superimposed visual objects of art effects.

Claims

1. A method of generating animated art effects on static images, the method comprising:

detecting areas of interest on an original static image and determining features of the areas of interest;

creating visual objects of art effects which relate to the features of the areas of interest;

modifying parameters of visual objects in accordance with features of an accompanying sound; and

generating an animation frame comprising the original static image with superimposed visual objects of art effects.

2. The method of claim 1, wherein the detecting of areas of interest comprises processing the original static image by performing at least one of brightness control, contrast control, gamma correction, customization of balance of white color and conversion of the color system of the original static image.

3. The method of claim 1, wherein the features of the accompanying sound the accompanying sound comprise volume, spectrum, speed, clock cycle, rate and rhythm.

4. The method of claim 1, wherein the generating of the animation frame comprises processing pixels of the original static image by a filter, before combining the processed pixels with the visual objects.

5. The method of claim 1, wherein in the generating of the animation frame, the visual objects are randomly chosen for representation from a set of available visual objects.

6. The method of claim 1, wherein in the generating of the animation frame the visual objects are chosen for representation from a set of available visual objects based on a probability, which depends on features of the visual objects.

17. A non-transitory computer-readable recording medium having embodied thereon a program, wherein the program, when executed by a processor of a computer, causes the computer to execute the method of claim 1.

7. A system for generating animated art effects on static images, the system comprising:

a module which detects areas of interest on an original static image and which detects a position of the areas of interest;

a module which detects features of the areas of interest;

a module which generates visual objects of art effects which relate to the features of the areas of interest;

a module which detects features of an accompanying sound and determines parameters of the accompanying sound;

a module which generates animation frames by combining the static images and the visual objects, which are modified based on current features of the accompanying sound, according to semantics of operation of an effect; and

a display unit which displays the animation frames.

8. The system of claim 7, wherein the module which detects the areas of interest automatically detects the position of the areas of interest according to semantics of operation of an effect, using methods and tools of processing and segmentation of images, and a list of the detected areas of interest, is formed at an output of the module which detects the areas of interest.

9. The system of claim 8, wherein the list of the areas of interest and the static images are provided as an input of the module which detects the features of the areas of interest;

the module which detects the features of the areas of interest computes a set of features according to the semantics of operation of an effect for each area of interest from the input list, and the list of the features of the areas of interest, which is further transferred to the module which generates the visual objects, is formed at an output of the module which detects the features of the areas of interest.

10. The system of claim 9, wherein the list of the features of the areas of interest are provided as an input of the module which generates the visual objects, the module which generates the visual objects generates a set of visual objects from a group including figures, trajectories, sets of peaks, textures, styles, and composite objects, according to the semantics of operation of the effect, and wherein the list of visual objects is formed at an output of the module which generates the visual objects.

11. The system of claim 10, wherein a fragment of an audio signal of accompanying sound arrives as an input of the module which detects the features of the accompanying sound, the module which detects the features of the accompanying sound analyzes audio data and detects features according to the semantics of operation of the effect, and the list of features of accompanying sound for a current moment of time is formed at an output of the module which detects the features of the accompanying sound by request of the module which generates the animation frames.

12. The system of claim 11, wherein the static images, the list of visual objects of an effect, and the list of features of accompanying sound are provided as an input to the module which generates the animation frames, and wherein the image of the animation frame, which is transferred to the display unit, is formed at an output of the module which generates the animation frames.

13. The system of claim 7, wherein the module which detects the features of the accompanying sound contains a block of extrapolation of values of features that allows the module which detects the features of the accompanying sound to work asynchronously with the module which generates the animation frames.

14. The system of claim 13, wherein the module which detects the features of the accompanying sound, processes new fragments of audio data as the new fragments of audio data become accessible, and provides accompanying sound features in reply to requests of the module which generates the animation frames, selectively performing extrapolation of values of features.

15. The system of claim 7, wherein the module which detects the features of the accompanying sound contains a block of interpolation of values of features that allows the module which detects the features of accompanying sound to work asynchronously with the module which generates the animation frames.

16. The system of claim 15, wherein the module which detects the features of the accompanying sound, processes new fragments of audio data as the new fragments of audio data become accessible, and wherein the module provides accompanying sound features in response to requests of the module which generates the animation frames, selectively performing interpolation of values of features.

18. A system for generating animated art effects on static images, the system comprising:

a module which detects areas of interest of a static image, as well as positions of the areas of interest and features of the areas of interest;

a module which generates visual objects of an effect;

a module which detects features and parameters of an accompanying sound;

a module which generates animation frames by combining static images, the parameters of the accompanying sound and the visual objects, which are modified according to semantics of operation of an effect.

19. The system of claim 18, wherein the module which detects the position and features of the areas of interest, processes and segments images, and wherein the detected areas of interest are provided at an output of the module which detects the areas of interest.

20. The system of claim 19, wherein a list of the features of the areas of interest is transferred to the module which generates the visual objects.

21. The system of claim 18, wherein the module which detects the features of the accompanying sound contains a block of extrapolation of values of features that allows the module which detects the features of the accompanying sound to work asynchronously with the module which generates the animation frames.

22. The system of claim 21, wherein the module which detects the features of the accompanying sound, processes new fragments of audio data as they become available, and provides accompanying sound features in reply to requests from the module which generates the animation frames.

23. A method of generating animated art effects on static images, the method comprising:

detecting areas of interest and computing features relating to the areas of interest in an original static image;

generating visual objects of art effects which relate to the detected features;

modifying parameters of visual objects in accordance with features of an accompanying sound; and

generating an animation frame comprising the original static image with superimposed visual objects of art effects.

24. The method of claim 23, wherein the detecting of the areas of interest comprises performing at least one of brightness control, contrast control, gamma correction, customization of balance of white color and conversion of the color system of the image.

25. The method of claim 23, wherein the accompanying sound is determined by at least one of volume, spectrum, speed, clock cycle, rate and rhythm.