IMAGE ENHANCEMENT APPARATUS

• US 20140071137A1
• Filed: 09/05/2013
• Published: 03/13/2014
• Est. Priority Date: 09/11/2012
• Status: Abandoned Application

• Current Assignee: Nokia Technologies Oy (Nokia Corporation)
• Original Assignee: Nokia Corporation
• Inventors: KANNAN, Rajeswari, SHENOY, Ravi, PATWARDHAN, Pushkar Prasad
• Application Number:
  US14/018,779
• Publication Number:
  US 20140071137A1
• Time in Patent Office: Days
• US Class Current: 345/473
• CPC Class Codes: G06T 13/205 driven by audio data
• CPC Class Codes: G11B 27/034 on discs G11B27/036, G11B27/038 take precedence
• CPC Class Codes: G11B 27/10 Indexing; Addressing; Timing or synchronising; Measuring tape travel
• CPC Class Codes: G11B 27/11 by using information not detectable on the record carrier
• CPC Class Codes: G11B 27/28 by using information signals recorded by the same method as the main recording G11B27/22 takes precedence

Abstract

A method comprising: analysing at least two images to determine at least one object mutual to the at least two images, the object having a periodicity of motion; generating an animated image based on the at least two images, wherein the at least one object is animated; determining at least one audio signal associated with the at least one object; and combining the at least one audio signal with the animated image to generate an audio enabled animated image.

Claims

1. An apparatus comprising at least one processor and at least one memory including computer code for one or more programs, the at least one memory and the computer code configured to with the at least one processor cause the apparatus at least to:

analyse at least two images to determine at least one object mutual to the at least two images, the object having a periodicity of motion;

generate an animated image based on the at least two images, wherein the at least one object is animated;

determine at least one audio signal associated with the at least one object; and

combine the at least one audio signal with the animated image to generate an audio enabled animated image.

2. The apparatus as claimed in claim 1, wherein determining the at least one audio signal associated with the at least one object causes the apparatus to:

receive the at least one audio signal; and

filter the at least one audio signal.

3. The apparatus as claimed in claim 2, wherein receiving the at least one audio signal causes the apparatus to:

receive at least a portion of the at least one audio signal from at least one microphone at substantially the same time as the captured at least two images.

4. The apparatus as claimed in claim 2, wherein filtering the at least one audio signal causes the apparatus to:

determine at least one foreground sound source of the at least one audio signal; and

filter the at least one audio signal to remove the at least one foreground sound source from the at least one audio signal to generate an ambience audio signal as the at least one audio signal.

5. The apparatus as claimed in claim 2, wherein filtering the at least one audio signal causes the apparatus to:

determine at least one foreground sound source of the at least one audio signal; and

filter the at least one audio signal to extract the at least one foreground sound source from the at least one audio signal to generate a dominant sound component as the at least one audio signal.

6. The apparatus as claimed in claim 1, wherein determining the at least one audio signal associated with the at least one object causes the apparatus to:

receive an indication of the at least one object mutual to the at least two images;

identify the at least one object mutual to the at least two images; and

generate the at least one audio signal based on the identified object.

7. The apparatus as claimed in claim 6, wherein identifying the at least one object causes the apparatus to:

determine a location associated with the at least two images;

identify the at least one object based on the location of the at least two images;

select the at least one object.

8. The apparatus as claimed in claim 6, wherein identifying the at least one object causes the apparatus to:

pattern recognition analysis of the at least one object mutual to the at least two images.

9. The apparatus as claimed in claim 1, wherein determining the at least one audio signal associated with the at least one object causes the apparatus to at least one of:

receive the at least one audio signal from an external audio database;

receive the at least one audio signal from an internal audio database;

receive the at least one audio signal from a memory; and

synthesize the at least one audio signal.

10. The apparatus as claimed in claim 2, wherein receiving the at least one audio signal further causes the apparatus to:

generate an audio flow model to control a presentation of the at least one audio signal; and

process the at least one audio signal using the audio flow model.

11. The apparatus as claimed in claim 10, wherein generating the audio flow model causes the apparatus to at least one of:

determine an audio signal process;

determine an audio signal volume;

determine an audio signal playback speed;

determine an audio signal repetition periodicity;

determine an audio signal start time; and

determine an audio signal end time.

12. The apparatus as claimed in claim 1, wherein the apparatus is further caused to:

time synchronise the at least one audio signal with the animated image to generate a synchronised audio enabled animated image.

13. The apparatus as claimed in claim 1, wherein analysing the at least two images to determine the at least one object mutual to the at least two images further causes the apparatus to:

receive the at least two images from an image source;

output the at least two images on a display; and

receive at least one user input determining the at least one object mutual to the at least two images.

14. The apparatus as claimed in claim 1, wherein analysing the at least two images to determine the at least one object mutual to the at least two images further causes the apparatus to:

correlate the at least two images to determine at least one candidate object, the at least one candidate object being mutual to the at least two images and having a periodicity of motion; and

select the at least one candidate object as the at least one object.

15. An electronic device comprising the apparatus of claim 1.

16. A method comprising:

analysing at least two images to determine at least one object mutual to the at least two images, the object having a periodicity of motion;

generating an animated image based on the at least two images, wherein the at least one object is animated;

determining at least one audio signal associated with the at least one object; and

combining the at least one audio signal with the animated image to generate an audio enabled animated image.

17. The method as claimed in claim 16, wherein determining the at least one audio signal associated with the at least one object comprises:

receiving the at least one audio signal; and

filtering the at least one audio signal.

18. The method as claimed claim 17, wherein filtering the at least one audio signal comprises at least one of:

determining at least one foreground sound source of the at least one audio signal;

filtering the at least one audio signal to remove the at least one foreground sound source from the at least one audio signal to generate an ambience audio signal as the at least one audio signal associated with the at least one object; and

filtering the at least one audio signal to extract the at least one foreground sound source from the at least one audio signal to generate at least one synthetic audio signal associated with the at least one object.

19. The method as claimed in claim 16, wherein determining the at least one audio signal associated with the at least one object comprises at least one of:

receiving an indication of the at least one object mutual to the at least two images;

identifying the at least one object mutual to the at least two images;

generating the at least one audio signal based on the identified object;

determining a location associated with the at least two images;

identifying at least one object based on the location of the at least two images; and

selecting the at least one object.

20. The method as claimed in claim 16, wherein the method is further comprising time synchronising the at least one audio signal with the animated image to generate a synchronised audio enabled animated image.