Information processing apparatus capable of modifying images based on audio data, program and information processing method

• US 8,891,909 B2
• Filed: 09/11/2009
• Issued: 11/18/2014
• Est. Priority Date: 10/10/2008
• Status: Expired due to Fees

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Mochizuki, Daisuke, Nishizawa, Kazuto, Okumura, Mitsuo, Kimura, Takaomi, Gotoh, Tomohiko
• Primary Examiner(s): Thirugnanam, Gandhi
• Application Number:
  US12/557,858
• Publication Number:
  US 20100092107A1
• Time in Patent Office: 1,894 Days
• Field of Search: 382/309
• US Class Current: 382/309
• CPC Class Codes: G03B 31/06 in which sound track is associated with successively-shown still pictures
• CPC Class Codes: G06T 13/00 Animation
• CPC Class Codes: G06T 5/00 Image enhancement or restoration
• CPC Class Codes: G11B 27/034 on discs G11B27/036, G11B27/038 take precedence
• CPC Class Codes: H04N 5/76 Television signal recording
• CPC Class Codes: H04N 9/8211 the additional signal being a sound signal H04N9/835 takes precedence
• CPC Class Codes: H04N 9/8233 the additional signal being a character code signal

Abstract

An information processing apparatus is provided that includes a playback unit to play back music data, an analysis unit to analyze a feature of a relevant image of the music data, an image correction unit to perform image correction with use of any of a plurality of correction types, a storage unit to store one or more than one image, a selection unit to select a correction type corresponding to the feature of the relevant image analyzed by the analysis unit from the plurality of correction types, a correction control unit to cause the image correction unit to perform image correction of an image stored in the storage unit with use of the correction type selected by the selection unit, and an output unit to output the image corrected by the image correction unit.

Claims

1. An information processing apparatus embodied in a computer having a microprocessor, the apparatus comprising:

an analysis unit to analyze a feature of a reference image relevant to audio data;

an image selection unit to select one or more images based on a mood of the audio data;

a layout control unit to separate the audio data into a plurality of time frames, wherein the image selection unit selects a number of images based on a number of the time frames;

a selection unit to select an image modification type based on the feature of the reference image from a plurality of image modification types;

an image correction unit to modify the selected one or more images with use of the selected image modification type;

a control unit, performed by the computer, to cause the image correction unit to modify the selected one or more images with use of the modification type selected by the selection unit; and

an output unit to output the modified one or more images with the audio data.

2. The information processing apparatus according to claim 1, further comprising:

a creation unit to create a display screen including the modified one or more images.

3. The information processing apparatus according to claim 1, wherein

the selected image modification type includes a change to a visual effect performed on the one or more images;

and

the control unit causes the image correction unit to change the visual effect over a lapse of time.

4. The information processing apparatus according to claim 1, wherein

the image selection unit selects the one or more images further based on one of a release date, title, genre of the audio data.

5. The information processing apparatus according to claim 1, wherein

the layout control unit separates the audio data into a plurality of time frames based on the mood of the audio data.

6. The information processing apparatus according to claim 2, wherein

the analysis unit further analyzes a font of a character contained in the reference image, and

the display screen further includes additional information represented by a font identical or similar to the font analyzed by the analysis unit.

7. The information processing apparatus according to claim 2, wherein

the display screen further includes additional information of the reference image represented by a font corresponding to a feature of the audio data.

10. The information processing apparatus according to claim 1, further comprising:

a feature analyzing unit to identify a feature of the audio data.

8. A non-transitory memory storing a program for causing a computer to:

analyze a feature of a reference image relevant to audio data;

select one or more images based on a mood of the audio data;

separate the audio data into a plurality of time frames;

determine a number of selected images based on a number of the time frames;

select an image modification type based on the feature of the reference image from a plurality of image modification types;

modify the selected one or more images with use of the selected image modification type; and

output the modified one or more images with the audio data.

9. An information processing method comprising the steps of:

analyzing a feature of a reference image relevant to audio data;

selecting one or more images based on a mood of the audio data;

separating the audio data into a plurality of time frames;

determining a number of selected images based on a number of the time frames;

selecting an image modification type based on the feature of the reference image from a plurality of modification types;

modifying the selected one or more images with use of the selected modification type; and

outputting the modified one or more images with the audio data.

11. The method according to claim 9, wherein the audio data is separated based on the mood of the audio data.