CREATION OF A MULTI-MEDIA PRESENTATION

• US 20090307207A1
• Filed: 06/09/2008
• Published: 12/10/2009
• Est. Priority Date: 06/09/2008
• Status: Abandoned Application

• Current Assignee: Eastman Kodak Company
• Original Assignee: Eastman Kodak Company
• Inventors: Murray, Thomas J.
• Application Number:
  US12/135,521
• Publication Number:
  US 20090307207A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/433 using audio data
• CPC Class Codes: G06F 16/4393 Multimedia presentations, e.g. slide shows, multimedia albums
• CPC Class Codes: G10H 1/368 displaying animated or moving pictures synchronized with the music or audio part
• CPC Class Codes: G10H 2210/066 for pitch analysis as part of wider processing for musical purposes, e.g. transcription, musical performance evaluation; Pitch recognition, e.g. in polyphonic sounds; Estimation or use of missing fundamental
• CPC Class Codes: G10H 2210/076 for extraction of timing, tempo; Beat detection tempo display G10H2220/081; tempo control G10H2210/375
• CPC Class Codes: G10H 2220/011 Lyrics displays, e.g. for karaoke applications
• CPC Class Codes: G10H 2240/135 Library retrieval index, i.e. using an indexing scheme to efficiently retrieve a music piece
• CPC Class Codes: G10H 2240/311 MIDI transmission G10H2240/056 takes precedence
• CPC Class Codes: G11B 27/034 on discs G11B27/036, G11B27/038 take precedence
• CPC Class Codes: G11B 27/105 of operating discs

Abstract

A computer implemented method, computer system, and program storage device can be used for displaying images or videos simultaneously with a composition text that is read or sung. The displayed images or videos have been identified as related to selected words or phrases of the composition text and are displayed only when those selected words or phrases are read or sung in the accompanying audio playback. A number of techniques can be used to identify the appropriate images or videos for the selected words or phrases.

Claims

1. A computer implemented method for producing a multimedia presentation, comprising the steps of:

providing to a computer system, text of a composition that is read or sung in a corresponding audio file;

automatically searching metadata associated with media to identify those media that correspond to at least one word or phrase of the composition text, wherein the identified media comprises video and still images; and

automatically simultaneously displaying the identified media while playing the corresponding audio file.

2. The method of claim 1 wherein the media are stored on the computer-accessible memory system, and wherein the step of searching metadata includes the step of searching metadata stored in the computer-accessible memory system.

3. The method of claim 1 wherein the audio file is stored in a computer-accessible memory system and wherein the step of displaying the identified media includes the step of displaying the identified media on a display device.

4. The method of claim 1 further comprising the step of ranking the identified media based at least on:

the strength of the identified media relevance to at least one word or phrase in the composition text,

the quality of the identified media, or both the strength of the identified media relevance to at least one word or phrase in the composition text and the quality of the identified media.

5. The method of claim 1 wherein the step of ranking the words or phrases in the composition text further comprises the step of counting a number of occurrences of the words or phrases in the composition text.

6. The method of claim 1 wherein the step of ranking the words or phrases in the composition text further comprises the step of determining whether the words or phrases appear in a title of the composition text.

7. The method of claim 1 further comprising the step of ranking the words or phrases from the composition text according to their vocal emphasis as read or sung in the corresponding audio file of the composition text.

8. The method of claim 7 wherein the step of ranking the words or phrases from the composition text further comprises the step of detecting a voice inflection in the audio file reading or singing of the words or phrases.

9. The method of claim 1 wherein the identified media is displayed for words or phrases in the composition text for varying display durations.

10. The method of claim 1 wherein the media are not stored on the computer system containing composition text and wherein the metadata is searched on a network to which the computer system is connected.

11. A computer system comprising:

storage for text of a composition that is read or sung in a corresponding audio file, the corresponding audio file stored in the storage, wherein the storage also stores a plurality of media each having associated metadata stored therewith, and wherein the media comprise video and still images;

a programmed processor for searching the metadata associated with the media to identify those media that correspond to at least one word or phrase of the composition text; and

a display device under control of the programmed processor for simultaneously displaying the identified media while playing the corresponding audio file.

12. The computer system of claim 11 wherein the display device is a personal digital assistant (PDA), cell phone, digital picture frame, digital projection, or monitor.

13. A program storage device readable by a computer that embodies a program of instructions executable by the computer to perform method steps for generating a multimedia presentation, said method steps comprising:

reading and storing text of a composition that is read or sung in a corresponding audio file;

automatically searching metadata associated with media to identify those media that correspond to at least one word or phrase of the composition text, wherein the identified media comprises video and still images; and

automatically simultaneously displaying the identified media while playing the corresponding audio file.

14. The program storage device of claim 13 wherein the media are stored on the computer used to read the program of instructions, and wherein the step of automatically searching metadata includes the step of automatically searching metadata stored on that computer.

15. The program storage device of claim 13 wherein the audio file is stored on the computer used to read the program of instructions, and wherein the step of simultaneously displaying the identified media includes the step of simultaneously displaying the identified media on a display device coupled to the computer.

16. The program storage device of claim 13 wherein the program of instructions provides a step of ranking the identified media based on:

the strength of identified media relevance to the at least one word or phrase in the composition text,

the quality of the identified media, or

both the strength of identified media relevance to the at least one word or phrase in the composition text and the quality of the identified media.

17. The program storage device of claim 13 wherein the program of instructions provides a step of ranking individual words or phrases from the composition text according to their vocal emphasis as read or sung in the corresponding audio file of the composition text.

18. The program storage device of claim 13 wherein the program of instructions provides:

a step of ranking individual words or phrases from the composition text according to a number of occurrences of the individual words or phrases in the composition text,

a step of determining whether the words or phrases appear in a title of the composition text, or

both steps.

19. The program storage device of claim 13 wherein the program of instructions provides a step of displaying identified media for various words or phrases in the composition text for different display durations.