HIGHLY MEANINGFUL MULTIMEDIA METADATA CREATION AND ASSOCIATIONS

• US 20070294295A1
• Filed: 06/16/2006
• Published: 12/20/2007
• Est. Priority Date: 06/16/2006
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Sponsoring Entity: Microsoft Corporation
• Inventors: Finch, Gregory D., Finkelstein, Charles A.
• GRANTED PATENT: US 7,921,116 B2
• Time in patent office: 0 Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/40 of multimedia data, e.g. slideshows comprising image and additional audio data retrieval of still image data G06F16/50; retrieval of audio data G06F16/60; retrieval of video data G06F16/70
• CPC Class Codes: G06F 16/48 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 16/70 of video data

Abstract

Systems and methods for generating temporal metadata for a media source as a function of detected content. An analysis engine detects content within a media stream of a media source. A metadata creation engine generates temporal metadata as a function of the detected content. The generated temporal metadata may be used to create a media log for the media source, generate metadata subsequent detected content and to compare to media sources.

Claims

1. A system for creating temporal metadata from a media source comprising:

an import engine for obtaining a media stream from the media source, said import engine generating a media sequence from the media stream;

an analysis engine for detecting content within the media sequence;

a temporal metadata creation engine for creating temporal metadata for the media sequence as function of the detected content; and

a metadata storage component for storing the temporal metadata for the media source.

2. The system of claim 1, further comprising a user interface component for modifying a threshold setting of the analysis engine, modifying the created temporal metadata, and searching the stored temporal metadata.

3. The system of claim 1, wherein the media stream comprises at least one of the following types:

an audio stream, a video stream and a still video stream.

4. The system of claim 1, wherein the media sequence comprises at least one of the following types:

an audio sequence, a video sequence and a still video sequence.

5. The system of claim 1, wherein the media source comprises at least one of the following:

a motion video without sound, a motion video with sound, a sound recording and a digital photograph.

6. The system of claim 1, wherein the media source is generated by at least one of the following:

a digital camera, a cellular phone, a sound recorder, a video camera, a scanner, a computer, a digital video recording device and a digital audio player.

7. The system of claim 1, wherein the analysis engine comprises at least one of the following components:

music beat detection, audio dynamic peaks detection, speech detection, word boundary detection, word and phrase detection, dynamic image peaks, dynamic image change detection, and image pattern recognition.

8. The system of claim 1, wherein one of the components of the analysis engine is bypassed as a function of the type of media sequence.

9. The system of claim 1, wherein the metadata comprises at least one of the following:

alphanumeric text description of the detected content, motion video thumbnails of the detected content, audio thumbnail of the detected content, and still thumbnail of the detected content.

10. The system of claim 1, wherein the metadata storage component comprises a searchable database.

11. The system of claim 1, wherein the temporal metadata corresponds to at least one of closed captioning and subtitles.

12. The system of claim 1, wherein the temporal metadata comprises a searchable database including information indicating at least one of the following:

a location most appropriate to insert an advertisement and a location of adult content.

13. The system of claim 1, wherein the temporal metadata creation engine aggregates the metadata of the detected content for the media sequence and generates a log for the media source as a function of the aggregated metadata.

14. The system of claim 1, further comprising a metadata tagging component for creating metadata compatible with at least of the following:

online video repositories and media asset applications.

15. A method of providing temporal metadata for a media stream comprising:

detecting a first content within a first sequence of the media stream;

generating first temporal metadata for the first sequence as a function of the detected first content; and

detecting a second content within a second sequence of the media stream; and

generating second temporal metadata for the second sequence as a function of the detected second content and as a function of the first temporal metadata.

16. The method of claim 15, further comprising:

identifying, by a user, the first detected content; and

generating first temporal metadata for the first sequence as a function of the detected first content and the user identification.

17. The method of claim 16, wherein the user identifies a person in the first detected content and temporal metadata is generated for that person in the second detected content.

18. The method of claim 15, wherein the first and second content comprises at least one of the following:

voice pattern, and image pattern.

19. A method of comparing a first media stream and second media stream comprising:

analyzing the first media stream for a first content as a function of a first characteristic of the first media stream;

generating a first set temporal metadata based on the first content;

analyzing the second media stream for a second content as a function of a second characteristic of the second media stream;

generating a second set temporal metadata based on the second content;

comparing the first media stream to the second media stream as of function of the first and the second characteristics

providing an evaluation of the second media stream as a function of the comparison, the first set of temporal metadata and the second set of temporal metadata.

20. The method of claim 19, wherein at least one of the first characteristic and the second characteristic indicates at least one of the following:

copyright, a viewer rating, and adult content.