CONTEXT BASED VIDEO FINDER

• US 20100250585A1
• Filed: 03/04/2010
• Published: 09/30/2010
• Est. Priority Date: 03/24/2009
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Alonso Garcia, Javier, Kemp, Thomas, HAGG, Wilhelm, Eggink, Jana, Giron, Franck
• Granted Patent: US 8,346,801 B2
• Time in Patent Office: Days
• US Class Current: 707/769
• CPC Class Codes: G06F 16/70 of video data

Abstract

Embodiments of the invention relate to a method for video retrieval by providing a first audio video file, determining a first identifier of a first piece of music in the first audio video file, looking up for the first identifier first meta data in a music database, in which said first meta data are associated with said first identifier, providing second meta data of a second piece of music from the music database. The second piece of music is included in a second audio video file. Further the method is conducted by determining a similarity measure by comparing the first and second meta data, and providing the second audio video file or an identifier thereof depending on the similarity measure. Further embodiments relate to a server, a user device and a system and a computer program product for video retrieval.

Claims

1. A method for video retrieval, comprising:

providing a first audio video file;

determining a first identifier of a first piece of music in the first audio video file;

looking up for said first identifier first meta data in a music database, in which said first meta data are associated with said first identifier;

providing second meta data of a second piece of music from said music database, wherein the second piece of music is included in a second audio video file;

determining, using a microprocessor, a similarity measure by comparing the first and second meta data; and

providing the second audio video file or an identifier thereof depending on the similarity measure.

2. The method of claim 1, wherein the first and/or second meta data are descriptive of a genre, a mood, a title and/or an artist.

3. The method of claim 1, wherein the first and/or second meta data are descriptive of beats per minute BPM and/or of a further low level descriptor.

4. The method of claim 1, wherein the first and/or second meta data are descriptive of collaborative filtering information.

5. The method of claim 1 further comprising,

providing a confidence measure indicating a probability that the second piece of music is correctly identified in the second audio video file, wherein the similarity measure depends on the confidence measure.

6. The method of claim 1, wherein the similarity measure depends on a similarity of the user profile to a collaborative filtering information.

7. The method of claim 1, wherein the first and/or second meta data are descriptive of a first and a second temporal position of the first and second pieces of music in the first and second audio video file, respectively.

8. The method of claim 1, wherein the first and/or second meta data are descriptive of an temporal order of pieces of music included in the first and second audio video files, respectively.

9. The method of claim 1, wherein the first and/or second meta data are descriptive of a first and second length of the first and second pieces of music in the first and second audio video file, respectively.

10. The method of claim 1, wherein the second audio video file is included in or associated with a web page and the web page is provided to the user.

11. The method of claim 10, wherein the first audio video file is included in or associated with a further web page and the similarity measure is determined by comparing a design of the first and second web pages.

12. The method of claim 1, wherein said first and/or said second identifier is a fingerprint.

13. The method of claim 1, wherein said first meta data are determined independently from said first audio video file based on a music file and/or an audio video file, which is obtained independently from said audio video file provided by said user.

14. The method of claim 1, wherein the similarity measure is provided in a similarity database comprising a similarity matrix of pieces of music.

15. A server, comprising:

a communication unit adapted to receive a first audio video file;

a storage adapted to store a music database;

a data processor adapted to determine a first identifier of a first piece of music in the first audio video file, and to look up for said first identifier first meta data in the music database, in which said first meta data are associated with said first identifier, and to look up second meta data of a second piece of music from said music database, wherein the second piece of music is included in a second audio video file, the data processor further being adapted to determine a similarity measure by comparing the first and second meta data, and to provide, to the communication unit, the second audio video file or an identifier thereof depending on the similarity measure,

wherein the communication unit is further adapted to provide the second audio video file or the identifier thereof.