Display of media previews

• US 6,370,543 B2
• Filed: 04/30/1997
• Issued: 04/09/2002
• Est. Priority Date: 05/24/1996
• Status: Expired due to Term

• Current Assignee: The Procter & Gamble Company
• Original Assignee: Magnifi, Inc. (Emmperative Marketing, Inc.)
• Inventors: Cremin, Karl, Smoot, Steve, Mills, Michael, Hoffert, Eric M., Ali, Adnan
• Primary Examiner(s): Alam, Hosain T.
• Assistant Examiner(s): Colbert, Ella
• Application Number:
  US08/847,156
• Publication Number:
  US 20010014891A1
• Time in Patent Office: 1,805 Days
• Field of Search: 707/104, 707/103, 707/512, 707/104.1, 395/200.77, 348/394, 348/41, 348/394.1, 345/302, 345/800, 345/815, 375/240, 725/37, 725/107, 725/110, 725/111, 725/112, 725/113, 725/41
• US Class Current: 725/113
• CPC Class Codes: G06F 16/40 of multimedia data, e.g. slideshows comprising image and additional audio data retrieval of still image data G06F16/50; retrieval of audio data G06F16/60; retrieval of video data G06F16/70
• CPC Class Codes: G06F 16/48 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 16/78 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 16/7834 using audio features
• CPC Class Codes: G06F 16/7844 using original textual content or text extracted from visual content or transcript of audio data
• CPC Class Codes: G06F 16/785 using colour or luminescence
• CPC Class Codes: G06F 16/786 using motion, e.g. object motion or camera motion
• CPC Class Codes: G06F 16/951 Indexing; Web crawling techniques
• CPC Class Codes: G06F 16/953 Querying, e.g. by the use of web search engines
• CPC Class Codes: Y10S 707/914 Video
• CPC Class Codes: Y10S 707/915 Image
• CPC Class Codes: Y10S 707/916 Audio
• CPC Class Codes: Y10S 707/943 News
• CPC Class Codes: Y10S 707/99945 Object-oriented database structure processing

Abstract

A method and apparatus for searching for multimedia files in a distributed database and for displaying results of the search based on the context and content of the multimedia files.

Claims

1. A method comprising:

examining a media object to locate portions of the media object having a plurality media object comprises digital video;

determining a preview image size by computing an aspect ratio A and determining a target height IH of said preview image as the preview height FH less the height of any top and bottom border and determining a target width IW of said preview image as a function of said target height IH and said aspect ratio A;

selecting images from said media object for display in said preview;

storing said preview of the media object based on said content-based predetermined characteristics;

searching a database of previews based on one or more of said content-based predetermined characteristics; and

displaying the preview in response to the search.

2. The method of claim 1, wherein the content-based predetermined characteristics may include video characteristics and audio characteristics.

3. The method of claim 2, wherein the video characteristics comprise video motion activity determined by one or more of a motion metric and a brightness metric.

4. The method of claim 3, wherein the motion metric comprises an estimate of the type of content found in a video file.

5. The method of claim 4, wherein the video file may be characterized as containing a low, medium, or high degree of motion.

6. The method of claim 5, wherein the low degree of motion is indicative of a talk show.

7. The method of claim 5, wherein the medium degree of motion is indicative of newscasts or commercials.

8. The method of claim 5, wherein the high degree of motion is indicative of action films and sports.

9. The method of claim 3, wherein the brightness metric comprises an estimate of the brightness content found in the video file.

10. The method of claim 9, wherein the video file may be characterized as containing a dark, moderate or bright intensity of brightness.

11. The method of claim 3, wherein the motion metric and brightness metric combined, may enhance a user'"'"'s ability to search a video.

12. The method of claim 2, wherein the audio characteristics comprise audio amplitude activity determined by a music-speech metric.

13. The method of claim 12, wherein the music-speech metric comprises an estimate of the type of content found in an audio file.

14. The method of claim 13, wherein the audio file may be characterized as containing a low, moderate, or high rate of change in amplitude activity.

15. The method of claim 14, wherein the low rate of change in amplitude activity is indicative of music signals.

16. The method of claim 14, wherein the moderate rate of change in amplitude activity is indicative of music and speech signals.

17. The method of claim 14, wherein the high rate of change in amplitude activity is indicative of speech signals.

18. The method of claim 13, wherein the audio file may be characterized as containing a continuous or discontinuous signal.

19. The method of claim 18, wherein the continuous signal is indicative of music signals.

20. The method of claim 18, wherein the discontinuous signal is indicative of speech signals.

21. The method of claim 1, wherein the preview comprises a low-bandwidth presentation of said media object.

22. The method of claim 1 further comprising computing the number of images for display as the preview width divided by the sum of the target width IW and any spacing between images.

23. The method of claim 1, wherein the selecting images from said media object comprises:

decompressing frames of said media object at N points;

analyzing each of said frames to determine if said frames meet content-based predetermined characteristics and if one or more fames of said frames do meet said predetermined characteristics, selecting the one or more frames for display; and

if one or more frames of said frames do not meet said predetermined characteristics, selecting one or more substitute frames.

24. A method for storing a representation of a media object comprising:

examining said media object to locate portions of the media object having a plurality of content-based predetermined characteristics, wherein the media object comprises digital video;

determining a preview image size by computing an aspect ratio A and determining a target height IH of said preview image as the preview height FH less the height of any top and bottom border and determining a target width IW of said preview image as a function of said target height IH and said aspect ratio A;

selecting images from said media object for display in said preview; and

storing said preview of the media object.

25. The method of claim 24 further comprising searching a database of previews based on one or more of said content-based predetermined characteristics.

26. The method of claim 24 further comprising displaying said preview.

27. The method of claim 24 further comprising computing the number of images for display as the preview width divided by the sum of the target width IW and any spacing between images.

28. The method of claim 24, wherein the selecting images from said media object comprises:

decompressing frames of said media object at N points;

analyzing each of said frames to determine if said frames meet content-based predetermined characteristics and if one or more frames of said frames do meet said content-based predetermined characteristics, selecting the one or more frames for display; and

if one or more frames of said frames do not meet said predetermined characteristics, selecting one or more substitute frames.

29. A method comprising:

examining a media object to locate portions of the media object having a plurality of context-based and content-based predetermined characteristics based on a proximity of lexical information, wherein the context-based and content-based predetermined characteristics may include video characteristics and audio characteristics the audio characteristics comprising amplitude activity determined by a music-speech metric;

storing a preview of the media object;

searching a database of previews based on one or more of said context-based and content-based predetermined characteristics; and

displaying the preview in response to the search.

30. The method of claim 29, wherein the lexical information may include relevant text.

31. The method of claim 29, wherein the video characteristics comprise video motion activity determined by one or more of a motion metric and a brightness metric.

32. A method comprising:

examining a media object to locate portions of the media object having a plurality of predetermined characteristics, wherein the predetermined characteristics are content-based charcteristics including video characteristics and audio characteristics, the audio characteristics comprising audio amplitude activity determined by a music-speech metric;

storing a preview of the media object and

searching a database of previews based on one or more of said predetermined characteristics; and

displaying the preview in response to the search.

33. The method of claim 32, wherein the music-speech metric comprises an estimate of the type of content found in an audio file.

34. The method of claim 33, wherein the audio file may contain a low, moderate, or high rate of change in amplitude activity.

35. The method of claim 33, wherein the audio file may contain a continuous or discontinuous signal.

36. A method comprising:

examining a media object to locate portions of the media object having a plurality of predetermined characteristics, wherein the predetermined characteristics are content-based characteristics;

determining a preview image size;

selecting images from said media object for display in said preview by decompressing frames of said media object at N points and analyzing each of said frames to determine if said frames meet predetermined characteristics;

if said frames do meet said predetermined characteristics, selecting said frames for display;

if one of said frames do not meet said predetermined characteristics, selecting a substitute frame;

storing a preview of the media object;

searching a database of previews based on one or more of said predetermined characteristics; and

displaying the preview in response to the search.

37. The method of claim 36, wherein the media object comprises a digital video, the method further comprising:

computing an aspect ratio A;

determining a target height IH of said preview image as the preview height FH less the height of any top and bottom border; and

determining a target width IW of said preview image as a function of said target height IH and said aspect ratio A.

38. The method of claim 37 futher comprising computing the number of images for display as the preview width divided by the sum of the target width IW and any spacing between images.

39. A method comprising the steps of:

a step for examining a media object to locate portions of the media object having a plurality of content-based predetermined characteristics, wherein the media object comprises digital video;

a step for determining a preview image size by computing an aspect ratio A and determining a target height IH of said preview image as the preview height FH less the height of any top and bottom border and determining a target width IW of said preview image as a function of said target height IH and said aspect ratio A;

a step for selecting images from said media object for display in said preview;

a step for storing said preview of the media object;

a step for searching a database of previews based on one or more of said content-based predetermined characteristics; and

a step for displaying the preview in response to the search.

40. A method comprising the steps of:

a step for examining a media object to locate portions of the media object having a plurality of predetermined characteristics, wherein the predetermined characteristics are content-based characteristics;

a step for determining a preview image size;

a step for selecting images from said media object for display in said preview by decompressing frames of said media object at N points and analyzing each of said frames to determine if said frames meet predetermined characteristics;

if said frames do meet said predetermined characteristics, selecting said frames for display;

if one of said frames do not meet said predetermined characteristics, selecting a substitute frame;

a step for storing a preview of the media object;

a step for searching a database of previews based on one or more of said predetermined characteristics; and

a step for displaying the preview in response to the search.