Apparatus and method for optimizing keyframe and blob retrieval and storage

• US 6,119,123 A
• Filed: 12/02/1997
• Issued: 09/12/2000
• Est. Priority Date: 12/02/1997
• Status: Expired due to Fees

• Current Assignee: US Philips Corporation (Koninklijke Philips N.V.)
• Original Assignee: US Philips Corporation (Koninklijke Philips N.V.)
• Inventors: Elenbaas, Jan Hermanus, Dimitrova, Nevenka
• Primary Examiner(s): Black, Thomas G.
• Assistant Examiner(s): Mills, John G.
• Application Number:
  US08/982,972
• Time in Patent Office: 1,015 Days
• Field of Search: 707/1-225
• US Class Current: 1/1
• CPC Class Codes: G06F 16/71 Indexing; Data structures therefor; Storage structures
• CPC Class Codes: G06F 16/745 the internal structure of a single video sequence
• CPC Class Codes: Y10S 707/99943 Generating database or data structure, e.g. via user interface
• CPC Class Codes: Y10S 707/99945 Object-oriented database structure processing

Abstract

A method and apparatus for forming a visual index of scenes in a video image which has been or is being recorded in a computer readable memory. A selected number of keyframes are derived from the recorded image, each being representative of a respective scene therein. The keyframes are then ordered into a selected number of levels of detail of the scenes represented thereby, each level including a predetermined number of keyframes, each subsequent level including keyframes of greater detail than those in a preceding level. A header file is then formed which is descriptive of the ordered set of keyframes, and the header file is stored together with the ordered set of keyframes in the computer readable memory. A user can thereby identify and obtain optimized retrieval in accordance with his preferences of particular segments of the video image from a relatively slow memory device. The method and apparatus are equally applicable to formation of an indexed order of binary large objects ("blobs") in a set of multimedia documents in accordance with a user'"'"'s preferences.

Claims

1. A method of forming a user index of scenes in a video image which is recorded or being recorded in a computer-readable medium, said method comprising the steps of:

retrieving from the recorded video image a selected number of keyframes therein, each keyframe being a frame representative of a respective scene in said image;

ordering the keyframes in accordance with user preference information into a hierarchy of a selected number of levels of detail in the scenes represented thereby, each level including a predetermined number of keyframes, each subsequent level including keyframes of greater detail than those in a preceding level; and

storing the ordered keyframes in said computer-readable medium to thereby form said user index of scenes in said image ordered in accordance with the user preference information, thus reducing the time for accessing the ordered hierarchy for scenes according to the user'"'"'s preferences.

2. A method of forming a user index as claimed in claim 1, further comprising the steps of:

creating at least one header file which is descriptive of said keyframes; and

storing the at least one header file with the ordered keyframes, so that said header file is included in the user index.

3. A system for forming a user index of scenes in a video image which is recorded or being recorded in a computer-readable memory, said system comprising:

means for retrieving from said memory a selected number of keyframes of the video image, each keyframe being a frame representative of a respective scene in said image;

a first processor for ordering the keyframes in a hierarchy in accordance with user preference information into a selected number of levels of detail in the scenes represented thereby, each level including a predetermined number of keyframes, each subsequent level including keyframes of greater detail than those in a preceding level;

a second processor for creating at least one header file which is descriptive of said keyframes, and storing said at least one header file with the ordered keyframes so as to form said user index in said memory; and

means for retrieving said user index and displaying the keyframes therein for each level as such level is retrieved from said memory ordered in accordance with the user preference information, thus reducing the time for accessing the user index for scenes according to the user'"'"'s preferences.

4. A system as claimed in claim 3, wherein said first processor and said second processor are parts of a main processor.

5. A method for forming a user file of binary large objects ("blobs") in a set of multimedia documents recorded in a computer-readable medium, so as to optimize retrieval of blobs in accordance with user preference information;

said method comprising the steps of;

creating a preference file based on the user preference information;

retrieving blobs from the multimedia documents and ordering them into a selected number of levels in accordance with said preference file, each level including at least one blob from at least one of said documents and at least one link to another of said documents, each subsequent level including blobs from further multimedia documents; and

storing particular blobs and links in said computer-related medium so as to form a user file for retrieval thereof from said set of multimedia documents in accordance with said preference file, thereby reducing the time for accessing the user file for blobs according to the user'"'"'s preferences.

6. A system for forming a user file of binary large objects ("blobs") in a set of multimedia documents recorded in a computer-readable medium, so as to optimize retrieval of blobs in accordance with user preference information;

comprising;

a first processor for retrieving blobs from the multimedia documents and ordering them into a selected number of levels, each level including at least one blob from at least one of said documents and at least one link to another of said documents, each subsequent level including blobs from further multimedia documents;

a second processor for organizing the blobs and links from the first processor into a user file ordered in accordance with the user preference information;

a memory for storing the user file; and

means for retrieving blobs and links from the stored user file and displaying them to the user as each is retrieved, whereby the time for the user to access the user file for blobs and links according to the user'"'"'s preferences is reduced.

7. A system as claimed in claim 6, wherein said first processor and said second processor are part of a main processor.

8. A system as claimed in claim 6, wherein said memory is part of said computer-readable medium.

9. A system as claimed in claim 6, wherein said second processor analyzes each blob and link and determines if the respective blob or link is within an area of preference to the user.