Method and apparatus for management of multimedia assets

• US 20020049604A1
• Filed: 02/22/2001
• Published: 04/25/2002
• Est. Priority Date: 07/10/1996
• Status: Active Grant

• Current Assignee: University of Southern California
• Original Assignee: Survivors of the Shoah Visual History Foundation
• Inventors: Gustman, Samuel
• Granted Patent: US 6,477,537 B2
• Time in Patent Office: Days
• US Class Current: 705/1
• CPC Class Codes: G06F 16/40 of multimedia data, e.g. slideshows comprising image and additional audio data retrieval of still image data G06F16/50; retrieval of audio data G06F16/60; retrieval of video data G06F16/70
• CPC Class Codes: G06F 16/48 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: Y10S 707/99931 Database or file accessing
• CPC Class Codes: Y10S 707/99932 Access augmentation or optimizing
• CPC Class Codes: Y10S 707/99933 Query processing, i.e. searching
• CPC Class Codes: Y10S 707/99934 Query formulation, input preparation, or translation
• CPC Class Codes: Y10S 707/99935 Query augmenting and refining, e.g. inexact access
• CPC Class Codes: Y10S 707/99943 Generating database or data structure, e.g. via user interface
• CPC Class Codes: Y10S 707/99944 Object-oriented database structure
• CPC Class Codes: Y10S 707/99945 Object-oriented database structure processing

Abstract

The invention is a generalized solution for management of multimedia assets. Generalized interfaces are used between a browser component, indexing server, archive server, tertiary storage manager, and method player components. The generalized interface defines a communication protocol that can be used by any browser, indexing server, archive server, tertiary storage manager, or method player component. Thus, system components supplied by multiple vendors can be interconnected to form a multimedia system that communicates using the generalized interfaces of the invention. A browser component can accept input such as search requests and display multimedia data. An indexing server component includes a data catalogue that catalogues multimedia data. The catalogue can be used to identify catalogue elements associated with data that can satisfy a search request. A search mechanism is used to identify the desired multimedia data. A search mechanism can create additional catalogues that are a subset of the catalogue provided on the indexing server. An archive server identifies a tertiary storage manager that manages the store containing the multimedia data. The tertiary storage manager retrieves the corresponding multimedia data from its store and sends it to a method play which plays it in a display region of the browser. The invention retains the content and results of a search such that it is only necessary to perform a search once. Search elements are used to store the content of a search, i.e., search criteria. A segment element is used to store the results of a search.

Claims

1. A method of accessing multimedia data comprising the steps of:

defining a catalogue for said multimedia data having a plurality of catalogue elements each of which is associated with a portion of said multimedia data;

specifying a search request;

identifying a result of said search request that satisfies said search request, said result containing one or more of said catalogue elements;

retrieving said portion of said multimedia data associated with said one or more of said catalogue elements;

storing said search request; and

storing said search result.

2. The method of claim 1 further comprising the steps of:

specifying a second search request;

comparing said second search request with said search request;

retrieving said search result when said second search request is the same as said search request.

3. The method of claim 1 wherein said search request is comprised of one or more elements, the step of storing said search request further comprises the steps of:

storing said one or more elements; and

storing cardinality information for said one or more elements; and

storing conjunctivity information for said one or more elements.

4. The method of claim 1 wherein said step of storing said search result further comprises the steps of:

creating a container element; and

creating a relationship between said container element and said one or more of said catalogue elements.

5. The method of claim 1 wherein said catalogue has a plurality of attribute and attribute elements, said step of identifying further comprises the step of performing one or more query operations on said plurality of attribute and attribute elements to identify said one or more of said catalogue elements.

6. The method of claim 1 wherein said step of identifying further comprises the steps of:

identifying a plurality of type instances using said search request;

identifying a plurality of keyword instances related to said plurality of type instances; and

identifying said one or more of said catalogue elements related to said keyword instances.

7. The method of claim 6 wherein said step of identifying a plurality of type instances further comprises the steps of:

identifying a set of type instances that meet a set of criteria in said search request;

identifying a second set of type instances that includes said set of type instances and type instances that are subtypes of said set of type instances;

8. The method of claim 7 wherein said step of identifying a plurality of keyword instances further comprises the steps of:

identifying a set of keyword instances that are related to said second set of type instances;

identifying a second set of keyword instances that include said set of keyword instances and child keyword instances of said set of keyword instances;

9. The method of claim 5 further comprising the steps of:

identifying a plurality of keyword instances based on said search request;

identifying said one or more of said catalogue elements related to said keyword instances.

10. The method of claim 1 wherein said step of identifying further comprises the steps of:

identifying a plurality of person instances using said search request;

identifying a plurality of container elements related to said plurality of person instances; and

identifying a plurality of catalogue elements related to said plurality of container element instances.

11. The method of claim 10 further comprising the steps of:

identifying a plurality of keywords associated with one of said plurality of catalogue elements;

examining said plurality of keywords to determine whether said one of said plurality of catalogue elements satisfies content criteria specified in said search request; and

including said one of said plurality of catalogue elements in a set of catalogue elements when said content criteria is satisfied.

12. The method of claim 10 wherein said step of identifying a plurality of person instances further comprises the steps of:

identifying a plurality of person information instances using said search request; and

identifying a plurality of person instances related to said plurality of person information instances.

13. The method of claim 1 wherein said step of retrieving further comprises the steps of:

associating a plurality of IDs to said portion of said multimedia data;

creating a pointers for each of said plurality of IDs, said physical storage pointer pointing to a location in which said portion of said multimedia data is stored;

retrieving said plurality of IDs;

retrieving said portion of said multimedia data from storage using said pointers.

14. The method of claim 1 wherein said step of retrieving further comprises the steps of:

searching cache for said portion of said multimedia data;

retrieving said portion of multimedia data into said cache from permanent storage, if said portion of multimedia data is resident on permanent storage and is not found in said cache;

16. The method of claim 15 wherein said generalized protocol is an application programming interface.

18. The system of claim 17 wherein said indexing server comprises:

a database management system (DBMS);

a plurality of catalogue elements coupled to said DBMS;

a plurality of attributes and attribute elements coupled to said plurality of catalogue elements.

19. The system of claim 17 wherein said text interface is an application programming interface.

20. The system of claim 17 wherein said text interface contains operations for querying said plurality of catalogue elements and said plurality of attributes and attribute elements.

21. The system of claim 17 further comprising a tertiary storage manager coupled to said archive server.

22. The system of claim 21 wherein said tertiary storage manager is a cache manager.

24. The article of manufacture of claim 23 further comprises:

computer readable program code configured to cause a computer to specify a second search request;

computer readable program code configured to cause a computer to compare said second search request with said search request;

computer readable program code configured to cause a computer to retrieve said search result when said second search request is the same as said search request.

25. The article of manufacture of claim 23 wherein said search request is comprised of one or more elements, said computer readable program code configured to cause a computer to store said search request further comprises:

computer readable program code configured to cause a computer to store said one or more elements; and

computer readable program code configured to cause a computer to store cardinality information for said one or more elements; and

computer readable program code configured to cause a computer to store conjunctivity information for said one or more elements.

26. The article of manufacture of claim 23 wherein said computer readable program code configured to cause a computer to store said search result further comprises:

computer readable program code configured to cause a computer to create a container element; and

computer readable program code configured to cause a computer to create a relationship between said container element and said one or more of said catalogue elements.

27. The article of manufacture of claim 23 wherein said catalogue has a plurality of attribute and attribute elements, said computer readable program code configured to cause a computer to identify further comprises computer readable program code configured to cause a computer to perform one or more query operations on said plurality of attribute and attribute elements to identify said one or more of said catalogue elements.

28. The article of manufacture of claim 23 wherein said computer readable program code configured to cause a computer to identify further comprises:

computer readable program code configured to cause a computer to identify a plurality of type instances using said search request;

computer readable program code configured to cause a computer to identify a plurality of keyword instances related to said plurality of type instances; and

computer readable program code configured to cause a computer to identify said one or more of said catalogue elements related to said keyword instances.

29. The article of manufacture of claim 28 wherein said computer readable program code configured to cause a computer to identify a plurality of type instances further comprises:

computer readable program code configured to cause a computer to identify a set of type instances that meet a set of criteria in said search request;

computer readable program code configured to cause a computer to identify a second set of type instances that includes said set of type instances and type instances that are subtypes of said set of type instances;

30. The article of manufacture of claim 29 wherein said computer readable program code configured to cause a computer to identify a plurality of keyword instances further comprises:

computer readable program code configured to cause a computer to identify a set of keyword instances that are related to said second set of type instances;

computer readable program code configured to cause a computer to identify a second set of keyword instances that include said set of keyword instances and child keyword instances of said set of keyword instances;

31. The article of manufacture of claim 27 further comprises:

computer readable program code configured to cause a computer to identify a plurality of keyword instances based on said search request;

computer readable program code configured to cause a computer to identify said one or more of said catalogue elements related to said keyword instances.

32. The article of manufacture of claim 23 wherein said computer readable program code configured to cause a computer to identify further comprises:

computer readable program code configured to cause a computer to identify a plurality of person instances using said search request;

computer readable program code configured to cause a computer to identify a plurality of container elements related to said plurality of person instances; and

computer readable program code configured to cause a computer to identify a plurality of catalogue elements related to said plurality of container element instances.

33. The article of manufacture of claim 32 further comprises:

computer readable program code configured to cause a computer to identify a plurality of keywords associated with one of said plurality of catalogue elements;

computer readable program code configured to cause a computer to examine said plurality of keywords to determine whether said one of said plurality of catalogue elements satisfies content criteria specified in said search request; and

computer readable program code configured to cause a computer to include said one of said plurality of catalogue elements in a set of catalogue elements when said content criteria is satisfied.

34. The article of manufacture of claim 32 wherein said computer readable program code configured to cause a computer to identify a plurality of person instances further comprises:

computer readable program code configured to cause a computer to identify a plurality of person information instances using said search request; and

computer readable program code configured to cause a computer to identify a plurality of person instances related to said plurality of person information instances.

35. The article of manufacture of claim 23 wherein said computer readable program code configured to cause a computer to retrieve further comprises:

computer readable program code configured to cause a computer to associate a plurality of IDs to said portion of said multimedia data;

computer readable program code configured to cause a computer to create a pointers for each of said plurality of IDs, said physical storage pointer pointing to a location in which said portion of said multimedia data is stored;

computer readable program code configured to cause a computer to retrieve said plurality of IDs;

computer readable program code configured to cause a computer to retrieve said portion of said multimedia data from storage using said pointers.

36. The article of manufacture of claim 35 wherein said computer readable program code configured to cause a computer to retrieve further comprise:

computer readable program code configured to cause a computer to search cache for said portion of said multimedia data;

computer readable program code configured to cause a computer to retrieve said portion of multimedia data into said cache from permanent storage, if said portion of multimedia data is resident on permanent storage and is not found in said cache.

15. A method of interfacing components in a multimedia system comprising the steps of:

defining a generalized protocol for interfacing components of a multimedia system;

communicating between two of said components using said generalized protocol.

17. A multimedia system comprising:

a browser;

a text interface coupled to said browser;

an indexing server coupled to said text interface;

a first media interface coupled to said browser;

an archive server coupled to said media interface;

a second media interface coupled to said browser;

a method player coupled to said second media interface.

23. An article of manufacture comprising:

a computer usable medium having computer readable program code embodied therein for accessing multimedia data, the computer readable program code in said article of manufacture comprising;

computer readable program code configured to cause a computer to define a catalogue for said multimedia data having a plurality of catalogue elements each of which is associated with a portion of said multimedia data;

computer readable program code configured to cause a computer to specify a search request;

computer readable program code configured to cause a computer to identify a result of said search request that satisfies said search request, said result containing one or more of said catalogue elements;

computer readable program code configured to cause a computer to retrieve said portion of said multimedia data associated with said one or more of said catalogue elements;

computer readable program code configured to cause a computer to store said search request; and

computer readable program code configured to cause a computer to store said search result.