Method and apparatus for identifying textual documents and multi-mediafiles corresponding to a search topic

• US 5,742,816 A
• Filed: 09/15/1995
• Issued: 04/21/1998
• Est. Priority Date: 09/15/1995
• Status: Expired due to Term

• Current Assignee: Bigchalk.Com, Inc. (Clarivate Plc)
• Original Assignee: Infonautics Corporation (Tucows Incorporated)
• Inventors: Weinberger, Marvin I., Barr, Thomas, Morgan, Howard, Husick, Lawrence A., Krupit, Michael S.
• Primary Examiner(s): Lintz, Paul R.
• Application Number:
  US08/529,250
• Time in Patent Office: 949 Days
• Field of Search: 395/615, 395/603, 395/762, 395/777, 395/807, 395/805
• US Class Current: 707/728
• CPC Class Codes: G06F 16/40 of multimedia data, e.g. slideshows comprising image and additional audio data retrieval of still image data G06F16/50; retrieval of audio data G06F16/60; retrieval of video data G06F16/70
• CPC Class Codes: G06F 16/48 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: Y10S 707/914 Video
• CPC Class Codes: Y10S 707/915 Image
• CPC Class Codes: Y10S 707/916 Audio
• CPC Class Codes: Y10S 707/99933 Query processing, i.e. searching
• CPC Class Codes: Y10S 707/99945 Object-oriented database structure processing

Abstract

A method and apparatus for identifying textual documents and multi-media files corresponding to a search topic. A plurality of document records, each of which is representative of at least one textual document, are stored, and a plurality of multi-media records, each of which is representative of at least one of multi-media file, are also stored. The document records have text information fields associated therewith, each of the text information fields representing text from one of the plurality of textual documents. The multi-media records have multi-media information fields for representing only digital video or audio information and associated text fields, each of the associated text fields representing text associated with one of the multi-media information fields. A single search query corresponding to the search topic is received. The single search query is preferably in a natural language format. An index database is searched in accordance with the single search query to simultaneously identify document records and multi-media records related to the single search query. The index database has a plurality of search terms corresponding to terms represented by the text information fields and the associated text fields. The index database also includes a table for associating each of the document and multi-media records with one or more of the search terms. A search result list having entries representative of both textual documents and multi-media files related to the single search query is generated in accordance with the document records and the multi-media records identified by the index database search. Text corresponding to the search topic is retrieved by selecting entries from the search result list representing document records to be retrieved, and then retrieving text represented by the text information fields associated with the selected document records. Digital video or audio information corresponding to the search topic is retrieved by selecting entries from the search result list representing selected multi-media records to be retrieved, and then retrieving digital video or audio information represented by multi-media information fields associated with the selected multi-media records.

Claims

1. A method for identifying textual documents and multi-media files corresponding to a search topic, comprising the steps of:

(A) storing document records each of which is representative of one of a plurality of textual documents, said document records having text information fields associated therewith, each of said text information fields representing text from one of said plurality of textual documents;

(B) storing multi-media records each of which is representative of one of a plurality of multi-media files, said multi-media records having multi-media information fields for representing only digital video or audio information and associated text fields, each of said associated text fields representing text associated with one of said multi-media information fields;

(C) receiving a single search query corresponding to said search topic;

(D) searching an index database in accordance with said single search query to simultaneously identify document records and multi-media records related to said single search query, said index database having a plurality of search terms corresponding to terms represented by said text information fields and said associated text fields, said index database including a table for associating each of said document and multi-media records with one or more of said search terms;

(E) generating a search result list having entries representative of both textual documents and multi-media files related to said single search query in accordance with said document records and said multi-media records identified in step (D);

(F) retrieving text corresponding to said search topic by selecting entries from said search result list representing selected document records to be retrieved, and then retrieving text represented by text information fields associated with said selected document records; and

(G) retrieving digital video or audio information corresponding to said search topic by selecting entries from said search result list representing selected multi-media records to be retrieved, and then retrieving digital video or audio information represented by multi-media information fields associated with said selected multi-media records.

2. The method of claim 1, wherein said document records and said multi-media records are formed from header files stored in a single common format on said database.

3. The method of claim 2, wherein said multi-media records include a plurality of still image records each of which is representative of a still image.

4. The method of claim 3, wherein said multi-media records include a plurality of motion video records each of which is representative of a sequence of motion video frames.

5. The method of claim 4, wherein said multi-media records include a plurality of digital audio records each of which is representative of a sequence of digital audio frames.

6. The method of claim 1, wherein step (E) further comprises the step of relevance ranking said document and multi-media records identified in step (D) by generating a relevance score corresponding to each of said entries in said search result list.

7. The method of claim 6, wherein step (E) further comprises the step of forming a relevance ordered search result list by ordering said entries in said search result list in accordance with said relevance ranking such that an entry with a highest relevance ranking represents a first entry on said relevance ordered search result list.

8. The method of claim 7, wherein entries corresponding to said document records identified in step (D) and entries corresponding to said multi-media records identified in step (D) are interspersed within said relevance ordered search result list.

9. The method of claim 1, wherein said single search query is in a natural language format.

10. An apparatus for identifying textual documents and multi-media files corresponding to a search topic, comprising:

(A) means for storing document records each of which is representative of one of a plurality of textual documents and multi-media records each of which is representative of one of a plurality of multi-media fries, said document records having text information fields associated therewith, each of said text information fields representing text from one of said plurality of textual documents, said multi-media records having multi-media information fields for representing only digital video or audio information and associated text fields, each of said associated text fields representing text associated with one of said multi-media information fields;

(B) means for receiving a single search query corresponding to said search topic;

(C) searching means, coupled to an index database and said means for receiving said single query, for searching said database in accordance with said single search query to simultaneously identify document records and multi-media records related to said single search query, said index database having a plurality of search terms corresponding to terms represented by said text information fields and said associated text fields, said index database including a table for associating each of said document and multi-media records with one or more of said search terms;

(D) search result list generation means, coupled to said searching means, for generating a search result list having entries representative of both textual documents and multi-media files related to said single search query in accordance with said document records and said multi-media records identified by said searching means;

(E) means for receiving signals representing selected document records and selected multi-media records identified on said search results list;

(F) first means for retrieving, from said means for storing, text represented by text information fields associated with said selected document records; and

(G) second means for retrieving, from said means for storing, digital video or audio information represented by multi-media information fields associated with said selected multi-media records.

11. The apparatus of claim 10, wherein said document records and said multi-media records are formed from header files stored in a single common format on said database.

12. The apparatus of claim 11, wherein said multi-media records stored on said database include a plurality of still image records each of which is representative of a still image.

13. The apparatus of claim 12, wherein said multi-media records stored on said database include a plurality of motion video records each of which is representative of a sequence of motion video frames.

14. The apparatus of claim 13, wherein said multi-media records stored on said database include a plurality of digital audio records each of which is representative of a sequence of digital audio frames.

15. The apparatus of claim 10, wherein said search result list generating means includes means for relevance ranking said document and multi-media records identified by said searching means by generating a relevance score corresponding to each of said entries in said search result list.

16. The apparatus of claim 15, wherein said result list generating means further comprises means for forming a relevance ordered search result list by ordering said entries in said search result list in accordance with said relevance ranking such that an entry with a highest relevance ranking represents a first entry on said relevance ordered search result list.

17. The apparatus of claim 16, wherein entries corresponding to said document records identified by said searching means and entries corresponding to said multi-media records identified by said searching means are interspersed within said relevance ordered search result list.

18. The apparatus of claim 10, wherein said single search query is in a natural language format.