Audio/video retrieval system that uses keyword indexing of digital recordings to display a list of the recorded text files, keywords and time stamps associated with the system

• US 5,794,249 A
• Filed: 12/21/1995
• Issued: 08/11/1998
• Est. Priority Date: 12/21/1995
• Status: Expired due to Fees

• Current Assignee: Hewlett-Packard Company (HP Inc.)
• Original Assignee: Hewlett-Packard Company (HP Inc.)
• Inventors: Bowers, Richard D., Orsolini, Garry S.
• Primary Examiner(s): Black, Thomas G.
• Assistant Examiner(s): ROBINSON, GRETA LEE
• Application Number:
  US08/576,106
• Time in Patent Office: 964 Days
• Field of Search: 395/613, 395/60, 707/1, 707/104, 704/251, 704/231, 345/328
• US Class Current: 704/200
• CPC Class Codes: G06F 16/71 Indexing; Data structures therefor; Storage structures
• CPC Class Codes: G06F 16/7834 using audio features
• CPC Class Codes: G06F 16/7844 using original textual content or text extracted from visual content or transcript of audio data
• CPC Class Codes: G11B 27/10 Indexing; Addressing; Timing or synchronising; Measuring tape travel
• CPC Class Codes: G11B 27/28 by using information signals recorded by the same method as the main recording G11B27/22 takes precedence
• CPC Class Codes: G11B 27/3036 Time code signal
• CPC Class Codes: G11B 27/34 Indicating arrangements indicating means incorporated in magazine or cassette G11B23/046 and G11B23/0875; indicating measured values in general G01D
• CPC Class Codes: Y10S 707/917 Text
• CPC Class Codes: Y10S 707/99931 Database or file accessing
• CPC Class Codes: Y10S 707/99945 Object-oriented database structure processing

Abstract

A recording is indexed by keywords. In order to perform the indexing, an audio portion of the recording is transcribed to produce text in a text file. A time stamp is associated with each word in the text. Each time stamp indicates a time in the recording at which occurs an associated word. Once a recording has been indexed, the recording may be searched along with other recordings. For example, in response to a user choosing a keyword, a text file for each recording is searched for occurrences of the keyword. At the conclusion of the search, each recording which includes an occurrence of the keyword is listed. When a user selects a first recording and a particular occurrence of the keyword, the first recording is played starting slightly before a time corresponding to a first time stamp associated with the particular occurrence of the keyword in the first recording. In response to control sequences, prior and next occurrences of the keyword can be observed in one or multiple recordings.

Claims

1. A method for accessing selections within a plurality of recordings, the method comprising the following steps:

(a) in response to a user choosing a keyword, searching a plurality of text files for occurrences of the keyword, wherein text files are associated with recordings so that for each of the plurality of recordings, one text file from the plurality of text files includes a text of an audio portion of the recording, each word in each text file being associated with a time stamp which indicates an approximate location in an associated recording of an occurrence of the word;

(b) listing recordings which include an occurrence of the keyword; and

,

(c) upon a user selecting a first recording and a particular occurrence of the keyword, playing the first recording starting slightly before a time corresponding to a first time stamp associated with the particular occurrence of the keyword in the first recording.

2. A method as in claim 1 wherein in step (c) upon a user selecting the first recording, a first-in-time occurrence of the keyword within the first recording is automatically selected as the particular occurrence of the keyword.

3. A method as in claim 1 wherein step (b) includes the following substeps:

(b.1) listing in a first window the recordings which include an occurrence of the keyword;

(b.2) highlighting one of the recordings from the recordings listed in the first window; and

,

(b.3) listing each of the occurrences of the keyword within the recording highlighted in substep (b.2).

4. A method as in claim 1 wherein words of the text of the audio portion of each recording and associated time stamps arranged in a balanced tree based on occurrences of each word of the text.

5. A system for accessing selections within a plurality of recordings, comprising:

a plurality of text files, each text file from the plurality of text files includes a text of an audio portion of an associated recording from the plurality of recordings;

search means, coupled to the text files for, in response to a user selecting a keyword, searching the text files for occurrences of the keyword; and

,

recording play means for, in response to a user selecting a particular occurrence of the keyword within a first recording, playing the first recording starting slightly before a time corresponding to the particular occurrence of the keyword in the first recording.

6. A system as in claim 5 wherein each word in each text file being associated with a time stamp which indicates an approximate location in an associated recording of an occurrence of the word.

7. A system as in claim 5 wherein text within the text files is stored in a balanced tree.

8. A system as in claim 5 wherein the search means includes:

a first keyword display which accepts from a user a specification of a particular keyword; and

,

a first window which displays a list of recordings which include an occurrence of the particular keyword.

9. A system as in claim 8 wherein the search means additionally includes:

a second window which displays occurrences of the keyword within a recording highlighted in the first window.

10. A system as in claim 5 wherein the search means includes the ability to search on a plurality of keywords connected by Boolean logic.

11. A system as in claim 5 wherein the search means includes the ability to perform concept based searches on the keyword.