System for recording, annotating and indexing audio data

• US 6,404,856 B1
• Filed: 04/10/1998
• Issued: 06/11/2002
• Est. Priority Date: 04/10/1998
• Status: Expired due to Term

• Current Assignee: Majandro LLC (IP Edge LLC)
• Original Assignee: Fuji Xerox Company Limited (Xerox Holdings Corp.), Xerox Corporation (Xerox Holdings Corp.)
• Inventors: Wilcox, Lynn R., Chiu, Patrick R., Gwizdka, Jacek
• Primary Examiner(s): Tsang, Fan
• Assistant Examiner(s): Escalante, Ovidio
• Application Number:
  US09/058,283
• Publication Number:
  US 20020027976A1
• Time in Patent Office: 1,523 Days
• Field of Search: 379/88.26, 379/88.27, 379/56--11, 379/172.5, 379/58-96, 379/88, 379/88.01, 379/67.1, 379/88.11, 379/100.05, 395/2.65, 395/2.45, 395/309, 704/240, 704/270, 340/8, 340/25, 340/44, 340/173, 364/513, 364/900, 370/352-466, 370/261, 455/550-556, 709/26, 707/100
• US Class Current: 379/67.1
• CPC Class Codes: G11B 2220/20 Disc-shaped record carriers
• CPC Class Codes: G11B 2220/213 Read-only discs
• CPC Class Codes: G11B 2220/2512 Floppy disks
• CPC Class Codes: G11B 2220/2545 CDs
• CPC Class Codes: G11B 2220/61 wherein solid state memory is used for storing A/V content storing computer data in solid state memories G06F
• CPC Class Codes: G11B 27/105 of operating discs
• CPC Class Codes: G11B 27/28 by using information signals recorded by the same method as the main recording G11B27/22 takes precedence
• CPC Class Codes: G11B 27/34 Indicating arrangements indicating means incorporated in magazine or cassette G11B23/046 and G11B23/0875; indicating measured values in general G01D
• CPC Class Codes: H04M 1/575 Means for retrieving and displaying personal data about calling party
• CPC Class Codes: H04M 1/6505 storing speech in digital form
• CPC Class Codes: H04M 1/656 for recording conversations
• CPC Class Codes: H04M 2201/38 Displays
• CPC Class Codes: H04M 3/42042 Notifying the called party of information on the calling party details within substation equipment H04M1/57, signalling details H04Q3/72
• CPC Class Codes: H04M 3/42059 Making use of the calling party identifier
• CPC Class Codes: H04M 3/42221 Conversation recording systems at the subscriber's set H04M1/656
• CPC Class Codes: H04M 3/436 Arrangements for screening incoming calls , i.e. evaluating the characteristics of a call before deciding whether to answer it based on the calling party profile H04M3/42059; based on location H04M3/42348; based on presence H04M3/42365; diversion H04M3/54
• CPC Class Codes: H04M 3/533 Voice mail systems

Abstract

An audio data system assigns properties to audio data and keywords to audio data files. The properties indicate the type of audio data and the keywords indicate the general content of an audio data file. The system provides an updatable database of audio data that is capable of being searched based on the properties and the keywords.

Claims

1. A digital audio recording system, comprising:

an audio data input device;

a processor in communication with the audio data input device responsive to the input of audio data to associate at least one property to a portion of the audio data, and at least one keyword to an entire audio data, so that the audio data may be searched and retrieved by one of selecting the at least one of the property and typing the at least one of the keyword into a query window such that the searching and retrieving are performed after said selecting or typing being entered, and that results in attributes of the retrieved audio data being displayed; and

a storage device and communication with the processor for storing the audio data.

2. The system of claim 1, further comprising an audio data segmentation system that segments the audio data into at least two audio data segments and wherein the processor associates the at least one property to at least one of the audio segments.

3. The system of claim 2, wherein the audio segmentation system comprises a speaker segmentation algorithm.

4. The system of claim 1, further comprising a pen-based interactive display adapted to receive pen-based input, wherein the processor is responsive to the pen-based input to generate at least one mark comprising digital ink for display on the pen-based interactive display, wherein the digital ink comprises the at least one property and the storage device stores the digital ink.

5. The system of claim 1, wherein the audio data input device comprises a microphone.

6. The system of claim 1, further comprising a call screening device that processes the audio data based upon the property.

7. The system of claim 6, further comprising a database comprising at least one property that identifies at least one caller.

8. The system of claim 1, further comprising a display with an audio data timeline.

9. The system of claim 8, wherein the property is indicated to a user with a color on the display of the audio data timeline.

10. The system of claim 8, wherein the audio data timeline is divided into two audio data timelines each corresponding to a speaker in the audio data.

11. The system of claim 1, wherein the property is one of caller id, speaker id, time of recording, time of last modification, action item, name and keyword.

12. The system of claim 1, wherein the processor searches the storage device and retrieves the audio data associated with the selection.

13. The system of claim 1, wherein the audio data is an audio data file and the property is a keyword.

14. The system of claim 13, wherein the storage device stores a plurality of audio data files each having at least one keyword, wherein the processor is responsive to a user inputted query that identifies a keyword, searches the storage device and retrieves the audio data files having the identified keyword.

15. The system of claim 1, further comprising a user interface for designating the property.

16. The system of claim 15, wherein the user interface is a button that allows the user to selectively apply the property to the audio data.

17. The system of claim 1, wherein the audio data input device is adapted to receive audio data from a telephone system.

18. The system of claim 1, wherein the audio data input device is adapted to receive audio data from a network.

19. The system of claim 18, wherein the audio data input device is adapted to receive audio data from an intranet.

20. The system of claim 18, wherein the audio data input device is adapted to receive audio data from the Internet.