Display accessory for a record playback system

• US 6,073,103 A
• Filed: 04/25/1996
• Issued: 06/06/2000
• Est. Priority Date: 04/25/1996
• Status: Expired due to Fees

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Stern, Edith Helen, Dunn, James M.
• Primary Examiner(s): MacDonald, Allen R.
• Assistant Examiner(s): COLLINS, ALPHONSO
• Application Number:
  US08/636,814
• Time in Patent Office: 1,503 Days
• Field of Search: 395/2.2, 395/2.84, 395/2.85, 395/2.87
• US Class Current: 704/276
• CPC Class Codes: G10L 21/06 Transformation of speech into a non-audible representation, e.g. speech visualisation or speech processing for tactile aids G10L15/26 takes precedence

Abstract

A record playback system includes a display showing elapsed time of a record playback operation together with symbols indicating occurrences of certain sequences of sound during the playback operation, the symbols positioned to indicate times at which respective sequences of sounds occur. In a preferred application, the records reproduced in the system are audible voice-mail messages, the specific sequences of sounds are numbers or sets of numbers spoken consecutively during the message, and the symbols representing such numbers are printed characters corresponding to respective numbers. In the preferred application, the messages are centrally recorded at a server of a computer network and distributed to individual client computers via the network. The tasks performed at the server include monitoring of elapsed recording time, detection of numbers spoken during each message as the recording is made, and recording of "displayable" symbols representing detected numbers in association with elapsed time at instants of their detection. The detection of spoken numbers is performed by software-based speaker-independent speech recognition. Thus, the messages retrieved at the client computers contain all the information needed to form the display of elapsed time and symbols indicating numbers spoken in each message.

Claims

1. An accessory for a sound recording and playback system comprising:

a visible display;

speech recording means coupled to said system for sequentially recording spoken messages to be audibly reproduced by said system, each recording produced by said recording means having a discrete starting point;

means interfacing between said system, said recording means, and said display for generating a chart of playback time on said display, said chart indicating time elapsed relative to said starting point during audible reproduction of a recording stored by said recording means;

speaker-independent speech recognition means coupled to said system for detecting occurrences of predetermined audible expressions during audible reproduction of a recording stored by said recording means;

said predetermined expressions constituting components of a limited vocabulary of N different expressions;

where N is a number greater than 2 but substantially less than the number of different expressions recordable by said recording means; and

means interfacing between said speech recognition means and said display for superimposing symbols on said time chart, said symbols representing respective said predetermined expressions detected by said speech recognition means and indicating times of occurrences of respective said expressions by their positions on said chart relative to an indication of the said starting point of a respective recording.

2. The accessory of claim 1 comprising:

means enabling a user of said system to use said time chart and said superimposed symbols to control audible replay of selected portions of a recording containing individual expressions indicated by said superimposed symbols in a manner enabling said user to review only said replayed portions without having to listen to the entire recording containing said portions.

3. The accessory of claim 2 wherein said system is a voice-mail retrieval and playback system, said audible reproduction of a said recording is effective to audibly reproduce multiple messages sequentially stored by said recording means, and said predetermined expressions detectable by said speech recognition means include words constituting elements of a spoken language.

4. The accessory of claim 3 wherein each said predetermined expression represents a spoken number, and wherein said means enabling said user to control said playback operation includes means enabling said user to interject a pause temporarily into said playback operation in order for the user to understand the context in which a respective number is spoken.

5. The accessory of claim 3 wherein each said predetermined expression represents a spoken number, and wherein said means enabling said user to control replay includes means enabling said user to control replay of a respective portion of a message containing a respectively spoken number, and thereby enable said user to understand the context of the respectively spoken number within the message containing said respective portion.

6. A computer program product on a computer readable medium for voice mail applications, said program product being transportable to and installable on computers and comprising:

instruction means for enabling a computer on which said program product is installed to receive and audibly replay a voice-mail message; and

instruction means, executable in timed coordination with replay of said message, for causing said computer on which said product is installed to visibly display a chart, said chart representing the elapsed playout time of the message, and indicating times of occurrence of predetermined audible expressions during said playout time.

7. A computer program product in accordance with claim 6 wherein said predetermined audible expressions correspond to words contained in a predetermined spoken language.

8. A computer program product in accordance with claim 7 wherein said corresponding words are numbers subject to contextual interpretation by having small portions of respective messages replayed.

9. A voice-mail system for a computer network having a server processing center for receiving and recording audible voice-mail messages, and client computers linked to said server processing center, said client computers having facilities for receiving and audibly replaying selected ones of the messages recorded at said server processing center;

said voice-mail system comprising;

time monitoring means at said server processing center operative to continually monitor time elapsed during recording of each voice-mail message received at said server processing center;

speech-recognition means at said server processing center, operative in time coordination with said means to monitor elapsed time, for recognizing when words in a predetermined vocabulary of words are spoken during the recording of each said message;

the number of words contained in said predetermined vocabulary of words being small in relation to the number of words comprising the language in which said messages are spoken;

data recording means at said server processing center for recording data representing printable symbols corresponding to words detected by said speech-recognition means, along with time information associating said symbols with times at which respective words are spoken during recording of messages containing said words;

means at each said client computer for receiving a selected message recorded at said server processing center, together with the printable symbol data and time associating information recorded with the selected message;

means at each said client computer for audibly reproducing said selected message; and

display means at each said client computer responsive to said printable symbol data and time associating information for producing a composite visible display containing time indications overlaid with printable symbols;

said composite display comprising a varying chart of time elapsed as said selected message is audibly reproduced and printed symbols corresponding to words in said selected message that were detected by said server speech-recognition means;

said printed symbols being positioned in relation to said chart of elapsed time to enable a user of the respective client computer to easily locate and audibly reproduce a portion of said selected message containing spoken words corresponding to the respective symbols.

10. A voice-mail system in accordance with claim 9 wherein said predetermined vocabulary of words consists exclusively of words representing numbers.

11. A voice-mail system in accordance with claim 10 wherein said printable symbols consist of printed numbers corresponding to individual number words detected by said server speech-recognition means.

12. A voice-mail system in accordance with claim 10 wherein said printable symbols consist of simple marks superimposed on said time chart;

said marks having no numerical significance per se but indicating times at which respective number words are spoken during audible replay of a said message.

13. A voice-mail device comprising:

means for storing a voice-mail message;

means for audibly replaying a voice-mail message stored by said storing means;

display means;

means coupled to display means and said replaying means for causing said display means to display a chart progressively indicating time elapsed during audible replay of a message stored by said storing means;

speech recognition means responsive to a voice-mail message applied to said storing means for detecting when said message contains certain predetermined words;

means coupled to said speech recognition means for storing data representing words detected by said speech recognition means; and

means responsive to said stored data representing said detected words for causing said display means to display indications of respective data in time coordination with audible replay of parts of a said message consisting of words represented by respective data.

14. A voice-mail device in accordance with claim 13 wherein said words detected by said speech-recognition means consist exclusively of numbers.

15. A voice-mail device in accordance with claim 14 wherein said displayed indications of said respective data comprise symbols representing numbers.

16. A voice-mail device in accordance with claim 14 wherein said displayed indications of data comprise marks superimposed on said time-chart display;

said marks having no numerical significance per se but indicating by their displayed presence times during audible message replay at which numbers are being spoken.