Computer-aided transcription system using pronounceable substitute text with a common cross-reference library

• US 5,815,639 A
• Filed: 05/20/1993
• Issued: 09/29/1998
• Est. Priority Date: 03/24/1993
• Status: Expired due to Term

• Current Assignee: LiveNote Inc. (The Woodbridge Co. Ltd.)
• Original Assignee: Engate, Inc.
• Inventors: Jarvis, Lawrence M., Bennett, James D.
• Primary Examiner(s): EISENZOPF, REINHARD
• Assistant Examiner(s): Doerrler, Michelle
• Application Number:
  US08/065,163
• Time in Patent Office: 1,958 Days
• Field of Search: 395/2.4, 395/2.44, 395/2.63, 395/2.79, 395/2.86, 395/2.85, 381/41, 381/43, 369/25, 369/29, 360/32, 364/419.02, 364/419.04, 364/419.05, 364/419.07, 364/419.15, 364/419.16
• US Class Current: 704/235
• CPC Class Codes: G06F 16/313 Selection or weighting of terms for indexing
• CPC Class Codes: G06F 16/685 using automatically derived transcript of audio data, e.g. lyrics speech recognition G10L15/00
• CPC Class Codes: G06F 16/7844 using original textual content or text extracted from visual content or transcript of audio data
• CPC Class Codes: G06F 40/166 Editing, e.g. inserting or deleting
• CPC Class Codes: G06F 40/169 Annotation, e.g. comment data or footnotes
• CPC Class Codes: G06F 40/242 Dictionaries
• CPC Class Codes: G06F 40/268 Morphological analysis
• CPC Class Codes: G06F 40/274 Converting codes to words; Guess-ahead of partial word inputs
• CPC Class Codes: G06F 40/289 Phrasal analysis, e.g. finite state techniques or chunking
• CPC Class Codes: G06F 40/55 Rule-based translation
• CPC Class Codes: G06F 40/58 Use of machine translation, e.g. for multi-lingual retrieval, for server-side translation for client devices or for real-time translation
• CPC Class Codes: G06Q 10/10 Office automation; Time management
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence
• CPC Class Codes: H04L 12/1822 Conducting the conference, e.g. admission, detection, selection or grouping of participants, correlating users to one or more conference sessions, prioritising transmission
• CPC Class Codes: H04L 12/1827 Network arrangements for conference optimisation or adaptation
• CPC Class Codes: H04L 12/1831 Tracking arrangements for later retrieval, e.g. recording contents, participants activities or behavior, network status
• CPC Class Codes: H04L 65/1101 Session protocols
• CPC Class Codes: H04L 65/762 at the source reformatting of additional data in video distribution servers H04N21/2355
• CPC Class Codes: H04L 9/40 Network security protocols
• CPC Class Codes: H04M 11/10 with dictation recording and playback systems
• CPC Class Codes: H04N 21/2368 : Multiplexing of audio and video streams
• CPC Class Codes: H04N 21/4341 : Demultiplexing of audio and video streams
• CPC Class Codes: H04N 5/073 : for mutually locking plural sources of synchronising signals, e.g. studios or relay stations
• CPC Class Codes: H04N 7/147 : Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals selecting H04Q
• CPC Class Codes: H04N 7/15 : Conference systems

Abstract

A transcription network having linked computer terminals for a court reporter and for examining, defending, and associate attorneys is disclosed. Cross-reference libraries, phoneme libraries, phoneme dictionaries, and pronunciation indices are used by a reporter terminal to generate readable text transcripts which are communicated to the other terminals for real-time review. Cross-reference libraries provide for the bulk of the transcription while stenographic keystrokes that cannot be directly transcribed are converted to phoneme text or other pronounceable form for down-line readability. A common cross-reference library is provided to supplement local cross-reference libraries to aid transcription and to provide for standardization. The reporter terminal provides for update and preparation of the local cross-reference libraries using case law and evidence prior to a proceeding, as well as provides key-stroke training for the court reporter. Foreign language tables are also provided to service proceedings involving two or more languages.

Claims

1. A reporting system for providing in real-time to a viewing terminal text representative of spoken words that is readable by a lay person, said reporting system operates on coded representations of spoken words in a first phoneme format generated in real time, said reporting system comprising:

a cross-reference library storing associations between coded representations of spoken words in the first phoneme format and corresponding exact alphabetic and numeric text;

a phoneme library for storing associations between coded representations of spoken words in the first phoneme format and pronounceable but not exact representations of spoken words in a second phoneme format;

a transcriber retrieving from said cross-reference library exact alphabetic and numeric text for coded representations of spoken words in the first phoneme format that have associations stored in said cross-reference library;

said transcriber retrieving from said phoneme library coded representations of spoken words in the second phoneme format that are pronounceable by a lay person using coded representations of spoken words in the first phoneme format for which said cross-reference library stores no associations; and

communication means for delivering both the exact alphabetic and numeric text and the coded representations of spoken words in the second phoneme format to the viewing terminal for display.

2. The reporting system of claim 1 further comprising pronunciation index means operable on coded representations of spoken words for which said phoneme means and said cross-reference means both fail to identify associations.

3. The reporting system of claim 1 further comprising phoneme library means responsive to said phoneme means for identifying associations between code representations of spoken words and corresponding alphabetical and numeric text.

4. The reporting system of claim 1 wherein said transcriber operates on associations identified to provide foreign language translation.

5. The reporting system of claim 1 further comprising:

a foreign language table; and

said transcriber operates on associations identified to provide translations of the identified associations by referencing said foreign language table.

6. A reporting system for providing to a viewing terminal text representative of spoken words that is readable by a lay person comprising:

input means for attempting, in real-time, to generate coded representations of words as such words are spoken;

cross-reference means responsive to said input means for attempting to identify exact alphabetic and numeric text of the words spoken from the coded representations generated by said input means;

substitution means, utilized whenever said cross-reference means fails to identify exact alphabetic and numeric text, for identifying pronounceable substitute text from the coded representations generated by said input means that, when pronounced by a lay person sounds like the spoken words; and

communication means for delivering the exact text from said cross-reference means and the substitute text from said substitution means to the viewing terminal for display.

7. The reporting system of claim 6 wherein said substitution means utilizes a phoneme library for identifying the substitute text.

8. The reporting system of claim 6 wherein said substitution means utilizes a pronunciation index for identifying the substitute text.

9. The reporting system of claim 6 for use with spoken words of a plurality of languages wherein said input means provides a real-time indication of the one of the plurality of languages of the spoken words, and said cross-reference means being responsive to the indication by basing the identification of the exact alphabetic and numeric text of the words on the language indicated.

10. The reporting system of claim 9 wherein said substitution means also being responsive to the indication by basing the identification of substitute text on the language indicated.

11. The reporting system of claim 6 for use with a plurality of speakers using a corresponding plurality of languages wherein said input means provides a real-time indication of the identity of the one of the plurality of speakers speaking, and said cross-reference means being responsive to the indication by basing the identification of the exact alphabetic and numeric text of the words on the language of the indicated speaker.

12. A real-time reporting system for providing to a plurality of viewers, each of which having a preferential one of a plurality of languages for reading, text representative of words spoken comprising:

input means for attempting, in real-time, to generate coded representations of words as such words are spoken;

cross-reference means responsive to said input means for attempting to identify exact alphabetic and numeric text in each of the preferential ones of the plurality of languages from the coded representations generated by said input means;

substitution means, utilized whenever said cross-reference means fails to identify exact alphabetic and numeric text, for identifying pronounceable substitute text from the coded representations generated by said input means that, when pronounced, sounds like the spoken words; and

communication means for automatically delivering to each of the plurality of viewers, in each viewers preferential one of the plurality of languages, the exact text from said cross-reference means and the substitute text from said substitution means for display.

13. The reporting system of claim 12 wherein said substitution means utilizes a phoneme library for identifying the substitute text.

14. The reporting system of claim 12 wherein said substitution means utilizes a pronunciation index for identifying the substitute text.

15. The reporting system of claim 12 for use with spoken words in the plurality of languages wherein said input means provides a real-time indication of the one of the plurality of languages of the spoken words, and said cross-reference means being responsive to the indication by basing the identification of the exact alphabetic and numeric text of the words on the language indicated.

16. The reporting system of claim 15 wherein said substitution means also being responsive to the indication by basing the identification of substitute text on the language indicated.