Audio and video transcription system for manipulating real-time testimony

• US 6,282,510 B1
• Filed: 02/03/2000
• Issued: 08/28/2001
• Est. Priority Date: 03/24/1993
• Status: Expired due to Term

• Current Assignee: Engate LLC
• Original Assignee: Engate, Inc.
• Inventors: Jarvis, Lawrence M., Bennett, James D.
• Primary Examiner(s): Dorvil, Richemond
• Assistant Examiner(s): MCFADDEN, SUSAN IRIS
• Application Number:
  US09/498,192
• Time in Patent Office: 572 Days
• Field of Search: 704/235, 704/260, 704/270, 386/46, 386/69, 386/85
• US Class Current: 704/235
• CPC Class Codes: G06F 16/313 Selection or weighting of terms for indexing
• CPC Class Codes: G06F 16/685 using automatically derived transcript of audio data, e.g. lyrics speech recognition G10L15/00
• CPC Class Codes: G06F 16/7844 using original textual content or text extracted from visual content or transcript of audio data
• CPC Class Codes: G06F 40/166 Editing, e.g. inserting or deleting
• CPC Class Codes: G06F 40/169 Annotation, e.g. comment data or footnotes
• CPC Class Codes: G06F 40/242 Dictionaries
• CPC Class Codes: G06F 40/268 Morphological analysis
• CPC Class Codes: G06F 40/274 Converting codes to words; Guess-ahead of partial word inputs
• CPC Class Codes: G06F 40/289 Phrasal analysis, e.g. finite state techniques or chunking
• CPC Class Codes: G06F 40/55 Rule-based translation
• CPC Class Codes: G06F 40/58 Use of machine translation, e.g. for multi-lingual retrieval, for server-side translation for client devices or for real-time translation
• CPC Class Codes: G06Q 10/10 Office automation; Time management
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence
• CPC Class Codes: H04L 12/1822 Conducting the conference, e.g. admission, detection, selection or grouping of participants, correlating users to one or more conference sessions, prioritising transmission
• CPC Class Codes: H04L 12/1827 Network arrangements for conference optimisation or adaptation
• CPC Class Codes: H04L 12/1831 Tracking arrangements for later retrieval, e.g. recording contents, participants activities or behavior, network status
• CPC Class Codes: H04L 65/1101 Session protocols
• CPC Class Codes: H04L 65/762 at the source reformatting of additional data in video distribution servers H04N21/2355
• CPC Class Codes: H04L 9/40 Network security protocols
• CPC Class Codes: H04M 11/10 with dictation recording and playback systems
• CPC Class Codes: H04N 21/2368 : Multiplexing of audio and video streams
• CPC Class Codes: H04N 21/4341 : Demultiplexing of audio and video streams
• CPC Class Codes: H04N 5/073 : for mutually locking plural sources of synchronising signals, e.g. studios or relay stations
• CPC Class Codes: H04N 7/147 : Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals selecting H04Q
• CPC Class Codes: H04N 7/15 : Conference systems

Abstract

A transcription network having linked computer terminals for a court reporter and for examining, defending, and associate attorneys. Based on the hardware present, the court reporter terminal automatically selects the most appropriate synchronization and audio and video transcript delivery schemes for the other terminals. A multi-mode synchronization scheme provides for various levels of synchronization of the textual transcript with the audio and video transcripts of the proceeding. A first-in first-out arrangement is provided for controlling the video and audio storage space so that a window of available audio and video can be specifically marked and retrieved for post-proceeding review.

Claims

1. A method utilized during a testimonial proceeding involving an attorney for facilitating the use of information from the testimonial proceeding, the method using a transcription system and a capture system, the method comprising:

converting, using the transcription system, spoken words to text in real time;

capturing, using the capture system, audio signals representative of the spoken words in real time;

associating the audio signals with the text;

displaying the text for real time review by the attorney;

while converting the spoken words to the text, accepting an input from the attorney and performing a search of the text using the accepted input; and

reproducing portions of the spoken words from portions of the audio signals corresponding to portions of the text located in response to the search.

2. The method of claim 1 further comprising reassociating the audio signals with the text to attempt to provide accurate synchronization therebetween.

3. The method of claim 1 wherein the reproduced portions of the spoken words are being reproduced for review by a judge.

4. The method of claim 1 wherein the reproduced portions of the spoken words are being reproduced for review by a jury.

5. The method of claim 1 using an attorney terminal and further comprising delivering at least the portions of the audio signals to the attorney terminal.

6. The method of claim 5 wherein reproduction of the portions of the spoken words occurs on the attorney terminal.

7. The method of claim 1 wherein the transcription system comprises a stenographic system.

8. The method of claim 7 further comprising converting the spoken words to a textual form utilizing a speech recognition system, and wherein the stenographic system and the speech recognition system coordinate the step of converting.

9. The method of claim 1 wherein the capture system comprises a video camera.

10. The method of claim 1 wherein the capture system comprises an audio recorder.

11. The method of claim 10 wherein the audio recorder comprises a tape recorder.

12. A method for facilitating the use of information from a testimonial proceeding, the method utilized at least in part during the testimonial proceeding, the method using a transcription system, a capture system and a terminal having a screen, the method comprising:

converting, using the transcription system, spoken words to text in real time;

capturing, using the capture system, audio signals representative of the spoken words in real time;

associating the audio signals with the text;

storing the text and the associated audio signals;

displaying the text on the screen for real time review;

accepting an input and performing a search of the stored text using the accepted input; and

reproducing portions of the spoken words from portions of the stored audio signals corresponding to portions of the stored text located in response to the search.

13. The method of claim 12 further comprising reassociating the audio signals with the text to attempt to provide accurate synchronization therebetween.

14. The method of claim 12 wherein the capture system comprises a video camera.

15. The method of claim 12 wherein the transcription system comprises a stenographic system.

16. The method of claim 15 further comprising converting the spoken words to a textual form utilizing a speech recognition system, and wherein the stenographic system and the speech recognition system coordinate the step of converting.

17. The method of claim 12 wherein the capture system comprises an audio recorder.

18. The method of claim 17 wherein the audio recorder comprises a tape recorder.

19. A method for facilitating the use of information from a testimonial proceeding, the method utilized at least in part during the testimonial proceeding, the method using a transcription system, a capture system and a terminal having a screen, the method comprising:

converting, using the transcription system, spoken words to text in real time;

capturing, using the capture system, audio signals representative of the spoken words in real time;

associating the audio signals with the text;

delivering the text to the terminal; and

displaying the text on the screen for real time review.

20. The method of claim 19 further comprising:

delivering at least portions of the audio signals to the terminal; and

reproducing at least portions of the spoken words from the at least portions of the audio signals delivered.

21. The method of claim 20 wherein the reproducing of the at least portions of the spoken words occurs along with the displaying of the text.

22. The method of claim 21 wherein the reproducing of the at least portions of the spoken words and the displaying of the text supports real time review.

23. The method of claim 19 further comprising delivering the audio signals to the terminal.

24. The method of claim 23 further comprising reproducing the spoken words corresponding to the audio signals delivered.

25. The method of claim 19 further comprising:

storing the text and the associated audio signals;

accepting an input and performing a search of the stored text using the accepted input; and

reproducing portions of the spoken words from portions of the stored audio signals corresponding to portions of the stored text located in response to the search.

26. A method for facilitating the use of information from a testimonial proceeding, the method utilized at least in part during the testimonial proceeding, the method using a transcription system, a capture system and a remote terminal having a screen, the method comprising:

converting, using the transcription system, spoken words to text in real time;

capturing, using the capture system, audio signals representative of the spoken words in real time;

storing the text and the audio signals;

communicating at least portions of the text and at least portions of the audio signals to the remote terminal;

displaying at the remote terminal the communicated text on the screen for real time review; and

reproducing at the remote terminal spoken words corresponding to the communicated audio signals for real time review.

27. The method of claim 26 further comprising accepting, at the remote terminal, an input and performing a search of the stored text using the accepted input.

28. The method of claim 26 wherein the capture system comprises a video camera.

29. The method of claim 26 wherein the capture system comprises an audio recorder.

30. The method of claim 29 wherein the audio recorder comprises a tape recorder.

31. The method of claim 26 wherein the transcription system comprises a stenographic system.