System and method for integrated delivery of media and synchronized transcription

• US 6,513,003 B1
• Filed: 02/03/2000
• Issued: 01/28/2003
• Est. Priority Date: 02/03/2000
• Status: Expired due to Term

• Current Assignee: Refinitiv US Organization, LLC (Refinitiv US Holdings, Inc.)
• Original Assignee: Fair Disclosure Financial Network, Inc.
• Inventors: Levine, Jason D., Benson, Matthew B., Bivings, Frank Gary Jr., Angell, Philip S., Haque, Mohammad A.
• Primary Examiner(s): Dorvil, Richemond
• Application Number:
  US09/498,233
• Time in Patent Office: 1,090 Days
• Field of Search: 704/270, 704/272, 704/275, 704/251, 704/231, 704/500, 704/507, 704/242, 704/245, 704/235, 704/265, 704/277
• US Class Current: 704/235
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence
• CPC Class Codes: H04L 65/1101 Session protocols
• CPC Class Codes: H04L 65/612 for unicast
• CPC Class Codes: H04L 65/752 adapting media to network capabilities
• CPC Class Codes: H04L 65/762 at the source reformatting of additional data in video distribution servers H04N21/2355
• CPC Class Codes: H04M 2201/40 using speech recognition speech recognition per se G10L15/00
• CPC Class Codes: H04M 3/42391 where the subscribers are hearing-impaired persons, e.g. telephone devices for the deaf

Abstract

A system for the capture of audio, video and other media from news and other events combines digitized delivery of those media with accompanying high-accuracy textual streams, synchronized with the content. Governmental, corporate and other group events may be captured using microphones, video camera and other equipment, whose output is digitized and sent to a transcription facility containing speech recognition workstations. Human transcription agents may assist in the initial conversion to text data, and human editorial agents may further review the audio and textual streams contemporaneously, to make corrections, add highlights, identify foreign phrases and otherwise increase the quality of the transcription service. Subscribers to the service may access a Website or other portal to view the media and text in a real time or near-real time to the original event, and access archival versions of other events for research, editing and other purposes. The subscribers may configure their accounts to deliver the streaming content in different ways, including full content delivery and background execution which triggers on key words for pop up text, audio, video or other delivery of important portions in real time. The subscribers may set up their accounts to stream different events at different dates and times, using different keywords and other settings.

Claims

1. A system for generating synchronized media and textual streams, the system comprising:

a first interface to at least one streaming media source;

a distribution server in communication with the first interface, the distribution server storing the media stream; and

a second interface in communication with the distribution server and a transcription engine, said transcription engine receiving the media stream and producing a textual stream corresponding to the media stream and outputting said textual stream to said distribution server,

wherein said distribution server synchronizes said textual stream with said stored media stream and produces a combined media and textual stream, and

wherein said distribution server outputs said combined media and textual stream to a recipient such that the recipient can observe said combined media and textual stream on a synchronized and simultaneous basis.

2. The system of claim 1, wherein the at least one streaming media source comprises an audio server outputting digitized audio to the first interface.

3. The system of claim 1, wherein the distribution server comprises a database for storing the media stream and the textual stream, and the distribution server synchronizes the textual stream and the media stream for storage in the database.

4. The system of claim 1, wherein the transcription engine comprises a voice recognition server executing a speech recognition module outputting a raw transcription stream, the voice recognition server presenting the raw transcription stream to a transcription agent to monitor the generation of the raw transcription stream.

5. The system of claim 4, wherein the transcription engine comprises a scopist workstation, the scopist workstation receiving the raw transcription stream from the voice recognition server and presenting the raw transcription stream to an editorial agent to edit and output as the textual stream.

6. The system of claim 1, wherein the combined media and textual stream is output to the recipient at a client workstation.

7. The system of claim 6, wherein the combined media and textual stream is output via an Internet connection.

8. The system of claim 7, wherein the client workstation comprises an administrative module, the administrative module managing the delivery of the combined media and textual stream to the recipient.

9. The system of claim 8, wherein the administrative module comprises delivery configurations, the delivery configurations comprising at least one of full delivery of the combined media and textual stream, background delivery of the combined media and textual stream, scheduling of the delivery of the combined media and textual stream, delivery of an alert based upon detection of a keyword in the textual stream, and delivery of the combined media and textual stream based upon detection of a keyword in the textual stream.

10. The system of claim 1, wherein the at least one streaming media source comprises a video server outputting digitized video to the first interface.

11. The system of claim 1, wherein the textual stream comprises textual output in a plurality of languages.

12. The system of claim 1, wherein the textual stream comprises textual output corresponding to a plurality of speakers.

13. The system of claim 12, wherein the textual stream comprises a plurality of channels, each corresponding to one of the speakers.

14. A method of generating synchronized media and textual streams, comprising:

a) receiving a media stream from at least one streaming media source;

b) storing the media stream in a distribution server;

c) outputting the media stream to a transcription engine;

d) generating a textual stream corresponding to the media stream in the transcription engine;

e) synchronizing the media stream with the textual stream;

f) producing a combined media and textual stream; and

g) outputting the combined media and textual steam to a recipient.

15. The method of claim 14, wherein the at least one streaming media source comprises an audio server outputting digitized audio.

16. The method of claim 14, wherein the distribution server comprises a database for storing the media stream and textual stream and wherein the step (e) of synchronizing the media stream and the textual stream is performed by the distribution server for storage in the database.

17. The method of claim 14, wherein the transcription engine comprises a voice recognition server, further comprising a step of (h) executing a speech recognition module on the voice recognition server and outputting a raw transcription stream, the voice recognition server presenting the raw transcription stream to a transcription agent to monitor the generation of the raw transcription stream.

18. The method of claim 17, wherein the transcription engine comprises a scopist workstation, further comprising a step of (i) receiving the raw transcription stream from the voice recognition server in the scopist workstation and presenting the raw transcription stream to an editorial agent to edit and output as the textual stream.

19. The method of claim 14, wherein the combined media and textual stream is output to the recipient at a client workstation.

20. The method of claim 19, wherein the combined media and textual stream is output via an Internet connection.

21. The method of claim 20, wherein the combined media and textual stream are received at the client workstation, the client workstation comprising an administrative module, further comprising a step of (j) managing the delivery of the combined media and textual stream to the recipient using the administrative module.

22. The method of claim 21, wherein the step (j) of managing comprises a step of using the administrative module to set delivery configurations, the delivery configurations comprising at least one of full delivery of the combined media and textual stream, background delivery of the combined media and textual stream, scheduling of the delivery of the combined media and textual stream, delivery of an alert based upon detection of a keyword in the textual stream, and delivery of the combined media and textual stream based upon detection of a keyword in the textual stream.

23. The method of claim 14, wherein the at least one streaming media source comprises a video server outputting digitized video to the first interface.

24. The method of claim 14, wherein the textual stream comprises textual output in a plurality of languages.

25. The method of claim 14, wherein the textual stream comprises textual output corresponding to a plurality of speakers.

26. The method of claim 25, wherein the textual stream comprises a plurality of channels, each corresponding to one of the speakers.