Method and system for audio-video integration

• US 9,412,372 B2
• Filed: 05/08/2013
• Issued: 08/09/2016
• Est. Priority Date: 05/08/2012
• Status: Active Grant

• Current Assignee: SpeakWrite, LLC
• Original Assignee: SpeakWrite, LLC
• Inventors: Henry, Paul, Jackson, Richard
• Primary Examiner(s): Sirjani, Fariba
• Application Number:
  US13/889,990
• Publication Number:
  US 20130304465A1
• Time in Patent Office: 1,189 Days
• US Class Current: 1/1
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence
• CPC Class Codes: G11B 27/031 Electronic editing of digitised analogue information signals, e.g. audio or video signals
• CPC Class Codes: G11B 27/036 Insert-editing
• CPC Class Codes: H04N 9/8233 the additional signal being a character code signal

Abstract

A method of dictation is described which, after transcription, integrates video into text at locations designated by the user. A user collects audio and visual information using an application that has been installed on the user'"'"'s mobile device. The user designates, using the application, the desired location of the video files within the audio file. Both the audio and video information are uploaded to a transcription provider. The transcription provider uses transcription software to transcribe the audio files into text, the transcription software being able to identify the transcriptionist as to the location within the audio file each video is to be inserted. The transcribed document with integrated audio and video is then delivered back to the user.

Claims

1. A method for integrating video into a transcribed document, the method being performed by a mobile device in communication with a server of a transcription provider, the method comprising;

providing an application for use on the mobile device, wherein said application is configured so that a user records audio to an audio file, selects video, and designates a location within said audio file at which said video is associated;

receiving two or more video segments from said user on the mobile device;

receiving said audio file from said user on the mobile device;

playing back said audio file to said user by the mobile device;

receiving, from said user, on the mobile device, and during the playing back of said audio file, one of the two or more video segments to obtain said video;

presenting to said user a graphical user interface depicting an audio slide bar configured to receive input designating a location within said audio file at which said video is to be associated;

receiving, from said user on the audio slide bar and during the playing back of said audio file, a designation of the location within said audio file at which said video is associated;

uploading said audio file, said video, and said location information from the mobile device to the server;

wherein a transcriptionist transcribes said audio file from the server to text by use of a transcription software that displays a further audio bar indicating a current location within said audio file and depicting the location at which said video is associated with a representative image from said video; and

receiving, on the mobile device, one or more transcriptions of said audio file in which said video is integrated into said text at said location designated by said user.

2. The method of claim 1, wherein said application is downloaded and installed by said user prior to use.

3. The method of claim 1, wherein said recording utilizes said mobile device'"'"'s integral microphone.

4. The method of claim 1, wherein said video is a photograph.

5. The method of claim 1, wherein the graphical user interface of the mobile device is configured to designate locations within said audio file, at which the two or more video segments are associated, by presenting hash marks along the audio slide bar.

6. The method of claim 1, wherein a graphical user interface, of the server, is configured to designate locations within said audio file, at which the two or more video segments are associated, by presenting hash marks along the further audio slide bar.

7. A system for integrating video into a transcribed document, comprising;

a mobile device for use by a user; and

a server belonging to a transcription provider, in communication with the mobile device, and being used by a transcriptionist;

wherein the mobile device includes an application resident on the mobile device;

wherein said application is configured so that a user records audio to an audio file, selects video, and designates a location within said audio file at which said video is associated;

wherein said application is configured to perform the following on the mobile device;

receive two or more video segments from said user;

receive said audio file from said user;

play back said audio file to said user;

receive, from the user and during the play back of said audio file, a selection of said video as one of the one or more video segments;

present to the user a graphical user interface depicting an audio slide bar configured to receive input designating a location within said audio file at which said video is to be associated;

receive, from said user on the audio slide bar and during the play back of said audio file, a designation of the location within said audio file at which said video is associated;

wherein said audio file and said video are uploaded from said mobile device of the user to the server;

wherein the server further includes transcription software configured to display, to the transcriptionist, a further audio bar indicating a current location within said audio file and depicting the location at which said video is associated with a representative image from said video; and

wherein the mobile device receives, from the server, and displays, at the mobile device, one or more transcriptions of said audio file in which said video is integrated into said text at said location designated by said user.

8. The system of claim 7, wherein said application is downloaded and installed by said user prior to use.

9. The system of claim 7, wherein said recording utilizes said mobile device'"'"'s integral microphone.

10. The system of claim 7, wherein said video is a photograph.

11. The system of claim 7, wherein the graphical user interface, of the mobile device, is configured to designate locations within said audio file, at which the two or more video segments are associated, by presenting hash marks along the audio slide bar.

12. The system of claim 7, wherein a graphical user interface, of the server, is configured to designate locations within said audio file, at which the one or more videos are associated, by presenting hash marks along the further audio slide bar.