TEXT-SYNCHRONIZED MEDIA UTILIZATION AND MANIPULATION

• US 20120315009A1
• Filed: 01/03/2012
• Published: 12/13/2012
• Est. Priority Date: 01/03/2011
• Status: Abandoned Application

• Current Assignee: Curtis A. Evans
• Original Assignee: Curtis A. Evans
• Inventors: Evans, Curt, Hugo, Paul R., Wiseman, David M.
• Application Number:
  US13/342,921
• Publication Number:
  US 20120315009A1
• Time in Patent Office: Days
• US Class Current: 386/230
• CPC Class Codes: G06F 16/685 using automatically derived transcript of audio data, e.g. lyrics speech recognition G10L15/00
• CPC Class Codes: H04N 21/41407 embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop constructional details of equipment or arrangements specially adapted for portable computer application G06F1/1626; arrangements specially adapted for mobile receivers in broadcast systems H04H20/57
• CPC Class Codes: H04N 21/440236 by media transcoding, e.g. video is transformed into a slideshow of still pictures, audio is converted into text
• CPC Class Codes: H04N 21/47217 for controlling playback functions for recorded or on-demand content, e.g. using progress bars, mode or play-point indicators or bookmarks specific graphical features in visual interfaces H04N21/4312
• CPC Class Codes: H04N 21/4828 for searching program descriptors retrieval of video data G06F16/739
• CPC Class Codes: H04N 5/765 Interface circuits between an apparatus for recording and another apparatus

Abstract

A method of retrieving multimedia content using a mobile computing device is disclosed. The method includes entering search terms on a mobile computing device, and searching for the search terms in a first transcript library stored in a memory of a mobile computing device to return a match. If no match is returned, the method includes searching for the search terms in a second transcript library stored in a location remote from the memory of the mobile computing device. The method further includes returning at least one search match and activating a search match to display transcript text, in a display of transcript text, corresponding to the search match, wherein the display of transcript text has unique corresponding multimedia. The method also includes performing a gesture on the display of transcript text to initiate play of the unique corresponding multimedia or a portion thereof.

Claims

1. A method of retrieving multimedia content using a mobile computing device comprising:

entering search terms on a mobile computing device;

searching for the search terms in a first transcript library stored in a memory of a mobile computing device to return a match, and, if no match is returned, searching for the search terms in a second transcript library stored in a location remote from the memory of the mobile computing device;

returning at least one search match;

activating a search match to display transcript text, in a display of transcript text, corresponding to the search match, wherein the display of transcript text has unique corresponding multimedia; and

performing a gesture on the display of transcript text to initiate play of the unique corresponding multimedia or a portion thereof.

2. The method of claim 1, wherein

performing a gesture on the display of transcript text to initiate play of the unique corresponding multimedia initiates play at a point in the unique corresponding multimedia that corresponds to the time at which sound associated with the transcript text is audible.

3. The method of claim 1, wherein

performing a gesture on the display of transcript text to initiate play of the unique corresponding multimedia initiates play, for a predetermined preview duration, at a point in the unique corresponding multimedia that corresponds to the time at which the sound associated with the transcript text is audible.

4. A computer program embodied on a computer readable medium comprising:

logic configured to display multimedia;

logic configured to select a playback location within said multimedia with a video scrub element;

logic configured to display text that corresponds to words audible within said multimedia;

logic configured to synchronize playback of said multimedia with a display of said text;

logic configured to select portions of said text;

logic configured to apply a highlighting graphic element to said portions of said text once selected;

logic selected to calculate time location t1 to t2 of said multimedia that corresponds to said highlighting graphic element; and

logic configured to coordinate a second graphic element with said video scrub element, wherein said second graphic element graphically denotes time location t1 to t2 of said multimedia.

5. The computer program of claim 4,

wherein a predetermined input gesture applied to said second graphic element causes playback of said multimedia beginning at time=t1.

6. The computer program of claim 4,

wherein the computer program operates on mobile computing device configured to display multimedia.

7. The computer program of claim 4,

wherein said video scrub element that represents a full duration of multimedia t=0 to t=end has facility to focus upon a selected portion of the multimedia shorter than t=0 to t=end.

8. The computer program of claim 4, further comprising logic to play said multimedia in variable playback speed.

9. The computer program of claim 8, wherein variable playback speed does not affect audio pitch.

10. A computer program embodied on a computer readable medium comprising:

logic configured to display multimedia;

logic configured to display a text transcription, wherein said text transcription is part of a synchronization index and corresponds to said multimedia; and

logic configured to display a scrub position element, wherein said scrub position element controls logic to effectuate a change in multimedia position and a substantially simultaneous change in text transcription position.

11. The computer program of claim 10, wherein said computer program operates on a mobile computing device.

12. A method for initiating a video seek sequence using a synchronization index and a mobile computing device comprising the steps:

performing a gesture applied to a word, or range of words, on a mobile computing device;

performing a timecode lookup, wherein a reference data set contains a time location t1 value that corresponds to said word or range of words;

requesting from a second computing device delivery of multimedia beginning at time t1; and

delivering multimedia beginning at time t1 to a receiving device.

13. The method of claim 12, further comprising seeking on said first computing device the multimedia file, and playing from t1 if found.

14. The method of claim 12, wherein delivering multimedia beginning at time t1 to a receiving device comprises providing instructions for the delivery of multimedia to a receiving device.

15. The method of claim 12, wherein said mobile computing device is the receiving device.

16. The method of claim 12, wherein said mobile computing device is a DVR.

17. The method of claim 12, wherein multimedia is delivered at t1 and cached thereafter so subsequent seek operations call multimedia residing locally to the receiving device.

18. A method for initiating a video seek sequence using a synchronization index and a mobile computing device comprising the steps:

displaying on a mobile computing device text from a synchronization index, wherein the mobile computing device comprises a viewing screen and a touch-sensitive input interface;

performing a gesture on a portion of the viewing screen corresponding to a word, or range of words, from the synchronization index, wherein the gesture is recognized by the touch-sensitive input interface;

performing a data lookup, wherein the synchronization index is referenced to provide data for a time location t1 that corresponds to the word or range of words;

seeking on the mobile computing device multimedia corresponding to the synchronization index, and

if found, accessing multimedia at t1.

19. The method of claim 18, further comprising:

requesting from a second computing device delivery of multimedia beginning at time t1;

delivering multimedia beginning at time t1, or providing instructions for the delivery of multimedia beginning at time t1, to a receiving device, wherein the multimedia comprises at least an audio element, and

caching within the mobile computing device at least a portion of the audio element.

20. A method for creating an errata report for a transcript comprising:

providing a first electronic transcript of spoken words, wherein said first electronic transcript is organized by pages with a predetermined number of lines per page and a predetermined number of alphanumeric characters per line in the range 1 to x,

and wherein each alphanumeric character can be identified by a coordinate page-line-character N;

displaying said transcript with computer logic configured to allow an operator to change said alphanumeric characters in the range 1 to x, wherein alphanumeric characters added in the range 1 to x remain associated with page0-line0 and not wrapping to subsequent page0-line1;

compiling a comparison transcript comprising said electronic transcript and any changed alphanumeric characters; and

providing an errata report by logic configured to aggregate all changes to one or more alphanumeric characters of said first electronic transcript.

21. The method of claim 20,

wherein alphanumeric characters deleted are indicated by a first font characteristic, and

wherein alphanumeric characters added are indicated by a second font characteristic.

22. The method of claim 20,

wherein said errata report lists in sequence each page-line in which an alphanumeric character has been added or removed.

23. The method of claim 20,

wherein said errata report lists in sequence each changed line, by page-line reference, in which an alphanumeric character has been added or removed, and

wherein each changed line is hyperlinked to its corresponding page-line of the transcript.

24. The method of claim 20, wherein said comparison transcript can be electronically saved in a .txt format suitable for use with transcript management software.

25. The method of claim 20, wherein said comparison transcript can be electronically saved in a format suitable for use with transcript management software, said format being selected from the group comprising ASCII text, .txt, .ptx, .ptf, .pcf, .mdb, .sbf, and .cms, .ccs, .cds, .cpl, .dcb, .lfp, .log, .lpt, .tlb, .vid.

26. A system for realtime text transcription using a mobile computing device comprising:

a realtime text transcription sending apparatus;

a data communication network; and

a mobile computing device with mobile computing device software embodied on computer readable media;

wherein said mobile computing device software comprises logic to receive a realtime text transcription from said realtime text transcription sending apparatus via said data communication network;

wherein said mobile computing device software comprises logic to annotate said realtime text transcription;

wherein said mobile computing device software comprises logic to transmit said annotations to a second computer or hosting server.

27. A computer program embodied on a computer readable medium comprising:

logic to receive a computer file in .ptx format; and

logic to render the content of the computer file on a mobile computing device.

28. The computer program of claim 27, wherein the logic to render the content of the computer file on the mobile computing device includes a conversion process that converts the computer file into one of multiple user selectable formats including at least single page and minuscript page formats for display on the mobile computing device.

29. The computer program of claim 28, wherein the conversion process converts the computer file into a PDF file having one of the multiple user selectable formats suitable for printing by the mobile computing device.

30. The computer program of claim 28, wherein the conversion process generates a word index from data read from the computer file.