Text to audio mapping, and animation of the text
First Claim
1. At least one computer-readable medium containing computer program instructions for creating a chronology mapping of text to an audio recording, said computer program instructions performing the steps of:
- feeding, as inputs to a computer-implemented mapper module, text in computer-readable form and an audio recording in computer-readable form, said audio recording corresponding to the text; and
assigning beginning and ending times to elements within the text at an arbitrary level of granularity.
2 Assignments
0 Petitions
Accused Products
Abstract
Apparati, methods, and computer-readable media for creation of a text to audio chronological mapping. Apparati, methods, and computer-readable media for animation of the text with the playing of the audio. A Mapper (10) takes as inputs text (12) and an audio recording (11) corresponding to that text (12), and with user assistance assigns beginning and ending times (14) to textual elements (15). A Player (50) takes the text (15), audio (17), and mapping (16) as inputs, and animates and displays the text (15) in synchrony with the playing of the audio (17). The invention can be useful to animate text during playback of an audio recording, to control audio playback as an alternative to traditional playback controls, to play and display annotations of recorded speech, and to implement characteristics of streaming audio without using an underlying streaming protocol.
-
Citations
25 Claims
-
1. At least one computer-readable medium containing computer program instructions for creating a chronology mapping of text to an audio recording, said computer program instructions performing the steps of:
-
feeding, as inputs to a computer-implemented mapper module, text in computer-readable form and an audio recording in computer-readable form, said audio recording corresponding to the text; and assigning beginning and ending times to elements within the text at an arbitrary level of granularity. - View Dependent Claims (2, 3, 4, 5, 6, 7)
-
-
8. A computer-implemented method for creating a chronology mapping of text to an audio recording, said method comprising the steps of:
-
feeding, as inputs to a computer-implemented mapper module, text in computer-readable form and an audio recording in computer-readable form, said audio recording corresponding to the text; assigning beginning and ending times to elements within the text at an arbitrary level of granularity; and producing structured text based on the elements and further based on the beginning and ending times of the elements. - View Dependent Claims (9)
-
-
10. Apparatus for creation of a chronology mapping of text to an audio recording, said apparatus comprising:
-
a computer-implemented mapper module having as inputs text in computer-readable form and an audio recording in computer-readable form, said audio recording corresponding to the text; means for assigning beginning and ending times to elements within the text at an arbitrary level of granularity; and interactive means for selecting at least one of the elements and the granularity of the elements. - View Dependent Claims (11)
-
-
12. Apparatus for animating text and displaying said animated text in synchrony with an audio recording, said apparatus comprising:
-
a computer-implemented player module having as inputs text, an audio recording corresponding to said text, and a chronological mapping between the text and the audio recording;
wherein;said player module animates the text, displays the text, and synchronizes the displayed text with playing of the audio recording; said animation causes the displayed text to change in synchrony with the playing of the audio recording; and said animation and synchronization are at the level of letters, phonemes, or syllables that make up the text, thus achieving synchrony with playback of the corresponding audio recording. - View Dependent Claims (13)
-
-
14. A computer-implemented method for animating text and displaying said animated text in synchrony with an audio recording, said method comprising the steps of:
-
feeding, as inputs to a computer-implemented player module, text, an audio recording corresponding to said text, and a chronological mapping between the text and the audio recording;
wherein;said player module animates the text, displays the text, and synchronizes the displayed text with playing of the audio recording; said animation causes the displayed text to change in synchrony with the playing of the audio recording; and said animation and synchronization are at the level of letters, phonemes, or syllables that make up the text, thus achieving synchrony with playback of the corresponding audio recording. - View Dependent Claims (15, 16)
-
-
17. At least one computer-readable medium containing computer program instructions for animating text and displaying said animated text in synchrony with an audio recording, said computer program instructions performing the steps of:
-
feeding, as inputs to a computer-implemented player module, text, an audio recording corresponding to said text, and a chronological mapping between the text and the audio recording;
wherein;said player module animates the text, displays the text, and synchronizes the displayed text with playing of the audio recording; said animation causes the displayed text to change in synchrony with the playing of the audio recording; and said animation and synchronization are at the level of letters, phonemes, or syllables that make up the text, thus achieving synchrony with playback of the corresponding audio recording. - View Dependent Claims (18, 19, 20, 21)
-
-
22. A computer-implemented method for transmitting audio recordings, said method comprising the steps of:
-
a client computer requesting that a server computer send to the client computer audio segments from a longer audio recording, said segments having time intervals of arbitrary durations; and responsive to said request from said client computer, said server computer sending said audio segments to said client computer. - View Dependent Claims (23, 24, 25)
-
Specification