Computerized notetaking system and method
First Claim
1. A method of taking notes of an event on a computerized notetaking device that has a display and at least when needed access to a recording device at least when needed an audio output device, said method comprising the steps of:
- (a) said recording device making an audio recording of said event;
(b) said computerized notetaking device inputting notes about said event from a user and inserting these notes into a document and displaying at least a portion of said document on said display and timestamping a plurality of these notes to synchronize them with said audio recording;
(c) said computerized notetaking device, having access to both the audio recording and the notes, inputting a timestamp-selective play command from a user and responsive to the play command, playing said audio recording starting from the selected timestamp'"'"'s point of synchronization as adjusted by a preplay parameter; and
(d) said computerized notetaking device also performing at least one step selected from the group consisting of the following Arabic-numbered steps;
(1) said computerized notetaking device playing background audio when not playing said audio recording, and additionally responsive to said play command, interrupting the background audio while playing said audio recording;
(2) said computerized notetaking device filtering the recorded audio in the time domain by attempting to find a fundamental frequency that falls in the range of fundamental frequencies of human speech and upon finding any such fundamental frequency, attempting to extract the integral harmonics of this fundamental frequency, the integral harmonics following the fundamental frequency as it varies over time, and retaining only the fundamental frequency and its integral harmonics and short sounds having no fundamental frequency to make the voice of a particular speaker more understandable;
(3) said computerized notetaking device, prior to playing said audio recording starting from a particular point, searching the audio recording for a pause in the sound level of the audio recording that is near said particular point and upon finding such a pause further adjusting said particular point so play starts near the end of said pause that was found;
(4) said computerized notetaking device, when responding to a lockstep play command that is accompanied by a scheduled stop point, searching the audio recording for a pause in the sound level of the audio recording that is near the scheduled stop point and upon finding such a pause stopping audio playback in the pause that was found;
(5) said computerized notetaking device, while inputting notes to a first location, also inputting a next-topic command and responsive to said next-topic command preparing a second location for notes and establishing a timestamp link that does not link to the notes at the first location but rather links to the second location for notes, and after responding to said next-topic command continuing to input notes to the first location; and
(6) said computerized notetaking device, while inputting notes to a first location, also inputting a next-topic command and responsive to said next-topic command preparing a second location for notes and establishing a timestamp link that does not link to the notes at the first location but rather links to the second location for notes and prompting for a next-topic label, and after inputting a termination to the next-topic label displaying the next-topic label at the second location and continuing to input notes to the first location.
0 Assignments
0 Petitions
Accused Products
Abstract
A computerized notetaking system that records audio and links notes to the audio and has enhancements such as: Always-on audio recording and external timestamp button that work even when the system is turned off. A “next-topic” command that prepares and timestamps a new paragraph while allowing the user to complete the current paragraph. Commands for creating callouts and sidebar boxes in the user notes. A choice of audio filters. Speech recognition for searching through and navigating an audio recording. Speech recognition accuracy enhancement based upon typed notes. Playback, including lockstep playback, that prefers starting and stopping at word boundaries without overlap when possible. A self-adjusting preplay parameter. A “repeat slower” command that replays a few seconds of audio and then resumes at normal speed. Integrated background audio that plays music or white noise when notes-related audio is not being played. Several other enhancements are disclosed.
102 Citations
24 Claims
-
1. A method of taking notes of an event on a computerized notetaking device that has a display and at least when needed access to a recording device at least when needed an audio output device, said method comprising the steps of:
-
(a) said recording device making an audio recording of said event;
(b) said computerized notetaking device inputting notes about said event from a user and inserting these notes into a document and displaying at least a portion of said document on said display and timestamping a plurality of these notes to synchronize them with said audio recording;
(c) said computerized notetaking device, having access to both the audio recording and the notes, inputting a timestamp-selective play command from a user and responsive to the play command, playing said audio recording starting from the selected timestamp'"'"'s point of synchronization as adjusted by a preplay parameter; and
(d) said computerized notetaking device also performing at least one step selected from the group consisting of the following Arabic-numbered steps;
(1) said computerized notetaking device playing background audio when not playing said audio recording, and additionally responsive to said play command, interrupting the background audio while playing said audio recording;
(2) said computerized notetaking device filtering the recorded audio in the time domain by attempting to find a fundamental frequency that falls in the range of fundamental frequencies of human speech and upon finding any such fundamental frequency, attempting to extract the integral harmonics of this fundamental frequency, the integral harmonics following the fundamental frequency as it varies over time, and retaining only the fundamental frequency and its integral harmonics and short sounds having no fundamental frequency to make the voice of a particular speaker more understandable;
(3) said computerized notetaking device, prior to playing said audio recording starting from a particular point, searching the audio recording for a pause in the sound level of the audio recording that is near said particular point and upon finding such a pause further adjusting said particular point so play starts near the end of said pause that was found;
(4) said computerized notetaking device, when responding to a lockstep play command that is accompanied by a scheduled stop point, searching the audio recording for a pause in the sound level of the audio recording that is near the scheduled stop point and upon finding such a pause stopping audio playback in the pause that was found;
(5) said computerized notetaking device, while inputting notes to a first location, also inputting a next-topic command and responsive to said next-topic command preparing a second location for notes and establishing a timestamp link that does not link to the notes at the first location but rather links to the second location for notes, and after responding to said next-topic command continuing to input notes to the first location; and
(6) said computerized notetaking device, while inputting notes to a first location, also inputting a next-topic command and responsive to said next-topic command preparing a second location for notes and establishing a timestamp link that does not link to the notes at the first location but rather links to the second location for notes and prompting for a next-topic label, and after inputting a termination to the next-topic label displaying the next-topic label at the second location and continuing to input notes to the first location. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 10, 11, 12, 13)
-
-
9. The method of claim L additionally comprising the steps of inputting a create callout command accompanied by a choice of target and responsive to said create callout command, said computerized notetaking device preparing an area for explanatory text, placing the caret inside the area for explanatory text and drawing connecting indicia connecting the target and the area for explanatory text.
-
14. A method of taking notes of an event on a computerized notetaking device that has a display and at least when needed access to a recording device at least when needed an audio output device, said method comprising the steps of:
-
(a) said recording device making an audio recording of said event;
(b) said computerized notetaking device inputting notes about said event from a user and timestamping a plurality of these notes to synchronize them with said audio recording;
(c) said computerized notetaking device attempting speech recognition of the audio recording so as to generate automatically recognized text that is also linked to said audio recording, and said computerized notetaking device displaying at least a portion of said automatically recognized text in manner that is distinguishable from said notes; and
(d) said computerized notetaking device inputting a play command that is selective of a portion of said automatically recognized text and responsive to said play command, playing the portion of the audio recording that was translated to said selected portion of said automatically recognized text. - View Dependent Claims (15, 16, 17)
-
-
18. A method of taking notes of an event on a computerized notetaking device that has a display and at least when needed access to a recording device at least when needed an audio output device, said method comprising the steps of:
-
(a) said recording device making an audio recording of said event;
(b) said computerized notetaking device inputting notes about said event from a user and inserting these notes into a document and displaying at least a portion of said document on said display and timestamping a plurality of these notes to synchronize them with said audio recording;
(c) said computerized notetaking device, having access to both the audio recording and the notes, inputting a timestamp-selective play command from a user and responsive to the play command, playing said audio recording starting from the selected timestamp'"'"'s point of synchronization as adjusted by a preplay parameter; and
(d) said computerized notetaking device playing background audio when not playing said audio recording, and additionally responsive to said play command, interrupting the background audio while playing said audio recording.
-
-
19. A method of taking notes of an event on a computerized notetaking device that has a display and at least when needed access to a recording device at least when needed an audio output device, said method comprising the steps of:
-
(a) said recording device making an audio recording of said event;
(b) said computerized notetaking device inputting notes about said event from a user and inserting these notes into a document and displaying at least a portion of said document on said display and timestamping a plurality of these notes to synchronize them with said audio recording;
(c) said computerized notetaking device, having access to both the audio recording and the notes, inputting a timestamp-selective play command from a user and responsive to the play command, playing said audio recording starting from the selected timestamp'"'"'s point of synchronization as adjusted by a preplay parameter; and
(d) said computerized notetaking device, prior to playing said audio recording starting from a particular point, searching the audio recording for a pause in the sound level of the audio recording that is near said particular point and upon finding such a pause further adjusting said particular point so play starts near the end of said pause that was found. - View Dependent Claims (20)
-
-
21. A method of taking notes of an event on a computerized notetaking device that has a display and at least when needed access to a recording device at least when needed an audio output device, said method comprising the steps of:
-
(a) said recording device making an audio recording of said event;
(b) said computerized notetaking device inputting notes about said event from a user and inserting these notes into a document and displaying at least a portion of said document on said display and timestamping a plurality of these notes to synchronize them with said audio recording;
(c) said computerized notetaking device, having access to both the audio recording and the notes, inputting a timestamp-selective play command from a user and responsive to the play command, playing said audio recording starting from the selected timestamp'"'"'s point of synchronization as adjusted by a preplay parameter; and
(d) said computerized notetaking device, while inputting notes to a first location, also inputting a next-topic command and responsive to said next-topic command preparing a second location for notes and establishing a timestamp link that does not link to the notes at the first location but rather links to the second location for notes, and after responding to said next-topic command continuing to input notes to the first location;
- View Dependent Claims (22)
-
-
23. A computerized notetaking device comprising:
-
(a) notes input means;
(b) display means for displaying notes that were input;
(c) audio recording means for creating an audio recording;
(d) selective audio output means for playing selected portions of the audio recording;
(e) timestamp means for linking a plurality of notes as they are input, each note to a particular point in the audio recording that was recorded about when the note was input, so as to synchronize the notes and the audio recording;
(f) timestamp-selective play command means for inputting a play command that is selective of one of the links between the notes and the audio recording and playing the audio recording starting from a point in the audio recording that was recorded few seconds prior to when the selected link'"'"'s note was input; and
(g) background audio means for playing background audio when not playing any portion of the audio recording and for allowing the playing of the audio recording to interrupt the playing of background audio.
-
-
24. A computerized notetaking device comprising:
-
(a) notes input means;
(b) display means for displaying notes that were input;
(c) audio recording means for creating an audio recording;
(d) selective audio output means for playing selected portions of the audio recording;
(e) timestamp means for linking a plurality of notes as they are input, each note to a particular point in the audio recording that was recorded about when the note was input, so as to synchronize the notes and the audio recording;
(f) timestamp-selective play command means for inputting a play command that is selective of one of the links between the notes and the audio recording and playing the audio recording starting from a point in the audio recording that was recorded few seconds prior to when the selected link'"'"'s note was input;
(g) always-on recording means on said device for always recording audio; and
(h) external timestamp button means accessible from the outside of said device for inputting a timestamp command even when the computerized notetaking device is not in use for taking notes.
-
Specification