Apparatus and method for displaying audio data as a discrete waveform

• US 5,634,020 A
• Filed: 12/31/1992
• Issued: 05/27/1997
• Est. Priority Date: 12/31/1992
• Status: Expired due to Fees

• Current Assignee: Avid Technology Incorporated
• Original Assignee: Avid Technology Incorporated
• Inventors: Norton, Mark J.
• Primary Examiner(s): Herndon, Heather R.
• Assistant Examiner(s): Burwell, Joseph R.
• Application Number:
  US07/997,716
• Time in Patent Office: 1,608 Days
• Field of Search: 360/13, 360/14.1, 395/154, 395/2.14, 395/2.19, 395/2.21, 395/2.23, 395/2.33-2.37, 395/2.39, 395/2.62, 395/2.74, 395/2.85, 395/2.87, 395/155, 395/157, 395/161, 381/40, 381/41, 381/45-48
• US Class Current: 715/727
• CPC Class Codes: G11B 27/034 on discs G11B27/036, G11B27/038 take precedence
• CPC Class Codes: G11B 27/34 Indicating arrangements indicating means incorporated in magazine or cassette G11B23/046 and G11B23/0875; indicating measured values in general G01D

Abstract

A display system represents an audio track as a discrete waveform, wherein each sample in the waveform may take on one of a discrete range of possible values. The discrete waveform indicates the presence of sound energy above user-set thresholds. Audio data samples are smoothed and applied to one or more thresholding functions. The resulting discrete output is displayed by using graphics of either different size or different color. An editor using this display system in conjunction with a computerized editing system receives an indication of where sufficient sound levels occur on the audio track. This information may be used to locate breaks in sound, dialog and other sound effects, which simplifies audio editing and synchronization of audio with other media in a multimedia presentation. Similar thresholds may be applied to the results of frequency analysis to provide an indication of which frequencies are present in the audio'"'"'s signal.

Claims

1. An apparatus for facilitating computerized editing of audio data, the apparatus comprising:

means for selecting a portion of the audio data;

means for applying a smoothing operation to the selected portion of the audio data to obtain an average value for each sample;

means for comparing the average value for each sample to a threshold value to generate a discrete waveform representative of the selected portion of the audio data; and

means for displaying the discrete waveform on a video display as a plurality of bars of substantially equal height, each of the plurality of bars having a color selected according to a value of a corresponding sample of the audio data.

2. The apparatus of claim 1 wherein the means for comparing includes means for performing a root-mean-square operation on the plurality of samples.

3. The apparatus of claim 1, further comprising:

means for receiving input from a user indicative of a selected threshold value;

wherein the means for comparing includes means for comparing each of the average values to the selected threshold value.

4. The apparatus of claim 3 wherein the threshold value is adjustable by the user.

5. The apparatus of claim 1, further comprising:

means for computing a signal-to-noise ratio of the selected portion of the audio data; and

means for determining the threshold value from the computed signal-to-noise ratio.

6. The apparatus of claim 1, further comprising means for determining the threshold value based upon the selected portion of the audio data.

7. The apparatus of claim 6 wherein the means for determining includes means for sorting sample values by amplitudes, resulting in a function with a local minimum between a noise level and a desired sound level, and means for selecting the local minimum as the threshold value.

8. The apparatus of claim 6 further comprising means for adding a series of samples that represent a steady state room audio tone to the history of samples from the selected portion of the audio data, thereby increasing the number of samples at the noise level.

9. An apparatus for facilitating computerized editing of a Foley track containing sound effects, the apparatus comprising:

means for translating data from the Foley track to a sequence of digital audio data;

means for selecting a portion of the digital audio data to be viewed by an editor;

means for generating, from the selected portion of the digital audio data, a discrete waveform as a plurality of bars of substantially equal height, each of the plurality of bars having a color selected according to a value of a corresponding sample of the audio data, wherein the discrete waveform indicates locations of significant sounds within the selected portion of the digital audio data and distinguishes such locations from locations without significant sounds, wherein a significant sound is a sound having particular audio characteristics;

means for displaying the generated discrete waveform on a video display, whereby a user may view locations of significant sounds in the selected portion of the digital audio data; and

means, operative in response to an input from the editor, for locating a sound effect on the Foley track using the generated discrete waveform.

10. A method for facilitating computerized editing of audio data, the method comprising the steps of:

selecting a portion of the audio data;

applying a smoothing operation to the selected portion of the audio data to obtain an average value for each sample;

comparing the average value for each sample to a threshold value to generate a discrete waveform representative of the selected portion of the audio data; and

displaying the discrete waveform on a video display as a plurality of bars of substantially equal height, each of the plurality of bars having a color selected according to a value of a corresponding sample of the audio data.

11. The method of claim 10 wherein the step of comparing includes determining a root-mean-square of each sample of audio data.

12. The method of claim 10, further comprising a step of receiving input from a user indicative of a selected threshold value, and wherein the step of comparing includes comparing each of the average values to the selected threshold value.

13. The method of claim 10, further comprising the steps of:

computing a signal-to-noise ratio of the audio data; and

determining the threshold value from the computed signal-to-noise ratio.

14. The method of claim 10 further comprising the step of determining the threshold value based upon the selected portion of the audio data.

15. The method of claim 14 wherein the step of determining includes the steps of:

sorting sample values of the audio data by amplitudes, resulting in a function with a local minimum between a noise level and a desired sound level; and

selecting the local minimum as the threshold value.

16. The method of claim 14 further comprising the step of adding a series of samples of the audio data that represent a steady state room audio tone to the samples of the audio data, thereby increasing the number of samples at the noise level.

17. A method for facilitating computerized editing of a Foley track containing sound effects, the method comprising the steps of:

translating data from the Foley track to a sequence of digital audio data;

selecting a portion of the digital audio data to be viewed by an editor;

generating, from the selected portion of the digital audio data, a discrete waveform as a plurality of bars of substantially equal height, each of the plurality of bars having a color selected according to a value of a corresponding sample of the audio data, wherein the discrete waveform indicates locations of significant sounds within the selected portion of the digital audio data and distinguishes such locations from locations without significant sounds, wherein a significant sound is a sound having particular audio characteristics;

displaying the generated discrete waveform on a video display, whereby a user may view locations of significant sounds in the selected portion of the digital audio data; and

locating, in response to an input from the editor, a sound effect on the Foley track using the generated discrete waveform.