Apparatus and method for playing back audio at faster or slower rates without pitch distortion

• US 5,386,493 A
• Filed: 09/25/1992
• Issued: 01/31/1995
• Est. Priority Date: 09/25/1992
• Status: Expired due to Term

• Current Assignee: Apple Inc.
• Original Assignee: Apple Computer Incorporated (Apple Inc.)
• Inventors: Zwartjes, Martijn, Degen, Leo M. W. F.
• Primary Examiner(s): MacDonald, Allen R.
• Assistant Examiner(s): Doerrler, Michelle
• Application Number:
  US07/951,239
• Time in Patent Office: 858 Days
• Field of Search: 395/2.87, 395/2.67-2.78, 381/51-53
• US Class Current: 704/267
• CPC Class Codes: G10H 1/0033 Recording/reproducing or transmission of music for electrophonic musical instruments
• CPC Class Codes: G10H 1/20 for transposition
• CPC Class Codes: G10L 21/04 Time compression or expansion

Abstract

A computer implemented apparatus and method for modifying the playback rate of a previously stored audio or voice data file stored within a computer system without altering the pitch of the audio data file as originally stored. The present invention also maintains a high level of sound quality during playback. The present invention includes a double buffering system in order to perform all of the desired calculations in real time. A time stretching technique is employed upon the audio data file to decrease or increase playback rate which creates audio segments requiring joining processing. Junctions are smoothed by employing a cross-fade amplitude envelope filter and a compressor/limiter is used to maintain filter range. The system may operate on a desktop computer allowing for advantageous playback and audio data management options of stored voice and or sound data.

Claims

1. A computer implemented apparatus for modifying a playback rate of previously stored audio data without varying playback pitch of said audio data, said audio data composed of a plurality of discrete data points stored in said computer, said computer implemented apparatus comprising:

buffer processing means for supplying audio data, said buffer processing means switching between a first buffer and a second buffer;

time stretching means for modifying said playback rate of said audio data said time stretching means coupled to said buffer processing means, said time stretching means comprising;

(a) means for reading a first segment of said audio data and for reading a second segment of said audio data, said first and second segments in sequence but not necessarily consecutive;

(b) means for increasing said playback rate of said audio data by extending said first and second segments by replicating and reincorporating portions of said first segment and said second segment; and

(c) means for decreasing said playback rate of said audio data by excluding predetermined segments of said audio data located between said first segment and said second segment;

means for reducing roll associated with a junction between said first segment and said second segment, said means for reducing roll comprising filtering means for fading out predetermined end data points of said first segment and for fading in predetermined start data points of said second portion, said filtering means coupled to said time stretching means, said filtering means comprising;

first filter means for applying a first filter to only said predetermined end data points of said first segment to fade out said predetermined end data points;

second filter means for applying a second filter to only said predetermined start data points of said second segment to fade in said predetermined start data points, wherein said first filter and said second filter comprise an equal power cross fade filter arrangement and wherein said first filter and said second filter are equal at said junction; and

means for adding results generated from said first filter means and said second filter means to generate an output signal; and

limiting means for constraining said output signal of said filtering means to operate within a predetermined range of fade in and fade out values, said limiting means coupled to receive said output signal from said filtering means.

2. A computer implemented apparatus as described in claim 1 further comprising:

audio output means for inputting a signal of audio data and for outputting an audible signal therefrom;

wherein said buffer processing means contains a first buffer available for processing and a second buffer not available for processing for direct output to said audio output means, said buffer processing means coupled to said audio output means; and

means for placing said first segment or said second segment into said first buffer or said second buffer depending on a status of said buffer processing means.

3. A computer implemented apparatus as described in claim 2 wherein said limiting means forces to zero said fade in and fade out values that are less than zero and forces to a maximum of said predetermined range of values said fade in and fade out values that exceed said predetermined range of values.

4. A computer implemented apparatus as described in claim 3 wherein said predetermined range of values of said limiting means is the binary range within 8 bits.

5. A computer implemented apparatus as described in claim 1 further comprising user data input means for indicating a particular audio data for use, said user data input means responsive to inputs from a computer user, said user input means coupled to said time stretching means.

6. A computer implemented apparatus as described in claim 1 further comprising playback rate input means for indicating whether said time stretching means increases or decreases said playback rate of said audio data, said playback rate input means responsive to inputs from a computer user, said playback rate input means coupled to said time stretching means.

7. A computer implemented apparatus for increasing or decreasing playback rate of a previously stored audio data file without increasing or decreasing playback pitch of said audio data file, said computer implemented apparatus comprising:

(a) first buffer means for storage of said audio data file;

(b) time stretching means for selecting a first portion of a predetermined length of said audio data file from said first buffer means, said first portion having a start and an end point, said time stretching means also for selecting a second portion of a predetermined length of said audio data file from said first buffer means, said second portion having a start and an end point, said time stretching means comprising;

(i) means for excluding intermediate data of said audio data file located between said end point of said first portion and said start point of said second portion, said means for excluding coupled to receive said first portion and said second portion; and

(ii) means for increasing said first portion by replicating said end point of said first portion and also for increasing said second portion by replicating said end point of said second portion, said means for increasing coupled to receive said first portion and said second portion;

(c) filter means for fading out said end point of said first portion and for fading in said start point of said second portion to reduce roll, said filter means coupled to receive output from said time stretching means, said filter means comprising;

first filter means for applying a first filter to only said end point of said first portion to fade out said predetermined end point;

second filter means for applying a second filter to only said start point of said second portion to fade in said start point, wherein said first filter and said second filter comprise an equal power cross fade filter arrangement; and

means for adding results generated from said first filter means and said second filter means to generate an output signal; and

(d) audio processing means coupled to said filter means for outputting a continuous audible signal based on said output signal.

8. A computer implemented apparatus as described in claim 7 further comprising a limiting means for limiting said filter means such that said fading in and said fading out are constrained within a predetermined domain, said limiting means coupled to said filter means and also coupled to said audio processing means.

9. A computer implemented apparatus as described in claim 8 wherein said predetermined domain is from zero to 255.

10. A computer implemented apparatus as described in claim 8 implemented on and with a Macintosh desktop computer by Apple Computer Incorporated.

11. A computer implemented apparatus as described in claim 8 further comprising a user input means for selecting said audio data file for loading into said first buffer means, said user input means coupled to said first buffer means.

12. A computer implemented apparatus as described in claim 7 wherein a portion is ready for output to said audio processing means after said time stretching means has selected said portion and said filter has faded in and faded out said portion;

and

wherein said audio processing means outputs said first portion after said first portion is ready for output while said time stretching means selects said second portion and said filter fades in and fades out said second portion.

13. A computer implemented apparatus as described in claim 7 wherein said first portion and said second portion are composed of audio sound data having signal amplitude;

and

wherein said first filter and said second filter of said equal power cross fade arrangement are parabolic functions.

14. A computer implemented apparatus as described in claim 13 wherein said end point of said first portion includes the last ten to twenty percent of said first portion;

and wherein

said start point of said second portion includes the first twenty to thirty-five percent of said second portion.

15. A computer implemented apparatus as described in claim 7 wherein said first portion and said second portion are composed of audio sound data having signal amplitude;

and

wherein said first filter and said second filter of said equal power cross fade arrangement are parabolic functions.

16. A computer implemented apparatus as described in claim 7 wherein said intermediate data excluded by said means for excluding is from 0 to 25 percent in length of said first portion.

17. A computer implemented apparatus as described in claim 7 wherein said means for excluding intermediate data of said audio data file which are located between said end point of said first portion and said start point of said second portion is utilized to increase said playback rate of said audio data file;

and

wherein said means for increasing the length of said end point of said first portion by replicating said end of said first portion and also for increasing the length of said end point of said second portion by replicating said end point of said second portion is utilized to decrease said playback rate of said audio data file.

18. A computer implemented apparatus as described in claim 17 further comprising a user input means for selecting said audio data file for loading into said first buffer means and also for indicating whether said time stretching means decreases or increases said playback rate, said user input means coupled to said first buffer means.

19. A computer implemented apparatus as described in claim 18 wherein said playback rate is increased by increasing a length of said intermediate data excluded by said means for excluding and wherein said playback rate is decreased by replicating a larger amount of said end point on said first and said second segments by said means for increasing.

20. A computer implemented apparatus for modifying a playback rate of a stored audio data file while maintaining original pitch of said stored audio data file and while also maintaining a high sound quality of said stored audio data file, said computer implemented apparatus comprising:

(a) selection means for selecting and storing a particular stored audio data file for output;

(b) processing means for processing successive segments of said stored audio data file, said processing means coupled to said selection means, said processing means comprising;

(i) time stretching means for selecting a first segment of said stored audio data file, said first segment of a predetermined length, said time stretching means also for selecting a second segment of said stored audio data file of predetermined length, said second segment following said first segment in sequence but not necessarily successive, said time stretching means for excluding a portion of said stored audio data file residing between said first segment and said second segment;

(ii) filter means for reducing roll by fading out end points of said first segment and fading in start points of said second segment in order to provide a smooth junction between said first and said second segments, said filter means coupled to said time stretching means, said filter means comprising;

first filter means for applying a first filter to only said end points of said first segment to fade out said end points;

second filter means for applying a second filter to only said start points of said second segment to fade in said start points, wherein said first filter and said second filter comprise an equal power cross fade filter arrangement wherein said first filter and said second filter have equal power at said junction; and

means for adding results generated from said first filter means and said second filter means to generate an output signal; and

(c) buffering means for holding a first buffer containing said second segment which is being processed by said processing means and for holding a second buffer containing said first segment which has already been processed by said processing means, said buffering means coupled to receive said output signal of said processing means.

21. A computer implemented apparatus as described in claim 20 further comprising audio output means for generating an audible signal based on said first segment held in said second buffer of said buffering means, said audio output means coupled to said buffering means.

22. A computer implemented apparatus as described in claim 20 further comprising a limiting means for limiting fade in and fade out ranges of said first and said second segments as filtered by said filter means, said limiting means coupled to said filter means.

23. A computer implemented apparatus as described in claim 22 wherein said processing means further comprises replicating means for expanding said first and said second segments by replicating said end points of said first and said second segments.

24. A computer implemented apparatus as described in claim 23 wherein said first segment and said second segment are composed of audio sound data having signal amplitude;

and

wherein said first filter and said second filter of said equal power cross fade filter arrangement are parabolic functions.

25. A computer implemented apparatus as described in claim 23 wherein said end points of said first segment include the last twenty to thirty-five percent of said first segment;

and wherein

said start points of said second segment include the first twenty to thirty-five percent of said second segment.

26. A computer implemented apparatus as described in claim 23 implemented on and with a Macintosh desktop computer manufactured by Apple Computer Incorporated of Cupertino, Calif.

27. A computer implemented apparatus as described in claim 23 wherein said selection means is a user input means for selecting said audio data file for loading into said first buffer means.

28. A computer implemented apparatus as described in claim 23 wherein said time stretching means excludes said portion of data between said first segment and said second segment to increase said playback rate of said audio data file;

and

wherein said replicating means for expanding said first and said second segments by replicating said end points of said first and said second segments is utilized to decrease said playback rate of said audio data file.

29. A computer implemented apparatus as described in claim 23 wherein said selection means further comprises a user input means for selecting said audio data file and also for indicating whether said time stretching means decreases or increases said playback rate, said user input means responsive to inputs from a computer user, said user input means coupled to said processing means.

30. A computer implemented apparatus as described in claim 22 wherein said portion of data excluded by said time stretching means is from 0 to 25 percent in length of said first segment.

31. A computer implemented method for increasing or decreasing playback rate of a previously stored audio data file in a first buffer without increasing or decreasing playback pitch of said audio data file, said method comprising the computer implemented steps of:

(a) selecting a first portion of a predetermined length of said audio data file from said first buffer, said first portion having a start point and an end point,

(b) selecting a second portion of a predetermined length of said audio data file from said first buffer, said second portion having a start point and an end point;

(c) modifying said playback rate of said audio data file by either;

(i) excluding intermediate data of said audio data file located between said end point of said first portion and said start point of said second portion;

or

(ii) expanding said first portion by replicating said end point of said first portion and expanding said second portion by replicating said end point of said second portion;

(d) smoothing a junction between said first portion and said second portion to reduce roll by filtering said first portion and said second portion by fading out said end point of said first portion and fading in said start point of said second portion, said step of filtering receiving audio data output from said step of modifying, said step of filtering further comprising the steps of;

applying a first filter to only said end point of said first portion to fade out said end point;

applying a second filter to only said start point of said second portion to fade in said start point, wherein said first filter and said second filter comprise an equal power cross fade filter arrangement and wherein said first filter and said second filter are equal in value at said junction; and

adding results generated from said step of applying a first filter and said step of applying a second filter to generate an output signal; and

(e) outputting a continuous audible signal based on said output signal by first processing said first portion and then consecutively processing said second portion.

32. A computer implemented method as described in claim 31 further comprising the computer implemented step of limiting said filtering step such that said fading in and said fading out are constrained within a predetermined domain.

33. A computer implemented method as described in claim 32 wherein said method accesses said audio data file and outputs said continuous audible signal in real-time.

34. A computer implemented method as described in claim 32 implemented on and with a Macintosh desktop computer manufactured by Apple Computer Incorporated.

35. A computer implemented method as described in claim 32 further comprising the computer implemented step of providing a user input for selecting said audio data file for loading into said first buffer.

36. A computer implemented method as described in claim 32 further including the computer implemented step of responding to a computer user input which indicates whether said step of modifying said playback rate decreases or increases said playback rate.

37. A computer implemented method as described in claim 31 wherein said first portion is output by said step of outputting a continuous audible signal while said second portion is still undergoing said step of modifying said playback rate and said step of filtering.

38. A computer implemented method as described in claim 31 wherein said first portion and said second portion are composed of audio sound data having signal amplitude;

and

wherein said first filter and said second filter of said step of filtering are parabolic functions.

39. A computer implemented method as described in claim 38 wherein said end point of said first portion includes the last twenty to thirty-five percent of said first portion;

and wherein

said start point of said second portion includes the first twenty to thirty-five percent of said second portion.

40. A computer implemented method as described in claim 31 wherein said intermediate data excluded by step of excluding is from 0 to 25 percent in length of said first portion.

41. A computer implemented method as described in claim 31 wherein step of excluding intermediate data of said audio data file which are located between said end point of said first portion and said start point of said second portion is utilized to increase said playback rate of said audio data file;

and

wherein said step of expanding said first portion by replicating said end of said first portion and increasing second portion by replicating said end point of said second portion is utilized to decrease said playback rate of said audio data file.

42. A computer implemented apparatus for modifying a playback rate of audio data without varying playback pitch of said audio data, said audio data composed of a plurality of discrete data points, said computer implemented apparatus comprising:

buffer processing logic supplying audio data, said buffer processing logic switching between a first buffer and a second buffer;

time stretching logic modifying said playback rate of said audio data received from said buffer processing logic, said time stretching logic coupled to said buffer processing logic, said time stretching logic comprising;

(a) read logic reading a first segment of said audio data and for reading a second segment of said audio data, said first and second segments in sequence but not necessarily consecutive;

(b) increasing logic increasing said playback rate of said audio data by extending said first and second segments by replicating and reincorporating portions of said first segment and said second segment, said increasing logic coupled to said read logic; and

(c) decreasing logic decreasing said playback rate of said audio data by excluding predetermined segments of said audio data located between said first segment and said second segment, said decreasing logic coupled to said read logic;

filtering logic fading out only end data points of said first segment and fading in only start data points of said second segment to smooth a junction between said first segment and said second segment, said filtering logic coupled to said time stretching logic, said filtering logic comprising;

first filter logic for applying a first filter to only said end data points of said first segment to fade out said end data points;

second filter logic for applying a second filter to only said start data points of said second segment to fade in said start data points, wherein said first filter and said second filter comprise an equal power cross fade filter arrangement and wherein said first filter and said second filter are equal at said junction; and

logic for adding results generated from said first filter logic and said second filter logic to generate an output signal; and

limiting logic constraining said output signal from said filtering logic so that said fading out and said fading in operate within a predetermined range of fade in and fade out values, said limiting logic coupled to receive said output signal of said filtering logic.

43. A computer implemented apparatus as described in claim 42 further comprising user data input device responsive to inputs from a computer user, wherein said increasing logic and said decreasing logic of said time stretching logic are responsive to said user data input device for increasing or decreasing said playback rate of said audio data file.

44. A computer implemented apparatus for modifying a playback rate of audio data without varying playback pitch of said audio data, said audio data composed of a plurality of discrete data points, said computer implemented apparatus comprising:

buffer processing logic supplying audio data, said buffer processing logic switching between a first buffer and a second buffer;

time stretching logic modifying said playback rate of said audio data received from said buffer processing logic, said time stretching logic coupled to said buffer processing logic, said time stretching logic comprising;

(a) read logic reading a first segment of said audio data and for reading a second segment of said audio data, said first and second segments in sequence but not necessarily consecutive;

(b) increasing logic increasing said playback rate of said audio data by extending said first and second segments by replicating and reincorporating portions of said first segment and said second segment, said increasing logic coupled to said read logic; and

(c) decreasing logic decreasing said playback rate of said audio data by excluding predetermined segments of said audio data located between said first segment and said second segment, said decreasing logic coupled to said read logic;

filtering logic fading out only predetermined data points of said first segment and fading in only predetermined data points of said second portion to smooth a junction between said first segment and said second segment, said filtering logic coupled to said time stretching logic, said filtering logic comprising;

first filter logic applying a first filter to only predetermined end data points of said first segment to fade out said predetermined end data points;

second filter logic applying a second filter to only predetermined start data points of said second segment to fade in said predetermined start data points, wherein said first filter and said second filter comprise an equal power cross fade filter arrangement and wherein said first filter and said second filter are equal in value at said junction; and

logic for adding results generated from said first filter logic and said second filter logic to generate an output signal; and

limiting logic constraining said output signal from said filtering logic so that said fading out and said fading in operates within a predetermined range of fade in and fade out values, said limiting logic coupled to said filtering logic.

45. A computer implemented apparatus as described in claim 44 wherein said first filter and said second filter of said filtering logic are parabolic functions.

46. A computer implemented apparatus as described in claim 44 further comprising user data input device responsive to inputs from a computer user, wherein said increasing logic and said decreasing logic of said time stretching logic are responsive to said user data input device for increasing or decreasing said playback rate of said audio data file.