System and method for tracking sound pitch across an audio signal

• US 9,183,850 B2
• Filed: 08/08/2011
• Issued: 11/10/2015
• Est. Priority Date: 08/08/2011
• Status: Active Grant

• Current Assignee: Friday Harbor LLC
• Original Assignee: Intellisis Corporation
• Inventors: Bradley, David C., Goldin, Daniel S., Gateau, Rodney, Fisher, Nicholas K., Hilton, Robert N., Roos, Derrick R., Wiewiora, Eric
• Primary Examiner(s): Roberts, Shaun
• Application Number:
  US13/205,483
• Publication Number:
  US 20130041656A1
• Time in Patent Office: 1,555 Days
• Field of Search: 704/207
• US Class Current: 1/1
• CPC Class Codes: G10L 2025/906 Pitch tracking
• CPC Class Codes: G10L 25/03 characterised by the type of extracted parameters
• CPC Class Codes: G10L 25/90 Pitch determination of speech signals
• CPC Class Codes: G10L 25/93 Discriminating between voiced and unvoiced parts of speech signals G10L25/90 takes precedence

Abstract

A system and method may be configured to analyze audio information derived from an audio signal. The system and method may track sound pitch across the audio signal. The tracking of pitch across the audio signal may take into account change in pitch by determining at individual time sample windows in the signal duration an estimated pitch and an estimated fractional chirp rate of the harmonics at the estimated pitch. The estimated pitch and the estimated fractional chirp rate may then be implemented to determine an estimated pitch for another time sample window in the signal duration with an enhanced accuracy and/or precision.

Claims

1. A method for analyzing an audio signal, the method comprising:

obtaining, using a computer processor, a first pitch and a first fractional chirp rate from a first portion of the audio signal;

determining, using the computer processor, a predicted pitch corresponding to the first pitch in a second portion of the audio signal, the predicted pitch being determined using the first pitch, the first fractional chirp rate, a first time corresponding to the first portion, and a second time corresponding to the second portion;

obtaining, using the computer processor, a pitch likelihood metric in a multi-dimensional representation for the second portion of the audio signal;

determining, using the computer processor, a weighting function using the predicted pitch;

determining, using the computer processor, a weighted pitch likelihood metric using the pitch likelihood metric and the weighting function; and

determining, using the computer processor, a second pitch from the second portion of the audio signal using the weighted pitch likelihood metric.

2. The method of claim 1, further comprising determining a second fractional chirp rate from the second portion of the audio signal using the weighted pitch likelihood metric.

3. The method of claim 1, further comprising determining a pitch likelihood metric for the first portion of the audio signal, wherein the first pitch and first fractional chirp rate are obtained from the pitch likelihood metric for the first portion of the audio signal.

4. The method of claim 1, wherein the predicted pitch is computed by multiplying a time difference between the second time and the first time by the fractional chirp rate and adding a result of the multiplication to the first pitch.

5. The method of claim 1, wherein the pitch likelihood metric for a given pitch indicates a likelihood a sound represented by the audio signal has the given pitch.

6. The method of claim 1, wherein the weighting function is a Gaussian function.

7. The method of claim 1, wherein the first portion of the audio signal corresponds to a first time sample window of the audio signal and the second portion of the audio signal corresponds to a second time sample window of the audio signal.

8. The method of claim 1. wherein the multi-dimensional representation includes a first domain corresponding to pitch and a second domain corresponding to fractional chirp rate.

9. A system configured to analyze an audio signal, the system comprising:

an electronic storage storing computer program modules that include computer program instructions; and

one or more processors coupled to the electronic storage and configured to execute the computer program instructions to;

obtain a first pitch and a first fractional chirp rate from a first portion of the audio signal;

determine a predicted pitch corresponding to the first pitch in a second portion of the audio signal, the predicted pitch being determined using the first pitch, the first fractional chirp rate, a first time corresponding to the first portion, and a second time corresponding to the second portion;

obtain a pitch likelihood metric in a multi-dimensional representation for the second portion of the audio signal;

determine a weighting using the predicted pitch;

determine a weighted pitch likelihood metric using the pitch likelihood metric and the weighting function; and

determine a second pitch from the second portion of the audio signal using the weighted pitch likelihood metric.

10. The system of claim 9, wherein the one or more processors are further configured to execute the computer program instructions to determine a second fractional chirp rate from the second portion of the audio signal using the weighted pitch likelihood metric.

11. The system of claim 9, wherein the one or more processors are further configured to execute the computer program instructions to determine a pitch likelihood metric for the first portion of the audio signal, wherein the first pitch and first fractional chirp rate are obtained from the pitch likelihood metric for the first portion of the audio signal.

12. The system of claim 9, wherein the predicted pitch is computed by multiplying a time difference between the second time and the first time by the fractional chirp rate and adding a result of the multiplication to the first pitch.

13. The system of claim 9, wherein the pitch likelihood metric for a given pitch indicates a likelihood a sound represented by the audio signal has the given pitch.

14. The system of claim 9, wherein the weighting function is a Gaussian function.

15. The system of claim 9, wherein the first portion of the audio signal corresponds to a first time sample window of the audio signal and the second portion of the audio signal corresponds to a second time sample window of the audio signal.

16. The system of claim 9, wherein the multi-dimensional representation includes a first domain corresponding to pitch and a second domain corresponding to fractional chirp rate.

17. A non-transitory computer readable storage medium having data stored therein representing computer program modules executable by a computer, the computer program modules including instructions to track pitch in an audio signal, the storage medium comprising:

instructions for obtaining a first pitch and a first fractional chirp rate from a first portion of the audio signal;

instructions for determining a predicted pitch corresponding to the first pitch in a second portion of the audio signal, the predicted pitch being determined using the first pitch, the first fractional chirp rate, a first time corresponding to the first portion, and a second time corresponding to the second portion;

instructions for obtaining a pitch likelihood metric in a multi-dimensional representation for the second portion of the audio signal;

instructions for determining a weighting function using the predicted pitch;

instructions for determining a weighted pitch likelihood metric using the pitch likelihood metric and the weighting function; and

instructions for determining a second pitch from the second portion of the audio signal using the weighted pitch likelihood metric.

18. The non-transitory computer readable storage medium of claim 17, further comprising instructions for determining a second fractional chirp rate from the second portion of the audio signal using the weighted pitch likelihood metric.

19. The non-transitory computer readable storage medium of claim 17, further comprising instructions for determining a pitch likelihood metric for the first portion of the audio signal, wherein the first pitch and first fractional chirp rate are obtained from the pitch likelihood metric for the first portion of the audio signal.

20. The non-transitory computer readable storage medium of claim 17, wherein the predicted pitch is computed by multiplying a time difference between the second time and the first time by the fractional chirp rate and adding a result of the multiplication to the first pitch.

21. The non-transitory computer readable storage medium of claim 17, wherein the pitch likelihood metric for a given pitch indicates a likelihood a sound represented by the audio signal has the given pitch.

22. The non-transitory computer readable storage medium of claim 17, wherein the weighting function is a Gaussian function.

23. The non-transitory computer readable storage medium of claim 17, wherein the multi-dimensional representation includes a first domain corresponding to pitch and a second domain corresponding to fractional chirp rate.