Pitch shifting frequencies

• US 9,159,325 B2
• Filed: 12/31/2007
• Issued: 10/13/2015
• Est. Priority Date: 12/31/2007
• Status: Active Grant

• Current Assignee: Adobe Inc.
• Original Assignee: Adobe Systems Incorporated (Adobe Inc.)
• Inventors: Green, Peter
• Primary Examiner(s): Pesin, Boris
• Assistant Examiner(s): HEFFINGTON, JOHN M
• Application Number:
  US11/967,790
• Publication Number:
  US 20150206540A1
• Time in Patent Office: 2,843 Days
• Field of Search: 715/716, 715/727, 715/771, 715/773, 715/726
• US Class Current: 1/1
• CPC Class Codes: G06F 16/34 Browsing; Visualisation therefor
• CPC Class Codes: G06F 3/04847 Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
• CPC Class Codes: G10H 1/0008 Associated control or indicating means
• CPC Class Codes: G10H 2210/066 for pitch analysis as part of wider processing for musical purposes, e.g. transcription, musical performance evaluation; Pitch recognition, e.g. in polyphonic sounds; Estimation or use of missing fundamental
• CPC Class Codes: G10H 2210/325 Musical pitch modification pitch analysis G10H2210/066; musical effects G10H2210/155
• CPC Class Codes: G10H 2220/116 for graphical editing of sound parameters or waveforms, e.g. by graphical interactive control of timbre, partials or envelope non-graphical waveform editing G10H2250/615
• CPC Class Codes: G10L 19/00 Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis in musical instruments G10H
• CPC Class Codes: G11B 27/034 on discs G11B27/036, G11B27/038 take precedence
• CPC Class Codes: G11B 27/34 Indicating arrangements indicating means incorporated in magazine or cassette G11B23/046 and G11B23/0875; indicating measured values in general G01D

Abstract

System and methods for audio editing are provided. In one implementation, a computer-implemented method is provided. The computer-implemented method includes presenting a visual representation of digital audio data as a frequency spectrum including a first visual region corresponding to a first time period and a first frequency range in the digital audio data. A first user input identifies a second visual region within the first visual region and corresponding to a second time period and a second frequency range. A second user input specifies one or more frequency modifications to the second visual region. The second time period and the second frequency range corresponding to the second visual region are modified creating a modified second visual region. The modified second visual region is mixed into the first visual region creating edited digital audio data.

Claims

1. A computer-implemented method comprising:

presenting a visual representation of digital audio data as a frequency spectrum where the visual representation comprises a first visual region corresponding to a first time period and a first frequency range in the digital audio data;

receiving a first input identifying a second visual region within the first visual region, the second visual region representing a pitch corresponding to a second time period and a second frequency range in the digital audio data, wherein the second time period is within the first time period and the second frequency range is within the first frequency range;

presenting a graphic representation of the pitch represented in the second visual region, wherein one or more envelope control points are included on the pitch when the pitch varies over time within the second time period, the one or more envelopes outlining the pitch variance over time;

receiving second input specifying one or more frequency modifications to the pitch represented in the second visual region of the digital audio data via user manipulation of at least one of the control points;

based on the second input, modifying the digital audio data corresponding to the pitch represented in the second visual region to create a modified pitch in the second visual region; and

mixing the modified digital audio data corresponding to the pitch in the second visual region into the digital audio data to create edited digital audio data.

2. The computer-implemented method of claim 1, further comprising:

modifying the second time period and the second frequency range of the digital audio data within the initial visual display of the digital audio data.

3. The computer-implemented method of claim 1, wherein the graphic representation includes a line with two endpoints, and wherein the multiple control points are located between the two endpoints.

4. The computer-implemented method of claim 1, wherein modifying the digital audio data corresponding to the pitch includes identifying a specific frequency range and modifying the digital audio data corresponding to the pitch according to the specific frequency range.

13. The computer-implemented method of claim 1, wherein the modifying includes pitch shifting all of the digital, audio data within the second region by a specified amount.

19. The computer-implemented method of claim 1, wherein the multiple control points are created automatically.

20. The computer-implemented method of claim 1, wherein the multiple control points are user-created.

5. A computer program product, encoded on a non-transitory computer-readable medium, operable to cause data processing apparatus to perform operations comprising:

presenting a visual representation of digital audio data as a frequency spectrum where the visual representation comprises a first visual region corresponding to a first time period and a first frequency range in the digital audio data;

receiving a first input identifying a second visual region within the first visual region, the second visual region representing a pitch corresponding to a second time period and a second frequency range in the digital audio data, wherein the second time period is within the first time period and the second frequency range is within the first frequency range;

presenting a graphic representation of the pitch represented in the second visual region, wherein one or more envelope control points are added to the pitch when the pitch varies over time within the second time period, the one or more envelopes outlining the pitch variance over time;

receiving second input specifying one or more frequency modifications to the pitch represented in the second visual region of the digital audio data via user manipulation of at least one of the control points;

based on the second input, modifying the digital audio data corresponding to the pitch represented in the second visual region to create a modified pitch in the second visual region; and

mixing the modified digital audio data corresponding to the pitch in the second visual region into the digital audio data to create edited digital audio data.

6. The computer program product of claim 5, further comprising:

modifying the second time period and the second frequency range of the digital audio data within the initial visual display of the digital audio data.

7. The computer program product of claim 5 wherein the graphic representation includes a line with two endpoints, and wherein the multiple control points are located between two endpoints.

8. The computer program product of claim 5, wherein modifying the digital audio data corresponding to the pitch includes identifying a specific frequency range and modifying the digital audio data corresponding to the pitch according to the specific frequency range.

14. The computer program product of claim 5, wherein the modifying includes pitch shifting all of the digital audio data within the second region by a specified amount.

9. A system comprising one or more computing devices that have one or more processors and that are operable to perform operations comprising:

presenting a visual representation of digital audio data as a frequency spectrum where the visual representation comprises a first visual region corresponding to a first time period and a first frequency range in the digital audio data;

receiving a first input identifying a second visual region within the first visual region, the second visual region representing a pitch corresponding to a second time period and a second frequency range in the digital audio data, wherein the second time period is within the first time period and the second frequency range is within the first frequency range;

presenting a graphic representation of the pitch represented in the second visual region;

adding one or more envelope control points to the pitch when the pitch varies over time within the second time period, the one or more envelopes outlining the pitch variance over time;

receiving second input specifying one or more frequency modifications to the pitch represented in the second visual region of the digital audio data via user manipulation of at least one of the control points;

based on the second input, modifying the digital audio data corresponding to the pitch represented in the second visual region to create a modified pitch in the second visual region; and

mixing the modified digital audio data corresponding to the pitch in the second visual region into the digital audio data to create edited digital audio data.

10. The system of claim 9, further comprising:

means for modifying the second time period and the second frequency range of the digital audio data within the first visual region of the digital audio data.

11. The system of claim 9, wherein the graphic representation includes a line with two endpoints, and wherein the multiple control points are located between the two endpoints.

12. The system of claim 9, wherein modifying the digital audio data corresponding to the pitch includes identifying a specific frequency range and modifying the digital audio data corresponding to the pitch according to the specific frequency range.

15. The system of claim 9, wherein the modifying includes pitch shifting all of the digital audio data within the second region by a specified amount.

16. A computer-implemented method comprising:

presenting a visual representation of digital audio data as a frequency spectrum where the visual representation comprises a first visual region corresponding to a first time period and a first frequency range in the digital audio data;

receiving a first input identifying a second visual region within the first visual region, the second visual region representing a pitch corresponding to a second time period and a second frequency range in the digital audio data, wherein the second time period is within the first time period and the second frequency range is within the first frequency range;

presenting a graphic representation of the pitch represented in the second visual region, wherein one or more envelope control points are included on the pitch when the pitch varies over time within the second time period, the one or more envelopes outlining the pitch variance over time

receiving second input specifying one or more frequency modifications to the pitch represented in the second visual region of the digital audio data via user manipulation of at least one of the control points;

identifying automatically one or more additional regions within the digital audio data, each additional region including a pitch corresponding to the pitch represented in the second visual region;

based on the second input, modifying the digital audio data corresponding to the pitch represented in the second visual region to create a modified pitch in the second visual region and applying automatically the modification made within the second visual region to digital audio data corresponding to each identified additional region to create a modified pitch in each identified additional region; and

mixing the modified digital audio data corresponding to the pitch in the second visual region and the modified digital audio data corresponding to each modified pitch in the identified additional regions into the digital audio data to create edited digital audio data.

17. A computer program product, encoded on a non-transitory computer-readable medium, operable to cause data processing apparatus to perform operations comprising:

presenting a visual representation of digital audio data as a frequency spectrum where the visual representation comprises a first visual region corresponding to a first time period and a first frequency range in the digital audio data;

receiving a first input identifying a second visual region within the first visual region, the second visual region representing a pitch corresponding to a second time period and a second frequency range in the digital audio data, wherein the second time period is within the first time period and the second frequency range is within the first frequency range;

presenting a graphic representation of the pitch represented in the second visual region, wherein one or more envelope control points are added to the pitch when the pitch varies over time within the second time period, the one or more envelopes outlining the pitch variance over time

receiving second input specifying one or more frequency modifications to the pitch represented in the second visual region of the digital audio data via user manipulation of at least one of the control points;

identifying automatically one or more additional regions within the digital audio data, each additional region including a pitch corresponding to the pitch represented in the second visual region;

based on the second input, modifying the digital audio data corresponding to the pitch represented in the second visual region to create a modified pitch in the second visual region and applying automatically the modification made within the second visual region to digital audio data corresponding to each identified additional region to create a modified pitch in each identified additional region; and

mixing the modified digital audio data corresponding to the pitch in the second visual region and the modified digital audio data corresponding to each modified pitch in the identified additional regions into the digital audio data to create edited digital audio data.

18. A system comprising one or more computing devices that have one or more processors and that are operable to perform operations comprising:

presenting a visual representation of digital audio data as a frequency spectrum where the visual representation comprises a first visual region corresponding to a first time period and a first frequency range in the digital audio data;

receiving a first input identifying a second visual region within the first visual region, the second visual region representing a pitch corresponding to a second time period and a second frequency range in the digital audio data, wherein the second time period is within the first time period and the second frequency range is within the first frequency range;

presenting a graphic representation of the pitch represented in the second visual region;

adding one or more envelope control points to the pitch when the pitch varies over time within the second time period, the one or more envelopes outlining the pitch variance over time

receiving second input specifying one or more frequency modifications to the pitch represented in the second visual region of the digital audio data via user manipulation of at least one of the control points;

identifying automatically one or more additional regions within the digital audio data, each additional region including a pitch corresponding to the pitch represented in the second visual region;

based on the second input, modifying the digital audio data corresponding to the pitch represented in the second visual region to create a modified pitch in the second visual region and applying automatically the modification made within the second visual region to digital audio data corresponding to each identified additional region to create a modified pitch in each identified additional region; and

mixing the modified digital audio data corresponding to the pitch in the second visual region and the modified digital audio data corresponding to each modified pitch in the identified additional regions into the digital audio data to create edited digital audio data.