System and method for performing automatic audio production using semantic data

• US 9,304,988 B2
• Filed: 08/28/2014
• Issued: 04/05/2016
• Est. Priority Date: 08/28/2013
• Status: Active Grant

• Current Assignee: LANDR Audio, Inc.
• Original Assignee: LANDR Audio, Inc.
• Inventors: Terrell, Michael John, Mansbridge, Stuart, Reiss, Joshua D., De Man, Brecht
• Primary Examiner(s): Cordero, Marivelisse Santiago
• Assistant Examiner(s): BRINICH, STEPHEN M
• Application Number:
  US14/471,758
• Publication Number:
  US 20150066481A1
• Time in Patent Office: 586 Days
• Field of Search: 704 1- 10, 704/270, 704/243, 704257-258, 707/769, 707/802, 707/791, 340/4.14
• US Class Current: 1/1
• CPC Class Codes: G06F 40/30 Semantic analysis
• CPC Class Codes: G06F 40/40 Processing or translation of natural language natural language analysis G06F40/20; semantic analysis G06F40/30
• CPC Class Codes: G10H 1/0091 Means for obtaining special acoustic effects combined with modulation G10H1/043
• CPC Class Codes: G10H 1/46 Volume control
• CPC Class Codes: G10H 2240/091 Info, i.e. juxtaposition of unrelated auxiliary information or commercial messages with or between music files
• CPC Class Codes: G10H 2240/141 Library retrieval matching, i.e. any of the steps of matching an inputted segment or phrase with musical database contents, e.g. query by humming, singing or playing; the steps may include, e.g. musical analysis of the input, musical feature extraction, query formulation, or details of the retrieval process
• CPC Class Codes: H04H 60/04 Studio equipment; Interconnection of studios

Abstract

There is described a computer implemented method for performing automatic audio production, comprising: receiving an audio signal to be processed; receiving semantic information; determining at least one semantic-based rule using the received semantic information, the semantic-based rule comprising production data that defines how the audio signal to be processed should be produced; processing the audio signal to be processed using the production data, thereby obtaining a produced audio signal; outputting the produced audio signal.

Claims

1. A computer-implemented method for performing automatic audio production, comprising:

receiving an audio signal to be processed via a semantic analysis module;

receiving semantic information via the semantic analysis module, the semantic information comprising at least one of chromosomal features, classification features, and production features;

determining at least one semantic-based rule using the received semantic information, the semantic-based rule comprising production data that defines how the audio signal to be processed should be produced;

processing the audio signal to be processed using the production data via an audio processing module, thereby obtaining a produced audio signal, the production data comprising at least one of given audio processing actions to be performed and respective static characteristics for the given audio processing actions, a configuration for the audio processing actions, and target production features for the produced audio signal;

outputting the produced audio signal via the audio processing module;

wherein said determining the at least one semantic-based rule comprising production data comprises;

accessing a database containing a plurality of reference records;

identifying at least one reference record using the semantic information via the semantic analysis module; and

assigning a value for the at least one of the given audio processing actions to be performed and the respective static characteristics for the given audio processing actions via the semantic analysis module, the configuration for the audio processing actions, and the target production features for the produced audio signal using the at least one identified reference record.

2. The computer-implemented method of claim 1, wherein the semantic information relates to the audio signal to be processed.

3. The computer-implemented method of claim 2, wherein the semantic information is received from a user interface.

4. The computer-implemented method of claim 2, further comprising determining the semantic information from the received audio signal.

5. The computer-implemented method of claim 1, wherein the semantic information relates to a reference audio signal, the method further comprising:

receiving the reference audio signal; and

extracting the semantic information from the reference audio signal.

6. The computer-implemented method of claim 1, wherein for each of the a plurality of reference records, the database comprises respective reference classification features, respective reference chromosomal features, a respective reference configuration for reference processing actions, respective reference static characteristics for the reference processing actions, and respective reference production features.

7. The computer-implemented method of claim 6, further comprising determining dynamic characteristics for the given audio processing actions using the value assigned to the target production features.

8. The computer-implemented method of claim 7, said processing the audio signal comprises performing the given audio processing actions on the audio signal according to the configuration and using the static and dynamic characteristics.

9. The computer-implemented method of claim 8, further comprising determining a value of the production features between the given audio processing actions and modifying the dynamic characteristics accordingly.

10. The computer-implemented method of claim 1, wherein said receiving the audio signal to be processed and outputting the produced audio signal are performed in substantially real-time so that the audio signal to be processed and the produced audio signal be synchronized.

11. The computer-implemented method of claim 1, wherein the production data is determined for only one region of the audio signal to be processed.

12. The computer-implemented method of claim 1, further comprising receiving user production preferences, said processing the audio signal being performed using the production data and the user production preferences.

13. The computer-implemented method of claim 12, further comprising evaluation of the produced audio signal from a user and determining the user production preferences using the received evaluation.

14. A computer readable medium having recorded thereon statements and instructions for execution by a processing unit to perform the steps of the method of claim 1.

15. The computer-implemented method of claim 6, wherein said identifying at least one reference record comprises identifying the at least one reference record that matches the at least one of chromosomal features, classification features, and production features contained in the semantic information.

16. An automatic audio production system comprising:

a semantic analysis module for receiving semantic information and determining at least one semantic-based rule using the received semantic information, the semantic information comprising at least one of chromosomal features, classification features, and production features, the semantic-based rule comprising production data that defines how an audio signal to be processed should be produced, and the production data comprising at least one of given audio processing actions to be performed and respective static control parameters for the given audio processing actions, a configuration for the audio processing actions, and target production features for the produced audio signal; and

an audio processing module for receiving the audio signal to be processed, processing the audio signal to be processed using the production data, in order to obtain a produced audio signal, and outputting the produced audio signal; and

a production database containing a plurality of reference records, the semantic analysis module being further adapted to;

identify at least one reference record using the semantic information; and

assign a value for the at least one of the given audio processing actions to be performed and the respective static control parameters for the given audio processing actions, the configuration for the audio processing actions, and the target production features for the produced audio signal using the at least one identified reference record.

17. The automatic audio production system of claim 16, wherein the semantic information relates to the audio signal to be processed.

18. The automatic audio production system of claim 17, wherein the semantic analysis module is adapted to receive the semantic information from a user interface.

19. The automatic audio production system of claim 17, wherein the semantic analysis module is further adapted to receive the audio signal to be processed and determine the semantic information from the audio signal to be processed.

20. The automatic audio production system of claim 16, wherein the semantic information relates to a reference audio signal, the semantic analysis module being further adapted to:

receive the reference audio signal; and

extract the semantic information from the reference audio signal.

21. The automatic audio production system of claim 16, wherein for each one of the plurality of reference records, the database comprises respective reference classification features, respective reference chromosomal features, a respective reference configuration for reference processing actions, respective reference static control parameters for the reference processing actions, and respective reference production features.

22. The automatic audio production system of claim 21, wherein the audio processing module is adapted to determine dynamic control parameters for the given processing actions using the value assigned to the target production features.

23. The automatic audio production system of claim 22, wherein the audio processing module comprises a plurality of audio processors and is adapted to organize the plurality of audio processors according to the configuration and control the plurality of audio processors according to the static and dynamic control parameters.

24. The automatic audio production system of claim 23, wherein the audio processing module is further adapted to determine a value of the production features between the audio processors and modify the dynamic parameters accordingly.

25. The automatic audio production system of claim 16, wherein an input of the audio signal to be processed and an output of the produced audio signal are performed in substantially real-time so that the audio signal to be processed and the produced audio signal be synchronized.

26. The automatic audio production system of claim 16, wherein the semantic analysis module is adapted to determine the production data for only one region of the audio signal to be processed.

27. The automatic audio production system of claim 16, the semantic analysis module is further adapted to receive user production preferences and determine the production data using the user production preferences.

28. The automatic audio production system of claim 27, further comprising a production evaluation module for receiving an evaluation of the produced audio signal from a user and determining the user production preferences using the received evaluation.

29. The automatic audio production system of claim 21, wherein said identifying at least one reference record comprises identifying the at least one reference record that matches the at least one of chromosomal features, classification features, and production features contained in the semantic information.