Method of editing audio signals using separated objects and associated apparatus

• US 10,349,196 B2
• Filed: 10/03/2016
• Issued: 07/09/2019
• Est. Priority Date: 10/03/2016
• Status: Active Grant

• Current Assignee: Nokia Technologies Oy (Nokia Corporation)
• Original Assignee: Nokia Technologies Oy (Nokia Corporation)
• Inventors: Vilermo, Miikka Tapani, Lehtiniemi, Arto Juhani, Laaksonen, Lasse Juhani, Tammi, Mikko Tapio
• Primary Examiner(s): Gauthier, Gerald
• Application Number:
  US15/283,681
• Publication Number:
  US 20180096705A1
• Time in Patent Office: 1,009 Days
• Field of Search: 84464 R, 84465, 84603, 84477 R, 84604, 84610, 84611, 84734, 369 4755, 369 84, 369 1, 369 5321, 369 4715, 381 22, 381119, 381 20, 463 35, 700 94, 704 1, 704 9, 704205, 704258, 704500, 709227, 360 722, 37920201, 386227, 386290, 705 734, 715716, 725 28, 725143, 725 18, 345440, 703 8
• CPC Class Codes: G10H 1/46 Volume control
• CPC Class Codes: G10H 2210/105 Composing aid, e.g. for supporting creation, edition or modification of a piece of music
• CPC Class Codes: G10H 2210/131 Morphing, i.e. transformation of a musical piece into a new different one, e.g. remix
• CPC Class Codes: G10H 2210/155 Musical effects
• CPC Class Codes: G10H 2220/106 using icons, e.g. selecting, moving or linking icons, on-screen symbols, screen regions or segments representing musical elements or parameters
• CPC Class Codes: G10H 2240/091 Info, i.e. juxtaposition of unrelated auxiliary information or commercial messages with or between music files metadata G10H2240/075
• CPC Class Codes: G11B 27/031 Electronic editing of digitised analogue information signals, e.g. audio or video signals
• CPC Class Codes: H04H 60/04 Studio equipment; Interconnection of studios
• CPC Class Codes: H04H 60/73 using meta-information
• CPC Class Codes: H04S 2400/11 Positioning of individual sound objects, e.g. moving airplane, within a sound field H04S2420/13 takes precedence
• CPC Class Codes: H04S 3/008 in which the audio signals are in digital form, i.e. employing more than two discrete digital channels data reduction aspects thereof based on psychoacoustics G10L19/02
• CPC Class Codes: H04S 7/30 Control circuits for electronic adaptation of the sound field

Abstract

A method comprises providing an audio file comprising two or more discrete tracks; separating the two or more discrete tracks; setting a limit on an amount at least one of the two or more discrete tracks may be altered; and outputting the separated and limited discrete tracks as a file for use by an end user.

Claims

1. A method, comprising:

providing an audio file comprising two or more discrete tracks;

separating the two or more discrete tracks;

setting a limit on an ability to alter an amount of an effect, using a visual object, wherein the visual object is configured to be presented on a display so as to be manipulated, based on at least one of the two or more discrete tracks; and

outputting the separated and limited discrete tracks for altering the amount of the effect.

2. The method of claim 1, wherein setting the limit on the ability to alter the amount of the effect based on at least one of the two or more discrete tracks comprises storing the limit as metadata.

3. The method of claim 2, wherein storing the limit as metadata comprises manually setting the limit in the metadata.

4. The method of claim 3, wherein manually setting the limit in the metadata comprises manually determining upper and lower limits of acceptable sound of at least one of the two or more discrete tracks.

5. The method of claim 2, wherein storing the limit as metadata comprises automatically setting the limit in the metadata based on a configuration of the two or more discrete tracks of the audio file.

6. The method of claim 5, wherein automatically setting the limit in the metadata comprises determining an audio quality based on a correlation between the two or more discrete tracks of the audio file before separation and the two or more discrete tracks after separation.

7. The method of claim 1, further comprising at least one of:

outputting the separated and limited discrete tracks as a file; and

encrypting the outputted file.

8. The method of claim 2, wherein storing the limit as metadata comprises storing audio in a spatial audio object coding format.

9. The method of claim 2, wherein storing the limit as metadata comprises storing audio in a spatial audio object coding format and storing the metadata in an MP4 container.

10. A method, comprising:

receiving an audio file comprising two or more discrete tracks;

analyzing the two or more discrete tracks to determine a set limit on an ability to alter an amount of an effect, using a visual object based on manipulating an image on a display, based on at least one of the two or more discrete tracks;

editing at least one of the two or more discrete tracks; and

remixing the two or more discrete tracks based on the determined set limit for altering the amount of the effect for the at least one of the two or more discrete tracks.

11. The method of claim 10, further comprising separating the two or more discrete tracks from each other before analyzing.

12. The method of claim 11, wherein separating the two or more discrete tracks from each other is based on a blind signal separation format or a spatial audio object coding format.

13. The method of claim 10, further comprising exceeding the determined set limit for altering the amount of the effect.

14. The method of claim 10, wherein the received audio file includes no metadata.

15. The method of claim 10, wherein analyzing the two or more discrete tracks comprises calculating a correlation between the two or more separated discrete tracks and setting a limit on an extent of possible remixing based on the calculated correlation.

16. An apparatus, comprising:

at least one processor; and

at least one non-transitory memory including computer program code configured to, with the at least one processor, cause the apparatus at least to;

receive an audio file comprising two or more discrete tracks;

separate the two or more discrete tracks from each other;

analyze the two or more discrete tracks to determine a set limit on an ability to alter an amount of an effect, using a visual object controllable as an image on a display, based on at least one of the two or more discrete tracks; and

allow a remix of the two or more discrete tracks based on the determined set limit for altering the amount of the effect for the at least one of the two or more discrete tracks.

17. The apparatus of claim 16, wherein the apparatus is further caused to separate the two or more discrete tracks from each other based on a blind signal separation format.

18. The apparatus of claim 16, wherein the apparatus is further caused to separate the two or more discrete tracks from each other based on a spatial audio object coding format.

19. The apparatus of claim 16, wherein the apparatus is further caused to allow the remix to exceed the determined set limit.

20. The apparatus of claim 16, wherein analyzing the two or more discrete tracks comprises further causing the apparatus to calculate a correlation between the two or more separated discrete tracks and to set a limit on an extent of remixing based on the calculated correlation.