Multimedia display based on audio and visual complexity

• US 8,626,322 B2
• Filed: 07/02/2009
• Issued: 01/07/2014
• Est. Priority Date: 12/30/2008
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Weber, Ralf, Vergnaud, Guillaume
• Primary Examiner(s): MCCORD, PAUL C
• Application Number:
  US12/497,534
• Publication Number:
  US 20100168881A1
• Time in Patent Office: 1,650 Days
• Field of Search: 700/94
• US Class Current: 700/94
• CPC Class Codes: G10L 25/48 specially adapted for particular use
• CPC Class Codes: G11B 27/034 on discs G11B27/036, G11B27/038 take precedence
• CPC Class Codes: G11B 27/038 Cross-faders therefor
• CPC Class Codes: G11B 27/28 by using information signals recorded by the same method as the main recording G11B27/22 takes precedence
• CPC Class Codes: G11B 27/34 Indicating arrangements indicating means incorporated in magazine or cassette G11B23/046 and G11B23/0875; indicating measured values in general G01D

Abstract

A computer-implemented method and system are provided for profiling or analyzing audio data based on an audio parameter. The audio data is divided into audio data into segments. Each segment is characterized by the audio parameter in a defined range. Effects are selected according to the segments meeting criteria for the audio parameter of the effects. A media presentation is authored or generated using the selected effects.

Claims

1. A computer-implemented method for generating a multi-media presentation, comprising:

analyzing audio data based on an audio parameter;

dividing the audio data into a plurality of segments based at least in part on the audio parameter falling in a defined range for all audio data included in each segment of the plurality of segments, each segment having a segment profile including the defined range for the audio parameter;

accessing a plurality of effects to include in the multi-media presentation, each effect of the plurality of effects including an audio requirement profile;

comparing the audio parameter in the segment profile for each segment of the plurality of segments to the audio requirement profile for each effect of the plurality of effects;

generating, in response to comparing the audio parameter, a list of selectable effects based at least in part on the audio parameter meeting an acceptance criteria associated with the audio requirement profile; and

generating the multi-media presentation using the list of selectable effects.

2. The computer-implemented method of claim 1, wherein the audio parameter is selected from the group comprising:

beats per minute, rhythmic strength, harmonic complexity, and square root of the arithmetic mean of the square of density variations (RMS) strength.

3. The computer-implemented method of claim 1, wherein the dividing step is based on a range of the audio parameter.

4. The computer-implemented method of claim 1, wherein the acceptance criteria is an acceptance range.

5. A computer-implemented method for generating a multi-media presentation, comprising:

analyzing audio data based on an audio parameter;

dividing the audio data into a plurality of segments based at least in part on the audio parameter falling in a defined range for audio data included in each segment of the plurality of segments, each segment having a segment profile including the defined range for the audio parameter;

linking an audio requirements profile of each of one or more effects to the audio parameter;

adjusting the one or more effects based on the audio parameter;

comparing the audio parameter in the segment profile for each segment of the plurality of segments to the audio requirement profile for each effect of the plurality of effects;

generating, in response to comparing the audio parameter, a list of selectable effects based at least in part on the audio parameter meeting an acceptance criteria associated with the audio requirement profile; and

generating a multi-media presentation using the list of selectable effects.

6. The computer-implemented method of claim 5, wherein the audio parameter is selected from the group comprising:

beats per minute, rhythmic strength, harmonic complexity, and square root of the arithmetic mean of the square of density variations (RMS) strength.

7. The computer-implemented method of claim 5, wherein the dividing step is based on a range of the audio parameter.

8. The computer-implemented method of claim 5, wherein the step of adjusting further comprises adjusting one or more of the transition duration, effect duration, in points, and out points of the one or more effects.

9. A computer-implemented system for generating a multi-media presentation, comprising:

memory configured to store audio data; and

one or more processors configured to analyze the audio data based on an audio parameter and divide the audio data into a plurality of segments based at least in part on the audio parameter falling in a defined range for all audio data included in each segment of the plurality of segments, each segment having a segment profile including the defined range for the audio parameter,

the one or more processors further configured to access a plurality of effects to include in the multi-media presentation, each effect of the plurality of effects including an audio requirement profile,

the one or more processors further configured to compare the audio parameter in the segment profile for each segment of the plurality of segments to the audio requirement profile for each effect of the plurality of effects; and

the one or more processors further configured to generate, in response to comparing the audio parameter, a list of selectable effects based at least in part on the audio parameter meeting an acceptance criteria associated with the audio requirement profile and generate a multi-media presentation using the list of selectable effects.

10. The computer-implemented system of claim 9, wherein the audio parameter is selected from the group comprising:

beats per minute, rhythmic strength, harmonic complexity, and square root of the arithmetic mean of the square of density variations (RMS) strength.

11. The computer-implemented system of claim 9, wherein the dividing step is based on a range of the audio parameter.

12. The computer-implemented system of claim 9, wherein the acceptance criteria is an acceptance range.

13. A computer-implemented system for generating a multi-media presentation, comprising:

memory configured to store audio data; and

one or more processors configured to analyze audio data based on an audio parameter and divide the audio data into a plurality of segments based at least in part on the audio parameter falling in a defined range for all audio data included in each segment of the plurality of segments, each segment having a segment profile including the defined range for the audio parameter,

the one or more processors further configured to link an audio requirements profile of each of one or more effects to the audio parameter, adjust the one or more effects based on the audio parameter, compare the audio parameter in the segment profile for each segment of the plurality of segments to the audio requirement profile for each effect of the plurality of effects, generate a list of selectable effects based at least in part on the audio parameter meeting an acceptance criteria associated with the audio requirement profile, and generate a multi-media presentation using the list of selectable effects.

14. The computer-implemented system of claim 13, wherein the audio parameter is selected from the group comprising:

beats per minute, rhythmic strength, harmonic complexity, and square root of the arithmetic mean of the square of density variations (RMS) strength.

15. The computer-implemented system of claim 13, wherein the dividing step is based on a range of the audio parameter.

16. The computer-implemented system of claim 13, wherein the one or more processors is further configured to adjust one or more of the transition duration, effect duration, in points, and out points of the one or more effects.

17. A non-transitory computer-readable storage medium storing one or more programs configured for execution by a computer for generating a multi-media presentation, the one or more programs comprising instructions to:

analyzing audio data based on an audio parameter;

dividing the audio data into a plurality of segments based at least in part on the audio parameter falling in a defined range for all audio data included in each segment of the plurality of segments, each segment having a segment profile including the defined range for the audio parameter;

accessing a plurality of effects to include in the multi-media presentation, each effect of the plurality of effects including an audio requirement profile;

comparing the audio parameter in the segment profile for each segment of the plurality of segments to the audio requirement profile for each effect of the plurality of effects;

generating, in response to comparing the audio parameter, a list of selectable effects based at least in part on the audio parameter meeting an acceptance criteria associated with the audio requirement profile; and

generating the multi-media presentation using the list of selectable effects.

18. A non-transitory computer-readable storage medium storing one or more programs configured for execution by a computer, the one or more programs comprising instructions to:

analyzing audio data based on an audio parameter;

dividing the audio data into a plurality of segments based at least in part on the audio parameter falling in a defined range for audio data included in each segment of the plurality of segments, each segment having a segment profile including the defined range for the audio parameter;

linking an audio requirements profile of each of one or more effects to an audio parameter;

adjusting the one or more effects based on the audio parameter;

comparing the audio parameter in the segment profile for each segment of the plurality of segments to the audio requirement profile for each effect of the plurality of effects;

generating, in response to comparing the audio parameter, a list of selectable effects based at least in part on the audio parameter meeting an acceptance criteria associated with the audio requirement profile; and

generating a slideshow using the list of selectable effects.