Method, apparatus and computer program product for providing content dependent media content mixing

• US 20070245375A1
• Filed: 03/21/2006
• Published: 10/18/2007
• Est. Priority Date: 03/21/2006
• Status: Abandoned Application

• Current Assignee: Nokia Corporation
• Original Assignee: Nokia Corporation
• Inventors: Tian, Jilei, Nurminen, Jani
• Application Number:
  US11/385,578
• Publication Number:
  US 20070245375A1
• Time in Patent Office: Days
• US Class Current: 725/45
• CPC Class Codes: G10H 1/0041 in coded form
• CPC Class Codes: G10H 2230/021 Mobile ringtone, i.e. generation, transmission, conversion or downloading of ringing tones or other sounds for mobile telephony; Special musical data formats or protocols herefor mobile telephone transmission specifically adapted for electrophonic musical tools or instruments G10H2240/251
• CPC Class Codes: G10H 2240/085 Mood, i.e. generation, detection or selection of a particular emotional content or atmosphere in a musical piece
• CPC Class Codes: G10L 13/00 Speech synthesis; Text to speech systems

Abstract

A method of providing content dependent media content mixing includes automatically determining an emotional property of a first media content input, determining a specification for a second media content in response to the determined emotional property, and producing the second media content in accordance with the specification.

Claims

1. A method of providing content dependent media content mixing, the method comprising:

automatically determining an emotional property of a first media content input;

determining a specification for a second media content in response to the determined emotional property; and

producing the second media content in accordance with the specification.

2. A method according to claim 1, wherein the second media content is musical content.

3. A method according to claim 2, wherein the first media content is text content.

4. A method according to claim 3, wherein determining the emotional property comprises dividing the text content into segments and determining by text analysis the emotional property associated with each of the segments.

5. A method according to claim 4, further comprising mixing the musical content with synthetic speech derived from the text content.

6. A method according to claim 2, wherein determining the specification comprises selecting the musical content from a group of musical elements that are associated with respective emotional properties.

7. A method according to claim 2, wherein determining the specification comprises providing instructions to modify a pre-composed musical element according to the determined emotional property.

8. A method according to claim 5, further comprising varying a mixing gain in response to timing based instructions.

9. A method according to claim 8, wherein the mixing gain is increased during pauses in the text content.

10. A method according to claim 1, wherein producing the second media content comprises one of:

generating music;

modifying a musical score; and

selecting an appropriate musical score.

11. A computer program product for providing content dependent media content mixing, the computer program product comprising at least one computer-readable storage medium having computer-readable program code portions stored therein, the computer-readable program code portions comprising:

a first executable portion for automatically determining an emotional property of a first media content input;

a second executable portion for determining a specification for a second media content in response to the determined emotional property; and

a third executable portion for producing the second media content in accordance with the specification.

12. A computer program product according to claim 11, wherein the second media content is musical content.

13. A computer program product according to claim 12, wherein the first executable portion further includes instructions for dividing a text into segments and determining by text analysis the emotional property associated with each of the segments.

14. A computer program product according to claim 13, further comprising fourth executable instruction for mixing the musical content with synthetic speech derived from the text.

15. A computer program product according to claim 12, wherein the second executable portion further includes instructions for selecting the musical content from a group of musical elements that are associated with respective emotional properties.

16. A computer program product according to claim 12, wherein the second executable portion further includes instructions for providing instructions to modify a pre-composed musical element according to the determined emotional property.

17. A computer program product according to claim 14, further comprising a fourth executable portion for varying a mixing gain in response to timing based instructions.

18. A computer program product according to claim 17, wherein the fourth executable portion further includes instructions for increasing the mixing gain during pauses in the text.

19. A computer program product according to claim 11, wherein third executable portion comprises one of:

generating music;

modifying a musical score; and

selecting an appropriate musical score.

20. A device for providing content dependent media content mixing, the device comprising:

a first module configured to automatically determine an emotional property of a first media content input; and

a second module configured to determine a specification for a second media content in response to the determined emotional property and producing the second media content in accordance with the specification.

21. A device according to claim 20, wherein the first module is a text content analyzer and the first media content is a text, and wherein the second module is a music module and the second media content is musical content.

22. A device according to claim 21, wherein the music module is capable of accessing musical elements associated with respective emotional properties.

23. A device according to claim 21, wherein the music module is capable of accessing at least one pre-composed musical element and the music module is further configured to modify the pre-composed musical element according to the determined property.

24. A device according to claim 21, wherein the text content analyzer is capable of dividing a text into segments and determining by text analysis the emotional property associated with each of the segments.

25. A mobile terminal for providing content dependent media content mixing, the mobile terminal comprising:

an output device capable of delivering media in a user perceptible manner;

a first module configured to automatically determine an emotional property of a first media content input; and

a second module configured to determine a specification for a second media content in response to the determined emotional property and produce the second media content in accordance with the specification.

26. A mobile terminal according to claim 25, wherein the first module is a text content analyzer and the first media content is a text, and wherein the second module is a music module and the second media content is musical content.

27. A mobile terminal according to claim 26, wherein the text content analyzer is capable of dividing a text into segments and determining by text analysis the emotional property associated with each of the segments.

28. A mobile terminal according to claim 26, wherein the output device is an audio mixer capable of mixing a plurality of audio signals.

29. A mobile terminal according to claim 28, wherein the audio mixer is configured to vary a mixing gain in response to timing based instructions.

30. A mobile terminal according to claim 29, the missing gain is increased during pauses in the text.

31. A mobile terminal according to claim 28, further comprising a text-to-speech module capable of producing synthetic speech responsive to the input text, the text-to-speech module delivering the synthetic speech to the audio mixer,

wherein the audio mixer mixes the synthetic speech and the musical content.

32. A mobile terminal according to claim 26, wherein the music module is capable of accessing musical elements associated with respective emotional properties.

33. A mobile terminal according to claim 26, wherein the music module is capable of accessing at least one pre-composed musical element and the music module is further configured to modify the pre-composed musical element according to the determined property.