Method and system for expressing affective state in communication by telephone

• US 20020082007A1
• Filed: 12/18/2001
• Published: 06/27/2002
• Est. Priority Date: 12/22/2000
• Status: Abandoned Application

• Current Assignee: Nokia Corporation
• Original Assignee: Nokia Corporation
• Inventors: Ronkainen, Sami, Hoisko, Jyrki, Kangas, Petri, Tuomela, Urpo, Kangas, Kari J.
• Application Number:
  US10/023,564
• Publication Number:
  US 20020082007A1
• Time in Patent Office: Days
• US Class Current: 455/412.1
• CPC Class Codes: H04M 1/72427 for supporting games or graphical animations
• CPC Class Codes: H04M 1/7243 with interactive means for internal management of messages
• CPC Class Codes: H04M 2203/352 In-call/conference information service
• CPC Class Codes: H04M 2207/18 wireless networks
• CPC Class Codes: H04M 3/42102 Making use of the called party identifier
• CPC Class Codes: H04M 3/4211 where the identifier is used to access a profile
• CPC Class Codes: H04M 3/4872 Non-interactive information services

Abstract

The invention relates to a method and system in which the content and intelligibility of communication by telephone are improved by means of music. Musical compositions are typically works that create in a listener an association with a certain emotion. In the invention, a suitable piece of music (10a, 10b, . . . , 10n) describing the state of mind of the caller (32) is set to be played in the background of a message to be conveyed by phone. The caller may thus communicate his affective state to the conversation partner without expressing it directly in words. Conversely, the music playing in the background of the message gives the called party (34) immediately an idea of the state of mind of the caller so that he can adopt a suitable attitude in the situation. In the invention, the musical compositions are placed in a directory (30) which may be located in the cellular phone (33, 35) of the caller or called party or in the equipment of the operator (36) switching calls. A suitable musical composition is selected by means of a menu (28) in the cellular phone or by an automatic state of mind recognizer connected to the phone.

Claims

1. A method for expressing an affective state (20a, 20b, . . . , 20n) of the caller (32) and/or called party (34) to the conversation partner in communication by telephone, where the caller and called party send each other messages (60) wherein during the communication, the recipient of a message hears a musical composition (10a, 10b, . . . , 10n) representing the affective state of the sender of the message.

2. A method according to claim 1 wherein the messages (60) of the caller (32) and called party (34) are speech messages.

3. A method according to claim 1 wherein the communication takes place in a system comprising equipment of an operator (36) switching calls and in which system at least one phone is a cellular phone (33, 35).

4. A method according to claim 3 wherein the phone of the caller (32) is a cellular phone (33) and that the musical composition (10a, 10b, . . . , 10n) is attached to the message (60) sent by the caller in the caller'"'"'s cellular phone.

5. A method according to claim 4 wherein the musical composition (10a, 10b, . . . , 10n) is transferred together with the message (60) on the same audio channel from the cellular phone (33) of the caller (32) to the phone of the called party (34).

6. A method according to claim 3 wherein the phone of the called party (34) is a cellular phone (35) and that the musical composition (10a, 10b, . . . , 10n) is attached to the message (60) sent by the caller (32) in the cellular phone of the called party.

7. A method according to claim 6 wherein there is transferred from the cellular phone (33) of the caller (32) to the cellular phone (35) of the called party (34) an identifier (64) on the basis of which the musical composition (10a, 10b, . . . , 10n) is selected.

8. A method according to claim 7 wherein the identifier (64) specifies the name (11a, 11b, . . . , 11n) of the musical composition (10a, 10b, . . ., 10n).

9. A method according to claim 7 wherein the identifier (64) specifies the affective state (20a, 20b, . . . , 20n) of the caller (32).

10. A method according to claim 3 wherein the musical composition (10a, 10b, . . . , 10n) is attached to the message (60) sent by the caller (32) in the equipment of the operator (36) switching the call.

11. A method according to claim 10 wherein there is transferred from the cellular phone (33) of the caller (32) to the operator (36) an identifier (64) on the basis of which the musical composition (10a, 10b, . . . , 10n) is selected.

12. A method according to claim 11 wherein the identifier (64) specifies the name (11a, 11b, . . . , 11n) of the musical composition (10a, 10b, . . . , 10n).

13. A method according to claim 11 wherein the identifier (64) specifies the affective state (20a, 20b, . . . , 20n) of the caller (32).

14. A method according to claim 3 wherein the phones of the caller (32) and called party (34) are cellular phones (33, 35) and from the cellular phone of the caller to the cellular phone of the called party there is sent a file (80) which contains a musical composition (10a, 10b, . . . , 10n) stored in electric form.

15. A method according to claim 14 wherein the musical composition (10a, 10b, . . . , 10n) is set to be played on the cellular phone (35) of the called party (34).

16. A method according to claim 14 wherein the musical composition is set to be played on a separate sound reproducing apparatus (82) connected to the cellular phone (35) of the called party (34).

18. A system according to claim 17 wherein the musical compositions (10a, 10b, . . . , 10n) are stored in the directory (30) in electric form.

19. A system according to claim 17 wherein the musical compositions (10a, 10b, . . . , 10n) are stored in the directory (30) in the form of midi or mp3 files.

20. A system according to claim 17 wherein the directory (30) is in the cellular phone (33) of the caller (32).

21. A system according to claim 17 wherein the directory (30) is in the cellular phone (35) of the called party (34).

22. A system according to claim 17 wherein the directory (30) is in the equipment of the operator (36).

23. A system according to claim 17 wherein the menu (28) is arranged to be at least in the cellular phone (33) of the caller (32).

24. A system according to claim 17 wherein the system further comprises an automatic state of mind recognizer (40).

25. A system according to claim 24 wherein the automatic state of mind recognizer (40) is arranged to be in the cellular phone (33) of the caller (32).

26. A system according to claim 24 wherein the automatic state of mind recognizer (40) is arranged to be in the cellular phone (35) of the called party (34).

27. A system according to claim 24 wherein the automatic state of mind recognizer (40) includes a set of sensors (42, 44, 46, 48) measuring the bodily functions of the user of the phone and a decoding device (50) which processes the measurement results produced by the sensors.

28. A system according to claim 27 wherein the automatic state of mind recognizer (40) includes an EMG sensor (42) for measuring the tension of neck muscles.

29. A system according to claim 27 wherein the automatic state of mind recognizer (40) includes a respiration sensor (44) for measuring the respiration rate and depth of breathing.

30. A system according to claim 27 wherein the automatic state of mind recognizer (40) includes a GSR sensor (46) for measuring the electrical conductivity of skin.

31. A system according to claim 27 wherein the automatic state of mind recognizer (40) includes a BVP sensor (48) for measuring the blood flow rate.

17. A system for expressing an affective state of a caller (32) and/or called party (34) to the conversation partner in communication by telephone, where the caller and called party send each other messages (60), which system comprises at least one cellular phone (33, 35) and the equipment of an operator (36) switching calls, wherein the system further comprises a directory (30) storing musical compositions (10a, 10b, . . . , 10n) representing various affective states (20a, 20b, . . . , 20n) and a menu (28) for selecting musical compositions in the directory.