SYSTEM AND METHOD OF PROVIDING VOICE-MESSAGE CALL SERVICE

• US 20150340037A1
• Filed: 05/26/2015
• Published: 11/26/2015
• Est. Priority Date: 05/23/2014
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd. (Samsung Group)
• Original Assignee: Samsung Electronics Co. Ltd. (Samsung Group)
• Inventors: KIM, Seon-ae, SHIN, Hyun-jae, KIM, Hong-chul
• Granted Patent: US 9,906,641 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence
• CPC Class Codes: H04L 51/046 Interoperability with other network applications or services
• CPC Class Codes: H04L 51/066 Format adaptation, e.g. format conversion or compression
• CPC Class Codes: H04L 51/56 Unified messaging, e.g. interactions between e-mail, instant messaging or converged IP messaging [CPM]
• CPC Class Codes: H04M 1/651 with speech synthesis
• CPC Class Codes: H04M 1/72433 for voice messaging, e.g. dictaphones for answering incoming calls H04M1/64
• CPC Class Codes: H04M 1/72436 for text messaging, e.g. short messaging services [SMS] or e-mails
• CPC Class Codes: H04M 2201/40 using speech recognition speech recognition per se G10L15/00
• CPC Class Codes: H04M 2201/60 Medium conversion
• CPC Class Codes: H04M 2207/18 wireless networks
• CPC Class Codes: H04M 2250/60 logging of communication history, e.g. outgoing or incoming calls, missed calls, messages or URLs logging of telephone numbers H04M1/56, H04M1/57
• CPC Class Codes: H04M 3/42382 Text-based messaging services in telephone networks such as PSTN/ISDN, e.g. User-to-User Signalling or Short Message Service for fixed networks
• CPC Class Codes: H04M 3/42391 where the subscribers are hearing-impaired persons, e.g. telephone devices for the deaf
• CPC Class Codes: H04M 3/533 Voice mail systems
• CPC Class Codes: H04M 7/0042 where the data service is a text-based messaging service H04M7/0054 takes precedence
• CPC Class Codes: H04W 4/12 Messaging; Mailboxes; Announcements
• CPC Class Codes: H04W 4/14 Short messaging services, e.g. short message services [SMS] or unstructured supplementary service data [USSD]
• CPC Class Codes: H04W 4/18 Information format or content conversion, e.g. adaptation by the network of the transmitted or received information for the purpose of wireless delivery to users or terminals
• CPC Class Codes: H04W 88/02 Terminal devices

Abstract

Provided are a system and method of providing a voice-message call service. A mobile device that performs a call with an external mobile device comprises a control unit configured to obtain text, the text converted from voice data that is exchanged between the mobile device and the external mobile device, during the call between the mobile device and the external mobile device, and obtain input text input to the mobile device and provided text that is received from the external mobile device; and a display unit configured to arrange the text, the input text, and the provided text and display the arranged text, input text, and provided text on a screen of the device, during the call between the mobile device and the external mobile device.

Claims

1. A mobile device that performs a call with an external mobile device, the mobile device comprising:

a control unit configured to obtain text, the text converted from voice data that is exchanged between the mobile device and the external mobile device, during the call between the mobile device and the external mobile device, and obtain input text input to the mobile device and provided text that is received from the external mobile device; and

a display unit configured to arrange the text, the input text, and the provided text and display the arranged text, input text, and provided text on a screen of the device, during the call between the mobile device and the external mobile device.

2. The device of claim 1, wherein the text, the input text, and the provided text are arranged in a temporal order in which the text, the input text, and the provided text are received by the mobile device, and

wherein the display unit is configured to display a chat window comprising the arranged text, input text, and provided text on the screen of the device.

3. The device of claim 1, wherein the display unit is configured to display the arranged text, input text, and provided text distinguishably from each other.

4. The device of claim 3, wherein the display unit is configured to display a reliability of the text according to reliability of voice conversion of the text.

5. The device of claim 3, further comprising an audio output unit configured to output original voice data that corresponds to the text, according to selection of the text.

6. The device of claim 5, wherein the selected text is a sentence or a word in a sentence.

7. The device of claim 1, wherein, when an output method of the external mobile device is changed during the call between the mobile device and the external mobile device, the mobile device receives information indicating the changed output method, and

wherein the output method comprises a voice-only output method, a text-only output method, and a voice and text output method.

8. The device of claim 7, wherein the control unit is further configured to control the mobile device to output an indicator of the changed output method to the user of the mobile device by using at least one selected from a voice, a text, and a vibration.

9. The device of claim 7, wherein the control unit is further configured to recommend the user of the mobile device to change an input method of the mobile device during the call between the mobile device and the external mobile device, according to the output method of the external mobile device, and

wherein the input method comprises a voice-only input method, a text-only input method, and a voice and text input method.

10. The device of claim 1, wherein the control unit is further configured to associate the arranged text, input text, and provided text with a call list that comprises a call history in relation to the external device, and stores the call list.

11. The device of claim 10, wherein the control unit is further configured to store a part of the arranged text, input text, and provided text, and

wherein the part of the arranged text, input text, and provided text indicates a text that is obtained for a preset time period during the call between the mobile device and the external mobile device before a predetermined event occurs.

12. A method of a mobile device performing a call with an external mobile device, the method comprising:

obtaining text, the text converted from voice data that is exchanged between the mobile device and the external mobile device, during the call between the mobile device and the external mobile device;

obtaining input text that is input to the device;

obtaining provided text that is received from the external mobile device; and

arranging the text, the input text, and the provided text and displaying the arranged text, input text, and provided text on a screen of the device, during the call between the mobile device and the external mobile device.

13. The method of claim 12, wherein the text, the input text, and the provided text are arranged in a temporal order in which the text, the input text, and the provided text are received by the mobile device, and

the displaying comprises displaying a chat window comprising the arranged text, input text, and provided text on the screen of the device.

14. The method of claim 12, wherein the displaying comprises distinguishably displaying the arranged text, input text, and provided text.

15. The method of claim 14, wherein the converted text is displayed according to reliability of voice conversion of the text.

16. The method of claim 14, further comprising outputting original voice data that corresponds to the text, according to selection of the text.

17. The method of claim 16, wherein the selected text is a sentence or a word in a sentence.

18. The method of claim 12, further comprising, when an output method of the external mobile device is changed during the call between the mobile device and the external mobile device, receiving information indicating the changed output method, and

wherein the output method comprises a voice-only output method, a text-only output method, and a voice and text output method.

19. The method of claim 18, further comprising outputting using at least one selected from a voice, a text, and a vibration an indicator of the changed output method.

20. The method of claim 18, further comprising:

recommending the user of the mobile device to change an input method of the device during the call between the mobile device and the external mobile device, according to the output method of the external mobile device, and

wherein the input method comprises a voice-only input method, a text-only input method, and a voice and text input method.

21. The method of claim 12, further comprising associating the arranged text, input text, and provided text with a call list that comprises a call history in relation to the external device, and storing the call list.

22. The method of claim 21, wherein the storing comprises storing a part of the arranged text, input text, and provided text, and

wherein the part of the arranged text, input text, and provided text indicates a text that is obtained for a preset time period during the call between the mobile device and the external mobile device before a predetermined event occurs.

26. A non-transitory computer-readable recording medium having recorded thereon a program for executing the method of claim 12, by using a computer.

23. A system that provides a call between a first mobile device and a second mobile device, the system comprising:

a server comprising;

a communication unit configured to receive a voice of a first user from the first mobile device; and

a control unit configured to convert the voice of the first user into text,

wherein the communication unit is further configured to transmit the text to the second device;

the first mobile device configured to provide the voice of the first user to the server; and

the second mobile device configured to display the text, which is transmitted to the second mobile device, in a chat window that is displayed on a screen of the second mobile device during the call, wherein the chat window displays a conversation between the first user and a second user.

24. The system of claim 23, wherein the server is further configured to store the text.

25. The system of claim 24, wherein the server is further configured to store the voice of the first user that is received from the first mobile device.

27. A mobile device comprising:

a transceiver; and

a processor configured to control the transceiver to establish a voice-message communication session with an external mobile device, the voice-message communication session supporting transmission and reception of voice data and text data between the mobile device and the external mobile device.

28. The mobile device of claim 27, further comprising:

a display; and

an input/output unit configured to receive input from a user and output information to a user;

wherein the processor is further configured to control the display to display the text data received from the external mobile device as text information and control the input/output unit to output the voice data received from the external mobile device as audio information.

29. The mobile device of claim 28, wherein the processor is further configured to control the input/output unit to receive text data from the user and voice data from the user, and control the transceiver to transmit the text data and the voice data to the external mobile device.

30. The mobile device of claim 29, wherein the processor is further configured to control the mobile device to operate in a voice call mode.

31. The mobile device of claim 30, wherein the processor is further configured to control the transceiver to receive text data from the external mobile device and convert the text data into voice data and control the input/output unit to output the converted text data as the voice data, in the voice call mode.

32. The mobile device of claim 29, wherein the processor is further configured to control the mobile device to operate in a text mode.

33. The mobile device of claim 32, wherein the processor is further configured to control the transceiver to receive voice data from the external mobile device and convert the voice data into text data and control the input/output unit to output the converted voice data as the text data, in the text mode.

34. The mobile device of claim 29, wherein the processor is further configured to control the mobile device to operate in a combination mode comprising a voice call mode and a text mode.

35. The mobile device of claim 34, wherein the processor is further configured to control the transceiver to receive text data from the external mobile device and convert the text data into voice data and control the input/output unit to output the converted text data as the voice data, in the combination mode, and

wherein the processor is further configured to control the transceiver to receive voice data from the external mobile device and convert the voice data into text data and control the input/output unit to output the converted voice data as the text data, in the combination mode.

36. The mobile device of claim 34, wherein the processor is further configured to control the input/output unit to receive the input as text data or voice data and output the information as text data or voice data.

37. The mobile device of claim 34, wherein the processor is further configured to control the input/output unit to receive the input as text data or voice data and simultaneously output the information as text data and voice data.

38. The mobile device of claim 29, wherein the transceiver is configured to transmit and receive the voice data over a voice channel of the voice-message communication session and transmit and receive the text data over a text data channel of the voice-message communication session.