System and method of providing voice-message call service

• US 9,906,641 B2
• Filed: 05/26/2015
• Issued: 02/27/2018
• Est. Priority Date: 05/23/2014
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Kim, Hong-chul, Kim, Seon-ae, Shin, Hyun-jae
• Primary Examiner(s): THOMAS-HOMESCU, ANNE L
• Application Number:
  US14/721,352
• Publication Number:
  US 20150340037A1
• Time in Patent Office: 1,008 Days
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence
• CPC Class Codes: H04L 51/046 Interoperability with other network applications or services
• CPC Class Codes: H04L 51/066 Format adaptation, e.g. format conversion or compression
• CPC Class Codes: H04L 51/56 Unified messaging, e.g. interactions between e-mail, instant messaging or converged IP messaging [CPM]
• CPC Class Codes: H04M 1/651 with speech synthesis
• CPC Class Codes: H04M 1/72433 for voice messaging, e.g. dictaphones for answering incoming calls H04M1/64
• CPC Class Codes: H04M 1/72436 for text messaging, e.g. short messaging services [SMS] or e-mails
• CPC Class Codes: H04M 2201/40 using speech recognition speech recognition per se G10L15/00
• CPC Class Codes: H04M 2201/60 Medium conversion
• CPC Class Codes: H04M 2207/18 wireless networks
• CPC Class Codes: H04M 2250/60 logging of communication history, e.g. outgoing or incoming calls, missed calls, messages or URLs logging of telephone numbers H04M1/56, H04M1/57
• CPC Class Codes: H04M 3/42382 Text-based messaging services in telephone networks such as PSTN/ISDN, e.g. User-to-User Signalling or Short Message Service for fixed networks
• CPC Class Codes: H04M 3/42391 where the subscribers are hearing-impaired persons, e.g. telephone devices for the deaf
• CPC Class Codes: H04M 3/533 Voice mail systems
• CPC Class Codes: H04M 7/0042 where the data service is a text-based messaging service H04M7/0054 takes precedence
• CPC Class Codes: H04W 4/12 Messaging; Mailboxes; Announcements
• CPC Class Codes: H04W 4/14 Short messaging services, e.g. short message services [SMS] or unstructured supplementary service data [USSD]
• CPC Class Codes: H04W 4/18 Information format or content conversion, e.g. adaptation by the network of the transmitted or received information for the purpose of wireless delivery to users or terminals
• CPC Class Codes: H04W 88/02 Terminal devices

Abstract

Provided are a system and method of providing a voice-message call service. A mobile device that performs a call with an external mobile device comprises a control unit configured to obtain text, the text converted from voice data that is exchanged between the mobile device and the external mobile device, during the call between the mobile device and the external mobile device, and obtain input text input to the mobile device and provided text that is received from the external mobile device; and a display unit configured to arrange the text, the input text, and the provided text and display the arranged text, input text, and provided text on a screen of the device, during the call between the mobile device and the external mobile device.

Claims

1. A system for providing a call between a first electronic device and a second electronic device, the system comprising:

a server comprising;

a memory storing first instructions, and

a processor configured to execute the first instructions to at least;

control to obtain voice data originating from the first electronic device during the call between the first electronic device and the second electronic device, and

control to generate a first text to be sent to the second electronic device by converting the voice data into the first text; and

the second electronic device comprising;

a memory storing second instructions, and

a processor configured to execute the second instructions to at least;

control to execute an application to perform the call between the first electronic device and the second electronic device,

control to obtain, via the application, a second text input by a user of the second electronic device during the call between the first electronic device and the second electronic device,

control to obtain, via the application, the first text and the voice data during the call between the first electronic device and the second electronic device, and

control to provide, via the application, the first text, the second text, and the voice data during the call between the first electronic device and the second electronic device.

2. The system of claim 1, wherein the processor of the server is further configured to control to store the first text.

3. The system of claim 2, wherein the processor of the server is further configured to control to store the voice data originating from the first electronic device.

4. The system of claim 1, wherein the first text and the second text are arranged on the screen in a temporal order.

5. The system of claim 4, wherein the first text and the second text are arranged on the screen in the temporal order in a chat window.

6. A method of providing a call between a first electronic device and a second electronic device, the method comprising:

obtaining, by a server, voice data of the call originating from the first electronic device during the call between the first electronic device and the second electronic device;

generating, by the server, a first text to be sent to the second electronic device by converting the voice data into the first text;

sending, by the server, the first text to the second electronic device;

executing, by the second electronic device, an application to perform the call between the first electronic device and the second electronic device;

obtaining, via the application by the second electronic device, a second text input by a user of the second electronic device during the call between the first electronic device and the second electronic device;

obtaining, via the application by the second electronic device, the first text from the server during the call between the first electronic device and the second electronic device; and

providing, via the application by the second electronic device, the first text, the second text, and the voice data during the call between the first electronic device and the second electronic device.

7. The method of claim 6, further comprising:

storing, by the server, the first text.

8. The method of claim 6, further comprising:

storing, by the server, the voice data originating from the first electronic device.

9. The method of claim 6, wherein the providing comprises providing the first text and the second text arranged on the screen in a temporal order.

10. The method of claim 9, wherein the first text and the second text are arranged on the screen in the temporal order in a chat window.

11. A server for providing a text converted from voice data towards both a first electronic device and a second electronic device during a call between the first electronic device and the second electronic device, the server comprising:

one or more memories storing instructions, and

one or more processors configured to execute the instructions to, during the call between the first electronic device and the second electronic device, at least;

control to obtain first voice data of the call originating from the first electronic device, wherein the first voice data of the call is to be sent towards the second electronic device,

control to obtain second voice date of the call originating from the second electronic device, wherein the second voice data of the call is to be sent towards the first electronic device,

control to generate a second text by converting the second voice data into the second text,

control to send the second text towards the first electronic device, and

control to send the second text towards the second electronic device,

wherein the first text, the second text, and the second voice data are provided, via an application, at the first electronic device while the first electronic device is performing the call with the second electronic device,

wherein the first text, the second text, and the first voice data are provided, via an application, at the second electronic device while the second electronic device is performing the call with the first electronic device.

12. The server of claim 11, wherein the one or more processors are configured to execute the instructions, during the call between the first electronic device and the second electronic device, further to control to store the first text and the second text.

13. The server of claim 11, wherein the one or more processors are configured to execute the instructions, during the call between the first electronic device and the second electronic device, further to control to store the first voice data originating from the first electronic device and the second voice data originating from the second electronic device.

14. A method of a server providing a text converted from voice data towards both a first electronic device and a second electronic device during a call between the first electronic device and the second electronic device, the method comprising:

obtaining first voice data of the call originating from the first electronic device during the call between the first electronic device and the second electronic device, wherein the first voice data of the call is to be sent towards the second electronic device;

generating a first text by converting the first voice data into the first text, during the call between the first electronic device and the second electronic device;

sending the first text to the second electronic device during the call between the first electronic device and the second electronic device such that the first text is displayed at the second electronic device;

sending the first text to the first electronic device during the call between the first electronic device and the second electronic device such that the first text is displayed at the first electronic device;

obtaining second voice data of the cell originating from the second electronic device during the call between the first electronic device and the second electronic device, wherein the second voice data of the call is to be sent towards the first electronic device;

generating a second text by converting the second voice data into the second text during the call between the first electronic device and the second electronic device;

sending the second text to the second electronic device during the call between the first electronic device and the second electronic device such that the second text is displayed at the second electronic device; and

sending the second text to the first electronic device during the call between the first electronic device and the second electronic device such that the second text is displayed at the first electronic device.

15. The method of claim 14, further comprising:

storing the first text and the second text during the call between the first electronic device and the second electronic device.

16. The method of claim 14, further comprising:

storing the first voice data originating from the first electronic device and the second voice data originating from the second electronic device during the call between the first electronic device and the second electronic device.

17. A server for providing a text converted from voice data towards both a first electronic device and a second electronic device during a call between the first electronic device and the second electronic device, the server comprising:

one or more memories storing instructions, and

one or more processors configured to execute the instructions to, during the call between the first electronic device and the second electronic device, at least;

control to obtain first voice data of the call originating from the first electronic device, wherein the first voice data of the call is to be sent towards the second electronic device,

control to generate a first text by converting the first voice data into the first text,

control to obtain a second text input by a user of the first electronic device,

control to send the first text towards the second electronic device,

control to send the first text towards the first electronic device, and

control to send the second text towards the second electronic device,

wherein the first text and the second text are provided in a temporal order, via an application, at the second electronic device while the second electronic device is performing the call with the first electronic device.