Transcription of communications through a device

• US 10,284,717 B2
• Filed: 07/19/2018
• Issued: 05/07/2019
• Est. Priority Date: 10/02/2013
• Status: Active Grant

• Current Assignee: Sorenson Ip Holdings, LLC
• Original Assignee: Sorenson Ip Holdings, LLC
• Inventors: Pan, Jasper Cheekeong
• Primary Examiner(s): Doan, Kiet M
• Application Number:
  US16/039,692
• Publication Number:
  US 20180324296A1
• Time in Patent Office: 292 Days
• Field of Search: 455466, 455556, 455417, 4555561, 37921501, 379 52, 370352
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence
• CPC Class Codes: G10L 15/30 Distributed recognition, e.g. in client-server systems, for mobile phones or network applications
• CPC Class Codes: H04M 1/72478 for hearing-impaired users
• CPC Class Codes: H04M 2201/40 using speech recognition speech recognition per se G10L15/00
• CPC Class Codes: H04M 3/42391 where the subscribers are hearing-impaired persons, e.g. telephone devices for the deaf
• CPC Class Codes: H04M 3/4936 Speech interaction details speech recognition per se G10L15/00
• CPC Class Codes: H04W 4/12 Messaging; Mailboxes; Announcements

Abstract

A method to transcribe communications is provided. The method may include obtaining first communication data during a communication session between a first communication device and a second communication device and transmitting the first communication data to the second communication device by way of a mobile device that is locally coupled with the first communication device. The method may also include receiving, at the first communication device, second communication data from the second communication device through the mobile device and transmitting the second communication data to a remote transcription system. The method may further include receiving, at the first communication device, transcription data from the remote transcription system, the transcription data corresponding to a transcription of the second communication data, the transcription generated by the remote transcription system and presenting, by the first communication device, the transcription of the second communication data.

Claims

1. A system comprising:

one or more processors;

a microphone coupled to the one or more processors, the microphone configured to obtain audio of a user of the system and to generate first communication data based on the audio;

one or more computer-readable media coupled to the one or more processors, the one or more computer-readable media configured to store instructions that when executed by the one or more processors cause the system to perform operations, the operation comprising;

establish local wireless communication between the system and a relay device;

obtain an indication of a request for a communication session originating from a communication device by way of the relay device;

direct the first communication data to the communication device by way of the relay device, the first communication data being part of the communication session between the system and the communication device;

obtain, by way of the relay device, second communication data of the communication session originating from the communication device;

transmit the second communication data to a remote transcription system; and

obtain transcription data originating from the remote transcription system, the transcription data corresponding to a transcription of the second communication data, the transcription generated by the remote transcription system;

a speaker coupled to the one or more processors and configured to broadcast the second communication data; and

an electronic display coupled to the one or more processors and configured to present the transcription of the second communication data.

2. The system of claim 1, wherein the second communication data includes audio data or the audio data and video data.

3. The system of claim 2, wherein when the second communication data includes the audio data and the video data, only the audio data is transmitted to the remote transcription system.

4. The system of claim 1, wherein the local wireless communication is established between the relay device and the system responsive to at least one of the system or the relay device automatically detecting a presence of another of the at least one of the system or the relay device without user input.

5. The system of claim 1, further comprising disabling communication between the relay device and the system while communication between the communication device and the relay device is maintained.

6. The system of claim 1, wherein the indication of the request for the communication session is automatically routed by the relay device to the system without input from the user.

7. The system of claim 1, wherein the relay device is a mobile cellular device and the request for the communication session is directed to the mobile cellular device by the communication device and not the system.

8. A system comprising:

one or more processors;

one or more computer-readable media coupled to the one or more processors, the one or more computer-readable media configured to store instructions that when executed by the one or more processors cause the system to perform operations, the operation comprising;

obtain first communication data of a communication session between the system and a communication device by way of a relay device;

direct the first communication data to the communication device by way of the relay device that is locally coupled with the system;

obtain, by way of the relay device, second communication data of the communication session originating from the communication device; and

obtain transcription data originating from a remote transcription system, the transcription data corresponding to a transcription of the second communication data, the transcription generated by the remote transcription system in response to the remote transcription system obtaining the second communication data of the communication session; and

an electronic display coupled to the one or more processors and configured to present the transcription of the second communication data.

9. The system of claim 8, wherein the second communication data includes audio data or the audio data and video data.

10. The system of claim 9, wherein when the second communication data includes the audio data and the video data, only the audio data is transmitted to the remote transcription system.

11. The system of claim 8, wherein the operations further comprise establish local communication between the system and the relay device.

12. The system of claim 11, wherein the local communication is established between the relay device and the system responsive to at least one of the system or the relay device automatically detecting a presence of another of the at least one of the system or the relay device without user input.

13. The system of claim 11, wherein the operations further comprise disabling communication between the relay device and the system while communication between the communication device and the relay device is maintained.

14. The system of claim 8, further comprising a speaker coupled to the one or more processors and configured to broadcast the second communication data.

15. The system of claim 8, wherein the operations further comprise obtain an indication of a request for the communication session originating from the communication device by way of the relay device.

16. The system of claim 15, wherein the indication of the request for the communication session is automatically routed by the relay device to the system without input from a user.

17. The system of claim 15, wherein the relay device is a mobile cellular device and the request for the communication session is directed to the mobile cellular device by the communication device and not the system.

18. A system comprising:

means for obtaining first audio data;

means for transmitting the first audio data to a communication device by way of a relay device, the first audio data being part of a communication session between the system and the communication device;

means for receiving, by way of the relay device, second communication data of the communication session originating from the communication device;

means for transmitting the second communication data to a remote transcription system;

means for receiving transcription data originating from the remote transcription system, the transcription data corresponding to a transcription of the second communication data, the transcription generated by the remote transcription system; and

means for presenting the transcription of the second communication data.

19. The system of claim 18, further comprising means for receiving an indication of a request for the communication session originating from the communication device by way of the relay device.

20. The system of claim 19, wherein the relay device is a mobile cellular device and the request for the communication session is directed to the mobile cellular device by the communication device and not the system.