System and method for language translation in a hybrid peer-to-peer environment

• US 9,128,927 B2
• Filed: 05/16/2013
• Issued: 09/08/2015
• Est. Priority Date: 09/24/2010
• Status: Active Grant

• Current Assignee: Damaka, Inc.
• Original Assignee: Damaka, Inc.
• Inventors: Chaturvedi, Sivakumar, Gundabathula, Satish
• Primary Examiner(s): Han, Qi
• Application Number:
  US13/895,491
• Publication Number:
  US 20130332144A1
• Time in Patent Office: 845 Days
• Field of Search: 704/3, 704/2, 704/8, 704/277, 704/270, 704/270.1
• US Class Current: 1/1
• CPC Class Codes: G06F 40/40 Processing or translation of natural language natural language analysis G06F40/20; semantic analysis G06F40/30
• CPC Class Codes: G06F 40/58 Use of machine translation, e.g. for multi-lingual retrieval, for server-side translation for client devices or for real-time translation
• CPC Class Codes: G10L 15/005 Language recognition

Abstract

An improved system and method are disclosed for peer-to-peer communications. In one example, the method enables an endpoint to send and/or receive audio speech translations to facilitate communications between users who speak different languages.

Claims

1. A method for communicating, by a first endpoint in a hybrid peer-to-peer network, in an ongoing communication session with a second endpoint and a third endpoint via a bridge comprising:

identifying, by the first endpoint, that the first endpoint is associated with a first spoken language, the second endpoint is associate with a second spoken language, and the third endpoint is associated with a third spoken language;

sending, by the first endpoint, a request to the bridge for an inbound port and an outbound port to be provisioned on the bridge for the first endpoint;

notifying, by the first endpoint, a language translation component in the hybrid peer-to-peer network of the inbound port, wherein the language translation component is accessible to the first endpoint via the hybrid peer-to-peer network, and wherein the notifying instructs the language translation component to send audio received from the first endpoint to the inbound port;

sending to the language translation component, by the first endpoint, audio speech input received by the first endpoint from a user of the first endpoint, wherein the audio speech input sent by the first endpoint is in the first spoken language; and

receiving, by the first endpoint, audio speech originating from the second and third endpoints from the outbound port on the bridge, wherein the audio speech received by the first endpoint via the outbound port was sent to the bridge by the second and third endpoints in the second and third spoken languages, respectively, translated into the first spoken language, and then sent to the first endpoint in the first spoken language.

2. The method of claim 1 further comprising:

identifying, by the first endpoint, that a fourth endpoint is associated with the first spoken language; and

sending, by the first endpoint, the audio speech received from the user of the first endpoint directly to the fourth endpoint without using the bridge.

3. The method of claim 1 further comprising:

identifying, by the first endpoint, that a fourth endpoint is associated with the first spoken language; and

sending, by the first endpoint, the audio speech received from the user of the first endpoint to the inbound port on the bridge.

4. The method of claim 1 further comprising sending, by the first endpoint, non-audio data directly to at least one of the second and third endpoints, wherein the non-audio data does not pass through the bridge.

5. The method of claim 1 further comprising receiving, by the first endpoint, non-audio data directly from at least one of the second and third endpoints, wherein the non-audio data does not pass through the bridge.

6. The method of claim 1 further comprising directly notifying the second and third endpoints, by the first endpoint, of the inbound and outbound ports, wherein the notifying does not use the bridge.

7. The method of claim 1 further comprising receiving, by the first endpoint, notifications directly from each of the second and third endpoints of inbound and outbound ports corresponding to the second and third endpoints.

8. The method of claim 1 further comprising sending an indication, by the first endpoint, to the language translation component that the audio speech input is to be translated into the second and third languages.

9. A method for translating audio speech in a hybrid peer-to-peer network comprising:

receiving, by a speech-to-text module, first audio speech media from a first endpoint via a hybrid peer-to-peer network, wherein the first audio speech media is in a first human language;

converting, by the speech-to-text module, the first audio speech media into original text;

sending, by the speech-to-text module, the original text to the first endpoint;

waiting, by the speech-to-text module, for an approval of the original text from the first endpoint;

sending, by the speech-to-text module, the original text to a language translation module only after receiving the approval;

translating, by the language translation module, the original text into translated text in a second human language;

sending, by the language translation module, the translated text to a text-to-speech module;

converting, by the text-to-speech module, the translated text into second audio speech media, wherein the second audio speech media is in the second human language; and

sending the second audio speech media to a second endpoint in the hybrid peer-to-peer network, wherein sending the second audio speech media to the second endpoint includes sending the second audio speech media to a port on a bridge identified by the first endpoint.

10. The method of claim 9 wherein sending the second audio speech media is performed by the text-to-speech module.

11. The method of claim 9 further comprising:

translating, by the language translation module, the original text into translated text in a third human language;

sending, by the language translation module, the translated text to the text-to-speech module;

converting, by the text-to-speech module, the translated text into third audio speech media, wherein the third audio speech media is in the third human language; and

sending the third audio speech media to a third endpoint by sending the third audio speech media to a port on the bridge identified by the first endpoint.

12. The method of claim 11 wherein the ports for the second and third audio speech media are the same port.

13. A device comprising:

a network interface;

a processor coupled to the network interface; and

a memory coupled to the processor and containing a plurality of instructions for execution by the processor, the instructions including instructions for;

identifying that a first endpoint running on the device is associated with a first spoken language in an ongoing communication session with a second endpoint and a third endpoint via a bridge, the second endpoint is associate with a second spoken language, and the third endpoint is associated with a third spoken language;

sending a request to the bridge for an inbound port and an outbound port to be provisioned on the bridge for the first endpoint;

notifying a language translation component in the hybrid peer-to-peer network of the inbound port, wherein the language translation component is accessible to the first endpoint via the hybrid peer-to-peer network, and wherein the notifying instructs the language translation component to send audio received from the first endpoint to the inbound port;

sending to the language translation component audio speech input received by the first endpoint from a user of the first endpoint, wherein the audio speech input sent by the first endpoint is in the first spoken language; and

receiving audio speech originating from the second and third endpoints from the outbound port on the bridge, wherein the audio speech received by the first endpoint via the outbound port was sent to the bridge by the second and third endpoints in the second and third spoken languages, respectively, translated into the first spoken language, and then sent to the first endpoint in the first spoken language.

14. The device of claim 13 further comprising instructions for:

identifying that a fourth endpoint is associated with the first spoken language; and

sending the audio speech received from the user of the first endpoint directly to the fourth endpoint without using the bridge.

15. The device of claim 13 further comprising instructions for:

identifying that a fourth endpoint is associated with the first spoken language; and

sending the audio speech received from the user of the first endpoint to the inbound port on the bridge.

16. The device of claim 13 further comprising instructions for sending non-audio data directly to at least one of the second and third endpoints, wherein the non-audio data does not pass through the bridge.

17. The device of claim 13 further comprising instructions for receiving non-audio data directly from at least one of the second and third endpoints, wherein the non-audio data does not pass through the bridge.

18. The device of claim 13 further comprising instructions for directly notifying the second and third endpoints of the inbound and outbound ports, wherein the notifying does not use the bridge.

19. The device of claim 13 further comprising instructions for receiving notifications directly from each of the second and third endpoints of inbound and outbound ports corresponding to the second and third endpoints.

20. The device of claim 13 further comprising instructions for sending an indication to the language translation component that the audio speech input is to be translated into the second and third languages.