Cross-language communication between proximate mobile devices

• US 9,053,097 B2
• Filed: 05/04/2012
• Issued: 06/09/2015
• Est. Priority Date: 05/05/2011
• Status: Active Grant

• Current Assignee: Yappn Canada Inc. (Yappn Corp.)
• Original Assignee: Ortsbo Inc. (Axion Ventures, Inc.)
• Inventors: Zivkovic, Aleksandar
• Primary Examiner(s): Spooner, Lamont
• Application Number:
  US13/464,172
• Publication Number:
  US 20120284014A1
• Time in Patent Office: 1,131 Days
• Field of Search: 704/9, 704 2- 8
• US Class Current: 1/1
• CPC Class Codes: G06F 40/58 Use of machine translation, e.g. for multi-lingual retrieval, for server-side translation for client devices or for real-time translation

Abstract

A system facilitates cross-language communication among users of respective wireless communication devices. Two or more mutually-agreeing users establish and participate in a cross-language communication session, without revealing private information, such as their telephone numbers. Once the session has been established, each user enters text into her wireless communication device, and a translated version of the entered text is displayed on a screen of the other user'"'"'s wireless communication device. The text may be entered, such as by typing on a keyboard on the wireless communication device or by speaking inputs into a microphone and automatically recognizing the speech. Optionally, the translated text may be spoken by a speech synthesizer. No permanent information about the participants need be stored in the respective wireless communication devices, so once the communication session ends, no further communication between or among the participants is possible, without establishing another session, thereby preserving each user'"'"'s privacy.

Claims

1. A computer-implemented method for facilitating cross-language communication among users of respective wireless communication devices, the method comprising:

receiving, at a first of the wireless communication devices, a first user input indicating willingness to participate in a cross-language communication session with a second of the wireless communication devices;

receiving, at the second wireless communication device, a second user input indicating willingness to participate in the cross-language communication session with the first wireless communication device;

receiving, at the first wireless communication device, a first signal from a first sensor of the first wireless communication device, other than an antenna;

receiving, at the second wireless communication device, a second signal from a second sensor of the second wireless communication device, other than an antenna;

automatically comparing the first signal to the second signal to determine whether the first signal and the second signal satisfy a similarity criterion;

if the first and second signals satisfy the similarity criterion, automatically establishing the cross-language communication session; and

if the cross-language communication session is established;

after receiving the first and second user inputs, receiving a first user message entered on the first wireless communication device in a first natural language;

automatically generating a translated first user message, including translating the first user message into a second natural language, different than the first natural language; and

outputting the translated first user message on the second wireless communication device.

2. A method according to claim 1, further comprising, as part of the cross-language communication session:

after outputting the translated first user message on the second wireless communication device, receiving a second user message entered on the second wireless communication device;

automatically generating a translated second user message, including translating the second user message into the first natural language; and

outputting the translated second user message on the first wireless communication device.

3. A method according to claim 1, further comprising, during the cross-language communication session:

receiving subsequent first user messages entered on the first wireless communication device;

for each subsequent first user message;

automatically generating a corresponding translated first user message, including translating the subsequent first user message into the second natural language; and

outputting the corresponding translated first user message on the second wireless communication device;

receiving subsequent second user messages entered on the second wireless communication device; and

for each subsequent second user message;

automatically generating a corresponding translated second user message, including translating the subsequent second user message into the first natural language; and

outputting the corresponding translated second user message on the first wireless communication device.

4. A method according to claim 1, wherein automatically generating the translated first user message comprises translating the first user message into the second natural language within the first wireless communication device.

5. A method according to claim 1, wherein automatically generating the translated first user message comprises translating the first user message into the second natural language within the second wireless communication device.

6. A method according to claim 1, wherein automatically generating the translated first user message comprises:

sending a request to a server, distinct from the first and second wireless communication devices, to translate the first user message; and

receiving, from the server, a translation of the first user message into the second natural language.

7. A method according to claim 1, further comprising:

before receiving the first and second user inputs indicating willingness to participate in the cross-language communication session, receiving, by at least one of the first and second wireless communication device, a user input identifying the first natural language; and

responsive to receiving the user input identifying the first natural language, storing, by at least one of the first and second wireless communication device, an indication of the first natural language.

8. A method according to claim 1, further comprising wirelessly communicating at least one of the first user message and the translated first user message from the first wireless communication device directly to the second wireless communication device.

9. A method according to claim 1, further comprising:

wirelessly communicating at least one of the first user message and the translated first user message from the first wireless communication device, via a wireless communication network, to the second wireless communication device; and

wherein generating the translated first user message occurs within at least one of the first and second wireless communication devices.

10. A method according to claim 1, further comprising automatically coordinating establishment of the cross-language communication session by a server, distinct from and wirelessly communicatively coupled to the first and second wireless communication devices, including:

receiving, at the server, information about the first and second user inputs indicating willingness to participate in the cross-language communication session; and

automatically associating the first wireless communication device with the second wireless communication device, based on the similarity of the first and second signals.

11. A method according to claim 10, wherein associating the first with the second wireless communication device comprises automatically selecting the first and second wireless communication devices from among a plurality of wireless communication devices, based on the similarity of the first and second signals.

12. A method according to claim 11, wherein automatically establishing the cross-language communication session comprises establishing the cross-language communication session only if a distance between the first and second wireless communication devices is less than a threshold value.

13. A method according to claim 12, further comprising automatically calculating the threshold value, based on a number of wireless communication devices physically proximate the first wireless communication device.

14. A method according to claim 11, wherein automatically establishing the cross-language communication session comprises establishing the cross-language communication session only if at least a portion of a network addresses of the first wireless communication device is similar to at least a portion of a network address of the second wireless communication devices.

15. A method according to claim 11, wherein:

receiving the first signal comprises receiving an ambient sound signal from a microphone of the first wireless communication device; and

receiving the second signal comprises receiving an ambient sound signal from a microphone of the second wireless communication device.

16. A method according to claim 11, wherein:

receiving the first signal comprises receiving an image signal from a camera of the first wireless communication device; and

receiving the second signal comprises receiving an image signal from a camera of the second wireless communication device.

17. A method according to claim 11, wherein:

receiving the first signal comprises receiving an acceleration signal from an accelerometer of the first wireless communication device; and

receiving the second signal comprises receiving an acceleration signal from an accelerometer of the second wireless communication device.

18. A method according to claim 10, further comprising:

receiving, at the first wireless communication device, a third user input including information about the second wireless communication device; and

wherein

associating the first with the second wireless communication device comprises associating the first with the second wireless communication device, based on the received information about the second wireless communication device.

19. A method according to claim 10, wherein automatically generating the translated first user message comprises translating the first user message into the second natural language by the server.

20. A method according to claim 1, wherein automatically establishing the cross-language communication session comprises establishing the cross-language communication session only if the first wireless communication device is physically proximate the second wireless communication device.

21. A method according to claim 1, further comprising:

recording a time at which the first signal is received;

recording a time at which the second signal is received; and

wherein;

automatically establishing the cross-language communication session comprises establishing the cross-language communication session only if the first and second signals are respectively received by the first and second wireless communication devices within a predetermined amount of time.

22. A method according to claim 1, wherein the first and second signals indicate the first wireless communication device and the second wireless communication device are similarly oriented.

23. A method according to claim 1, wherein first and second signals indicate the first wireless communication device and the second wireless communication device have collided with each other.

24. A method according to claim 1, wherein:

receiving the first signal comprises receiving an ambient sound signal from a microphone of the first wireless communication device; and

receiving the second signal comprises receiving an ambient sound signal from a microphone of the second wireless communication device.

25. A method according to claim 1, wherein:

receiving the first signal comprises receiving an image signal from a camera of the first wireless communication device; and

receiving the second signal comprises receiving an image signal from a camera of the second wireless communication device.

26. A method according to claim 1, wherein:

receiving the first signal comprises receiving an accelerometer signal from an accelerometer of the first wireless communication device; and

receiving the second signal comprises receiving an accelerometer signal from an accelerometer of the second wireless communication device.

27. A method according to claim 1, wherein comparing the first signal to the second signal and automatically establishing the cross-language communication session are performed without revealing to either of the users private information about the other user and without revealing private information to either of the users about the other user'"'"'s wireless communication device.

28. A method according to claim 1, wherein comparing the first signal to the second signal and automatically establishing the cross-language communication session are performed:

leaving no permanent information in either of the wireless communication devices about the user of the other wireless communication device; and

leaving no permanent information in either of the wireless communication devices about the other wireless communication device;

such that, once the cross-language communication session ends, no further cross-language communication between the wireless communication devices is possible, without establishing another cross-language communication session.

29. A method according to claim 1, wherein comparing the first signal to the second signal and automatically establishing the cross-language communication session are performed such that each user'"'"'s privacy is preserved.

30. A system for facilitating cross-language communication among users of respective wireless communication devices, the system comprising:

first and second wireless communication devices, each wireless communication device including a respective;

first user interface configured to receive a respective user input indicating willingness to participate in a cross-language communication session with the other wireless communication device;

second user interface configured to receive a respective user message, after receipt of the user inputs indicating willingness to participate in the cross-language communication session;

third user interface configured to output a respective translated user message; and

sensor, other than an antenna, configured to receive an ambient signal;

a coordination module configured to automatically;

compare the first signal to the second signal to determine whether the first signal and the second signal satisfy a similarity criterion; and

if the first and second signals satisfy the similarity criterion, establish the cross-language communication session;

a first automatic translation module configured, if the cross-language communication session is established, to generate the translated user message by translating the user message received by the first wireless communication device from a first natural language to a second natural language; and

a first transmitter module configured, if the cross-language communication session is established, to wirelessly send, from the first wireless communication device to the second wireless communication device, at least one of the user message received by the first wireless communication device and the translated user message.

31. A system according to claim 30, wherein the coordination module is configured automatically compare the first signal to the second signal to determine whether the first signal and the second signal satisfy a similarity criterion and automatically establish the cross-language communication session, all without revealing to either of the users private information about the other user and without revealing private information to either of the users about the other user'"'"'s wireless communication device.

32. A system according to claim 30, wherein the coordination module is configured automatically compare the first signal to the second signal to determine whether the first signal and the second signal satisfy a similarity criterion and automatically establish the cross-language communication session, all while leaving no permanent information in either of the wireless communication devices about the user of the other wireless communication device and leaving no permanent information in either of the wireless communication devices about the other wireless communication device, such that, once the cross-language communication session ends, no further cross-language communication between the wireless communication devices is possible, without establishing another cross-language communication session.

33. A system according to claim 30, wherein the coordination module is configured automatically compare the first signal to the second signal to determine whether the first signal and the second signal satisfy a similarity criterion and automatically establish the cross-language communication session, such that each user'"'"'s privacy is preserved.

34. A system for facilitating cross-language communication among users of respective first and second wireless communication devices, the first wireless communication device having a first sensor, other than an antenna, configured to receive a first signal from an ambient signal source and the second wireless communication device having a second sensor, other than an antenna, configured to receive a second signal from an ambient signal source, the system comprising:

a server configured to automatically coordinate establishment of a cross-language communication session including the first and second wireless communication devices, the server including;

a session initiation receiver configured to receive information about first and second user inputs, received by the respective first and second wireless communication devices, indicating willingness to participate in the cross-language communication session; and

a coordination module configured to automatically;

compare the first signal to the second signal to determine whether the first signal and the second signal satisfy a similarity criterion; and

if the first and second signals satisfy the similarity criterion, associate the first wireless communication device with the second wireless communication device.

35. A system according to claim 34, wherein the coordination module is configured to select the first and second wireless communication devices from among a plurality of wireless communication devices, based on similarity of the first and second signals, to associate the first wireless communication device with the second wireless communication device.

36. A system according to claim 35, wherein the coordination module is configured to select the first and second wireless communication devices from among a plurality of wireless communication devices, based on physical proximity of the first wireless communication device to the second wireless communication device.

37. A system according to claim 34, wherein the coordination module is configured automatically compare the first signal to the second signal to determine whether the first signal and the second signal satisfy a similarity criterion and automatically establish the cross-language communication session, all without revealing to either of the users private information about the other user and without revealing private information to either of the users about the other user'"'"'s wireless communication device.

38. A system according to claim 34, wherein the coordination module is configured automatically compare the first signal to the second signal to determine whether the first signal and the second signal satisfy a similarity criterion and automatically establish the cross-language communication session, all while leaving no permanent information in either of the wireless communication devices about the user of the other wireless communication device and leaving no permanent information in either of the wireless communication devices about the other wireless communication device, such that, once the cross-language communication session ends, no further cross-language communication between the wireless communication devices is possible, without establishing another cross-language communication session.

39. A system according to claim 34, wherein the coordination module is configured automatically compare the first signal to the second signal to determine whether the first signal and the second signal satisfy a similarity criterion and automatically establish the cross-language communication session, such that each user'"'"'s privacy is preserved.

40. A computer program product for facilitating cross-language communication among users of respective wireless communication devices, the computer program product comprising a non-transitory computer-readable medium having computer readable program code stored thereon, the computer readable program code configured to:

receive, at a first of the wireless communication devices, a first user input indicating willingness to participate in a cross-language communication session with a second of the wireless communication devices;

receive, at the second wireless communication device, a second user input indicating willingness to participate in the cross-language communication session with the first wireless communication device;

receive, at the first wireless communication device, a first signal from a first sensor of the first wireless communication device, other than an antenna;

receive, at the second wireless communication device, a second signal from a second sensor of the second wireless communication device, other than an antenna;

automatically compare the first signal to the second signal to determine whether the first signal and the second signal satisfy a similarity criterion;

if the first and second signals satisfy the similarity criterion, automatically establish the cross-language communication session; and

if the cross-language communication session is established;

after receiving the first and second user inputs, receive a first user message entered on the first wireless communication device in a first natural language;

automatically generate a translated first user message, including translating the first user message into a second natural language, different than the first natural language; and

output the translated first user message on the second wireless communication device.