Method for providing foreign language acquisition and learning service based on context awareness using smart device

• US 9,653,000 B2
• Filed: 12/06/2012
• Issued: 05/16/2017
• Est. Priority Date: 12/06/2011
• Status: Active Grant

• Current Assignee: Joon Sung Wee
• Original Assignee: Joon Sung Wee
• Inventors: Wee, Joon Sung
• Primary Examiner(s): Hillery, Nathan
• Application Number:
  US14/362,718
• Publication Number:
  US 20150010889A1
• Time in Patent Office: 1,622 Days
• CPC Class Codes: G06F 40/58 Use of machine translation, e.g. for multi-lingual retrieval, for server-side translation for client devices or for real-time translation
• CPC Class Codes: G06Q 10/109 Time management, e.g. calendars, reminders, meetings or time accounting
• CPC Class Codes: G09B 19/06 Foreign languages with audible presentation of material to be studied G09B5/04
• CPC Class Codes: G09B 5/065 Combinations of audio and video presentations, e.g. videotapes, videodiscs, television systems

Abstract

According to the method of the present invention for providing a foreign language acquisition and learning service based on context awareness by using a smart device, a service provider server receives user information from a user terminal, extracts foreign language learning content by using the user information, and transmits same to the user terminal, thereby providing the foreign language learning content that is tailored to the context of the user and the information of the user.

Claims

1. A method of providing a context awareness-based foreign language acquisition and learning service using a smart mobile device, the method comprising:

receiving, by a service provision server, user information from the smart mobile device;

receiving, by the service provision server, real world event information from an electronic scheduler of a user of the smart mobile device in response to a request from the smart mobile device;

generating, from electronic storage, foreign language learning content based on the received real world event information as context information of the user and using the received user information, the foreign language learning content being in a language foreign to the user;

receiving, from the smart mobile device, setting information specifying times and frequency at which the foreign language learning content is to be transmitted to the smart mobile device,

transmitting at the specified times and frequency, using a network, the extracted foreign language learning content as a push message to the smart mobile device, and

presenting in real time, in a language foreign to the user, an augmented reality overlay including a 3D virtual object overlaid on a real world image, the augmented reality overlay including a plurality of characters providing foreign language learning content as an exemplary dialogue between the plurality of characters based on a current location of the user of the smart mobile device,

wherein the plurality of characters and dialogue are overlaid on an image of the current location of the user, the image captured by a camera of the smart mobile device, and wherein the smart mobile device comprises a smart mobile device on which an application program for receiving and outputting the foreign language learning content has been installed,

wherein the generated foreign language learning content is based on a current location of the user, and

wherein the generated foreign language learning content is designed to be presented as a dialogue of a character presented at the smart mobile device.

2. The method of claim 1, wherein the user information comprises an age, gender, vocation, foreign language level, hobby or field of interest of the user.

3. The method of claim 1, wherein the context information comprises time information, issue information, theme information, event information received from the smart mobile device, surrounding environment information, or location information received from the smart mobile device.

4. The method of claim 1, wherein the setting information comprises a degree of difficulty, quantity, type or content of the foreign language learning content.

5. The method of claim 1, wherein the generating comprises generating the foreign language learning content for presentation via virtual reality or multimedia.

6. The method of claim 1, wherein the generating of the foreign language learning content comprises generating the foreign language learning content using the setting information.

7. The method of claim 1, wherein the push message comprises a schedule alarm notification.

8. The method of claim 1, further comprising:

transmitting, by the service provision server, at least a portion of the generated foreign language learning content to a social network service of the user.

9. The method of claim 1, wherein the generated foreign language learning content is not a translation of any foreign language input received by the smart mobile device.

10. The method of claim 1, further comprising:

transmitting a message to the smart mobile device recommending a friend of the user to join a scheduled event.

11. The method of claim 1, wherein the generated foreign language learning content comprises a word.

12. The method of claim 1, wherein the generated foreign language learning content comprises an idiomatic phrase.

13. The method of claim 1, further comprising:

receiving from the smart mobile device, an indication that a portion of the generated foreign language learning content is to be added to a word list associated with the user.

14. The method of claim 1,

wherein the augmented reality overlay is based on one or more of season information, traffic conditions, and emotion information.

15. A system for providing a context awareness-based foreign language acquisition and learning service using a smart mobile device, the system comprising:

a service provision server communicatively coupled to a network, and

a memory containing stored executable instructions,

wherein the service provision server comprises one or more computer processors which execute the stored executable instructions for;

receiving user information from the smart mobile device,

receiving real world event information from an electronic scheduler of a user of the smart mobile device in response to a request from the smart mobile device,

receiving, from the smart mobile device, setting information specifying times and frequency at which the foreign language learning content is to be transmitted to the smart mobile device,

generating, from electronic storage, foreign language learning content based on the received real world event information as context information of the user and using the received user information, the foreign language learning content being in a language foreign to the user,

transmitting at the specified times and frequency, using the network, the extracted foreign language learning content as a push message to the smart mobile device, and

presenting in real time, in a language foreign to the user, an augmented reality overlay including a 3D virtual object overlaid on a real world image, the augmented reality overlay including a plurality of characters providing foreign language learning content as an exemplary dialogue between the plurality of characters based on a current location of the user of the smart mobile device, and

wherein the plurality of characters and dialogue are overlaid on an image of the current location of the user, the image captured by a camera of the smart mobile device,

wherein the generated foreign language learning content is based on a current location of the user, and

wherein the generated foreign language learning content is designated to be presented as a dialogue of a character presented at the smart mobile device.

16. An article of manufacture for providing a context awareness-based foreign language acquisition and learning service using a smart mobile device, the article of manufacture comprising:

at least one non-transitory computer processor readable storage medium; and

instructions stored on the at least one non-transitory computer processor readable storage medium,

wherein the instructions are readable from the at least one non-transitory computer processor readable storage medium by at least one computer processor and thereby cause the at least one computer processor to operate so as to;

receive user information from the smart mobile device,

receive real world event information from an electronic scheduler of a user of the smart mobile device in response to a request from the smart mobile device,

receive, from the smart mobile device, setting information specifying times and frequency at which the foreign language learning content is to be transmitted to the smart mobile device,

generate, from electronic storage, foreign language learning content based on the received real world event information as context information of the user and using the received user information, the foreign language learning content being in a language foreign to the user,

transmit at the specified times and frequency, using a network, the extracted foreign language learning content as a push message to the smart mobile device, and

present in real time, in a language foreign to the user, an augmented reality overlay including a 3D virtual object overlaid on a real world image, the augmented reality overlay including a plurality of characters providing foreign language learning content as an exemplary dialogue between the plurality of characters based on a current location of the user of the smart mobile device, and

wherein the plurality of characters and dialogue are overlaid on an image of the current location of the user, the image captured by a camera of the smart mobile device,

wherein the generated foreign language learning content is based on a current location of the user, and

wherein the generated foreign language learning content is designed to be presented as a dialogue of a character presented at the smart mobile device.