System for Compiling Word Usage Frequencies

• US 20090063478A1
• Filed: 11/13/2008
• Published: 03/05/2009
• Est. Priority Date: 01/13/2005
• Status: Active Grant

• Current Assignee: Kyndryl Incorporated
• Original Assignee: International Business Machines Corporation
• Inventors: Chen, Yen-Fu, Dunsmoir, John W.
• Granted Patent: US 8,543,373 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 40/216 using statistical methods
• CPC Class Codes: G09B 19/06 Foreign languages with audible presentation of material to be studied G09B5/04
• CPC Class Codes: G10L 15/183 using context dependencies, e.g. language models

Abstract

A system for assisting a user who is learning a language to prioritize words to be learned in order of usage frequency is disclosed. A frequency determination program running on a computer determines the frequency of usage of each word at a list of locations provided by the user. Different algorithms to identify what constitutes a word are employed depending upon the language of the source data. The total number of words at each location and their usage frequency found during the user session, along with a total number of words and their usage frequency for all user sessions performed regardless of location, are calculated and made available to the user. The user can view usage frequencies for words from a single location, a group of locations, or all user sessions performed.

Claims

1-15. -15. (canceled)

16. A system for compiling word usage frequencies comprising:

a processor;

memory connected to said processor;

a frequency determination program loaded into said memory and operable by said processor;

an analyze graphic-based data program loaded into said memory and operable by said processor;

an analyze alphabet-based data program loaded into said memory and operable by said processor;

a calculate results program loaded into said memory and operable by said processor;

a graphic dictionary loaded into said memory and operable by said processor;

a list of punctuation marks and spaces loaded into said memory and operable by said processor;

a list of locations loaded into said memory and operable by said processor;

a character list loaded into said memory and operable by said processor;

a location word list loaded into said memory and operable by said processor; and

an overall word list loaded into said memory and operable by said processor.

17. The system of claim 16, wherein said frequency determination program instructs said processor to read said list of locations, determine whether each location is graphic based or alphabet based, execute said graphic-based data program for said locations that are graphic based, execute said alphabet-based data program for said locations that are alphabet based, execute said calculate results program, display an output from said calculate results program, and combine said location word list with said overall word list to record the frequency of all words ever found by said frequency determination program.

18. The system of claim 16, wherein said determination if said words at said locations are graphic based or alphabet based uses Unicode encoding of said words at said locations.

19. The system of claim 16, wherein said locations are selected from the group consisting of documents, electronic mail, and websites having hyperlinks.

20. The system of claim 16, wherein said graphic-based data program populates said location word list with each unique word found at each of said graphic based locations and a number of times said word is present by matching a string of characters to said graphic dictionary.

21. The system of claim 16, wherein said alphabet-based data program populates said location word list with each unique word found at each of said alphabet-based locations and a number of times said word is present by locating a string of characters located between characters listed in said list of punctuation marks and spaces.

22. The system of claim 16, wherein said calculate results program calculates word usage frequencies as a ratio and a percentage for each location.

23. The system of claim 16, wherein said calculate results program calculates word usage frequencies as a ratio and a percentage across all locations.

24. The system of claim 17, wherein said output from said calculate results program is user-configurable to be displayed by individual location, a group of locations, or as a total of all locations.

25. The system of claim 16 further comprising a user interface wherein the user provides a location and a depth.

26-32. -32. (canceled)