Associating files of data

• US 6,308,176 B1
• Filed: 04/20/1999
• Issued: 10/23/2001
• Est. Priority Date: 04/24/1998
• Status: Expired due to Fees

• Current Assignee: APR Smartlogik Limited
• Original Assignee: SLG Realisations Plc (Progress Software Corporation)
• Inventors: Bagshaw, Marcus A.
• Primary Examiner(s): Vu, Kim
• Assistant Examiner(s): TRUONG, CAM Y T
• Application Number:
  US09/295,292
• Time in Patent Office: 917 Days
• Field of Search: 707/1-6, 707/10, 709/217
• US Class Current: 707/690
• CPC Class Codes: G06F 16/35 Clustering; Classification
• CPC Class Codes: Y10S 707/99933 Query processing, i.e. searching
• CPC Class Codes: Y10S 707/99936 Pattern matching access

Abstract

Data files are associated with categories by processing said data files in combination with outline files. Large files (221) are divided into a plurality of file sections (223) each having a size substantially consistent with a preferred size. Each of the file sections is categorised (224) and the sets of associations are processed (225) to produce a set of category associations for the original undivided file (221).

Claims

1. Apparatus configured to associate data files of a size greater than a predetermined size with predetermined information categories, comprising:

dividing means configured to divide an input data file into a plurality of file sections having a size substantially consistent with a first preferred size;

categorizing means configured to categorize each of said file sections with respect to the predetermined information categories to produce provisional sets of category associations; and

processing means, configured to process said provisional sets of category associations to produce an output set of category associations for the input data file;

said processing means being configured to remove altogether sections with no associations or with very few associations and to determine whether too few associated sections remain and instruct operation of said dividing means and said categorizing means again with a second preferred size larger than said first preferred size.

2. Apparatus according to claim 1, wherein said dividing means is configured to divide files into file sections each having a size substantially consistent with a preferred size, wherein said preferred size is smaller than said predetermined size.

3. Apparatus according to claim 1, wherein said dividing means is configured to remove tables from a data file before dividing said file into sections.

4. Apparatus according to claim 1, wherein said processing means is configured to determine the desirability to increase size sections, and, if such a determination is made, said dividing means is instructed to increase size sections and repeat the dividing process.

5. Apparatus according to claim 1, including data sources arranged to continually supply data for association.

6. Apparatus according to claim 1, wherein said categorising means is configured to categorise each file section by processing a section in combination with association files.

7. Apparatus according to claim 1, including searching means configured to search categories in response to a user request.

8. Apparatus according to claim 7, including output means configured to supply output information identifying files selected by said search.

26. A computer-readable medium having computer-readable instructions according to claim 1, such that when executing said instructions a computer also performs the step of removing tables from a data file before dividing the file into sections.

9. A method of associating data files of a size greater than a predetermined size with predetermined information categories, comprising the steps of:

dividing an input data file into a plurality of file sections each having a size substantially consistent with a first preferred size;

categorizing each of said file sections with respect to the predetermined information categories to produce provisional sets of category associations; and

processing said provisional sets of category associations to produce an output set of category associations for the input data file;

removing altogether sections with no associations or with very few associations and determining whether too few associated sections remain and dividing and categorizing again with a second preferred size larger than the first preferred size.

10. A method according to claim 9, wherein said preferred size is smaller than said predetermined size.

11. A method according to claim 9, wherein tables are removed from a data file before said file is divided into sections.

12. A method according to claim 9, wherein an assessment is made as to the desirability to increase size sections, whereafter the size of said section are increased and the dividing process is repeated.

13. A method according to claim 9, wherein data files are continually received from data sources.

14. A method according to claim 9, wherein said categorising is performed by processing a data file in combination with association files.

15. A method according to claim 9, wherein categories are searched in response to a user request.

16. A method according to claim 15, wherein information identifying files is generated in response to said search and returned to a requesting user.

17. A computer system programmed to execute stored instructions such that in response to said stored instructions said system is configured to:

divide an input data file into a plurality of file sections having a size substantially consistent with a first preferred size;

categorize each of said file sections with respect to predetermined information categories to produce provisional sets of category associations;

process said provisional sets of category associations to produce an output set of category associations for the input data file; and

remove altogether sections with no associations or with very few associations, determine whether too few associated sections remain and divide and categorize again with a second preferred size larger than the first preferred size.

18. A computer system programmed to execute stored instructions according to claim 17, configured to divide files into file sections each having a size substantially consistent with a preferred size, wherein said preferred size is smaller than said predetermined size.

19. A computer system programmed to execute stored instructions according to claim 17, configured to remove tables from a data file before dividing said file into sections.

20. A computer system programmed to execute stored instructions according to claim 17, configured to determine the desirability to increase size sections and, if such a determination is made, to increase size sections and to repeat the dividing process.

21. A computer system programmed to execute stored instructions according to claim 17, configured to continually supply data for association.

22. A computer system programmed to execute stored instructions according to claim 17, configured to categories each file section by processing a section in combination with association files.

23. A computer system programmed to execute stored instructions according to claim 17, configured to search categories in response to a user request.

24. A computer system programmed to execute stored instructions according to claim 23, configured to supply output information identifying files selected by said search.

25. A computer-readable medium having computer-readable instructions executable by a computer such that, when executing said instructions, a computer will perform the steps of:

dividing an input data file into a plurality of file sections each having a size substantially consistent with a first preferred size;

categorizing each of said file sections with respect to predetermined information categories to produce provisional sets of category associations; and

processing said provisional sets of category associations to produce an output set of category associations for the input data file;

removing altogether sections with no associations or with very few associations and determining whether too few associated sections remain and dividing and categorizing again with a second preferred size larger than the first preferred size.

27. A computer-readable medium having computer-readable instructions according to claim 25, such that when executing said instructions a computer will also perform the steps of assessing the desirability to increase the size of file sections and, where appropriate, increasing the size of said sections and repeating the file division process.

28. A computer-readable medium having computer-readable instructions according to claim 25, such that when executing said instructions a computer will also perform the step of searching categories in response to user requests.

29. A computer-readable medium having computer-readable instructions according to claim 28, such that when executing said instructions a computer will also perform the step of generating information identifying files in response to said search and returning said identifying information to a requesting user.

30. An apparatus configured to associate files of data of a size greater than a predetermined size, comprising:

dividing means configured to divide a file into a plurality of file sections having a size substantially consistent with a preferred size;

categorizing means configured to categorize each of said file sections in combination with association files to produce sets of section associations;

processing means, configured to process said sets of section associations to produce a set of category associations for the original undivided file; and

storage means for storing said association files as outline files.

31. The apparatus of claim 30 wherein each of said stored outline files relates to a respective category.

32. A method of associating files of data of a size greater than a predetermined size, comprising the steps of:

dividing a file into a plurality of file sections each having a size substantially consistent with a preferred size;

categorizing each of said file sections in combination with association files to produce sets of section associations;

processing said sets of section associations to produce a set of category associations for the original undivided file; and

storing the association files as outline files.

33. The method of claim 32 wherein each association file relates to a respective category.

34. A computer system programmed to execute stored instructions such that in response to said stored instructions said system is configured to:

divide a file into a plurality of file sections having a size substantially consistent with a preferred size;

categorize each of said file sections in combination with association files to produce sets of section associations; and

process said sets of section associations to produce a set of category associations for the original undivided file.

35. The computer system of claim 34 wherein the system is configured to store an outline file relating to each category for which association is required.

36. A computer-readable medium having computer-readable instructions executable by a computer such that, when executing said instructions, a computer will perform the steps of:

dividing a file into a plurality of file sections each having a size substantially consistent with a preferred size;

categorizing each of said file sections in combination with association files to produce sets of section associations;

processing said sets of section associations to produce a set of category associations for the original undivided file; and

said association files preferably being stored in the form of outline files.