System and method for adapting an internet filter

• US 7,194,464 B2
• Filed: 12/07/2001
• Issued: 03/20/2007
• Est. Priority Date: 12/07/2001
• Status: Expired due to Term

• Current Assignee: Forcepoint LLC
• Original Assignee: Forcepoint LLC
• Inventors: Lee, Chris, Ruskin, Dan, Anderson, Mark, Kester, Harold
• Primary Examiner(s): Rimell; Sam
• Assistant Examiner(s): OHBA, MELLISSA M
• Application Number:
  US10/017,750
• Publication Number:
  US 20030110168A1
• Time in Patent Office: 1,929 Days
• Field of Search: 707 1- 10, 707/104.1, 707/201, 709/203, 709/217, 709/225, 709/229, 713201-202
• US Class Current: 1/1
• CPC Class Codes: G06F 16/951 Indexing; Web crawling techniques
• CPC Class Codes: H04L 63/0227 Filtering policies mail message filtering H04L51/212
• CPC Class Codes: Y10S 707/99936 Pattern matching access

Abstract

A system and method for updating a filtering system which controls access to a website/page between a local area network (LAN) and an Internet. The LAN includes an Internet gateway system coupled to a workstation and configured to receive a URL request. The system controls access to the website/page associated with the URL based on one or more categories that are associated with the URL. The Internet gateway system can determine the category that is associated with the URL by referencing a master database or requesting the category from a database factory. The database factory can receive URLs from multiple Internet gateway systems. The database factory determines whether the identifier was previously categorized by the database factory and provides the category to the Internet gateway system. Once the Internet gateway system has the category, it applies rules associated with the category and user to filter access to the requested website/page.

Claims

1. A system for collecting identifiers for updating a filtering system which controls access to a wide area network (WAN) of websites/pages, comprising:

a master database including one or more identifiers received from a user to request access to an Internet website/page, and one or more categories associated with each of the one or more identifiers;

an access system coupled to the WAN and configured to send an identifier request if the identifier request is not in the master database; and

a database factory configured to receive the identifier request, select one or more categories to associate with the identifier request if the one or more categories were not previously associated with the identifier, and provide the selected one or more categories to the master database.

2. The system of claim 1, wherein the access system comprises an Internet gateway system coupled to a filter system.

3. The system of claim 2, wherein the identifier is a uniform resource locator (URL).

4. The system of claim 2, wherein the identifier is an Internet Protocol (I.P.) address.

5. The system of claim 2, wherein the identifier is a domain name.

6. The system of claim 2, wherein the master database includes a request frequency that is associated with the identifier and indicative of the frequency of requests for the identifier at the filter system.

7. The system of claim 6, wherein the database factory is configured to receive the request frequency to prioritize the received identifiers.

8. A method for collecting collection data for updating a filtering system which controls access to Internet sites, the method comprising:

receiving a request from a user in the form of an identifier to access a website/page;

determining whether the identifier is stored in a master database of categorized identifiers;

if the identifier is stored, recalling a category that is associated with the identifier and applying a rule to the identifier that is associated with the category;

if the identifier is not stored, determining whether the identifier is stored in an uncategorized database; and

if the identifier is not stored in the uncategorized database, posting the identifier to the uncategorized database, else updating an uncategorized database request frequency associated with the identifier.

9. The method of claim 8, further comprising:

updating a master database request frequency in the master database if the identifier is stored in the master database.

10. The method of claim 8, further comprising:

pre-filtering the identifier and/or website/page associated with the identifier for data characteristics that are indicative of one or more categories;

determining whether data characteristics were found during the pre-filtering; and

if data characteristics were found, associating one or more indicators with the identifier in the uncategorized database.

11. The method of claim 10, wherein the rule blocks access to the website/page based on the category associated with the identifier and the user.

12. The method of claim 10, wherein the rule allows access to the website/page based on the category associated with the identifier and the user.

13. The method of claim 10, wherein the identifier is a uniform resource locator (URL).

14. The method of claim 10, wherein the identifier is an Internet Protocol (I.P.) address.

15. The method of claim 10, wherein the identifier is a domain name.

16. The method of claim 10, wherein the uncategorized database further includes additional data associated with the identifier.

17. The method of claim 16, wherein the additional data includes a trace ID.

18. The method of claim 16, wherein the additional data includes a primary language used by the filter system.

19. The method of claim 16, wherein the additional data includes the uncategorized database request frequency.

20. The method of claim 10, wherein the master database further includes additional data associated with the identifier.

21. The method of claim 20, wherein the master database further includes the master database request frequency.

22. A method for adapting a filter system which controls access to Internet sites, the method comprising:

receiving a request from a user in the form of an identifier to access a website/page;

determining whether the identifier is in a master database of categorized identifiers and one or more categories associated with the identifier;

if the identifier is not in the master database, determining whether the identifier is in an uncategorized database, else applying one or more rules to the one or more categories associated with the identifier;

if the identifier is not in the uncategorized database, posting the identifier to the uncategorized database, else updating an uncategorized database request frequency in the uncategorized database that is associated with the identifier;

uploading the uncategorized database to a database factory;

determining whether each identifier has been previously categorized by the database factory;

for each identifier that was not previously categorized, categorizing each identifier and/or a website/page associated with the identifier to select one or more categories to associated with each identifier; and

posting each identifier along with its selected one or more categories into a database of categorized sites; and

downloading the database of categorized sites to the filter system for incorporation into the master database.

23. The method of claim 22, further comprising:

updating a master database request frequency in the master database if the identifier is in the master database; and

uploading the master database request frequency and the associated identifier to the database factory.

24. The method of claim 22, wherein the one or more rules include blocking access to the website/page based on the one or more categories associated with the identifier and the user.

25. The method of claim 22, wherein the one or more rules include allowing access to the website/page based on the one or more categories associated with the identifier and the user.

26. The method of claim 22, wherein the uncategorized database further includes additional data associated with the identifier.

27. The method of claim 26, wherein the additional data includes a request frequency.

28. The method of claim 26, wherein the additional data includes an indicator.

29. The method of claim 26, wherein the additional data includes a trace ID.

30. The method of claim 26, wherein the additional data includes a primary language used by the filter system.

31. The method of claim 26, further comprising merging and sorting the uncategorized database based on each identifier and the additional data associated with each identifier.

32. The method of claim 26, further comprising:

pre-filtering the identifier and/or website/page associated with the identifier for data characteristics that are indicative of the one or more categories; and

associating one or more indicators with the identifier.

33. The method of claim 32, wherein the pre-filtering is performed on text strings, graphics, and audio that are associated with the identifier and or website/page associated with the identifier.

34. The method of claim 32, wherein the one or more indicators can include a category flag.

35. The method of claim 34, further comprising screening the identifier using the one or more indicators prior to sending the identifier to the database factory.

36. The method of claim 35, wherein the identifier is a uniform resource locator (URL).

37. The method of claim 35, wherein the identifier is an Internet Protocol (I.P.) address.

38. The method of claim 35, wherein the identifier is a domain name.

39. A system for collecting identifiers for updating a filtering system which controls access to Internet websites/pages between a local area network and an Internet, comprising:

a workstation configured for a user to send an identifier to request an Internet website/page;

an Internet gateway system coupled to the workstation and configured to receive the identifier and to allow or deny access to the Internet website/page associated with the identifier;

a master database of identifiers along with one or more categories associated with each identifier;

a filter system coupled to the Internet gateway system and configured to receive the identifier from the Internet gateway system, determine whether the identifier is in the master database, send the identifier to a database factory if the identifier is not in the master database, and apply one or more rules to one or more categories that are associated with the identifier, wherein the one or more categories are received from the database factory; and

a database factory configured to receive the identifier from the filter system if the identifier was not in the master database, determine whether the identifier was previously categorized by the database factory, if the identifier was not previously categorized, determine the one or more categories to associate with the identifier and provide the one or more categories to the filter system, else provide the one or more categories that were previously associated with the identifier.

40. The system of claim 39, wherein the identifier is in the master database and is associated with the one or more categories.

41. The system of claim 39, wherein the filter system is further configured to pre-filter the identifier and/or the Internet website/page associated with the identifier for a data characteristic that is indicative of the one or more categories, and associating one or more indicators with the identifier.

42. The system of claim 41, wherein pre-filtering can be performed on text strings, graphics, and audio that are associated with the identifier and/or the Internet website/page.

43. The system of claim 41, wherein the one or more indicators can include a category flag.

44. The system of claim 43, wherein the filter system uses the one or more indicators to screen the identifier prior to sending the identifier to the database factory.

45. The system of claim 39, wherein the Internet gateway system comprises:

a firewall module configured to provide an electronic boundary between the workstation and the Internet; and

a router module configured to find a best path from the firewall module to the Internet website/page associated with the identifier.

46. The system of claim 45, wherein the filter system comprises:

a management module configured to provide an interface for a system administrator to select the one or more rules that are applied to the one or more categories associated with the identifier;

an uncategorized database configured to store the identifier if the identifier is not in the master database; and

an upload/download manager module configured to send the stored identifier to the database factory and to receive the one or more categories from the database factory.

47. The system of claim 46, wherein the uncategorized database includes a request frequency that is associated with the identifier and indicates the frequency of requests for the identifier in the uncategorized database.

48. The system of claim 47, wherein the upload/download manager module is configured to send the request frequency from the uncategorized database to the database factory.

49. The system of claim 48, wherein the master database includes a request frequency that is associated with the identifier and indicates the frequency of requests for the identifier in the master database.

50. The system of claim 49, wherein the upload/download manager module is configured to send the request frequency from the master database to the database factory.

51. The system of claim 46, wherein the one or more rules include blocking access to the Internet website/page based on the one or categories associated with the identifier and the user.

52. The system of claim 46, wherein the one or more rules include allowing access to the Internet website/page based on the one or categories associated with the identifier and the user.

53. The system of claim 39, wherein the database factory comprises:

an upload/download module configured to receive the identifier from the filter system and provide the one or more categories to the filter system;

an identifier processing module configured to receive the identifier from the upload/download module and determine whether the identifier has been previously categorized by the database factory;

a categorization system module configured to categorize the identifier if not previously categorized by the database factory; and

a database of categorized identifiers configured to store the identifier and the one or more categories.

54. The system of claim 53, wherein the upload/download module is configured to receive a request frequency from the filter system to prioritize the identifier.

55. The system of claim 54, wherein the request frequency is associated with the identifier and indicates the frequency of requests for the identifier in the uncategorized database.

56. The system of claim 54, wherein the request frequency is associated with the identifier and indicates the frequency of requests for the identifier in the master database.

57. The system of claim 53, wherein the identifier is a uniform resource locator (URL).

58. The system of claim 53, wherein the identifier is an Internet Protocol (I.P.) address.

59. The system of claim 53, wherein the identifier is a domain name.

60. The system of claim 53, further comprising:

a second filter system; and

a second Internet gateway system coupled to the second filter system and the database factory.

61. The system of claim 60, wherein the identifier processing module is further configured to merge and sort the identifier and a second identifier received from the second Internet gateway system.