METHOD AND SYSTEM FOR VARIABLE KEYWORD PROCESSING BASED ON CONTENT DATES ON A WEB PAGE

• US 20080275877A1
• Filed: 05/04/2007
• Published: 11/06/2008
• Est. Priority Date: 05/04/2007
• Status: Abandoned Application

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Wallenfelt, Brian P., Bates, Cary L.
• Application Number:
  US11/744,235
• Publication Number:
  US 20080275877A1
• Time in Patent Office: Days
• US Class Current: 707/7
• CPC Class Codes: G06F 16/958 Organisation or management of web site content, e.g. publishing, maintaining pages or automatic linking

Abstract

A method for modifying knowledge documents, includes: updating an index based on keyword weights, detecting a page that has not been indexed; parsing the page into structures; associating the structures with dates contained thereof; separating the dates on the page into one or more past and future dates; determining whether the page has undergone changes following the separating of dates; wherein in the event the page has not undergone changes the one or more future dates are checked to determine if one or more of the future dates have become additional past dates, and flagging the structures that contain the one or more additional past dates; and wherein during a keyword analysis of the page the structures associated with the one or more past dates and additional past dates are omitted when determining the keyword weights associated with the page.

Claims

1. A method for updating an index based on keyword weights, the method comprising:

detecting a page that has not been indexed;

parsing the page into structures;

associating the structures with dates contained therein;

separating the dates on the page into one or more past and future dates;

determining whether the page has undergone changes following the separating of dates;

wherein in the event the page has not undergone changes the one or more future dates are checked to determine if one or more of the future dates have become additional past dates, and flagging the structures that contain the one or more additional past dates; and

wherein during a keyword analysis of the page the structures associated with the one or more past additional past dates are omitted when determining the keyword weights associated with the page.

2. The method of claim 1, wherein keywords found in structures associated with the one or more additional past dates are given a smaller weighting than keywords found in structures with future dates that are still current.

3. The method of claim 1, wherein the structures comprise:

a paragraph, a list entry, a table entry, a row.

4. The method of claim 1, wherein the structures are written in hypertext markup language (HTML).

5. The method of claim 1, wherein if the page has undergone changes following the separating of dates, the page is parsed again into structures and the dates are separated into one or more past and future dates.

6. The method of claim 1, wherein the index based on keyword weights is updated on a cyclical basis.

7. The method of claim 1, wherein the method is carried out over one or more of the following:

newsgroups, databases, open directories, computing devices, intranets, and the Internet.

8. The method of claim 1, wherein the pages are web pages.

9. A system for updating an index based on keyword weights, the system comprising:

a series of pages with keywords and dates;

a software tool configured for searching the series of pages for keywords and dates;

wherein the software tool parses the page into structures;

wherein the software tool associates the structures with dates contained therein;

wherein the software tool separates the dates on the page into one or more past and future dates; and

wherein the software tool determines whether the page has undergone changes following the separating of dates;

wherein in the event the page has not undergone changes the one or more future dates are checked to determine if one or more of the future dates have become one or more additional past dates, and flagging the structures that contain the one or more additional past dates; and

wherein the flagged structures are omitted when determining the keyword weights associated with the page.

10. The system of claim 9, wherein keywords found in structures associated with the one or more additional past dates are given a smaller weighting than keywords found in structures with future dates that are still current.

11. The system of claim 9, wherein the structures comprise:

a paragraph, a list entry, a table entry, a row.

12. The system of claim 9, wherein the structures are written in hypertext markup language (HTML).

13. The system of claim 9, wherein if the page has undergone changes following the separating of dates, the software tool parses the page again into structures and the dates are separated into one or more past and future dates.

14. The system of claim 9, wherein the index based on keyword weights is updated on a cyclical basis.

15. The system of claim 9, wherein the software tool is configured for searching the series of pages for keywords and dates in one or more of the following:

newsgroups, databases, open directories, computing devices, intranets, and the Internet.