Method and system for capturing image of web site, managing information of web site, and providing image of web site

• US 8,010,500 B2
• Filed: 03/09/2006
• Issued: 08/30/2011
• Est. Priority Date: 03/10/2005
• Status: Active Grant

• Current Assignee: NHN Corporation
• Original Assignee: NHN Corporation
• Inventors: Chun, Se-Jin, Yoon, Ji-Hun, Lee, Hee-Won
• Primary Examiner(s): Vy; Hung T
• Assistant Examiner(s): CAO, PHUONG THAO
• Application Number:
  US11/817,157
• Publication Number:
  US 20080168085A1
• Time in Patent Office: 2,000 Days
• Field of Search: 707/102, 707/204, 707/667, 707/803, 707/E17.019, 707/999.102
• US Class Current: 707/667
• CPC Class Codes: G06F 16/951 Indexing; Web crawling techniques

Abstract

A website image capturing method includes the steps of: receiving at least one network address from a predetermined website information management system; accessing a website corresponding to the received at least one network address and determining whether a predetermined webpage error occurs in the website; generating image information through a capturing operation with respect to the website, when the webpage error does not occur in the website; generating predetermined access result information in association with the generation of the image information; and transmitting the access result information to the website information management system.

Claims

1. A method of archiving a website image, the method comprising the steps of:

receiving at least one network address for archiving a website;

accessing a website corresponding to the received network address repeatedly at time intervals;

detecting an error in the accessed website in accordance with a predetermined rule;

generating image information associated with the accessed website wherein the image information is generated based, at least in part upon a captured image of at least a portion of the accessed website if no error is detected according to the predetermined rule;

generating access result information in association with the accessed website and the generated image information;

generating a history list for each website accessed; and

storing in the history list the generated access result information in a database for each repeat,

wherein the step of detecting an error comprises the steps of;

checking a size of the website and an internal frame, when a webpage error occurs in the internal frame constituting the website;

calculating a ratio of the size of the internal frame to the size of the website, and when the calculated ratio is within a set numerical value, performing a capturing operation; and

including information associated with the webpage error of the internal frame in the access result information.

2. The method of claim 1, wherein:

an image of the accessed website is not captured and error information is generated, if an error is detected in accordance with the predetermined rule.

3. The method of claim 1, further comprising the steps of:

parsing the accessed website;

analyzing an error or a severity level of the webpage error with respect to the accessed website based, at least in part, upon the parsed information; and

generating analysis information if an error is detected in accordance with the predetermined rule.

4. A method of archiving a web site image, the method comprising the steps of:

receiving at least one network address for archiving a website;

accessing a website corresponding to the received network address repeatedly at time intervals;

detecting an error in the accessed website in accordance with a predetermined rule;

generating image information associated with the accessed website wherein the image information is generated based, at least in part upon a captured image of at least a portion of the accessed website if no error is detected according to the predetermined rule;

generating access result information in association with the accessed website and the generated image information;

generating a history list for each website accessed; and

storing in the history list the generated access result information in a database for each repeat,

wherein the step of detecting an error comprises the steps of;

checking a size of the website and an internal frame, when a webpage error occurs in the internal frame constituting the website;

calculating a ratio of the size of the internal frame to the size of the website, and when the calculated ratio is within a set numerical value, performing a capturing operation;

including information associated with the webpage error of the internal frame in the access result information;

determining a location change of the website through a predetermined validity check with respect to the received network address; and

generating website change information associated with the location change, when the website is changed, and including the website change information in the access result information, and the received network address is updated in a website information management system based on the website change information.

5. The method of claim 4, wherein the step of detecting an error further comprises the steps of:

determining a deletion of the website through a predetermined validity check with respect to the received network address; and

generating website change information associated with the deletion, when the website is deleted, and including the website change information in the access result information, and the received network address is updated in a website information management system based on the web site change information.

6. A method of archiving a website image, the method comprising the steps of:

receiving at least one network address for archiving a website;

accessing a website corresponding to the received network address repeatedly at time intervals;

detecting an error in the accessed website in accordance with a predetermined rule;

generating image information associated with the accessed website wherein the image information is generated based, at least in part upon a captured image of at least a portion of the accessed website if no error is detected according to the predetermined rule;

generating access result information in association with the accessed website and the generated image information;

generating a history list for each website accessed; and

storing in the history list the generated access result information in a database for each repeat,

wherein the step of generating the image information comprises the steps of;

setting a first point in time when a capturing operation is performed, based on a point in time when the website is initially accessed; and

determining whether the set first point in time is earlier than a second point in time when loading of the website is completed,

wherein the capturing operation is not performed if the first point in time is earlier than the second point in time.

7. The method of claim 6,

wherein the step of generating the image information further comprises the steps of:

setting a standard with respect to at least one of a number of colors, a size and a resolution with respect to the image information; and

deleting the image information when at least one of the number of colors, the size, and the resolution with respect to the image information does not satisfy the set standard, and including information associated with the deleting of the image information in the result access information.

8. The method of claim 6,

wherein the step of generating the image information further comprises the step of blocking a pop-up window so as to prevent the pop-up window from being captured.

9. A computer readable storage medium comprising an executable program, which when executed performs the steps of:

maintaining a list of network addresses;

receiving access result information associated with a website associated with a network address included in the list, from a predetermined website image capturing system repeatedly at time intervals;

detecting an error in the accessed website in accordance with a predetermined rule;

generating image information associated with the accessed website wherein the image information is generated based, at least in part upon a captured image of at least a portion of the accessed website if no error is detected according to the predetermined rule;

editing the image information if the image information is included;

generating a history list for each website accessed; and

storing in the history list the edited image information and one or more website identifier for each repeat,

wherein the step of detecting an error comprises the steps of;

checking a size of the website and an internal frame, when a webpage error occurs in the internal frame constituting the website;

calculating a ratio of the size of the internal frame to the size of the website, and when the calculated ratio is within a set numerical value, performing a capturing operation; and

including information associated with the webpage error of the internal frame in the access result information.

10. The computer readable storage medium of claim 9, wherein the access result information includes cause information of why the image information is not included therein and information about inaccessible website or inability to capture the image, if the image information is not included in the access result information.

11. The computer readable storage medium of claim 9, wherein the step of editing the image information determines whether a predetermined standardization about the image information is possible in association with recording in a database, and when the standardization is possible, edits the captured image.

12. The computer readable storage medium of claim 9, wherein the step of storing the edited image information stores the edited image information in a database, in association with at least one of a generation point in time of the image information, a receiving point in time of the access result information, and a recording point in time in the database.

13. The computer readable storage medium of claim 9, wherein the executable program, when executed, further performs the steps of:

receiving a search request associated with a website from a searcher;

extracting at least one image information associated with the website from a database, in response to the received search request;

arranging the extracted image information according to the time information and generating history information of the website; and

providing the searcher with the generated history information, as a result for the search request.

14. A computer readable storage medium comprising an executable program, which when executed performs the steps of:

receiving at least one network address for archiving a website;

accessing a website corresponding to the received network address repeatedly at time intervals;

detecting an error in the accessed website in accordance with a predetermined rule;

generating image information associated with the accessed website wherein the image information is generated based, at least in part upon a captured image of at least a portion of the accessed website if no error is detected according to the predetermined rule;

generating access result information in association with the accessed website and the generated image information; and

storing in a history list the generated access result information in a database for each repeat,

wherein the step of detecting an error comprises the steps of;

checking a size of the website and an internal frame, when a webpage error occurs in the internal frame constituting the website;

calculating a ratio of the size of the internal frame to the size of the website, and when the calculated ratio is within a set numerical value, performing a capturing operation; and

including information associated with the webpage error of the internal frame in the access result information.

15. A system comprising a computer programmed to capture a website image, the computer comprising:

a communication interface configured to receive at least one network address from a predetermined website information management system, and configured to transmit access result information, which is generated in response to the received network address, to a separate history list in the website information management system repeatedly at time intervals for each network address;

an error determination unit configured to access at each time interval a website corresponding to the received network address and configured to detect an error in the accessed website in accordance with a predetermined rule;

an image generation unit configured to generate at each time interval image information associated with the accessed website wherein the image information is generated based, at least in part, upon a captured image of at least a portion of the accessed website if no error is detected according to the predetermined rule; and

an information generation unit configured to generate at each time interval the access result information in association with the accessed website and the generated image information,

wherein the error determination unit is configured to check a size of the website and an internal frame, when a webpage error occurs in the internal frame constituting the website;

to calculate a ratio of the size of the internal frame to the size of the website, and when the calculated ratio is within a set numerical value, perform a capturing operation; and

to include information associated with the webpage error of the internal frame in the access result information.

16. A system of managing website information, the system comprising:

a computer-readable storage medium to store data;

a first database to maintain a list of network addresses on the computer-readable storage medium, the list corresponding to a predetermined website;

a communication interface configured to receive repeatedly at time intervals access result information of a website associated with a network address included in the list, from a predetermined website image capturing system;

an image determination unit configured to determine at each time interval whether the received access result information includes image information associated with a capturing operation with respect to the website, wherein the image information is generated based, at least in part, upon a captured image of at least a portion of the website, if no error is detected according to the predetermined rule;

an image editor configured to edit the image information if the image information is included; and

a second database to record in a history list for each website the edited image information in association with a website identifier identifying the website for each repeat,

wherein the image determination unit is configured to check a size of the website and an internal frame, when a webpage error occurs in the internal frame constituting the website;

to calculate a ratio of the size of the internal frame to the size of the website, and when the calculated ratio is within a set numerical value, perform a capturing operation; and

to include information associated with the webpage error of the internal frame in the access result information.

17. The system of claim 16, further comprising:

an image extraction unit configured to receive a search request associated with the website from a searcher, and in response to the received search request, to extract at least one of the captured image information associated with the website from the second database; and

a history generation unit configured to arrange the extracted image information according to the time information and to generate history information about the website; and

a result providing unit configured to provide the searcher with the generated history information, as a result of the search request.