Networked architecture for enabling automated gathering of information from Web servers

• US 6,517,587 B2
• Filed: 07/27/1999
• Issued: 02/11/2003
• Est. Priority Date: 12/08/1998
• Status: Expired due to Term

• Current Assignee: Yodlee Incorporated (Envestnet Incorporated)
• Original Assignee: Yodlee.com, Inc. (Envestnet Incorporated)
• Inventors: Satyavolu, Ramakrishna, Inala, Suman Kumar, Rangan, P. Venkat
• Primary Examiner(s): Feild, Joseph H.
• Assistant Examiner(s): Bashore, William L.
• Application Number:
  US09/362,914
• Publication Number:
  US 20020023104A1
• Time in Patent Office: 1,295 Days
• Field of Search: 707/501.1, 707/3, 707/511, 707/102, 707/6, 707/103, 707/5, 709/238, 709/221, 709/203, 709/223, 709/219, 370/357, 715/501.1
• US Class Current: 715/234
• CPC Class Codes: G06F 16/954 Navigation, e.g. using categorised browsing
• CPC Class Codes: G06F 16/957 Browsing optimisation, e.g. caching or content distillation
• CPC Class Codes: G06F 16/958 Organisation or management of web site content, e.g. publishing, maintaining pages or automatic linking
• CPC Class Codes: G06F 21/41 where a single sign-on provides access to a plurality of computers
• CPC Class Codes: G06F 2221/2119 Authenticating web pages, e.g. with suspicious links
• CPC Class Codes: H04L 65/1101 Session protocols
• CPC Class Codes: H04L 67/02 based on web technology, e.g. hypertext transfer protocol [HTTP]
• CPC Class Codes: Y10S 707/99933 Query processing, i.e. searching
• CPC Class Codes: Y10S 707/99935 Query augmenting and refining, e.g. inexact access

Abstract

A data-gathering and reporting system for collecting WEB summaries from the Internet for individual subscribers to a Portal subscription system has a plurality of gatherer servers each connected to the Internet, to an ascending hierarchy of work request distribution servers, and to a ascending hierarchy of collector servers. A work request generator at the top of the hierarchy of distribution servers generates work requests for collecting WEB summaries, and a filer server at the top of the hierarchy of collector servers writes data to a database. Work flow is by work requests from the work request generator down the hierarchy of distributor servers to the gatherer servers, where work requests are accomplished by gathering WEB summaries from Internet servers according to the work requests, and by data collected from the gatherer servers up the hierarchy of collector servers to the filing server.

Claims

1. A data-gathering and reporting system for collecting WEB summaries from the Internet for individual subscribers to a Portal subscription system, comprising:

a plurality of gatherer servers each connected to the Internet, to an ascending hierarchy of work request distribution servers, and to a ascending hierarchy of collector servers;

a work request generator at the top of the hierarchy of distribution servers, generating work requests for collecting WEB summaries; and

a filer server at the top of the hierarchy of collector servers, the file server connected to and writing data to a database;

wherein flow is by work requests from the work request generator down the hierarchy of distributor servers to the gatherer servers where work requests are accomplished by gathering WEB summaries from Internet servers according to the work requests, and by data collected from the gatherer servers up the hierarchy of collector servers to the filing server, and wherein gating of work assignments and data between one server and another in the hierarchy of distributor servers is by the one server having a queue with an adjustable threshold, and demanding data or work assignments from the other server as a result of the queue level falling to the threshold.

2. The system of claim 1 wherein latency and database writing efficiency is adjusted by adjusting queue thresholds among servers.

3. The system of claim 1 wherein server power and capacity required in a system is adjusted by scaling the number of servers and number of hierarchical levels of servers.

4. The system of claim 1 wherein priority is assigned to work assignments, and work assignments and collected data are gated from server to server according to assigned priority as well as by need.

5. The system of claim 1 wherein work assignments are expressed in a markup language, allowing all information required to fill an assignment to be encapsulated such that only the one or more filing servers need be connected to the database.

6. The system of claim 1 wherein some work assignments are automatically scheduled for individual subscribers and some assignments are on demand from individual subscribers.