Data warehouse system and query processing method used in the system, and data collecting method and apparatus for the method, and charging method and apparatus in the system

• US 20060253435A1
• Filed: 07/13/2006
• Published: 11/09/2006
• Est. Priority Date: 11/11/1998
• Status: Abandoned Application

• Current Assignee: Itaru Nishizawa, Kazutomo Ushijima, Shigekazu Inohara, Shinji Fujiwara
• Original Assignee: Itaru Nishizawa, Kazutomo Ushijima, Shigekazu Inohara, Shinji Fujiwara
• Inventors: Fujiwara, Shinji, Ushijima, Kazutomo, Nishizawa, Itaru, Inohara, Shigekazu
• Application Number:
  US11/485,272
• Publication Number:
  US 20060253435A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/24524 Access plan code generation and invalidation; Reuse of access plans
• CPC Class Codes: G06F 16/25 Integrating or interfacing systems involving database management systems
• CPC Class Codes: G06F 16/27 Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
• CPC Class Codes: Y10S 707/99952 Coherency, e.g. same view to multiple users

Abstract

In order to realize a practical data warehouse system with the use of a network in a distributed environment, for example, data collectors for creating/managing each replica of server data for clients shown in FIG. 1 are connected to a network. A data collector holds a data request condition given from a user via a client and negotiates with a server which supplies data according to such resources as a storage unit, a CPU, etc., usable by the data collector, thereby the range and quality of the data for which a replica is to be created can be adjusted. For query processing, a part or the whole of a query from a client is processed with the use of a replica created in the data collector. Queries which cannot be processed with any replica in the data collector are transferred to the server. Because a replica created in the data collector can be used to process a query from a client in such a way, the server load can be reduced.

Claims

1. (canceled)

2. A data warehouse system, comprising:

a plurality of client devices, each for accepting a processing request from each user thereof;

a server provided with a file system and used for searching said file system according to access requests from said client devices;

a data collector, which is separate from said server and associated with said client devices and is provided with a storage device, for collecting data requested by users of said client devices and storing the data into said storage devices as a replica which is partially replicating said file system; and

a network for connecting said client devices to said server respectively via said data collector,

wherein said data collector comprises;

a replica creation control means for determining whether a new replica of said file system is to be created and stored in said storage device, in response to a replica creation request from one of said client devices, by referring to a replica management table which holds at least a data range and a data updating interval of each replica stored in the storage device,

a query analysis unit for analyzing a query processing request from one of said client devices to select, as an object to be searched, a replica stored in said storage device or said file system,

a query processing unit for searching said replica stored in said storage device according to a query analysis result from said query analysis unit, and

a communication control unit for selecting a procedure for accessing said server according to said query analysis result, and

wherein said server comprises;

a communication control unit for receiving said query analysis result transmitted from said data collector.

4. A data warehouse system according to claim 2, wherein said replica management table further holds addition replica descriptions including a data range, a data updating interval and a location of each replica stored in the storage device of cooperative data collectors, and

wherein said replica creation control means determines whether a new replica of said file system is to be created and stored or not, by referring to addition replica description.

6. A data warehouse system according to claim 4, wherein said new data includes at least sampling of data in related databases, extraction of each field, creation of a summary for text data, extraction of each keyword, lossless/lossy compression of still image data, extraction of each frame, reduction of colors, reduction of resolution, contraction in size, reduction of frames of dynamic picture image data, compression of picture image data in each frame, sound quality adjustment for voices, and conversion to character data.

3. A data warehouse system, comprising:

a plurality of client device, each for accepting a processing request from each user thereof;

a server provided with a file system and used for searching said file system according to access requests from said client devices;

a plurality of data collectors, which are separate from said server and each data collector being associated with at least one of said client devices and each being provided with a storage device, each for collecting data requested by a corresponding user and storing the data into said storage devices as a replica partially replicating said file system; and

a network for connecting said client devices to said server respectively via an associated data collector,

wherein each of said data collectors comprises;

a replica creation control means for determining whether a new replica of said file system is to be created and stored in said storage device, in response to a replica creation request from a corresponding client device, by referring to a replica management table which holds replica descriptions at least including a data range and a data updating interval of each replica stored in the storage device,

a query analysis unit for analyzing a query processing request from one of said client devices to select, as an object to be searched, a replica stored in said storage device according to a query analysis result term from said query analysis unit,

a query processing unit for searching said replica stored in said storage device according to a query analysis result from said query analysis unit, and

a communication control unit for selecting a procedure for accessing said server according to said query analysis result, and

wherein said server comprises;

a communication control unit for receiving said query analysis result transmitted from said data collector.

5. A data warehouse system, comprising:

a plurality of client devices, each for accepting a processing request from each user thereof;

at least one server provided with a database or a file system and used for searching said database or file system according to access requests from said client devices;

a data collector, which is separate from said servers and associated with said client devices and is provided with a storage device, for collecting data requested by users of said client devices and storing the data into said storage devices as new data created from said database or file system; and

a network for connecting said client devices to said server respectively via said data collector.