System and method for hierarchical data distribution

• US 5,721,914 A
• Filed: 09/14/1995
• Issued: 02/24/1998
• Est. Priority Date: 09/14/1995
• Status: Expired due to Fees

• Current Assignee: Verizon Patent and Licensing Incorporated (Verizon Communications Inc.)
• Original Assignee: MCI Incorporated (Verizon Communications Inc.)
• Inventors: DeVries, Larry R.
• Primary Examiner(s): Black, Thomas G.
• Assistant Examiner(s): HO, RUAY L
• Application Number:
  US08/527,901
• Time in Patent Office: 894 Days
• Field of Search: 395/601, 395/611, 395/602, 395/612, 395/613, 395/614, 395/615, 395/616, 395/603, 395/604, 395/605, 395/606, 395/607, 395/608, 395/609, 395/610, 395/670, 395/671, 395/672, 359/118
• US Class Current: 1/1
• CPC Class Codes: G06F 16/27 Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
• CPC Class Codes: G06F 16/275 Synchronous replication

Abstract

The hierarchical data distribution system (HDDS) includes a top level master database system, bottom level client servers, each with its own database copy, and at least one intermediate database level. HDDS is an event driven pusher type system. The entry of update data into the system invokes the distribution process. First, the master database system is updated. Then, the master database system updates several database systems at the first intermediate database level. Each database system at the first intermediate database level then updates several database systems at the next lower database level. This may be a lower level intermediate level or it may be client servers. This process continues until the lowest level database systems, the client servers, have been updated. The distribution process performs any necessary reformatting, data assembly and data view processing before transmitting the update data. Each higher level database system must update fewer lower level servers and overall update performance is improved. If communications to a destination server are not functional, the distribution system detects this immediately because it is unable to establish communications with the destination server. Transitional inconsistency is reduced because the distribution process is invoked for all destination servers at the same time. System resources are not wasted because communications are only established when there is data to be updated.

Claims

1. In a hierarchical distributed computing environment including a plurality of servers arranged in at least three levels of hierarchy, the highest level of hierarchy including at least one highest level server, the lowest level of hierarchy including at least one lowest level server and there being at least one intermediate level of hierarchy including at least one intermediate level server, each server including at least one database, a method for replicating changes effected to a database of said highest level server to databases of servers at the other levels of hierarchy, comprising the steps of:

a) said highest level server, in receipt of a change to a database thereof, transmitting an indicator of said change to at least one server of an intermediate level of hierarchy;

b) said intermediate level server, in receipt of said indicator of said change, entering said change into a database thereof, and thereafter transmitting an indicator of said change to at least one lower level server, and

c) said lower level server, in receipt of said indicator of said change from said intermediate level server, entering said change into a database thereof.

2. The method of claim 1, wherein said highest level server includes a distribution table, said highest level server further performing the step of:

determining an intermediate level server to which an indicator of the change therefrom is to be transmitted by referencing said distribution table.

3. The method of claim 1, wherein said intermediate level server includes a distribution table, said intermediate level server further performing the step of:

determining the servers to which an indicator of said change therefrom is to be transmitted by referencing said distribution table.

4. The method of claim 1, wherein said highest level server further performs the step of:

reformatting said indicator of said change from the format of said highest level server to the format of said intermediate level server, the format being determined by reference to a distribution table.

5. The method of claim 1, wherein said intermediate level server further performs the step of:

reformatting said indicator of said change from the format of said intermediate level server to the format of the server to which the indicator is to be transmitted, the format being determined by reference to a distribution table.

6. The method of claim 1, wherein said highest level server further performs the step of:

assembling said indicator of said change by use of data assembly routines indicated by a distribution table.

7. The method of claim 1, wherein said intermediate level server further performs the step of:

assembling said indicator of said change by use of data assembly routines indicated by a distribution table.

8. The method of claim 1, wherein said highest level server further performs the step of:

assembling said indicator of said change by use of data view routines indicated by a distribution table.

9. The method of claim 1, wherein said intermediate level server further performs the step of:

assembling said indicator of said change by use of data view routines indicated by a distribution table.

10. The method of claim 1, wherein said step (a) further comprises the steps of:

retransmitting said indicator of said change to at least one intermediate level server if the previous transmission was unsuccessful; and

transmitting an indicator of transmission failure if the number of unsuccessful transmissions exceeds a predetermined limit.

11. The method of claim 10, wherein, for said step (b), said highest level server further

saves the indicator of said change and an indicator of the progress of transmission of said indicator of said change;

and

if said highest level server fails, restores the saved indicator of said change and said indicator of the progress of transmission of said indicator of said change after restoration of operation of said highest level server.

12. The method of claim 1, wherein said step (b) further comprises the steps of:

retransmitting said indicator of said change to at least one lower level server if the previous transmission was unsuccessful; and

transmitting an indicator of transmission failure if the number of unsuccessful transmissions exceeds a predetermined limit.

13. The method of claim 12, wherein, for said step (b), said highest level server further

saves the indicator of said change and an indicator of the progress of transmission of said indicator of said change;

and

if said highest level server fails, restores the saved indicator of said change and an indicator of the progress of transmission of said indicator of said change, upon restoration of operation of said highest level server.

14. The method of claim 1, wherein each highest level server and each intermediate level server has a distribution table, data assembly routines indicated by the distribution table and an input queue for receiving an indicator of a change, and wherein, in response to entry of an indicator of said change into said input queue, said each highest level server and each intermediate level server performs the steps of:

referencing its distribution table to determine the at least one server to which an indicator of said change is to be transmitted;

referencing its distribution table to reformat the indicator of said change; and

using the data assembly routines indicated by its distribution table to assemble the indicator of said change.

15. The method of claim 14, wherein each highest level server and each intermediate level server has at least one communication queue for receiving an indicator of said change after said change has been reformatted and assembled, said each server transmitting the indicator of said change from its communication queue in response to receipt of the indicator by the communication queue.

16. A hierarchical distributed computing environment having a hierarchy of at least a highest level and a lowest level, comprising:

at least one highest level server transmitting an indicator of a change to its database to a server at a lower level;

at least one intermediate level server for receiving said indicator of said change from said highest level server and transmitting it to a server at a level lower than the level of said intermediate level server;

at least one lowest level server for receiving said indicator of said change and entering said change to its database; and

a data communications network, coupled to said servers, for communicating data including said indicator of said change and said change between said servers.

17. The hierarchical distributed computing environment of claim 16, wherein said highest level server comprises:

a processor;

a memory, coupled to and accessible by said processor, for storing data to be processed by said processor, said memory including a database in which data is stored;

a data receiver, coupled to said processor, for receiving indicators of changes to be made to data stored in said database;

a database modifier, coupled to said data receiver, for entering modifications to the data in said database according to any received indicator of any change; and

a data transmitter, coupled to said processor and said data communications network, for transmitting said any indicator of said any change from said highest level server to at least one intermediate level server.

18. The hierarchical distributed computing environment of claim 17, wherein said highest level server further comprises:

a distribution table stored in said memory; and

a destination determiner coupled to said distribution table for determining the at least one intermediate level server to which said any indicator of said any change is to be transmitted from said highest level server by reference to said distribution table.

19. The hierarchical distributed computing environment of claim 17, wherein said highest level server further comprises:

a reformatter coupled to said data receiver for reformatting said any indicator of said any change from the format of said highest level server to the format of said one intermediate level server by reference to said distribution table.

20. The hierarchical distributed computing environment of claim 17, wherein said highest level server further comprises:

an indicator assembler for assembling said any indicator of said any change by use of data assembly routines indicated by said distribution table.

21. The hierarchical distributed computing environment of claim 17, wherein said highest level server further comprises:

an input queue, contained in said memory, for receiving said any indicator of said any change; and

an indicator output device, coupled to said input queue, for determining any server to which said any indicator is to be transmitted, reformatting said any indicator and assembling said any indicator in response to entry of said any change into said queue.

22. The hierarchical distributed computing environment of claim 17, wherein said data transmitter of said highest level server is coupled to said database modifier and said one intermediate level server,

wherein said data transmitter repetitively transmits said any indicator of said any change to said one intermediate level server if previous transmissions thereto were unsuccessful, said data transmitter further comprising:

a failure transmitter, coupled to said data transmitter, for transmitting an indicator of transmission failure if the number of unsuccessful transmissions exceeds a predetermined limit.

23. The hierarchical distributed computing environment of claim 17, wherein said intermediate level server comprises:

a processor;

a memory, coupled to and accessible by said processor, for storing data to be processed by said processor, said memory including a database in which data is stored;

a data receiver, coupled to said processor and said data communications network, for receiving indicators of changes to be made to the data in said database;

a database modifier, coupled to said data receiver, for entering modifications to the data in said database according to any received indicator of any change; and

a data transmitter, coupled to said processor and said data communications network for, transmitting said any indicator of said any change from said intermediate level server to at least one server at a level lower than said intermediate level server.

24. The system of claim 23, wherein each highest level server and each intermediate level server comprises:

a distribution table stored in the memory of said server;

data assembly routines, stored in said memory, indicated by said distribution table;

an input queue in said memory for receiving an indicator of any change;

a destination determining device, coupled to said distribution table and said input queue, for determining any server to which said indicator of said any change is to be transmitted by reference to said distribution table, in response to the entry of said any change into said input queue;

a reformatter, coupled to said distribution table and said input queue, for reformatting each indicator by reference to said distribution table, in response to entry of said any change into said input queue; and

an indicator assembler, coupled to said data assembly routines and said input queue, for assembling said indicator of said any change using said data assembly routines indicated by said distribution table in response to the entry of said any change into said input queue.

25. The system of claim 24, wherein said each highest level server and said each intermediate level server further comprises:

a communication queue, coupled to said indicator assembler, for receiving an indicator of said any change after said any change has been reformatted and assembled; and

a data transmitter, coupled to said communication queue, for transmitting said indicator of said any change from said communication queue in response to receipt of said indicator by the communication queue.

26. The hierarchical distributed computing environment of claim 16, wherein said one intermediate level server comprises:

a processor;

a memory, coupled to and accessible by said processor, for storing data to be processed by said processor, said memory including a database in which data is stored;

a data receiver, coupled to said processor and said data communications network, for receiving indicators of changes to be made to the data in said database;

a database modifier, coupled to said data receiver, for entering modifications to the data in said database according to any received indicator of any change; and

a data transmitter, coupled to said processor and said data communications network for, transmitting said any indicator of said any change from said intermediate level server to at least one server at a level lower than said intermediate level server.

27. The hierarchical distributed computing environment of claim 26, wherein said intermediate level server further comprises:

a distribution table stored in said memory; and

a destination determiner coupled to said distribution table for determining the at least one server to which said any indicator of said any change is to be transmitted from said intermediate level server by reference to said distribution table.

28. The system of claim 26, wherein said intermediate level server further comprises:

a reformatter coupled to said data receiver for reformatting said any indicator of said any change from the format of said intermediate level server to the format of said one server to which said any indicator is to be transmitted by reference to said distribution table.

29. The hierarchical distributed computing environment of claim 26, wherein said intermediate level server further comprises:

an indicator assembler for assembling said any indicator of said any change by use of data assembly routines indicated by said distribution table.

30. The hierarchical distributed computing environment of claim 26, wherein said intermediate level server further comprises:

an input queue, contained in said memory, for receiving said any indicator of said any change; and

an indicator output device, coupled to said input queue, for determining any server to which said any indicator is to be transmitted, reformatting said any indicator and assembling said any indicator in response to the entry of a change into the queue.

31. The hierarchical distributed computing environment of claim 26, wherein said data transmitter of said intermediate level server is coupled to said database modifier and said one lower level server, wherein said data transmitter repetitively transmits said any indicator of said any change to said one lower level server if previous transmissions were unsuccessful, said data transmitter further comprising:

a failure transmitter, coupled to said data transmitter, for transmitting an indicator of transmission failure if the number of unsuccessful transmissions exceeds a predetermined limit.

32. The hierarchical distributed computing environment of claim 16, wherein said one lowest level server comprises:

a processor;

a memory, coupled to and accessible by said processor, for storing data to be processed by said processor, said memory including a database in which data is stored;

a data receiver, coupled to said processor and said data communications network, for receiving indicators of changes to be made to the data in said database; and

a database modifier, coupled to said data receiver, for entering modifications to the data in said database according to any received indicator of any change.