Distributed system for communication networks in multi-user applications

• US 5,841,980 A
• Filed: 05/15/1996
• Issued: 11/24/1998
• Est. Priority Date: 05/15/1996
• Status: Expired due to Term

• Current Assignee: Sony Interactive Entertainment LLC (Sony Group Corp.)
• Original Assignee: RTIME, Inc. (Sony Group Corp.)
• Inventors: Waters, Rolland M., Allred, John
• Primary Examiner(s): Rinehart, Mark H.
• Application Number:
  US08/648,839
• Time in Patent Office: 923 Days
• Field of Search: 395/200.34, 395/200.35, 395/200.31, 395/200.33, 395/200.38, 395/200.47, 395/200.48, 395/200.57, 395/200.66, 395/182.02, 370/328, 370/432, 370/312, 455/435, 455/449, 465/42, 345/330, 345/331, 707/201, 463/42
• US Class Current: 709/204
• CPC Class Codes: H04L 67/10 in which an application is distributed across nodes in the network software deployment G06F8/60; multiprogramming arrangements G06F9/46
• CPC Class Codes: H04L 67/131 Protocols for games, networked simulations or virtual reality
• CPC Class Codes: H04L 67/30 Profiles
• CPC Class Codes: H04L 69/329 in the application layer [OSI layer 7]
• CPC Class Codes: H04L 9/40 Network security protocols
• CPC Class Codes: Y10S 707/99952 Coherency, e.g. same view to multiple users

Abstract

The present invention is directed to overcoming bandwidth limitations of network backbones to allow for true national participation in multi-user applications across a large-scale network. Three techniques are used to minimize the amount of backbone loading: (1) A fully distributed system architecture is described that retains national participation in each application environment by allocating resources among responsible servers at remote locations; (2) Multiple zones of interest are defined within an application environment so that only relevant data applicable to each participant within a given application environment is transmitted across the network backbone; and (3) Seamless multi-server management is described that provides interaction across application environment regional boundaries without sacrificing continuity among participants or increasing the number of postcards transmitted. The present invention therefore provides a distributed system that offers multi-user applications nationwide interaction among participants within the present bandwidth limitations of existing network backbones.

Claims

1. In a distributed system comprising a plurality of servers interconnected by a network backbone, each server hosting at least one local client, and each local client having at least one local participant, a method for allowing a plurality of participants to participate in a multi-user application, the multi-user application including a distributed global application environment comprising a plurality of local application environments, each local application environment residing on an associated server, each local application environment comprising a plurality of parameters relating to a local participant, the method for each server comprising:

(a) receiving local participant information from a local client regarding a local participant, the local participant information comprising a change in a parameter of the local application environment;

(b) evaluating the local participant information based on relevance of the parameter to other local participants to determine the number and identity of local participants interested in the local participant information;

(c) copying the local participant information for every local participant interested in the information;

(d) copying the local participant information for every other server in the distributed system;

(e) distributing by the local server a copy of the local participant information to every local participant interested in the information;

wherein distribution of the local participant information is restricted to local participants interested in the local participant information; and

(f) distributing by the local server a copy of the local participant information to every other server in the distributed system, but not distributing by the local server a copy of the local participant information to any remote participant to thereby reduce the number of copies of local participant information being distributed to participants.

2. A distributed system for use in a communication network to reduce bandwidth loading along a network backbone in a multi-user application, comprising:

(a) a communication network backbone; and

(b) a local server connected to at least one remote server by the network backbone, each server having a plurality of associated participants to the multi-user application, wherein each server administers the multi-user application with respect to its associated participants by maintaining data related to the multi-user application relevant to each associated participant at the local server and communicating data to each remote server, said administration comprising;

(i) receiving, at the local server, local participant information associated with participants administered by the local server;

(ii) copying the local participant information for other participants administered by the local server;

(iii) copying the local participant information for remote servers;

(iv) distributing by the local server a copy of the local participant information to other local participants administered by the local server;

(v) distributing by the local server a copy of the local participant information to each remote server, but not distributing by the local server a copy of the local participant information to any remote participant to thereby reduce the number of copies of local participant information being distributed to participants;

(vi) receiving, from a remote server, remote participant information associated with participants administered by the remote server;

(vii) copying the remote participant information for local participants administered by the local server; and

(viii) distributing by the local server a copy of the remote participant information to each local participant administered by the local server.

3. The distributed system of claim 2, wherein data is transmitted among servers over said network backbone using a multicast protocol.

4. The distributed system of claim 2, wherein data is transmitted among servers over said network backbone using a point-to-point protocol.

5. A method for allowing a plurality of participants to participate in an application environment of a distributed multi-user application in a system having at least one local server and at least one remote server interconnected by a network having a finite bandwidth, each server having at least one participant in the multi-user application for which it administers the multi-user application, comprising:

(a) receiving, by the local server, local participant information from participants administered by the local server;

(b) copying the local participant information for other participants administered by the local server;

(c) copying the local participant information for remote servers;

(d) distributing by the local server a copy of the local participant information to each of the other participants administered by the local server;

(e) distributing by the local server a copy of the local participant information to each of the remote servers, but not distributing by the local server a copy of the local participant information to any remote participant to thereby reduce the number of copies of local participant information being distributed to participants;

(f) receiving, by the local server, remote participant information associated with participants administered by the remote server;

(g) copying the remote participant information for participants administered by the local server; and

(h) distributing by the local server a copy of the remote participant information to each participant administered by the local server.

6. The method of claim 5, wherein the distributed system maintains a global timebase and the local participant information includes a timestamp associated with each participant'"'"'s information related to the global timebase that is used to extrapolate current participant status to other participants to the multi-user application in the distributed system.

7. The method of claim 5 wherein a plurality of zones of interest are defined within the application environment, and wherein:

(a) the step of copying the local participant information for other participants administered by the local server comprises;

(i) evaluating local participant information according to zones of interest;

(ii) determining which local participants are interested in the local participant information;

(iii) prioritizing local participant information based on relevance of the information to other participants administered by the local server;

(iv) filtering local participant information based on priority and according to network bandwidth limitations so as to optimize network bandwidth utilization; and

(v) copying the filtered local participant information for interested participants administered by the local server; and

(b) the step of distributing the local participant information to other participants administered by the local server comprises distributing the local participant information to all participants administered by the local server interested in the local participant information.

8. The method of claim 7, wherein:

(a) the zones of interest in the application environment contain at least one object having object characteristics; and

(b) the step of evaluating local participant information according to zones of interest comprises distinguishing between the object characteristics of objects within the zones of interest.

9. The method of claim 8, wherein:

(a) each participant defines at least one zone of interest; and

(b) the step of copying the local participant information for other participants administered by the local server comprises evaluating local participant information according to other participants'"'"' zones of interest.

10. The method of claim 9, wherein:

(a) object characteristics include the type of the object;

(b) at least one participant assigns a type to an object within the zone of interest; and

(c) the step of evaluating local participant information further comprises comparing the types of the objects with the zone of interest.

11. The method of claim 9, wherein:

(a) object characteristics include the position of the object;

(b) at least one participant assigns a position to an object within the zone of interest; and

(c) the step of evaluating local participant information further comprises comparing the positions of objects with the zone of interest.

12. The method of claim 9, wherein:

(a) object characteristics include the priority of the object;

(b) each participant assigns a priority to an object within the zone of interest; and

(c) the step of evaluating local participant information further comprises comparing the priority of objects within the zone of interest.

13. The method of claim 9, wherein:

(a) object characteristics include the data rate for communication of information related to the associated object;

(b) each participant assigns a data rate to an object within the zone of interest; and

(c) the step of evaluating local participant information further comprises comparing the data rate of objects within the zone of interest.

14. The method of claim 9, wherein the step of evaluating local participant information according to other participants'"'"' zones of interest comprises:

(a) coalescing zones of interest into related groups;

(b) evaluating local participant information according to each group;

(c) determining which groups are interested in local participant information;

(d) for each group showing interest, evaluating each zone of interest; and

(e) for each zone of interest implicating local participant information, determining which local participants have specified the zone of interest.

15. The method of claim 9, wherein:

(a) each server defines at least one zone of interest;

(b) the step of copying the local participant information for remote servers comprises;

(i) evaluating local participant information according to remote server'"'"'s zones of interest;

(ii) determining which remote servers are interested in the local participant information;

(iii) prioritizing local participant information based on relevance of the information to remote servers;

(iv) filtering local participant information based on priority and according to network bandwidth limitations so as to optimize network bandwidth utilization; and

(v) copying the filtered local participant information for interested remote servers; and

(c) the step of distributing the local participant information to remote servers comprises distributing the local participant information to all remote servers interested in the local participant information.

16. The method of claim 15, wherein the step of evaluating local participant information according to remote servers'"'"' zones of interest comprises:

(a) coalescing zones of interest into related groups;

(b) evaluating local participant information according to each group;

(c) determining which groups are interested in local participant information;

(d) for each group showing interest, evaluating each zone of interest; and

(e) for each zone of interest implicating local participant information, determining which remote servers have specified the zone of interest.

17. The method of claim 15, wherein the step of each server defining at least one zone of interest comprises:

(a) evaluating all zones of interest defined by local participants; and

(b) coalescing all zones of interest into at least one zone of interest for each server.

18. The method of claim 8, wherein:

(a) each server defines at least one zone of interest;

(b) the step of copying the local participant information for remote servers comprises;

(i) evaluating local participant information according to remote server'"'"'s zones of interest;

(ii) determining which remote servers are interested in the local participant information;

(iii) prioritizing local participant information based on relevance of the information to remote servers;

(iv) filtering local participant information based on priority and according to network bandwidth limitations so as to optimize network bandwidth utilization; and

(v) copying the filtered local participant information for interested remote servers; and

(c) the step of distributing the local participant information to remote servers comprises distributing the local participant information to all remote servers interested in the local participant information.

19. The method of claim 18, wherein the step of evaluating local participant information according to remote servers'"'"' zones of interest comprises:

(a) coalescing zones of interest into related groups;

(b) evaluating local participant information according to each group;

(c) determining which groups are interested in local participant information;

(d) for each group showing interest, evaluating each zone of interest; and

(e) for each zone of interest implicating local participant information, determining which remote servers have specified the zone of interest.

20. The method of claim 5, wherein a plurality of zones of interest are defined within the application environment, and wherein:

(a) the step of copying the remote participant information for participants administered by the local server comprises;

(i) evaluating remote participant information according to zones of interest;

(ii) determining which local participants are interested in the remote participant information;

(iii) prioritizing remote participant information based on relevance of the information to interested participants administered by the local server;

(iv) filtering remote participant information based on priority and according to network bandwidth limitations so as to optimize network bandwidth utilization; and

(v) copying the filtered remote participant information for interested participants administered by the local server; and

(b) the step of distributing the local participant information to participants administered by the local server comprises distributing the remote participant information to all participants administered by the local server interested in the local participant information.

21. The method of claim 20, wherein:

(a) the zones of interest in the application environment contain a plurality of objects having object characteristics; and

(b) the step of evaluating local participant information according to zones of interest comprises distinguishing between the object characteristics of objects within the zones of interest.

22. The method of claim 21, wherein:

(a) each participant defines at least one zone of interest; and

(b) the step of copying the local participant information for other participants administered by the local server comprises evaluating local participant information according to other participants'"'"' zones of interest.

23. The method of claim 22, wherein:

(a) object characteristics include the type of the object;

(b) at least one participant assigns a type to an object within the zone of interest; and

(c) the step of evaluating local participant information further comprises comparing the types of the objects with the zone of interest.

24. The method of claim 22, wherein:

(a) object characteristics include the position of the object;

(b) at least one participant assigns a position to an object within the zone of interest; and

(c) the step of evaluating local participant information further comprises comparing the positions of objects with the zone of interest.

25. The method of claim 22, wherein:

(a) object characteristics include the priority of the object;

(b) each participant assigns a priority to an object within the zone of interest; and

(c) the step of evaluating local participant information further comprises comparing the priority of objects within the zone of interest.

26. The method of claim 22, wherein:

(a) object characteristics include the data rate for communication of information related to the object;

(b) each participant assigns a data rate to an object within the zone of interest; and

(c) the step of evaluating local participant information further comprises comparing the data rate of objects within the zone of interest.

27. The method of claim 22, wherein the step of evaluating local participant information according to other participants'"'"' zones of interest comprises:

(a) coalescing zones of interest into related groups;

(b) evaluating local participant information according to each group;

(c) determining which groups are interested in local participant information;

(d) for each group showing interest, evaluating each zone of interest; and

(e) for each zone of interest implicating local participant information, determining which local participants have specified the zone of interest.

28. The method of claim 22, wherein:

(a) each server defines at least one zone of interest;

(b) the step of copying the local participant information for remote servers comprises;

(i) evaluating local participant information according to remote server'"'"'s zones of interest;

(ii) determining which remote servers are interested in the local participant information;

(iii) prioritizing local participant information based on relevance of the information to remote servers;

(iv) filtering local participant information based on priority and according to network bandwidth limitations so as to optimize network bandwidth utilization; and

(v) copying the filtered local participant information for interested remote servers; and

(c) the step of distributing the local participant information to remote servers comprises distributing the local participant information to all remote servers interested in the local participant information.

29. The method of claim 28, wherein the step of evaluating local participant information according to remote servers'"'"' zones of interest comprises:

(a) coalescing zones of interest into related groups;

(b) evaluating local participant information according to each group;

(c) determining which groups arc interested in local participant information;

(d) for each group showing interest, evaluating each zone of interest; and

(e) for each zone of interest implicating local participant information, determining which remote servers have specified the zone of interest.

30. The method of claim 28, wherein the step of each server defining at least one zone of interest comprises:

(a) evaluating all zones of interest defined by local participants; and

(b) coalescing all zones of interest into at least one zone of interest for each server.

31. The method of claim 21, wherein:

(a) each server defines at least one zone of interest;

(b) the step of copying the local participant information for remote servers comprises;

(i) evaluating local participant information according to remote server'"'"'s zones of interest;

(ii) determining which remote servers are interested in the local participant information;

(iii) prioritizing local participant information based on relevance of the information to remote servers;

(iv) filtering local participant information based on priority and according to network bandwidth limitations so as to optimize network bandwidth utilization; and

(v) copying the filtered local participant information for interested remote servers; and

(c) the step of distributing the local participant information to remote servers comprises distributing the local participant information to all remote servers interested in the local participant information.

32. The method of claim 31, wherein the step of evaluating local participant information according to remote servers'"'"' zones of interest comprises:

(a) coalescing zones of interest into related groups;

(b) evaluating local participant information according to each group;

(c) determining which groups are interested in local participant information;

(d) for each group showing interest, evaluating each zone of interest; and

(e) for each zone of interest implicating local participant information, determining which remote servers have specified the zone of interest.

33. The method of claim 5, wherein the application environment is divided into a plurality of regions, each region is administered by at least one server having at least one participant in the multi-user application, a plurality of zones of interest are defined within each region of the application environment, and wherein:

(a) the step of copying the local participant information for remote servers comprises;

(i) evaluating local participant information according the zones of interest;

(ii) determining which remote servers administering participants in neighboring regions are interested in the local participant information, wherein each neighboring region shares at least one common overlapping subregion with the region administered by the local server, the common overlapping subregion comprising at least a portion of the neighboring region and at least a portion of the region administered by the local server;

(iii) prioritizing local participant information based on relevance of the information to the remote servers administering participants in neighboring regions;

(iv) filtering local participant information based on priority and according to network bandwidth limitations so as to optimize network bandwidth utilization; and

(v) copying the filtered local participant information for interested remote servers administering participants in neighboring regions; and

(b) the step of distributing the local participant information to remote servers comprises distributing the local participant information to interested remote servers administering participants in neighboring regions.

34. The method of claim 33, wherein:

(a) the zones of interest in the application environment contain a plurality of objects having object characteristics; and

(b) the step of evaluating local participant information according to zones of interest comprises distinguishing between the object characteristics of objects within the zones of interest.

35. The method of claim 34, wherein:

(a) each participant defines at least one zone of interest; and

(b) the step of copying the local participant information for other participants administered by the local server comprises evaluating local participant information according to other participants'"'"' zones of interest.

36. The method of claim 35, wherein:

(a) object characteristics include the type of the object;

(b) at least one participant assigns a type to an object within the zone of interest; and

(c) the step of evaluating local participant information further comprises comparing the types of the objects with the zone of interest.

37. The method of claim 35, wherein:

(a) object characteristics include the position of the object;

(b) at least one participant assigns a position to an object within the zone of interest; and

(c) the step of evaluating local participant information further comprises comparing the positions of objects with the zone of interest.

38. The method of claim 35, wherein:

(a) object characteristics include the priority of the object;

(b) each participant assigns a priority to an object within the zone of interest; and

(c) the step of evaluating local participant information further comprises comparing the priority of objects within the zone of interest.

39. The method of claim 35 wherein:

(a) object characteristics include the data rate for communication of information related of the object;

(b) each participant assigns a data rate to an object within the zone of interest; and

(c) the step of evaluating local participant information further comprises comparing the data rate of objects within the zone of interest.

40. The method of claim 35, wherein the step of evaluating local participant information according to other participants'"'"' zones of interest comprises:

(a) coalescing zones of interest into related groups;

(b) evaluating local participant information according to each group;

(c) determining which groups are interested in local participant information;

(d) for each group showing interest, evaluating each zone of interest; and

(e) for each zone of interest implicating local participant information, determining which local participants have specified the zone of interest.

41. The method of claim 35, wherein:

(a) each server defines at least one zone of interest;

(b) the step of copying the local participant information for remote servers comprises;

(i) evaluating local participant information according to remote server'"'"'s zones of interest;

(ii) determining which remote servers are interested in the local participant information;

(iii) prioritizing local participant information based on relevance of the information to remote servers;

(iv) filtering local participant information based on priority and according to network bandwidth limitations so as to optimize network bandwidth utilization; and

(v) copying the filtered local participant information for interested remote servers; and

(c) the step of distributing the local participant information to remote servers comprises distributing the local participant information to all remote servers interested in the local participant information.

42. The method of claim 41, wherein the step of evaluating local participant information according to remote servers'"'"' zones of interest comprises:

(a) coalescing zones of interest into related groups;

(b) evaluating local participant information according to each group;

(c) determining which groups are interested in local participant information;

(d) for each group showing interest, evaluating each zone of interest; and

(e) for each zone of interest implicating local participant information, determining which remote servers have specified the zone of interest.

43. The method of claim 41, wherein the step of each server defining at least one zone of interest comprises:

(a) evaluating all zones of interest defined by local participants; and

(b) coalescing all zones of interest into at least one zone of interest for each server.

44. The method of claim 34, wherein:

(a) each server defines at least one zone of interest;

(b) the step of copying the local participant information for remote servers comprises;

(i) evaluating local participant information according to remote server'"'"'s zones of interest;

(ii) determining which remote servers are interested in the local participant information;

(iii) prioritizing local participant information based on relevance of the information to remote servers;

(iv) filtering local participant information based on priority and according to network bandwidth limitations so as to optimize network bandwidth utilization; and

(v) copying the filtered local participant information for interested remote servers; and

(c) the step of distributing the local participant information to remote servers comprises distributing the local participant information to all remote servers interested in the local participant information.

45. The method of claim 44, wherein the step of evaluating local participant information according to remote servers'"'"' zones of interest comprises:

(a) coalescing zones of interest into related groups;

(b) evaluating local participant information according to each group;

(c) determining which groups are interested in local participant information;

(d) for each group showing interest, evaluating each zone of interest; and

(e) for each zone of interest implicating local participant information, determining which remote servers have specified the zone of interest.

46. The method of claim 33, wherein each local region is administered by a plurality of servers, and wherein:

(a) the step of copying the local participant information for remote servers comprises copying the local participant information for every other server administering the local region; and

(b) the step of distributing the local participant information to remote servers comprises distributing the local participant information to every other server administering the local region.

47. A method for allowing a plurality of participants in a global application environment of a multi-user application, the global application environment defining a plurality of zones of interest, wherein the multi-user application is administered in a server connected to a plurality of participant stations by a network having a finite bandwidth, wherein the global application environment comprises a plurality of local application environments, one corresponding to each participant station, wherein each local application environment comprises a plurality of objects, each object comprising a parameter relating to a corresponding participant within the multi-user application the method comprising:

(a) running local versions of the multi-user application at the participant stations such that users at the participant stations interact with corresponding local application environments;

(b) sending, by the participant stations, participant information to the server;

wherein the participant information comprises a changed object of the local application environment;

(c) receiving, by the server, participant information from the plurality of participant stations;

(d) evaluating participant information according to zones of interest;

(e) determining which of the other participants are interested in the participant information;

(f) prioritizing participant information based on relevance of the information to the other participants;

(g) filtering participant information based on priority and according to network bandwidth limitations so as to optimize network bandwidth utilization; and

(h) copying the filtered participant information for interested participants; and

(i) distributing the filtered participant information only to the interested participants.

48. The method of claim 47, wherein:

(a) the zones of interest in the global application environment contain at least one object having object characteristics; and

(b) the step of evaluating participant information according to zones of interest comprises distinguishing between the object characteristics of objects within the zones of interest.

49. The method of claim 48, wherein:

(a) each participant defines at least one zone of interest; and

(b) the step of copying the participant information for other participants comprises evaluating participant information according to other participants'"'"' zones of interest.

50. The method of claim 49. wherein:

(a) object characteristics include the type of the object;

(b) at least one participant assigns a type to an object within the zone of interest; and

(c) the step of evaluating participant information further comprises comparing the types of the objects with the zone of interest.

51. The method of claim 49, wherein:

(a) object characteristics include the position of the object;

(b) at least one participant assigns a position to an object within the zone of interest, and

(c) the step of evaluating participant information further comprises comparing the positions of objects with the zone of interest.

52. The method of claim 49, wherein:

(a) object characteristics include the priority of the object;

(b) each participant assigns a priority to an object within the zone of interest; and

(c) the step of evaluating participant information further comprises comparing the priority of objects within the zone of interest.

53. The method of claim 49, wherein:

(a) object characteristics include the data rate for communication of information related of the associated object;

(b) each participant assigns a data rate to an object within the zone of interest; and

(c) the step of evaluating participant information further comprises comparing the data rate of objects within the zone of interest.

54. The method of claim 49, wherein the step of evaluating participant information according to other participants'"'"' zones of interest comprises:

(a) coalescing zones of interest into related groups;

(b) evaluating participant information according to each group;

(c) determining which groups are interested in participant information;

(d) for each group showing interest, evaluating each zone of interest; and

(e) for each zone of interest implicating the participant information, determining which participants have specified the zone of interest.