Storing and retrieving objects on a computer network in a distributed database

• US 8,688,708 B2
• Filed: 09/27/2012
• Issued: 04/01/2014
• Est. Priority Date: 01/28/2004
• Status: Active Grant

• Current Assignee: Point of Data Corporation
• Original Assignee: Point of Data Corporation
• Inventors: Tharp, Stanford, Meadway, Michael
• Primary Examiner(s): ROBINSON, GRETA LEE
• Application Number:
  US13/629,418
• Publication Number:
  US 20130073602A1
• Time in Patent Office: 551 Days
• Field of Search: 707/707, 707/740, 707/753, 707/770, 707/797, 707/799, 707/800, 707/803, 709/201, 709/202, 709/204, 709/206
• US Class Current: 707/740
• CPC Class Codes: G06F 16/958 Organisation or management of web site content, e.g. publishing, maintaining pages or automatic linking
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]

Abstract

Further preferred embodiments of the present invention include methods directed to (a) Active Data Structures, (b) Mobile Devices, (c) Ad-Hoc Device Collections, and (d) Concurrent Massively Parallel Supercomputers. Therein, a distributed, object-oriented database engine utilizing independent, intelligent processing nodes as a cooperative, massively parallel system with redundancy and fault tolerance. Instead of using traditional methods of parallelism as found in most distributed databases, the invention utilizes a messaging system and a series of message processing nodes to determine where attributes and data files associated with objects are stored. The architecture is loosely coupled, each node independently determining if it manages or routes storage and retrieval requests.

Claims

1. A method of assembling a catalog of objects and object references from objects stored within a network, the network including a plurality of interconnected computers with each computer storing a plurality of objects and a plurality of object catalogs, the method comprising:

running a plurality of agent programs on each computer, the plurality of agent programs containing a plurality of programmable virtual machine environments, a plurality of standardized collections of executable functions suitable for communication with a respective one the computers, and a plurality of executable functions for managing objects and sending and receiving messages;

compiling a plurality of messages, each message including source and destination meta data, meta data describing properties of the message, object data embedded within the message, and a plurality of object data payloads;

receiving at least one first message from at least one a computer, a program executed on a computer receiving the at least one first message, and a plurality of sensors that perform measurements, the at least one first message including source and destination meta data, meta data describing properties of the message, object data embedded within the message, and a plurality of object data payloads;

transmitting at least one second message to at least one of a computer and a program executed on a computer transmitting the at least one second message, the at least one second message including source and destination meta data, meta data describing properties of the message, object data embedded within the message, and a plurality of object data payloads;

determining the disposition of at least one of the plurality of messages by executing code written for the virtual machine embedded within the agent program; and

creating a plurality of catalogs containing a plurality of references to a plurality of object data and a plurality of object properties, each catalog comprising a plurality of indices and a plurality of object storage areas; and

wherein the agent computer program uses a plurality of algorithms to store event objects organized in a structure within a storage device such that the structure organization is determined by a plurality of algorithms which assess the relationship of the agent computer program with a plurality of other agent computer programs and the content of the event objects.

2. The method of claim 1 wherein the agent computer program uses a plurality of algorithms to dispatch a plurality of event objects to a plurality of agent computer programs using a plurality of networks, based on the relationship of the agent computer program to an algorithmically defined plurality of agent computer programs.

3. The method of claim 2 wherein the plurality of agent computer programs and plurality of connecting networks represents a tree structure containing a plurality of records, wherein each record or node of records within the tree is controlled and manipulated by a plurality of agent computer programs.

4. The method of claim 3 where a plurality of agent computer programs individually manage a plurality of uniquely identified tree structures.

5. The method of claim 2 wherein the plurality of agent computer programs and plurality of connecting networks represents a multiway-trie containing a plurality of records, wherein each record or node of records within the tree is controlled and manipulated by a plurality of agent computer programs.

6. The method of claim 5 where a plurality of agent computer programs individually manage a plurality of uniquely identified multiway-trie structures.

7. The method of claim 2 wherein the plurality of agent computer programs and plurality of connecting networks represents a doubly-linked list, wherein each record or set of records within the list is controlled and manipulated by a plurality of agent computer programs.

8. The method of claim 7 where a plurality of agent computer programs individually manage a plurality of doubly-linked lists.

9. The method of claim 2 wherein the plurality of agent computer programs and plurality of connecting networks represents a queue, wherein each record or set of records within the queue is controlled and manipulated by a plurality of agent computer programs.

10. The method of claim 9 where a plurality of agent computer programs individually manage a plurality of queues.

11. The method of claim 2 wherein the plurality of agent computer programs and plurality of connecting networks represents a stack, wherein each record or set of records within the queue is controlled and manipulated by a plurality of agent computer programs.

12. The method of claim 11 where a plurality of agent computer programs individually manage a plurality of stacks.

13. The method of claim 1 wherein the agent computer program uses a plurality of algorithms to dispatch a plurality of requests for event object components to a plurality of agent computer programs using a plurality of networks, based on the relationship of the agent computer program to an algorithmically defined plurality of agent computer programs.

14. The method of claim 1 wherein the agent computer program uses a plurality of algorithms to dispatch a plurality of request replies for event object components to a plurality of agent computer programs using a plurality of networks, based on the relationship of the agent computer program to an algorithmically defined plurality of agent computer programs where the reply routing is algorithmically determined to satisfy a plurality of requirements.

15. The method of claim 1 wherein the plurality of agent computer programs represents a tree structure containing a plurality of records, wherein each record or node of records within the tree is controlled and manipulated by a plurality of agent computer programs.

16. The method of claim 15 where a plurality of agent computer programs individually manage a plurality of agent programs that manage uniquely identified tree structures.

17. The method of claim 1 wherein the plurality of agent computer programs represents a multiway-trie containing a plurality of records, wherein each record or node of records within the tree is controlled and manipulated by a plurality of agent computer programs.

18. The method of claim 17 where a plurality of agent computer programs individually manage a plurality of agent programs that manage uniquely identified multiway-trie structures.

19. The method of claim 1 wherein the plurality of agent computer programs represents a doubly-linked list, wherein each record or set of records within the list is controlled and manipulated by a plurality of agent computer programs.

20. The method of claim 19 where a plurality of agent computer programs individually manage a plurality of agent programs that manage uniquely identified doubly-linked lists.

21. The method of claim 1 wherein the plurality of agent computer programs represents a queue, wherein each record or set of records within the queue is controlled and manipulated by a plurality of agent computer programs.

22. The method of claim 21 where a plurality of agent computer programs individually manage a plurality of agent programs that manage uniquely identified doubly-linked queues.

23. The method of claim 1 wherein the plurality of agent computer programs represents a stack, wherein each record or set of records within the queue is controlled and manipulated by a plurality of agent computer programs.

24. The method of claim 23 where a plurality of agent computer programs individually manage a plurality of agent programs that manage uniquely identified stacks.

25. A method of assembling a catalog of objects and object references from objects stored within a network, the network including a plurality of interconnected computers with each computer storing a plurality of objects and a plurality of object catalogs, the method comprising:

running a plurality of agent programs on each computer, the plurality of agent programs containing a plurality of programmable virtual machine environments, a plurality of standardized collections of executable functions suitable for communication with a respective one the computers, and a plurality of executable functions for managing objects and sending and receiving messages;

compiling a plurality of messages, each message including source and destination meta data, meta data describing properties of the message, object data embedded within the message, and a plurality of object data payloads;

receiving at least one first message from at least one a computer, a program executed on a computer receiving the at least one first message, and a plurality of sensors that perform measurements, the at least one first message including source and destination meta data, meta data describing properties of the message, object data embedded within the message, and a plurality of object data payloads;

transmitting at least one second message to at least one of a computer and a program executed on a computer transmitting the at least one second message, the at least one second message including source and destination meta data, meta data describing properties of the message, object data embedded within the message, and a plurality of object data payloads;

determining the disposition of at least one of the plurality of messages by executing code written for the virtual machine embedded within the agent program; and

creating a plurality of catalogs containing a plurality of references to a plurality of object data and a plurality of object properties, each catalog comprising a plurality of indices and a plurality of object storage areas; and

wherein the agent computer program determines messages to be processed based on the location of the agent on a portable computing device.

26. The method of claim 25 wherein the agent computer program determines messages to be processed based on the location of the agent on a portable computing device which is a member of a plurality of mobile devices in which the incidence of plurality is determined by a separate data source.

27. The method of claim 25 wherein the agent computer program determines messages to be processed based on the location of the agent on a portable computing device which is a member of a plurality of mobile devices in which the incidence of plurality is determined by a separate entity.

28. The method of claim 25 wherein the agent computer program determines messages to be processed based on the location of the agent on a portable computing device which is a member of a plurality of mobile devices in which the incidence of plurality is determined by environmental factors or data not contained within messages.

29. The method of claim 25 wherein the agent computer program determines messages to be processed based on the location of the agent on a passive computing device.

30. The method of claim 25 wherein the agent computer program determines messages to be processed based on the location of the agent on a passive computing device that is in turn a member of a plurality of passive computing devices.

31. A method of assembling a catalog of objects and object references from objects stored within a network, the network including a plurality of interconnected computers with each computer storing a plurality of objects and a plurality of object catalogs, the method comprising:

running a plurality of agent programs on each computer, the plurality of agent programs containing a plurality of programmable virtual machine environments, a plurality of standardized collections of executable functions suitable for communication with a respective one the computers, and a plurality of executable functions for managing objects and sending and receiving messages;

compiling a plurality of messages, each message including source and destination meta data, meta data describing properties of the message, object data embedded within the message, and a plurality of object data payloads;

receiving at least one first message from at least one a computer, a program executed on a computer receiving the at least one first message, and a plurality of sensors that perform measurements, the at least one first message including source and destination meta data, meta data describing properties of the message, object data embedded within the message, and a plurality of object data payloads;

transmitting at least one second message to at least one of a computer and a program executed on a computer transmitting the at least one second message, the at least one second message including source and destination meta data, meta data describing properties of the message, object data embedded within the message, and a plurality of object data payloads;

determining the disposition of at least one of the plurality of messages by executing code written for the virtual machine embedded within the agent program; and

creating a plurality of catalogs containing a plurality of references to a plurality of object data and a plurality of object properties, each catalog comprising a plurality of indices and a plurality of object storage areas; and

wherein the agent computer program determines membership within a plurality of agents based on messages processed where the incidence of plurality is determined by a time period.

32. The method of claim 31 wherein the agent computer program determines membership within a plurality of agents based on messages processed where the incidence of plurality is determined by a plurality of time periods.

33. The method of claim 31 wherein the agent computer program determines membership within a plurality of agents based on messages processed where the incidence of plurality is determine by a physical location.

34. The method of claim 31 wherein the agent computer program determines membership within a plurality of agents based on messages processed where the incidence of plurality is determine by a plurality of physical locations.

35. The method of claim 31 wherein the agent computer program determines membership within a plurality of agents based on messages processed where the incidence of plurality is determine by a virtual or logical location.

36. The method of claim 31 wherein the agent computer program determines membership within a plurality of agents based on messages processed where the incidence of plurality is determine by a plurality of virtual or plurality of logical locations.

37. The method of claim 31 wherein the agent computer program determines membership within a plurality of agents based on messages processed where the incidence of plurality is determine by a plurality of characteristics detected in or extracted from messages received.

38. The method of claim 31 wherein the agent computer program determines membership within a plurality of agents based on messages processed where the incidence of plurality is determine by a plurality of characteristics detected in or extracted from environmental inputs.

39. The method of claim 31 wherein the agent computer program determines membership within a plurality of agents that are further contained within a plurality of agents based on messages processed.

40. The method of claim 31 wherein the agent computer program determines membership within a plurality of agents and determines messages to be processed based on the characteristics of the membership within the plurality of agents.

41. A method of assembling a catalog of objects and object references from objects stored within a network, the network including a plurality of interconnected computers with each computer storing a plurality of objects and a plurality of object catalogs, the method comprising:

running a plurality of agent programs on each computer, the plurality of agent programs containing a plurality of programmable virtual machine environments, a plurality of standardized collections of executable functions suitable for communication with a respective one the computers, and a plurality of executable functions for managing objects and sending and receiving messages;

compiling a plurality of messages, each message including source and destination meta data, meta data describing properties of the message, object data embedded within the message, and a plurality of object data payloads;

receiving at least one first message from at least one a computer, a program executed on a computer receiving the at least one first message, and a plurality of sensors that perform measurements, the at least one first message including source and destination meta data, meta data describing properties of the message, object data embedded within the message, and a plurality of object data payloads;

transmitting at least one second message to at least one of a computer and a program executed on a computer transmitting the at least one second message, the at least one second message including source and destination meta data, meta data describing properties of the message, object data embedded within the message, and a plurality of object data payloads;

determining the disposition of at least one of the plurality of messages by executing code written for the virtual machine embedded within the agent program; and

creating a plurality of catalogs containing a plurality of references to a plurality of object data and a plurality of object properties, each catalog comprising a plurality of indices and a plurality of object storage areas; and

wherein the agent computer program determines the messages to be processed based on membership in a plurality of agents that are contained within the logical boundaries of a multiple-device platform.

42. The method of claim 41 wherein the agent computer program determines the messages to be processed based on membership in a plurality of agents that are contained within the logical boundaries of a multiple-device platform and where the logical boundaries are further divided into logical partitions.

43. The method of claim 41 wherein the agent computer program determines the messages to be processed based on membership in a plurality of agents that are contained within the logical boundaries of a multiple-device platform and where the logical boundaries are further divided into logical partitions over a plurality of time periods based on the content of messages processed.