Implementation of a web scale data fabric
First Claim
1. A system for processing business operations transactions and associated augmented customer data, the system comprising:
- a plurality of computer servers interconnected with a software defined network (SDN) via a plurality of network switches, controllers, and network interfaces, and facilitated by an operating system (OS) comprising a network operating system (NOS), and a resource negotiator (RN), the plurality of computer servers configured for economical large scale computation and data storage with resilience despite underpinning commodity hardware failure and grow-shrink capacity changes of nodes and associated interconnectivity, wherein the plurality of computer servers are configured to;
implement commodity hardware for economy measured by ownership cost, andperform computation and store data within the computer grid;
direct attached storage (DAS) comprising just a bunch of disks (JBOD) configured for storage economy measured in total cost of ownership;
random access memory (RAM) coupled to the DAS to provide storage capacity for the plurality of computer servers;
a federated database (FD) that comprises a distributed in-memory cache (DIMC) and a plurality of log-structured merge tree (LSM-Tree) databases configured for resilient high-throughput data accumulation;
a central processing unit (CPU);
a co-processor coupled to the CPU to provide computation capacity for the plurality of computer servers;
wherein;
the SDN is configured to connect to an external computer network (ECN) for external client input and output,the NOS and the RN are configured to interface with the SDN to perform a physical-to-virtual network connectivity mapping between the plurality of computer servers and the ECN for negotiated bandwidth and latency conducive to at least one of computation, data receipt, and storage,the RN is configured to interface with the plurality of computer servers to perform physical-to-virtual parallel computation with negotiated computational capacity on data that is stored on the DAS or cached in the RAM,the NOS is configured to facilitate physical-to-virtual network connectivity with managed bandwidth and latency,the RN is configured to implement a resource-management platform,the FD is configured to interface with client applications and machine sources via the ECN to provide consistent data persistence for retrieved data, and interface with the SDN to configure interconnectivity among the plurality of computer servers, the client applications, and the machine sources,the DIMC is configured to interface with the plurality of computer servers to provide transient and temporary data persistence, and interface with the LSM-Tree to provide data resiliency, andthe LSM-Tree is configured to provide permanent data persistence, implement a non-relational database, and interface with the DFS to provide storate optimization for persisted data.
3 Assignments
0 Petitions
Accused Products
Abstract
Methods and systems for processing machine accelerated and augmented customer data using a Web-Scale Data Fabric (WSDF). According to embodiments, the data may be received as data transfer objects from a set of business operations client applications. The data transfer objects may be analyzed using complex event processing (CEP) and, based on the analyzing, rules specific to the business operations client application may be applied. The methods and systems may semantically classify text specific to the business operations client application. A federated database (FD) may archive the receive data transfer objects as well as analysis data specific to the business operations client application.
-
Citations
20 Claims
-
1. A system for processing business operations transactions and associated augmented customer data, the system comprising:
-
a plurality of computer servers interconnected with a software defined network (SDN) via a plurality of network switches, controllers, and network interfaces, and facilitated by an operating system (OS) comprising a network operating system (NOS), and a resource negotiator (RN), the plurality of computer servers configured for economical large scale computation and data storage with resilience despite underpinning commodity hardware failure and grow-shrink capacity changes of nodes and associated interconnectivity, wherein the plurality of computer servers are configured to; implement commodity hardware for economy measured by ownership cost, and perform computation and store data within the computer grid; direct attached storage (DAS) comprising just a bunch of disks (JBOD) configured for storage economy measured in total cost of ownership; random access memory (RAM) coupled to the DAS to provide storage capacity for the plurality of computer servers; a federated database (FD) that comprises a distributed in-memory cache (DIMC) and a plurality of log-structured merge tree (LSM-Tree) databases configured for resilient high-throughput data accumulation; a central processing unit (CPU); a co-processor coupled to the CPU to provide computation capacity for the plurality of computer servers; wherein; the SDN is configured to connect to an external computer network (ECN) for external client input and output, the NOS and the RN are configured to interface with the SDN to perform a physical-to-virtual network connectivity mapping between the plurality of computer servers and the ECN for negotiated bandwidth and latency conducive to at least one of computation, data receipt, and storage, the RN is configured to interface with the plurality of computer servers to perform physical-to-virtual parallel computation with negotiated computational capacity on data that is stored on the DAS or cached in the RAM, the NOS is configured to facilitate physical-to-virtual network connectivity with managed bandwidth and latency, the RN is configured to implement a resource-management platform, the FD is configured to interface with client applications and machine sources via the ECN to provide consistent data persistence for retrieved data, and interface with the SDN to configure interconnectivity among the plurality of computer servers, the client applications, and the machine sources, the DIMC is configured to interface with the plurality of computer servers to provide transient and temporary data persistence, and interface with the LSM-Tree to provide data resiliency, and the LSM-Tree is configured to provide permanent data persistence, implement a non-relational database, and interface with the DFS to provide storate optimization for persisted data. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12)
-
-
13. A method of processing business operations transactions and associated augmented customer data using a plurality of computer servers interconnected with a software defined network (SDN) via a plurality of network switches, controllers, and network interfaces, and facilitated by an operating system (OS) comprising a network operating system (NOS), and a resource negotiator (RN), the plurality of computer servers configured for economical large scale computation and data storage with resilience despite underpinning commodity hardware failure and grow-shrink capacity changes of nodes and associated interconnectivity, the method comprising:
-
implementing commodity hardware for economy measured by ownership cost; performing computation and store data within the computer grid; providing storage capacity for the plurality of computer servers using random access memory (RAM) coupled to direct attached storage (DAS); providing computation capacity for the plurality of computer servers using a co-processor coupled to a central processing unit (CPU); connecting, using the SDN, to an external computer network (ECN) for external client input and output; interfacing with the SDN by the NOS and the RN to perform a physical-to-virtual network connectivity mapping between the plurality of computer servers and the ECN for negotiated bandwidth and latency conducive to at least one of computation, data receipt, and storage; interfacing with the plurality of computer servers by the RN to perform physical-to-virtual parallel computation with negotiated computational capacity on data that is stored on the DAS or cached in the RAM; facilitating, by the NOS, physical-to-virtual network connectivity with managed bandwidth and latency; interfacing, by a federated database (FD), (i) with client applications and machine sources via the ECN to provide consistent data persistence for retrieved data, and (ii) with the SDN to configure interconnectivity among the plurality of computer servers, the client applications, and the machine sources; interfacing, by a distributed in-memory cache (DIMC), (i) with the plurality of computer servers to provide transient and temporary data persistence, and (ii) with a plurality of log-structured merge tree (LSM-Tree) to provide data resiliency, wherein the LSM tree is configured to provide permanent data persistence, implement a non-relational database, and interface with the DFS to provide storage optimization for persisted data. - View Dependent Claims (14, 15, 16, 17, 18, 19, 20)
-
Specification