Implementation of a web-scale data fabric
First Claim
1. A system for processing business operations transactions and associated augmented customer data, the system comprising:
- a plurality of computer servers interconnected with a software defined network (SDN) via a plurality of network switches, controllers, and network interfaces, and facilitated by an operating system (OS) comprising a network operating system (NOS) and a resource negotiator (RN), the plurality of computer servers configured for economical large scale computation and data storage with resilience despite underpinning commodity hardware failure and grow-shrink capacity changes of nodes and associated interconnectivity, wherein the plurality of computer servers are configured to;
implement commodity hardware for economy measured by ownership cost, andperform computation and store data within the computer grid;
direct attached storage (DAS) comprising just a bunch of disks (JBOD) configured for storage economy measured in total cost of ownership;
random access memory (RAM) coupled to the DAS to provide storage capacity for the plurality of computer servers;
a central processing unit (CPU);
a co-processor coupled to the CPU to provide computation capacity for the plurality of computer servers; and
a stream processor that comprises a plurality of message brokers (MB) hosted on a front office cluster and a back office cluster, and a plurality of complex event processors (CEP) configured for resilient high-throughput-low-latency data processing, the stream processor configured to;
ingest a first set of messages through a portion of the plurality of MBs hosted on the front office cluster,process, with lower latency, the first set of messages using the RAM,ingest a second set of messages through an additional portion of the plurality of MBs hosted on the back office cluster, andprocess, with higher latency, the second set of messages using the DAS;
wherein;
the SDN is configured to connect to an external computer network (ECN) for external client input and output,the NOS and the RN are configured to interface with the SDN to perform a physical-to-virtual network connectivity mapping between the plurality of computer servers and the ECN for negotiated bandwidth and latency conducive to at least one of computation, data receipt, and storage,the RN is configured to interface with the plurality of computer servers to perform physical-to-virtual parallel computation with negotiated computational capacity on data that is stored on the DAS or cached in the RAM,the NOS is configured to facilitate physical-to-virtual network connectivity with managed bandwidth and latency, andthe RN is configured to implement a resource-management platform.
3 Assignments
0 Petitions
Accused Products
Abstract
Methods and systems for processing machine accelerated and augmented customer data using a Web-Scale Data Fabric (WSDF). According to embodiments, the data may be received as data transfer objects from a set of business operations client applications. The data transfer objects may be analyzed using complex event processing (CEP) and, based on the analyzing, rules specific to the business operations client application may be applied. The methods and systems may semantically classify text specific to the business operations client application. A federated database (FD) may archive the receive data transfer objects as well as analysis data specific to the business operations client application.
50 Citations
20 Claims
-
1. A system for processing business operations transactions and associated augmented customer data, the system comprising:
-
a plurality of computer servers interconnected with a software defined network (SDN) via a plurality of network switches, controllers, and network interfaces, and facilitated by an operating system (OS) comprising a network operating system (NOS) and a resource negotiator (RN), the plurality of computer servers configured for economical large scale computation and data storage with resilience despite underpinning commodity hardware failure and grow-shrink capacity changes of nodes and associated interconnectivity, wherein the plurality of computer servers are configured to; implement commodity hardware for economy measured by ownership cost, and perform computation and store data within the computer grid; direct attached storage (DAS) comprising just a bunch of disks (JBOD) configured for storage economy measured in total cost of ownership; random access memory (RAM) coupled to the DAS to provide storage capacity for the plurality of computer servers; a central processing unit (CPU); a co-processor coupled to the CPU to provide computation capacity for the plurality of computer servers; and a stream processor that comprises a plurality of message brokers (MB) hosted on a front office cluster and a back office cluster, and a plurality of complex event processors (CEP) configured for resilient high-throughput-low-latency data processing, the stream processor configured to; ingest a first set of messages through a portion of the plurality of MBs hosted on the front office cluster, process, with lower latency, the first set of messages using the RAM, ingest a second set of messages through an additional portion of the plurality of MBs hosted on the back office cluster, and process, with higher latency, the second set of messages using the DAS;
wherein;the SDN is configured to connect to an external computer network (ECN) for external client input and output, the NOS and the RN are configured to interface with the SDN to perform a physical-to-virtual network connectivity mapping between the plurality of computer servers and the ECN for negotiated bandwidth and latency conducive to at least one of computation, data receipt, and storage, the RN is configured to interface with the plurality of computer servers to perform physical-to-virtual parallel computation with negotiated computational capacity on data that is stored on the DAS or cached in the RAM, the NOS is configured to facilitate physical-to-virtual network connectivity with managed bandwidth and latency, and the RN is configured to implement a resource-management platform. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12)
-
-
13. A method of processing business operations transactions and associated augmented customer data using a plurality of computer servers interconnected with a software defined network (SDN) via a plurality of network switches, controllers, and network interfaces, and facilitated by an operating system (OS) comprising a network operating system (NOS) and a resource negotiator (RN), the plurality of computer servers configured for economical large scale computation and data storage with resilience despite underpinning commodity hardware failure and grow-shrink capacity changes of nodes and associated interconnectivity, the method comprising:
-
implementing commodity hardware for economy measured by ownership cost; performing computation and store data within the computer grid; providing storage economy measure in total cost of ownership using direct attached storage (DAS) comprising just a bunch of disks (JBOD); providing storage capacity for the plurality of computer servers using random access memory (RAM) coupled to direct attached storage (DAS); providing computation capacity for the plurality of computer servers using a co-processor coupled to a central processing unit (CPU); providing resilient high-throughput-low-latency data processing using a stream processor that comprises a plurality of message brokers (MB) hosted on a front office cluster and a back office cluster, and a plurality of complex event processors (CEP), including; ingesting a first set of messages through a portion of the plurality of MBs hosted on the front office cluster, processing, with lower latency, the first set of messages using the RAM, ingesting a second set of messages through an additional portion of the plurality of MBs hosted on the back office cluster, and processing, with higher latency, the second set of messages using the DAS; connecting, by the SDN, to an external computer network (ECN) for external client input and output; interfacing with the SDN, by the NOS and the RN, to perform a physical-to-virtual network connectivity mapping between the plurality of computer servers and the ECN for negotiated bandwidth and latency conducive to at least one of computation, data receipt, and storage; interfacing, by the RN, with the plurality of computer servers to perform physical-to-virtual parallel computation with negotiated computational capacity on data that is stored on the DAS or cached in the RAM; facilitating, by the NOS, physical-to-virtual network connectivity with managed bandwidth and latency; and implementing, by the RN, a resource-management platform. - View Dependent Claims (14, 15, 16, 17, 18, 19, 20)
-
Specification