Programmable streaming data processor for database appliance having multiple processing unit groups
First Claim
1. An asymmetric data processor comprising:
- a first group of nodes comprising one or more host processors, each host comprising a memory, a network interface, and one or more Central Processing Units (CPUs), wherein each host accepts and responds to queries for data, and transforms such queries into one or more jobs;
a second group of nodes comprising one or more Job Processing Units (JPUs), wherein each JPU comprises;
a memory, for storing data a network interface, for receiving data and instructions a streaming data interface, for receiving data from a streaming data source;
one or more general purpose CPUs, for responding to requests from at least one host computer in the first group, and to requests from other JPUs in the second group, and one or more Programmable Streaming Data Processors (PSDPs), which perform primitive functions directly on data received from the streaming data interface, each PSDP thus performing initial processing on a set of data; and
a network connecting the nodes within each group and between the two groups, and wherein a JPU receives jobs from one or most nodes in the first group, performs work requested by the job, and forms a reply.
8 Assignments
0 Petitions
Accused Products
Abstract
A data processing system having two or more groups of data processors that have attributes that are optimized for their assigned functions. A first group consists of one or more host computers responsible for interfacing with applications and/or end users to obtain queries and for planning query execution. A second processor group consists of many streaming record-oriented processors called Job Processing Units (JPUs), preferably arranged as an MPP structure. The JPUs typically carry out the bulk of the data processing required to implement the logic of a query. Each of the JPUs typically include a general purpose microcomputer, local memory, one or more mass storage devices, and one or more network connections. Each JPU also has a special purpose programmable processor, referred to herein as a Programmable Streaming Data Processor (PSDP). The PSDP serves as an interface between the CPU of a JPU and the mass storage device, to offload functions from the CPU of the JPU.
-
Citations
31 Claims
-
1. An asymmetric data processor comprising:
-
a first group of nodes comprising one or more host processors, each host comprising a memory, a network interface, and one or more Central Processing Units (CPUs), wherein each host accepts and responds to queries for data, and transforms such queries into one or more jobs;
a second group of nodes comprising one or more Job Processing Units (JPUs), wherein each JPU comprises;
a memory, for storing data a network interface, for receiving data and instructions a streaming data interface, for receiving data from a streaming data source;
one or more general purpose CPUs, for responding to requests from at least one host computer in the first group, and to requests from other JPUs in the second group, and one or more Programmable Streaming Data Processors (PSDPs), which perform primitive functions directly on data received from the streaming data interface, each PSDP thus performing initial processing on a set of data; and
a network connecting the nodes within each group and between the two groups, and wherein a JPU receives jobs from one or most nodes in the first group, performs work requested by the job, and forms a reply. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31)
-
Specification