×

Asymmetric streaming record data processor method and apparatus

  • US 20040117037A1
  • Filed: 09/18/2003
  • Published: 06/17/2004
  • Est. Priority Date: 09/18/2002
  • Status: Active Grant
First Claim
Patent Images

1. An asymmetric data processor comprising:

  • one or more host computers, each including a memory, a network interface and at least one CPU, each host computer being responsive to requests from end users and applications to process data;

    one or more Job Processing Units (JPUs), each having a memory, a network interface, one or more storage devices, and at least one CPU, each JPU being responsive to requests from host computers and from other JPUs to process data;

    a network enabling the host computers and the JPUs to communicate between and amongst each other, each of the host computers and JPUs forming a respective node on the network; and

    a plurality of software operators that allow each node to process data in a record-by-record, streaming fashion in which (i) for each operator in a given sequence of operators, output of the operator is input to a respective succeeding operator in a manner free of necessarily materializing data, and (ii) data processing follows a logical data flow and is based on readiness of a record, such that as soon as a subject record is ready record data is passed for processing from one part to a next part in the logical data flow, the flow of record data during data processing being substantially continuous so as to form a stream of record processing from operator to operator within nodes and across nodes of the network.

View all claims
  • 8 Assignments
Timeline View
Assignment View
    ×
    ×