Configurable parallel pipeline image processing system

• US 4,850,027 A
• Filed: 02/05/1988
• Issued: 07/18/1989
• Est. Priority Date: 07/26/1985
• Status: Expired due to Fees

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Kimmel, Milton J.
• Primary Examiner(s): Bourdreau, Leo H.
• Assistant Examiner(s): Mancuso, Joseph
• Application Number:
  US07/150,000
• Time in Patent Office: 529 Days
• Field of Search: 382/41, 382/49, 364/900, 364/736, 364/715, 364/133, 364/140
• US Class Current: 382/303
• CPC Class Codes: G06T 1/20 Processor architectures; Processor configuration, e.g. pipelining

Abstract

Configurable processing element groups (PEGs), made up of processing elements (PEs) and boolean combiner image switches (BC), arrayed in image processing subassemblies (CAGEs) having limited external PE connections, provide myriad image processing network choices without massive investment in memory and bus capacity. PEs have full variable connectability within the PEG, and connectability via limited bus connections to PEs in related PEGs. Image switching is implemented by the BC, which is feedback connected to PEs within the PEG. Each PEG is also directly connected to the next PEG, through its BC, in straighforward pipeline configuration. For simple jobs, the implementor configures simple networks of PEs within PEGs. For demanding jobs, the implementor configures PEs in one PEG together with PEs from other PEGs, in a compound bus-connected network within the CAGE. For very demanding jobs, the implementor uses the PEs in the system not only as binary window processors, but also as additional switching paths, logic inverters and delay elements, setting up the image processing system most closely approaching the optimum for the job. Limitations are only bus capacity, bus connections and CAGE to CAGE connections. The system features host computer, video buffer, and pipeline of CAGEs, each CAGE having bit stream input, an array of PEGs, and CAGE exit mechamism which provides a bit stream output in the form of X-Y coordinates of selected pels. An additional feedback loop, from BC output to BC input within the PE, significantly adds to capability with little additional structure.

Claims

1. A configurable parallel processing element pipelined system, for image processing with computational efficiency within available capacity comprising:

(a) image means for providing image data;

(b) image processing subassembly CAGE means (one or more of 3, 4, 5 . . .

     6) operatively connected to said image means for receiving image data, each CAGE comprising repowering repeating means (RR

     20), a plurality of configurable processing element groups (PEGs

     10) for processing said image data without storing a full iconic image within any of said processing element groups, and CAGE exit means (11-12, 17-18);

each PEG (10) comprising

a set of processing elements (PEs

     21) each having input and output; and

a boolean combiner (23), having inputs and outputs, a first portion of said inputs being connected to the outputs of said set of processing elements within its PEG and a second portion of said inputs being connected to at least one other PEG, having as outputs a set of boolean combined image transfer switches, a subset of which is feedback connected to said PEs within its PEG and a subset of which is forward connected to a receiving device to outside its PEG, and

(c) control means coupled to said image means and said image processing subassembly CAGE means for enabling a variety of interconnections of processing elements to be achievable.

2. A configurable parallel processing element pipelined system, for image processing with computational efficiency within available capacity comprising:

(a) image means for providing image data;

(b) image processing subassembly CAGE means (one or more of 3, 4, 5 . . .

     6) operatively connected to said image means for receiving image data, each CAGE comprising repowering repeating means (RR

     20), a plurality of configurable processing element groups (PEGs

     10) for processing said image data without storing a full iconic image within any of said processing element groups, a bus (9), and CAGE exit means (11-12, 17-18);

each PEG (10) comprising

a set of processing elements (PEs

     21) each having input and output;

a boolean combiner (23), having inputs and outputs, a first portion of said inputs being connected to the outputs of said set of processing elements within its PEG and a second portion of said inputs being connected to at least one other PEG, having as outputs a set of boolean combined image transfer switches, a subset of which is feedback connected to said PEs within its PEG and a subset of which is forward connected to a receiving device outside its PEG, said first set of boolean combined image transfer switches being feedback connected (22,

     29) to said set of PEs for full flexibility of PE interconnection internal to its PEG (10);

said second set being connected via said bus to a receiving device, which is the subsequent PEG or, alternatively, is said CAGE exit means, for full flexibility of PE interconnection to the receiving device; and

(c) control means coupled to said image means and said image processing subassembly CAGE means for enabling a variety of interconnections of processing elements to be achievable.

3. A configurable parallel processing element pipelined system, for image processing with computational efficiency within available capacity comprising:

(a) image means for providing image data;

(b) CAGE means, comprising at least one signal repeating image processing subassembly (CAGE

     3) operatively connected to said image means for receiving image data, each CAGE comprising repowering repeating means (RR

     20), a plurality of configurable processing element groups (PEGs

     10) for processing said image data without storing a full iconic image within any of said processing element groups, a bus (9), and CAGE exit means (11-12, 17-18);

each PEG (10) comprising

a set of (N) processing elements (PEs

     21) each having input and output;

a boolean combiner (23), having inputs and outputs, a first portion of said inputs being connected to the outputs of said set of processing elements in its PEG and a second portion of said inputs being connected to at least one other PEG, having as outputs two sets of (N) boolean combined image transfer switches each,

a first set of boolean combined image transfer switches connected to the outputs of said (N) PEs in its PEG for limited image transfer to said bus (9);

a second set (25) of (P) image transfer switches, connected to the second portion of said inputs of said boolean combiner 23, for limited image transfer from said bus (9); and

(c) control means coupled to said image means and said CAGE means for enabling a variety of interconnections of processing elements to be achievable to expand the capability of a PEG to include PEs from one or more other PEGs accessed via said bus.

4. A configurable parallel processing element pipelined system according to claim 3 further comprising:

(d) setup means directed by said control means to setup said image transfer switches and said CAGE means;

whereby the image processing system is configurable in accordance with the setup of PEs and image transfer switches within said PEGs.

5. A configurable parallel processing element pipelined system according to claim 3 further comprising:

said CAGE means comprises a plurality of signal repeating subassemblies (CAGEs 3,4,5 . . .

     6), and

said CAGE exit means includes enumerator means, for specifying a function of an image in compressed form.

6. A configurable parallel processing element pipelined system, for image processing with computational efficiency within available capacity comprising:

(a) control means (0-1), including image means for providing image data;

(b) image transfer means (7-8, 13,

     17);

(c) image processing subassembly CAGE means, comprising at least one signal repeating image processing subassembly (CAGEs 3, 4, 5 . . .

     6), operatively connected to said image transfer means, each CAGE comprising repowering repeating means (RR

     20), a plurality of configurable processing element groups (PEGs

     10) for processing said image data without storing a full iconic image within any of said processing element groups, a bus (9), and CAGE exit means (11-12, 17-18);

each PEG (10) comprising

a set of (N) processing elements (PEs

     21) each having input and output;

a boolean combiner (23), having inputs and outputs, a first portion of said inputs being connected to the outputs of said set of processing elements within its PEG and a second portion of said inputs being connected to at least one other PEG, having as outputs two sets of (N) boolean combined image transfer switches each,

a first set of boolean combined image transfer switches being feedback (22,

     29) connected to said set of PEs in its PEG for full flexibility of PE interconnection internal to said PEG (10);

a second set of boolean combined image transfer switches being connected to a receiving device, which is the subsequent PEG or, alternatively, is CAGE exit means, for full flexibility of PE interconnection to the receiving device;

a first set (24) of image transfer switches, connected to the outputs of said (N) PEs for limited image transfer to said bus (9);

a second set (25) of (P) image transfer switches, connected to the second portion of said inputs of said boolean combiner 23, for limited image transfer from said bus (9);

said control means being coupled to said image transfer means and said image processing subassembly CAGE means for enabling a variety of interconnections of processing elements to be achievable to expand the capability of a PEG to include PEs from one or more other PEGs accessed via said bus; and

(d) set up means directed by said control means to setup said image transfer switches and said CAGE means;

whereby the image processing system is configurable in accordance with the setup of PEs and image transfer switches within said PEGs.

7. A configurable parallel pipelined image processing system according to claim 6 further comprising:

said boolean combiner (23) operates by table lookup.

8. A configurable parallel pipelined image processing system according to claim 6 further comprising:

said processing elements (21) operate by table lookup.

9. A configurable parallel pipelined image processing system according to claim 6 further comprising:

at least one of the processing elements in said set of (N) processing elements in one of said PEGs (10) neighborhood function logic means is equipped with a neighborhood function feedback mechanism connecting a function of its output back as partial input for the next image.

10. A configurable parallel processing element pipelined system, for image processing with computational efficiency within available capacity comprising:

(a) control means, comprising host computer means (0) with associated image acquisition means, and controller means (1);

(b) image transfer means, comprising video buffer (7) connected to said control means in such fashion as to receive both image input (13) and control input (14);

(c) CAGE means, comprising a plurality of signal repeating image processing subassemblies (CAGEs 3, 4, 5 . . .

     6), operatively connected to said image transfer means, each CAGE comprising repowering repeating means (RR

     20) a plurality of configurable processing element groups (PEGs) (10) for processing said image input without storing a full iconic image within any of said processing element groups, a bus (9), and CAGE exit means (11-12, 17-18);

each PEG (10) comprising;

a set of (N) processing elements (21) each having input and output;

a boolean combiner (23), having inputs and outputs, a first portion of said inputs being connected to the outputs of said set of processing elements in its PEG and a second portion of said inputs being connected to at least one other PEG, having as outputs two sets of (N) boolean combined image transfer switches each;

a first set of boolean combined transfer switches having feedback (29) connection to said set of PEs for full flexibility of PE interconnection internal to its PEG (10);

a second set of boolean combined transfer switches being connected to a receiving device, which is the subsequent PEG or, alternatively, is CAGE exit means for full flexibility of PE interconnection to the receiving device;

a first set (24) of image transfer switches, connected to the outputs of said (N) PEs for limited image transfer to said bus (9);

a second set (25) of (P) image transfer switches, connected to the second portion of said inputs of said boolean combiner 23, for limited image transfer from said bus (9);

whereby a variety of interconnections of processing elements is achievable to expand the capability of a PEG 10 to include PEs from one or more other PEGs 10 accessed via said bus; and

(d) setup means directed by said control means to setup said image transfer means and said CAGE means;

whereby the image processing system is configurable in accordance with the setup of PEs and image transfer switches within said PEGs (10).

11. A configurable parallel pipelined image processing system according to claim 10 further comprising:

said PEGs (10) are arranged in pipelined configuration within CAGEs (3-6), and said CAGEs (3-6) are arranged with pipelined connections from the first CAGE (C0) to the last CAGE Cn (6) in sequence, and finally to said image transfer means; and

(e) said image transfer means comprises a video buffer (7) and video bus means (8) connecting said video buffer (7) and said CAGEs.

12. A configurable parallel pipelined image processing system according to claim 10 further comprising:

each PEG (10) comprises gating logic means (22) in said feedback connection, and said gating logic means is connected to said control means for setup.

13. A configurable parallel pipelined image processing system according to claim 10 further comprising:

said CAGE exit means includes a direct image transfer connection to the subsequent CAGE, distribution means for additional direct image transfer, and enumeration means for specifying an image in compressed form meaningful to said control means.