Method and server cluster for map reducing flow services and large documents

• US 20100115046A1
• Filed: 12/12/2008
• Published: 05/06/2010
• Est. Priority Date: 10/31/2008
• Status: Active Grant

• Current Assignee: Software AG
• Original Assignee: Software AG
• Inventors: Ramaiah, Ramu, Reddy Byreddy, Bhaskar, Punnoose, Vinay
• Granted Patent: US 8,682,998 B2
• Time in Patent Office: Days
• US Class Current: 709/208
• CPC Class Codes: G06F 2209/5017 Task decomposition
• CPC Class Codes: G06Q 10/06 Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling

Abstract

The present invention refers to a method for MapReducing the processing of an Electronic Data Interchange (EDI) document (1, the method comprising the following steps:

• • a. mapping the EDI document (1) into a plurality of intermediate documents (10, 11);
  • b. processing the intermediate documents (10, 11) to produce a plurality of intermediate results (20-23);
  • c. reducing the plurality of intermediate results (20-23) to produce a plurality of reduced intermediate results (30, 31); and
  • d. reducing the reduced intermediate results (30, 31) to produce a final result (2) representing the processed EDI document (1).

Claims

1. A method for MapReducing the processing of an Electronic Data Interchange (EDI) document (1), the method comprising the following steps:

a. mapping the EDI document (1) into a plurality of intermediate documents (10, 11);

b. processing the intermediate, documents (10, 11) to produce a plurality of intermediate results (20-23);

c. reducing the plurality of intermediate results (20-23) to produce a plurality of reduced intermediate results (30, 31); and

d. reducing the reduced intermediate results (30, 31) to produce a final result (2) representing the processed EDI document (1).

2. The method of claim 1, wherein the EDI document (1) is mapped such that each of the intermediate documents (10, 11) comprises at least one of a plurality of interchange envelopes, at least one of a plurality of functional group envelopes and/or at least one of a plurality of transaction set envelopes of the EDI document (1).

3. The method of claim 1, wherein steps a. and d. are performed by a master server (M1) of a server cluster and wherein steps b. and c. are performed by a plurality of slave servers (S1, S2) of the server cluster, each slave server (S1, S2) processing one or more intermediate documents (10, 11) and reducing one or more intermediate results (20-23).

4. The method of claim 3, further comprising the step of sending the intermediate documents (10, 11) to the slave servers (S1, S2) from the master server (M1) by an asynchronous invocation.

5. The method of claim 3, wherein the EDI document (1) is stored in a distributed file system accessible to the slave servers (S1, S2) and wherein the method further comprises the step of sending a reference to the intermediate documents (10, 11) to the slave servers (S1, S2) from the master server

6. The method of claim 1, wherein each of the intermediate results (20-23) comprises an identifier relating the respective intermediate result (20-23) to the EDI document (1).

7. The method of claim 1, wherein a processing logic for performing the processing of the slave servers (S1, S2) in step b. is distributed to the slave servers (S1, S2) during runtime.

8. A server cluster comprising a master server (M1) and a plurality of slave servers (S1, S2) adapted for performing a method of claim 1.

15. A computer program comprising instructions adapted for implementing a method of claim 1.

9. A method for MapReducing the processing of at least one input (1) of a FLOW service, the method comprising the steps of:

a. mapping the at least one input (1) of the FLOW service into a plurality of intermediate inputs (10, 11) by a mapper service (Mb);

b. executing a plurality of instances (F10, F10′

) of the FLOW service, the instances (F10, F10′

) of the FLOW service processing the intermediate inputs (10, 11) to produce a plurality of intermediate results (20-23);

c. reducing the intermediate results (20-23) into a plurality of reduced intermediate results (30, 31) by a plurality of first reducer services (R10, R11); and

d. reducing the reduced intermediate results (30, 31) to produce a final output (2) of the FLOW service from the reduced intermediate results (30, 31) by a second reducer service (R20).

10. The method of claim 9, wherein the mapper service (M10) and the second reducer service (R20) are executed on a master server (M1) of a server cluster and wherein the plurality of instances (F10, F10′

) of the FLOW service and the plurality of first reducer services (R10, R11) are executed on a plurality of slave servers (S1, S2) of the server cluster.

11. The method of claim 9, wherein an input signature of the mapper service (M10) conforms to an input signature of the FLOW service.

12. The method of claim 9, wherein an output signature of the reducer services (R10, R11, R20) conforms to an output signature of the FLOW service.

13. The method of claim 9, wherein at least one input of the FLOW service comprises an Electronic Data Interchange (EDI) document (1).

14. A server cluster comprising a master server (M1) and a plurality of slave servers (S1, S2) adapted for performing a method of claim 9.