Method and system for disintegrating an XML document for high degree of parallelism

• US 9,658,992 B2
• Filed: 05/18/2011
• Issued: 05/23/2017
• Est. Priority Date: 05/24/2010
• Status: Active Grant

• Current Assignee: TATA Consultancy Services Limited (Tata Sons Pvt Ltd.)
• Original Assignee: TATA Consultancy Services Limited (Tata Sons Pvt Ltd.)
• Inventors: Sahoo, Prabin Ranjan, Tendulkar, Dattatraya Mohan
• Primary Examiner(s): Nguyen, Chau
• Application Number:
  US13/698,072
• Publication Number:
  US 20140149852A1
• Time in Patent Office: 2,197 Days
• Field of Search: 715239
• CPC Class Codes: G06F 16/84 Mapping; Conversion
• CPC Class Codes: G06F 40/117 Tagging; Marking up details of markup languages G06F40/143; Designating a block; Setting of attributes style sheets, e.g. eXtensible Stylesheet Language Transformation [XSLT], G06F40/154
• CPC Class Codes: G06F 40/143 Markup, e.g. Standard Generalized Markup Language [SGML] or Document Type Definition [DTD]
• CPC Class Codes: G06F 40/151 Transformation
• CPC Class Codes: G06F 40/154 Tree transformation for tree-structured or markup documents, e.g. XSLT, XSL-FO or stylesheets
• CPC Class Codes: G06F 40/205 Parsing
• CPC Class Codes: G06F 40/221 Parsing markup language streams streaming G06F40/149

Abstract

The present invention relates to the field of high performance computation. Particularly, the invention relates to converting a huge XML document into SDML format which can be processed with high degree of parallelism to achieve high performance. In addition also SDML can be used as a standalone protocol for data representation. SDML deals with one time write and many times read. Further, SDML files can be splitted on number of lines which makes it easier to distribute among multi cores and even distributing across servers.

Claims

1. A method for processing an Extensible Markup Language (XML) file, the method comprising:

receiving, by a multicore processor, an Extensible Markup Language (XML) file comprising a plurality of Extensible Markup Language (XML) notations, wherein the plurality of XML notations are arranged in a plurality of lines, wherein each XML notation of the plurality of XML notations indicates an element of a record comprising information, and wherein each XML notation comprises tags at start and end of a line in the plurality of lines;

preprocessing, by the multicore processor, the XML file only once to create an intermediate XML file by reading the plurality of XML notations line by line in order to reorganize the XML file in a manner that each tag ends in a line, wherein related tags are organized in a line in the intermediate XML file;

converting, by the multicore processor, the intermediate XML file into a Simple Dependency Markup Language (SDML) file by reading start tags till end tags of the plurality of XML notations in the plurality of lines, wherein each line in SDML file starts with a start tag and ends with an end tag resulting in an aggregation of record in a single line;

iteratively checking, by the multicore processor, if more lines are available in the intermediate XML file for conversion into the SDML file, wherein upon completion of the conversion of the intermediate XML file into the SDML file, the intermediate XML file is deleted;

splitting, by the multicore processor, the SDML file into a plurality of SDML fragments such that the plurality of SDML fragments are distributed across cores of the multicore processor in order to parse the plurality of SDML fragments parallelly; and

combining, by the multicore processor, resultants of the parsed plurality of SDML fragments to create a Previously presented Simple Dependency Markup Language (SDML) file.

2. The method of claim 1, wherein the SDML file is split in parallel using a Unified Modeling Language (UML) notation.

3. The method of claim 1, wherein the SDML file is split into a plurality of SDML fragments such that the plurality of SDML fragments are distributed across a plurality of servers wherein a server of the plurality of servers comprises a multicore processor.

4. The method of claim 1, wherein the SDML files are split based on the number of lines into the SDML fragments.

5. The method of claim 1, wherein the SDML files are split based on the number of cores and maps, each core having a start offset and end offset wherein each core starts reading the file from the given offset till the end offset.