APPARATUS, SYSTEM, AND METHOD FOR GENERATING A RESOURCE UTILIZATION DESCRIPTION FOR A PARALLEL DATA PROCESSING SYSTEM

• US 20080114870A1
• Filed: 11/10/2006
• Published: 05/15/2008
• Est. Priority Date: 11/10/2006
• Status: Active Grant

• Current Assignee: Twitter Inc (X Holdings Corp.)
• Original Assignee: International Business Machines Corporation
• Inventors: Pu, Xiaoyan
• Granted Patent: US 7,660,884 B2
• Time in Patent Office: Days
• US Class Current: 709/224
• CPC Class Codes: G06F 9/5077 Logical partitioning of resources; Management or configuration of virtualized resources specific details on emulation or internal functioning of virtual machines G06F9/455

Abstract

An apparatus, system, and method are disclosed for generating a resource utilization description for a parallel data processing system. The method comprises developing a system model using the data flow graph for a target data processing job. The system model is then tuned based on a sample data set. The tuned system model is utilized to calculate the resource utilization description for the target data processing job. The resource utilization description may include disk space usage, scratch space usage, and processor utilization for each partition in the system. The method may further include determining a more efficient data flow graph to achieve the same results of the target data processing job.

Claims