Managing stream components based on virtual machine performance adjustments

• US 9,535,734 B2
• Filed: 03/06/2014
• Issued: 01/03/2017
• Est. Priority Date: 03/06/2014
• Status: Expired due to Fees

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Cao, Bin, Eidem, Jessica R., Muras, Brian R., Sun, Jingdong
• Primary Examiner(s): Dao, Thuy
• Assistant Examiner(s): Rivera, Anibal
• Application Number:
  US14/198,716
• Publication Number:
  US 20150254091A1
• Time in Patent Office: 1,034 Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/24568 Data stream processing; Continuous queries
• CPC Class Codes: G06F 2009/4557 Distribution of virtual machine instances; Migration and load balancing
• CPC Class Codes: G06F 2209/501 Performance criteria
• CPC Class Codes: G06F 8/61 Installation
• CPC Class Codes: G06F 9/45558 Hypervisor-specific management and integration aspects
• CPC Class Codes: G06F 9/4856 resumption being on a different machine, e.g. task migration, virtual machine migration G06F9/5088 takes precedence
• CPC Class Codes: G06F 9/50 Allocation of resources, e.g. of the central processing unit [CPU]
• CPC Class Codes: G06F 9/5027 the resource being a machine, e.g. CPUs, Servers, Terminals
• CPC Class Codes: G06F 9/5077 Logical partitioning of resources; Management or configuration of virtualized resources specific details on emulation or internal functioning of virtual machines G06F9/455
• CPC Class Codes: G06F 9/5094 where the allocation takes into account power or heat criteria power management in computers in general G06F1/3203; thermal management in computers in general G06F1/206
• CPC Class Codes: H04L 67/289 Intermediate processing functionally located close to the data consumer application, e.g. in same machine, in same home or in same sub-network

Abstract

Embodiments of the disclosure include a method, a system, and a computer program product for modifying a stream operator based on the virtual resources. The method includes receiving a first resource allocation and a second resource allocation of a virtual resource for a virtual machine supporting a stream computing application. The method also includes determining whether the second resource allocation changed within a tolerance relative to the first resource allocation. The method also includes identifying a stream operator in the stream computing application using the virtual resource of the virtual machine. The method also includes modifying the stream operator to accommodate the second resource allocation in response to the second resource allocation changing relative to the first resource allocation.

Claims

1. A method comprising:

initializing, by a stream application and based on a processing element, a first resource allocation of a first virtual resource, the first virtual resource provided by a virtual machine to enable operation of the processing element, the processing element containing one or more stream operators that operate on one or more tuples of the stream application;

monitoring, by the stream application, operation of the virtual machine to allocate one or more virtual resources including the first virtual resource;

detecting, by the stream application and based on the monitored operation of the virtual machine, a second resource allocation;

determining, by the stream application and based on the detected second resource allocation, an increase in the first virtual resource compared to the first resource allocation;

identifying, by the stream application and based on the detected second resource allocation of the virtual machine, the processing element of the stream application;

increasing, by the stream application and based on the determined increase in the virtual resource and based on the identified processing element, a first stream operator function of the processing element, the first stream operator function corresponding to the first virtual resource;

determining, by the stream application, a resource dependency that the first stream operator function depends on a second stream operation function, the second stream operator function corresponding to a second virtual resource, wherein the resource dependency is a ratio between the first stream operator function and the second stream operator function and is based on tuple processing performance monitored by the stream application; and

increasing, by the stream application and based on the determined resource dependency, the second stream operator function of the processing element.

2. The method of claim 1, wherein the stream operator function has an optimal range, and wherein the increased first stream operator function is further based on the optimal range.

3. The method of claim 1, wherein the increased first stream operator function of the stream application may be proportional to the determined increase in the first virtual resource of the virtual machine.