DEPLOYING OPERATORS OF A STREAMING APPLICATION BASED ON PHYSICAL LOCATION ATTRIBUTES OF A VIRTUAL MACHINE

• US 20150256439A1
• Filed: 05/14/2014
• Published: 09/10/2015
• Est. Priority Date: 03/06/2014
• Status: Active Grant

• Current Assignee: AirBNB Incorporated
• Original Assignee: International Business Machines Corporation
• Inventors: Bragstad, Lance, Branson, Michael J., Cao, Bin, Carey, James E., Odden, Mathew R.
• Granted Patent: US 9,680,729 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: H04L 41/083 for increasing network speed
• CPC Class Codes: H04L 41/12 Discovery or management of network topologies
• CPC Class Codes: H04L 41/342 between virtual entities, e.g. orchestrators, SDN or NFV entities
• CPC Class Codes: H04L 41/5009 Determining service level performance parameters or violations of service level contracts, e.g. violations of agreed response time or mean time between failures [MTBF]
• CPC Class Codes: H04L 41/5054 Automatic deployment of services triggered by the service manager, e.g. service implementation by automatic configuration of network components
• CPC Class Codes: H04L 43/0876 Network utilisation, e.g. volume of load or congestion level
• CPC Class Codes: H04L 43/16 Threshold monitoring
• CPC Class Codes: H04L 65/80 Responding to QoS
• CPC Class Codes: H04L 67/025 for remote control or remote monitoring of applications
• CPC Class Codes: H04L 67/1004 Server selection for load balancing
• CPC Class Codes: H04L 67/1008 based on parameters of servers, e.g. available memory or workload monitoring of computer activity G06F11/30
• CPC Class Codes: H04L 67/1012 based on compliance of requirements or conditions with available server resources
• CPC Class Codes: H04L 67/1021 based on client or server locations
• CPC Class Codes: H04L 67/1023 based on a hash applied to IP addresses or costs
• CPC Class Codes: H04L 67/131 Protocols for games, networked simulations or virtual reality

Abstract

A streams manager monitors operator performance of a streaming application to determine when the performance of an operator needs to be improved or optimized. The streams manager in conjunction with a cloud manager automatically determines one or more preferred virtual machines in a cloud with a specified streams infrastructure that best meet the needs of the underperforming operator or application component based on physical location attributes of the preferred virtual machines. The cloud manager determines the physical location attributes of the candidate virtual machines. The streams manager or the cloud manager can then determine a preferred virtual machine of the candidates to deploy the operator based on the physical location attributes. The streams manager then modifies the flow graph so one or more operators of the streaming application are deployed to a preferred virtual machine determined according to the physical location attributes of the preferred virtual machine.

Claims

1. An apparatus comprising:

at least one processor;

a memory coupled to the at least one processor;

a streaming application residing in the memory and executed by the at least one processor, the streaming application comprising a flow graph that includes a plurality of operators that process a plurality of data tuples; and

a streams manager residing in the memory and executed by the at least one processor, the streams manager monitoring performance of the streaming application, and when the streams manager determines an under-performing operator of the streaming application can be optimized, the streams manager modifies the flow graph to move the under-performing operator of the streaming application to a preferred virtual machine based on physical location attributes of the preferred virtual machine.

2. The apparatus of claim 1 wherein the streams manager monitors the performance of the streaming application and determines the under-performing operator by comparing current performance of the streaming application to at least one defined performance threshold.

3. The apparatus of claim 1 wherein the streams manager requests a cloud manager to provision at least one virtual machine with logic to implement at least one of the plurality of operators, and the cloud manager determines physical locations attributes of candidate virtual machines and determines the preferred virtual machine from the candidate virtual machines based on the physical location attributes, the cloud manager provisions the preferred virtual machine, and the streams manager modifies the flow graph to include the preferred virtual machine in the flow graph of the streaming application.

4. The apparatus of claim 3 wherein the request from the streams manager to the cloud manager to provision at least one virtual machine comprises a request that specifies a location restriction to select a preferred virtual machine for a specified component of the streams application.

5. The apparatus of claim 1 wherein the cloud manager determines physical locations attributes of candidate virtual machines and the streams manager determines the preferred virtual machine from the candidate virtual machines based on the physical location attributes and the streams manager modifies the flow graph to include the preferred virtual machine in the flow graph of the streaming application.

6. The apparatus of claim 5 wherein the streams manager determines the preferred virtual machine is not already available and requests the cloud manager to provision the preferred virtual machine in the cloud.

7. The apparatus of claim 6 wherein the streams manager sends a notification to the cloud manager that the flow graph has been modified to make the cloud manager aware of the change for load balancing.

8. The apparatus of claim 1 wherein the physical location attributes comprise:

climate, cooling cost, data regulation environment, virtual machine performance and peak demand utilization.

9. The apparatus of claim 1 wherein the physical location attributes include a security attribute of the physical machine hosting the virtual machine.

10. The apparatus of claim 1 wherein the streams manager communicates with a plurality of cloud managers in a multi-cloud environment.