Deploying operators of a streaming application based on physical location attributes of a virtual machine

• US 9,680,729 B2
• Filed: 05/14/2014
• Issued: 06/13/2017
• Est. Priority Date: 03/06/2014
• Status: Expired due to Fees

• Current Assignee: AirBNB Incorporated
• Original Assignee: International Business Machines Corporation
• Inventors: Branson, Michael J., Odden, Mathew R., Cao, Bin, Carey, James E., Bragstad, Lance
• Primary Examiner(s): Tokuta, Shean
• Application Number:
  US14/277,530
• Publication Number:
  US 20150256439A1
• Time in Patent Office: 1,126 Days
• CPC Class Codes: H04L 41/083 for increasing network speed
• CPC Class Codes: H04L 41/12 Discovery or management of network topologies
• CPC Class Codes: H04L 41/342 between virtual entities, e.g. orchestrators, SDN or NFV entities
• CPC Class Codes: H04L 41/5009 Determining service level performance parameters or violations of service level contracts, e.g. violations of agreed response time or mean time between failures [MTBF]
• CPC Class Codes: H04L 41/5054 Automatic deployment of services triggered by the service manager, e.g. service implementation by automatic configuration of network components
• CPC Class Codes: H04L 43/0876 Network utilisation, e.g. volume of load or congestion level
• CPC Class Codes: H04L 43/16 Threshold monitoring
• CPC Class Codes: H04L 65/80 Responding to QoS
• CPC Class Codes: H04L 67/025 for remote control or remote monitoring of applications
• CPC Class Codes: H04L 67/1004 Server selection for load balancing
• CPC Class Codes: H04L 67/1008 based on parameters of servers, e.g. available memory or workload monitoring of computer activity G06F11/30
• CPC Class Codes: H04L 67/1012 based on compliance of requirements or conditions with available server resources
• CPC Class Codes: H04L 67/1021 based on client or server locations
• CPC Class Codes: H04L 67/1023 based on a hash applied to IP addresses or costs
• CPC Class Codes: H04L 67/131 Protocols for games, networked simulations or virtual reality

Abstract

A streams manager monitors operator performance of a streaming application to determine when the performance of an operator needs to be improved or optimized. The streams manager in conjunction with a cloud manager automatically determines one or more preferred virtual machines in a cloud with a specified streams infrastructure that best meet the needs of the underperforming operator or application component based on physical location attributes of the preferred virtual machines. The cloud manager determines the physical location attributes of the candidate virtual machines. The streams manager or the cloud manager can then determine a preferred virtual machine of the candidates to deploy the operator based on the physical location attributes. The streams manager then modifies the flow graph so one or more operators of the streaming application are deployed to a preferred virtual machine determined according to the physical location attributes of the preferred virtual machine.

Claims

1. An apparatus comprising:

at least one processor;

a memory coupled to the at least one processor;

a streaming application residing in the memory and executed by the at least one processor, the streaming application comprising a flow graph that includes a plurality of operators that process a plurality of data tuples;

a streams manager residing in the memory and executed by the at least one processor, the streams manager monitoring performance of the streaming application, and when the streams manager determines an under-performing operator of the streaming application can be optimized sending a request to a cloud manager to provision at least one virtual machine, wherein the request specifies a location restriction that provides input for the cloud manger to determine a physical location for a preferred virtual machine based on physical location attributes of the preferred virtual machine; and

wherein the streams manager modifies the flow graph to move the under-performing operator of the streaming application to a preferred virtual machine based on the physical location attributes of the preferred virtual machine;

wherein the streams manager requests a cloud manager to provision at least one virtual machine with logic to implement at least one of the plurality of operators, and the cloud manager determines physical locations attributes of candidate virtual machines and determines the preferred virtual machine from the candidate virtual machines based on the physical location attributes, the cloud manager provisions the preferred virtual machine, and the streams manager modifies the flow graph to include the preferred virtual machine in the flow graph of the streaming application; and

wherein the location restriction indicates an operator processes politically sensitive data that must be performed in a specific political environment and instructs the cloud manager to select a VM with a physical location attribute that meets the location restriction for the specific nature of the sensitive data processed by the operator.

2. An apparatus comprising:

at least one processor;

a memory coupled to the at least one processor;

a streaming application residing in the memory and executed by the at least one processor, the streaming application comprising a flow graph that includes a plurality of operators that process a plurality of data tuples; and

a streams manager residing in the memory and executed by the at least one processor, the streams manager monitoring performance of the streaming application;

when the streams manager determines an under-performing operator of the streaming application can be optimized, sending a request to a cloud manager to provision at least one virtual machine;

wherein the request specifies a location restriction that provides input for the cloud manger to determine a physical location for a preferred virtual machine based on physical location attributes of the preferred virtual machine, wherein the location restriction indicates an operator processes politically sensitive data that must be performed in a specific political environment and instructs the cloud manager to select a VM with a physical location attribute that meets the location restriction for the specific nature of the sensitive data processed by the operator, wherein the physical location attributes include a security attribute of the physical machine hosting the virtual machine that indicates a high level of security for the physical location hosting the virtual machine; and

wherein the streams manager modifies the flow graph to move the under-performing operator of the streaming application to a preferred virtual machine based on the physical location attributes of the preferred virtual machine.

3. A computer-readable article of manufacture comprising software stored on a non-transitory computer readable medium, the software comprising:

a streams manager that monitors performance of a streaming application;

when the streams manager determines an under-performing operator of the streaming application can be optimized, the streams manager sends a request to a cloud manager to provision at least one virtual machine, wherein the request specifies a location restriction that provides input for the cloud manger to determine a physical location for a preferred virtual machine based on physical location attributes of the preferred virtual machine;

wherein the streams manager modifies a flow graph to move the under-performing operator of the streaming application to a preferred virtual machine based on physical location attributes of the preferred virtual machine;

wherein the streams manager requests a cloud manager to provision at least one virtual machine with logic to implement at least one of the plurality of operators, and the cloud manager determines physical locations attributes of candidate virtual machines and determines the preferred virtual machine from the candidate virtual machines based on the physical location attributes, the cloud manager provisions the preferred virtual machine, and the streams manager modifies the flow graph to include the preferred virtual machine in the flow graph of the streaming application; and

wherein the location restriction indicates an operator processes politically sensitive data that must be performed in a specific political environment and instructs the cloud manager to select a VM with a physical location attribute that meets the location restriction for the specific nature of the sensitive data processed by the operator.