Methods, systems, and computer readable storage devices for managing faults in a virtual machine network

• US 9,946,614 B2
• Filed: 12/16/2014
• Issued: 04/17/2018
• Est. Priority Date: 12/16/2014
• Status: Active Grant

• Current Assignee: AT&T Intellectual Property I LP (AT&T, Inc.)
• Original Assignee: AT&T Intellectual Property I LP (AT&T, Inc.)
• Inventors: Yang, Chen-Yui, Bajpay, Paritosh, Jong, Chang-Han, Qiu, Chaoxin Charles
• Primary Examiner(s): Bonzo, Bryce P
• Assistant Examiner(s): Arcos, Jeison C
• Application Number:
  US14/572,335
• Publication Number:
  US 20160170848A1
• Time in Patent Office: 1,218 Days
• CPC Class Codes: G06F 11/1438 Restarting or rejuvenating
• CPC Class Codes: G06F 11/1484 involving virtual machines
• CPC Class Codes: G06F 11/2023 Failover techniques

Abstract

Faults are managed in a virtual machine network. Failure of operation of a virtual machine among a plurality of different types of virtual machines operating in the virtual machine network is detected. The virtual machine network operates on network elements connected by transport mechanisms. A cause of the failure of the operation of the virtual machine is determined, and recovery of the virtual machine is initiated based on the determined cause of the failure.

Claims

1. A method, comprising:

detecting, by a processor, a failure of operation of a virtual machine among a plurality of different types of virtual machines operating in a virtual machine network, wherein the virtual machine network operates on network elements connected by transport mechanisms;

determining, by the processor, a cause of the failure of operation of the virtual machine, wherein the determining the cause of the failure includes identifying the cause of the failure as a fault of the virtual machine from among a plurality of possible causes which include;

a fault of a network element;

the fault of the virtual machine;

a fault of a virtual application being executed by the virtual machine; and

a fault of a transport mechanism; and

initiating a recovery of the virtual machine based on the cause of the failure that is determined, wherein when the cause of the failure is determined to be the fault of the virtual machine, the initiating the recovery of the virtual machine includes selecting between whether to restore operation of the virtual machine, migrate the virtual machine to a new network element, or stop operation of the virtual machine and replace the virtual machine with a new virtual machine, wherein the selecting between whether to restore operation of the virtual machine, migrate the virtual machine to the new network element, or stop operation of the virtual machine and replace the virtual machine with the new virtual machine is based upon a type of the virtual machine from among the plurality of different types of virtual machines, wherein the plurality of different types of virtual machines comprises at least two of;

load balancer virtual machines, database virtual machines, caching virtual machines, proxy virtual machines, operations virtual machines, administration virtual machines, maintenance virtual machines, control virtual machines, and monitoring virtual machines.

2. The method of claim 1, further comprising, responsive to a determination to replace the virtual machine with the new virtual machine, determining whether to instantiate the new virtual machine on a same network element on which the failure of operation of the virtual machine occurs or to instantiate the new virtual machine on the new network element.

3. The method of claim 2, further comprising, responsive to a determination to instantiate the new virtual machine on the new network element, identifying the new network element on which to instantiate the new virtual machine.

4. The method of claim 1, further comprising:

correlating the cause of the failure of operation of the virtual machine with causes of failures of operation of other virtual machines, wherein the initiating the recovery of the virtual machine is also based on results of the correlating.

5. A system, comprising:

a processor; and

a memory having instructions stored thereon which, when executed by the processor, cause the processor to perform operations comprising;

detecting a failure of operation of a virtual machine among a plurality of different types of virtual machines operating in a virtual machine network, wherein the virtual machine network operates on network elements connected by transport mechanisms;

determining a cause of the failure of operation of the virtual machine, wherein the determining the cause of the failure includes identifying a cause of the failure as the fault of the virtual machine from among a plurality of possible causes which include;

a fault of a network element;

the fault of the virtual machine;

a fault of a virtual application being executed by the virtual machine; and

a fault of a transport mechanism; and

initiating a recovery of the virtual machine based on the cause of the failure that is determined, wherein when the cause of the failure is determined to be the fault of the virtual machine, the initiating the recovery of the virtual machine includes selecting between whether to restore operation of the virtual machine, migrate the virtual machine to a new network element, or stop operation of the virtual machine and replace the virtual machine with a new virtual machine, wherein the selecting between whether to restore operation of the virtual machine, migrate the virtual machine to the new network element, or stop operation of the virtual machine and replace the virtual machine with the new virtual machine is based upon a type of the virtual machine from among the plurality of different types of virtual machines, wherein the plurality of different types of virtual machines comprises at least two of;

load balancer virtual machines, database virtual machines, caching virtual machines, proxy virtual machines, operations virtual machines, administration virtual machines, maintenance virtual machines, control virtual machines, and monitoring virtual machines.

6. The system of claim 5, wherein the operations further comprise, responsive to a determination to replace the virtual machine with the new virtual machine, determining whether to instantiate the new virtual machine on a same network element on which the failure of operation of the virtual machine occurs or to instantiate the new virtual machine on the new network element.

7. The system of claim 6, wherein the operations further comprise, responsive to a determination to instantiate the new virtual machine on the new network element, identifying the new network element on which to instantiate the new virtual machine.

8. The system of claim 5, wherein the operations further comprise:

correlating the cause of the failure of operation of the virtual machine with causes of failures of operation of other virtual machines, wherein the initiating the recovery of the virtual machine is also based on results of the correlating.

9. A computer readable storage device having instructions stored thereon which, when executed by a processor, cause the processor to perform operations comprising:

detecting a failure of operation of a virtual machine among a plurality of different types of virtual machines operating in a virtual machine network, wherein the virtual machine network operates on network elements connected by transport mechanisms;

determining a cause of the failure of operation of the virtual machine, wherein the determining the cause of the failure includes identifying the cause of the failure as a fault of the virtual machine from among a plurality of possible causes which include;

a fault of a network element;

the fault of the virtual machine;

a fault of a virtual application being executed by the virtual machine; and

a fault of a transport mechanism; and

initiating a recovery of the virtual machine based on the cause of the failure that is determined, wherein when the cause of the failure is determined to be the fault of the virtual machine, the initiating the recovery of the virtual machine includes selecting between whether to restore operation of the virtual machine, migrate the virtual machine to a new network element, or stop operation of the virtual machine and replace the virtual machine with a new virtual machine, wherein the selecting between whether to restore operation of the virtual machine, migrate the virtual machine to the new network element, or stop operation of the virtual machine and replace the virtual machine with the new virtual machine is based upon a type of the virtual machine from among the plurality of different types of virtual machines, wherein the plurality of different types of virtual machines comprises at least two of;

load balancer virtual machines, database virtual machines, caching virtual machines, proxy virtual machines, operations virtual machines, administration virtual machines, maintenance virtual machines, control virtual machines, and monitoring virtual machines.

10. The computer readable storage device of claim 9, wherein the operations further comprise, responsive to a determination to replace the virtual machine with the new virtual machine, determining whether to instantiate the new virtual machine on a same network element on which the failure of operation of the virtual machine occurs or to instantiate the new virtual machine on the new network element.

11. The computer readable storage device of claim 9, wherein the operations further comprise:

correlating the cause of the failure of operation of the virtual machine with causes of failures of operation of other virtual machines, wherein the initiating the recovery of the virtual machine is also based on results of the correlating.

12. The computer readable storage device of claim 10, the operations further comprising, responsive to a determination to instantiate the new virtual machine on the new network element, identifying the new network element on which to instantiate the new virtual machine.