Globally Distributed Utility Computing Cloud

• US 20090276771A1
• Filed: 03/09/2009
• Published: 11/05/2009
• Est. Priority Date: 09/15/2005
• Status: Active Grant

• Current Assignee: CA, Inc. (d/b/a CA Technologies) (Broadcom, Inc.)
• Original Assignee: 3tera Incorporated (Broadcom, Inc.)
• Inventors: Nickolov, Peter, Armijo, Bert, Miloushev, Vladimir
• Granted Patent: US 8,429,630 B2
• Time in Patent Office: Days
• US Class Current: 717/177
• CPC Class Codes: G06F 9/4856 resumption being on a different machine, e.g. task migration, virtual machine migration G06F9/5088 takes precedence
• CPC Class Codes: G06F 9/5072 Grid computing
• CPC Class Codes: G06Q 30/0283 Price estimation or determination
• CPC Class Codes: G06Q 30/04 Billing or invoicing
• CPC Class Codes: H04L 67/10 in which an application is distributed across nodes in the network software deployment G06F8/60; multiprogramming arrangements G06F9/46
• CPC Class Codes: H04L 67/1001 for accessing one among a plurality of replicated servers
• CPC Class Codes: H04L 67/1008 based on parameters of servers, e.g. available memory or workload monitoring of computer activity G06F11/30
• CPC Class Codes: H04L 67/101 based on network conditions
• CPC Class Codes: H04L 67/1014 based on the content of a request
• CPC Class Codes: H04L 67/1021 based on client or server locations
• CPC Class Codes: H04L 67/1029 using data related to the state of servers by a load balancer
• CPC Class Codes: H04L 67/1031 Controlling of the operation of servers by a load balancer, e.g. adding or removing servers that serve requests
• CPC Class Codes: H04L 67/34 involving the movement of software or configuration parameters network booting or remote initial program loading [RIPL] G06F9/4416
• CPC Class Codes: H04L 69/32 Architecture of open systems interconnection [OSI] 7-layer type protocol stacks, e.g. the interfaces between the data link level and the physical level
• CPC Class Codes: H04L 69/324 in the data link layer [OSI layer 2], e.g. HDLC
• CPC Class Codes: H04L 69/325 in the network layer [OSI layer 3], e.g. X.25 H04L69/16 takes precedence
• CPC Class Codes: H04L 69/328 in the presentation layer [OSI layer 6]
• CPC Class Codes: H04L 69/329 in the application layer [OSI layer 7]

Abstract

Various techniques are disclosed for use in computing networks such as, for example, on-demand, grid and/or utility computing networks. Examples of at least a portion of the techniques (and/or related features, aspects, and/or benefits) disclosed herein include: techniques for migrating virtual appliances from a first server grid to a second server grid via a communication network; techniques for migrating distributed applications from a first server grid to a second server grid via a communication network; techniques for delivering pre-packaged software in virtual appliances to computing systems for use in operating software applications; techniques for managing use of virtualized computing resources implemented in a computing network; exchange systems for renting or leasing computing resources provided over a computing network; techniques for offering, via a computing network, virtualized computing resources for use in deployment of one or more distributed applications at one or more server grids of a computing network; techniques for offering, via a computing network, distributed application components for use in deployment of one or more distributed applications at one or more server grids of a computing network; techniques for implementing exchange of computing resources between computing resource providers and computing resource subscribers of a computing network; and the like. In at least one embodiment, the computing network may include multiple different data centers and/or server grids which are deployed different geographic locations. In at least one embodiment, at least some of the server grids may be operable to provide on-demand, grid and/or utility computing resources for hosting various types of distributed applications. In at least one embodiment, a distributed application may be characterized as an application made up of distinct components (e.g., virtual appliances, virtual machines, virtual interfaces, virtual volumes, virtual network connections, etc.) in separate runtime environments. In at least one embodiment, different ones of the distinct components of the distributed application may be hosted or deployed on different platforms (e.g., different servers) connected via a network. In some embodiments, a distributed application may be characterized as an application that runs on two or more networked computers.

Claims

1-96. -96. (canceled)

97. A system for migrating a virtual appliance from a first server grid to a second server grid via a computer network, the system comprising:

at least one processor;

at least one interface operable to provide a communication link to at least one network device; and

memory;

the system being operable to;

run a first instance of the virtual appliance at the first server grid, wherein the first server grid has associated therewith a first portion of virtualized computing resources representing computing resources associated with a first plurality of physical servers, wherein the first instance of the virtual appliance has associated therewith a first instance of a virtual machine and a first instance of a virtual volume;

store, at the first instance of the virtual volume, a first disk image for use by the first instance of the virtual appliance;

establish a connection over the computer network from the first server grid to the second server grid;

transfer, to the second server grid, first virtual appliance information relating to the first instance of the virtual appliance, wherein the first virtual appliance information includes virtual appliance descriptor information and virtual appliance configuration information; and

start, using the first virtual appliance information, the second instance of the virtual appliance at the second server grid;

wherein the second instance of the virtual appliance includes a second instance of the virtual machine.

98. The system of claim 97 being further operable to:

identify a first portion of updated or modified data relating to the first disk image;

transfer, to the second server grid, information relating to the first portion of updated or modified data relating to the first disk image;

modify, using the first portion of updated or modified data, a second disk image for use by a second instance of the virtual appliance at the second server grid; and

start, using the modified second disk image, the second instance of the virtual appliance at the second server grid;

wherein the second instance of the virtual appliance includes a second instance of the virtual volume.

99. The system of claim 98 wherein the first instance of the virtual appliance has associated therewith current virtual appliance state information representing a current state of the first instance of the virtual appliance as of a specific time T, the system being further operable to:

start, using the modified second disk image, the second instance of the virtual appliance at the second server grid at a first state corresponding to the current state of the first instance of the virtual appliance as of the specific time T.

100. The system of claim 98 wherein the first instance of the virtual appliance has associated therewith current virtual appliance state information representing a current state of the first instance of the virtual appliance as of a specific time T, wherein the first instance of the virtual appliance includes a first virtual machine having associated therewith current virtual machine state information representing a current state of the first virtual machine as of the specific time T, the system being further operable to:

start, using the modified second disk image, the second instance of the virtual appliance at the second server grid at a first state corresponding to the current state of the first instance of the virtual appliance as of the specific time T; and

start, at the second server grid, an instance of the first virtual machine at a state corresponding to the current state of the first virtual machine as of the specific time T.

101. The system of claim 98:

wherein the first instance of the virtual appliance has associated therewith current virtual appliance state information representing a current state of the first instance of the virtual appliance as of a specific time T;

wherein said detecting further comprises detecting, while the first instance of the virtual appliance is running on the first server grid, the first portion of updated or modified data relating to the first disk image;

wherein said transferring further comprises transferring, to the second server grid while the first instance of the virtual appliance is running at the first server grid, the first disk image;

wherein said modifying further comprises modifying, using the first disk image transferred to the second server grid and using the first portion of updated or modified data, the second disk image to thereby generate the modified second disk image; and

wherein said starting further comprises starting, using the modified second disk image, the second instance of the virtual appliance at the second server grid at a first state corresponding to the current state of the first instance of the virtual appliance as of the specific time T.

102. The system of claim 98 being further operable to:

identify a first geographic location where the first server grid is deployed; and

identify a second geographic location where the second server grid is deployed;

wherein the second geographic location is different than the first geographic location.

103. The system of claim 97:

wherein the first server grid is deployed at a first geographic location; and

wherein the second server grid is deployed at a second geographic location different than the first geographic location.

104. A system for migrating a distributed application from a first server grid to a second server grid via a computer network, the system comprising:

at least one processor;

at least one interface operable to provide a communication link to at least one network device; and

memory;

run a first instance of the distributed application at the first server grid, wherein the first server grid has associated therewith a first portion of virtualized computing resources representing computing resources associated with a first plurality of physical servers, wherein the first instance of the distributed application has associated therewith a first instance of a virtual machine and a first instance of a virtual volume;

store, at the first instance of the virtual volume, a first disk image for use by the first instance of the distributed application;

establish a connection over the computer network from the first server grid to the second server grid;

transfer, to the second server grid, first distributed application information relating to the first instance of the distributed application, wherein the first distributed application information includes distributed application descriptor information and distributed application configuration information; and

start, using the first distributed application information, the second instance of the distributed application at the second server grid;

wherein the second instance of the distributed application includes a second instance of the virtual machine.

105. The system of claim 104 being further operable to:

identify a first portion of updated or modified data relating to the first disk image;

establish a connection over the computer network from the first server grid to the second server grid;

transfer, to the second server grid, information relating to the first portion of updated or modified data relating to the first disk image;

modify, using the first portion of updated or modified data, a second disk image for use by a second instance of the distributed application at the second server grid; and

start, using the modified second disk image, the second instance of the distributed application at the second server grid;

wherein the second instance of the distributed application includes a second instance of the virtual volume.

106. The system of claim 105 wherein the first instance of the distributed application has associated therewith current distributed application state information representing a current state of the first instance of the distributed application as of a specific time T, the system being further operable to:

start, using the modified second disk image, the second instance of the distributed application at the second server grid at a first state corresponding to the current state of the first instance of the distributed application as of the specific time T.

107. The system of claim 105 wherein the first instance of the distributed application has associated therewith current distributed application state information representing a current state of the first instance of the distributed application as of a specific time T, wherein the first instance of the distributed application includes a first virtual machine having associated therewith current virtual machine state information representing a current state of the first virtual machine as of the specific time T, the system being further operable to:

start, using the modified second disk image, the second instance of the distributed application at the second server grid at a first state corresponding to the current state of the first instance of the distributed application as of the specific time T; and

start, at the second server grid, an instance of the first virtual machine at a state corresponding to the current state of the first virtual machine as of the specific time T.

108. The system of claim 105:

wherein the first instance of the distributed application has associated therewith current distributed application state information representing a current state of the first instance of the distributed application as of a specific time T;

wherein said detecting further comprises detecting, while the first instance of the distributed application is running on the first server grid, the first portion of updated or modified data relating to the first disk image;

wherein said transferring further comprises transferring, to the second server grid while the first instance of the distributed application is running at the first server grid, the first disk image;

wherein said modifying further comprises modifying, using the first disk image transferred to the second server grid and using the first portion of updated or modified data, the second disk image to thereby generate the modified second disk image; and

wherein said starting further comprises starting, using the modified second disk image, the second instance of the distributed application at the second server grid at a first state corresponding to the current state of the first instance of the distributed application as of the specific time T.

109. The system of claim 105 being further operable to:

identify a first geographic location where the first server grid is deployed; and

identify a second geographic location where the second server grid is deployed;

wherein the second geographic location is different than the first geographic location.

110. The system of claim 104:

wherein the first server grid is deployed at a first geographic location; and

wherein the second server grid is deployed at a second geographic location different than the first geographic location.

111. A system for delivering pre-packaged software in virtual appliances to computing systems for use in operating software applications, the system comprising:

at least one processor;

at least one interface operable to provide a communication link to at least one network device; and

memory;

the system being operable to;

identify a first virtual appliance class by a first identifier;

request the first virtual appliance class from a first catalog service using the first identifier;

transfer the first virtual appliance class from the catalog server to a first computing system; and

start an instance of the first virtual appliance class on the first computing system.

112. The system of claim 111 wherein the first virtual appliance class includes a first class descriptor and a first storage volume, wherein the first class descriptor includes a definition of at least one configurable parameter for instances of the first virtual appliance class, and wherein the first storage volume includes a disk image of an operating system and software sufficient to create a virtual machine instance booted from the first storage volume, the system being further operable to:

create, using at least a portion of the disk image, the virtual machine instance; and

boot the virtual machine instance from the first storage volume;

wherein the virtual machine instance is operable to perform functions assigned to the first virtual appliance class.

113. The system of claim 111 being further operable to:

authenticate the first computing system to the first catalog service for a purpose of authorizing the transfer of the first virtual appliance class from the catalog server to the first computing system.

114. The system of claim 111 being further operable to:

request a first set of license terms for using the first virtual appliance; and

record an acceptance of the first license terms by an end user.

115. The system of claim 111 being further operable to:

request pricing information relating to a use of the first virtual appliance class.

116. The system of claim 111 being further operable to:

deliver pre-packaged software in virtual appliances to computing systems for use in operating distributed applications on the first computing system;

locate a first copy of the first virtual appliance class at the first computing system;

request from a first catalog service, using the first identifier, first metadata relating to the first virtual appliance class; and

verify, using the first metadata, whether the first copy is up-to-date with the first catalog service;

starting an instance of the first virtual appliance class on the first computing system using the first copy.

117. The system of claim 116 being further operable to:

determine wherein there is a need to transfer the first appliance class based on an outcome of the verification of the first copy of the first virtual appliance class.

118. An exchange system for renting or leasing computing resources provided over a computing network, the system comprising:

at least one processor;

at least one interface operable to provide a communication link to at least one network device; and

memory;

the system being operable to;

register a first set of computing resources provided by a first resource provider;

register a second set of computing resources provided by a second resource provider; and

register at least one resource subscriber including a first resource subscriber, wherein the first resource subscriber is registered to use a portion of the first set of computing resources and a portion of the second set of computing resources.

119. The system of claim 118 further comprising:

a metering system operable to measure an amount of computing resources used by the first resource subscriber; and

a billing system operable to;

facilitate initiation of a first automated payment relating to the resource subscriber'"'"'s usage of the first portion of computing resources;

facilitate initiation of a second automated payment relating to the resource subscriber'"'"'s usage of the second portion of computing resources;

facilitate delivery of the first automated payment to the first resource provider; and

facilitate delivery of the second automated payment to the second resource provider.

120. The system of claim 118 further comprising:

a metering system operable to measure usage of computing resources associated with the first resource subscriber; and

a billing system operable to facilitate an exchange of payment between the resource subscriber and publishers of the first and second sets of computing resources.

121. The system of claim 118 further comprising:

a first catalog service system operable to;

provide resource subscriber access, via the computing network, to a first catalog of virtual appliances; and

record resource subscriber acceptance of licensing terms associated with one or more virtual appliances.

122. The system of claim 118 further comprising:

a first catalog service system operable to;

provide resource subscriber access, via the computing network, to a first catalog of virtual appliances; and

facilitate an exchange of payment between the resource subscriber and at least one publisher of virtual appliances associated with the first catalog of virtual appliances.