Virtual data center environmental monitoring system

• US 10,228,292 B2
• Filed: 05/01/2017
• Issued: 03/12/2019
• Est. Priority Date: 05/21/2014
• Status: Active Grant

• Current Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Original Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Inventors: Ross, Peter George, Ferreira, Adolfo Bravo, Towner, Richard Chadwick
• Primary Examiner(s): Norman, Marc E
• Application Number:
  US15/583,905
• Publication Number:
  US 20170234738A1
• Time in Patent Office: 680 Days
• CPC Class Codes: G01K 3/14 in respect of space
• CPC Class Codes: G05D 23/1917 using digital means
• CPC Class Codes: G06F 11/301 where the computing system is a virtual computing platform, e.g. logically partitioned systems virtual machines G06F9/45533; logical partitioning of resources G06F9/5077
• CPC Class Codes: G06F 11/3058 Monitoring arrangements for monitoring environmental properties or parameters of the computing system or of the computing system component, e.g. monitoring of power, currents, temperature, humidity, position, vibrations thermal management in cooling arrangements of a computing system G06F1/206
• CPC Class Codes: G06F 11/3089 Monitoring arrangements determined by the means or processing involved in sensing the monitored data, e.g. interfaces, connectors, sensors, probes, agents software debugging using additional hardware using a specific debug interface G06F11/3656; performance evaluation by tracing or monitoring G06F11/3466
• CPC Class Codes: G06F 11/3452 Performance evaluation by statistical analysis
• CPC Class Codes: H05K 7/20836 Thermal management, e.g. server temperature control

Abstract

A virtual temperature monitoring system in a data center communicates with servers mounted in racks to receive internal temperature data generated by internal temperature sensors of the servers. The system derives a virtual sensor measurement of external temperatures external to the server, including a portion of a cold aisle that extends proximate to a rack in which the server is mounted, based upon a relationship between the received internal temperature sensors and the external environment. Sensor data from other sensors can be received via a building management system, and building management signals to the building management system can be generated based at least partially on the virtual sensor data. The virtual sensor data can be used to generate a graphical representation of the servers that highlights relative thermal characteristics of the servers based on the virtual external sensor measurements, including heat indices, excursions beyond thresholds, historical excursion histories, etc.

Claims

1. A system, comprising:

one or more processors; and

memory storing program instructions that when executed by the one or more processors cause the one or more processors to;

perform a calibration process, wherein to perform the calibration process the program instructions when executed by the one or more processors cause the one or more processors to;

track variations, over a common period of time, of both internal temperature sensor measurements generated by an internal temperature sensor of a computer system, and external temperature sensor measurements generated by an external temperature sensor mounted in an external environment proximate to the computer system;

derive a relationship between an internal temperature of the computer system and the external environment based at least in part upon the tracked variations;

subsequent to the calibration process, assign the derived relationship to one or more computer systems; and

for at least one of the one or more computer systems;

communicate with the at least one computer system to receive an internal temperature sensor measurement, generated by an internal sensor of the at least one computer system, indicating an internal temperature of the at least one computer system; and

derive a virtual external temperature sensor measurement of an external temperature of an environment external to the at least one computer system, based at least in part upon the received internal temperature sensor measurement and the derived relationship.

2. The system of claim 1, wherein the program instructions, when executed by the one or more processors further cause the one or more processors to:

determine a present operating state associated with the at least one computer system, based at least in part upon the derived virtual external temperature sensor measurement and at least one predetermined threshold value.

3. The system of claim 2, wherein:

the processor module is further configured to generate a graphical representation of the at least one computer system based at least in part upon the determined present operating state associated with the at least one computer system.

4. The system of claim 3, wherein:

the graphical representation of the at least one computer system comprises a video display, wherein;

the video display comprises a sequence of frames that correspond to various different timestamps, and

the sequence of frames of the video display is arranged in a chronological order based at least in part upon the timestamps corresponding to the frames, such that the video display is a graphical representation of the at least one computer system over a particular period of time.

5. The system of claim 1, wherein the program instructions, when executed by the one or more processors further cause the one or more processors to:

derive external virtual temperature sensor measurements for a plurality of external environments based at least in part upon received respective internal temperature sensor measurements of corresponding computer systems and the derived relationship, wherein different ones of the external virtual temperature sensor measurements correspond to different respective computer systems of a plurality of computer systems mounted in a common rack;

determine a temperature difference between a largest external virtual temperature sensor measurement and a smallest external virtual temperature sensor measurement for the plurality of external environments; and

determine that exhaust air is being recirculated to at least one of the plurality of computer systems mounted in the common rack, based at least in part upon a determination that the temperature difference exceeds at least one predetermined threshold temperature difference value.

6. The system of claim 1, wherein:

the one or more processors are to receive a relative humidity sensor measurement of the external environment proximate to the at least one computer system; and

the program instructions further comprise instructions that, when executed by the one or more processors cause the one or more processors to;

derive a virtual heat index measurement indicating a heat index of the external environment proximate to the at least one computer system based at least in part upon the derived external virtual temperature sensor measurement and the relative humidity sensor measurement; and

determine that the heat index value of the derived virtual heat index measurement exceeds a predetermined heat index threshold value.

7. The system of claim 1, wherein the program instructions, when executed by the one or more processors further cause the one or more processors to:

derive a plurality of virtual external temperature sensor measurements of external temperatures of a plurality of environments external to a corresponding one of a plurality of computer systems installed in a rack, based at least in part upon corresponding received internal temperature sensor measurements from respective ones of the computer systems, and upon the derived relationship between the internal temperature and the external environment; and

determine a present operating state associated with the rack, based at least in part upon the plurality of virtual external temperature sensor measurements and a predetermined threshold value.

8. A method, comprising:

performing a calibration process comprising;

tracking variations, over a common period of time, of both internal temperature sensor measurements generated by an internal temperature sensor of a computer system, and external temperature sensor measurements generated by an external temperature sensor mounted in an external environment proximate to the computer system;

deriving a relationship between an internal temperature of the computer system and the external environment based at least in part upon the tracked variations;

subsequent to the calibration process, assigning the derived relationship to one or more computer systems; and

for at least one of the one or more computer systems;

communicating with the at least one computer system to receive an internal temperature sensor measurement generated by an internal sensor of the at least one computer system, indicating an internal temperature of the at least one computer system; and

deriving a virtual external temperature sensor measurement of an external temperature of an environment external to the at least one computer system, based at least in part upon the received internal temperature sensor measurement and the derived relationship.

9. The method of claim 8, further comprising:

determining a present operating state associated with the at least one computer system, based at least in part upon the derived virtual external temperature sensor measurement and a predetermined threshold value.

10. The method of claim 9, further comprising:

generating a graphical representation of the at least one computer system based at least in part upon the determined present operating state associated with the at least one computer system.

11. The method of claim 8, further comprising:

determining corresponding external virtual temperature sensor measurements for a plurality of external environments that correspond to respective computer systems of a plurality of computer systems mounted in a common rack, based at least in part upon respective received internal temperature sensor measurements and the derived relationship;

determining a temperature difference between a largest external virtual temperature sensor measurement and a smallest external virtual temperature sensor measurement for the plurality of external environments; and

determining that exhaust air is being recirculated to at least one of the plurality of computer systems mounted in the common rack, based at least in part upon a determination that the temperature difference exceeds a predetermined threshold temperature difference value.

12. The method of claim 8, further comprising:

deriving a virtual heat index measurement indicating a heat index value of the external environment proximate to the at least one computer system based at least in part upon the external virtual temperature sensor measurement and a relative humidity sensor measurement of the external environment received from a device associated with the external environment; and

determining that the heat index value of the derived virtual heat index measurement exceeds a predetermined heat index threshold value.

13. The method of claim 12, further comprising:

responsive to determining that the heat index value exceeds the predetermined heat index threshold value, generating an output signal indicating that the heat index threshold value is exceeded.

14. A non-transitory computer readable medium storing a program of instructions that, when executed by a computer system, cause the computer system to:

perform a calibration process, wherein to perform the calibration process the program instructions when executed by the one or more processors cause the one or more processors to;

track variations, over a common period of time, of both internal temperature sensor measurements, generated by an internal temperature sensor of a computer system, and external temperature sensor measurements generated by an external temperature sensor mounted in an external environment proximate to the computer system;

derive a relationship between an internal temperature of the computer system and the external environment based at least in part upon the tracked variations;

subsequent to the calibration process, assign the derived relationship to one or more computer systems; and

for at least one of the one or more computer systems;

communicate with the at least one computer system to receive an internal temperature sensor measurement, generated by an internal sensor of the at least one computer system, indicating an internal temperature of the at least one computer system; and

derive a virtual external temperature sensor measurement of an external temperature of an environment external to the at least one computer system, based at least in part upon the received internal temperature sensor measurement and the derived relationship.

15. The non-transitory computer readable medium of claim 14, wherein the program of instructions, when executed by the computer system, cause the computer system to:

determine a present operating state associated with the at least one computer system, based at least in part upon the derived virtual external temperature sensor measurement and a predetermined threshold value.

16. The non-transitory computer readable medium of claim 15, wherein the program of instructions, when executed by the computer system, cause the computer system to:

derive a virtual heat index measurement indicating a heat index value of the external environment proximate to the at least one computer system based at least in part upon the external virtual temperature sensor measurement and a relative humidity sensor measurement of the external environment received from a device associated with the external environment; and

determine the present operating state associated with the at least computer system based at least in part on a determination that the heat index value of the derived virtual heat index measurement exceeds a predetermined heat index threshold value.

17. The non-transitory computer readable medium of claim 16, wherein the program of instructions, when executed by the computer system, cause the computer system to:

responsive to the determination that the heat index value of the derived virtual heat index measurement exceeds the predetermined heat index threshold value, generate an associated output signal.

18. The non-transitory computer readable medium of claim 15, wherein the program of instructions, when executed by the computer system, cause the computer system to:

generate a graphical representation of the at least one computer system based at least in part upon the determined present operating state associated with the at least one computer system.

19. The non-transitory computer readable medium of claim 14, further comprising instructions to:

determine corresponding external virtual temperature sensor measurements for a plurality of external environments that correspond to respective computer systems of a plurality of computer systems mounted in a common rack, based at least in part upon received respective internal temperature sensor measurements and the derived relationship;

determine a temperature difference between a largest external virtual temperature sensor measurement and a smallest external virtual temperature sensor measurement for the plurality of external environments; and

determine that exhaust air is being recirculated to at least one of the plurality of computer systems mounted in the common rack, based at least in part upon a determination that the temperature difference exceeds a predetermined threshold temperature difference value.

20. The non-transitory computer readable medium of claim 14, wherein the program of instructions, when executed by the computer system, cause the computer system to:

derive a plurality of virtual external temperature sensor measurements of external temperatures of a plurality of environments external to corresponding ones of a plurality of computer systems installed in a rack, based at least in part upon received respective internal temperature sensor measurements from corresponding computer systems and upon the derived relationship between the internal temperature and the external environment; and

determining a present operating state associated with the rack, based at least in part upon the plurality of virtual external temperature sensor measurements and the predetermined threshold value.