Diagnostic and managing distributed processor system

• US 7,552,364 B2
• Filed: 09/29/2003
• Issued: 06/23/2009
• Est. Priority Date: 05/13/1997
• Status: Expired due to Fees

• Current Assignee: Round Rock Research LLC
• Original Assignee: Micron Technology, Inc.
• Inventors: Nguyen, Ken, Johnson, Karl S., Amdahl, Carlton G., Wallach, Walter A.
• Primary Examiner(s): Baderman; Scott T
• Assistant Examiner(s): Contino; Paul F.
• Application Number:
  US10/675,917
• Publication Number:
  US 20040153786A1
• Time in Patent Office: 2,094 Days
• Field of Search: 714/47
• US Class Current: 714/47.2
• CPC Class Codes: G06F 1/20 Cooling means
• CPC Class Codes: G06F 1/206 comprising thermal management
• CPC Class Codes: G06F 1/26 Power supply means, e.g. regulation thereof for memories G11C
• CPC Class Codes: G06F 11/0748 in a remote unit communicating with a single-box computer node experiencing an error/fault remote testing G06F11/2294
• CPC Class Codes: G06F 11/0772 Means for error signaling, e.g. using interrupts, exception flags, dedicated error registers
• CPC Class Codes: G06F 11/0784 Routing of error reports, e.g. with a specific transmission path or data flow
• CPC Class Codes: G06F 11/0793 Remedial or corrective actions recovery from an exception in an instruction pipeline G06F9/3861; by retry G06F11/1402; for recovering from a failure of a protocol instance or entity H04L69/40
• CPC Class Codes: G06F 11/2015 Redundant power supplies power supply failure G06F1/30
• CPC Class Codes: G06F 11/2294 by remote test
• CPC Class Codes: G06F 11/2736 using a dedicated service processor for test
• CPC Class Codes: G06F 11/3027 where the computing system component is a bus
• CPC Class Codes: G06F 11/3051 Monitoring arrangements for monitoring the configuration of the computing system or of the computing system component, e.g. monitoring the presence of processing resources, peripherals, I/O links, software programs verification or detection of system hardware configuration G06F11/2247
• CPC Class Codes: G06F 11/3055 Monitoring arrangements for monitoring the status of the computing system or of the computing system component, e.g. monitoring if the computing system is on, off, available, not available error or fault processing without redundancy G06F11/0703; error detection or correction by redundancy in data representation G06F11/08; error detection or correction by redundancy in operation G06F11/14; error detection or correction by redundancy in hardware G06F11/16
• CPC Class Codes: G06F 11/3058 Monitoring arrangements for monitoring environmental properties or parameters of the computing system or of the computing system component, e.g. monitoring of power, currents, temperature, humidity, position, vibrations thermal management in cooling arrangements of a computing system G06F1/206
• CPC Class Codes: G06F 11/3065 Monitoring arrangements determined by the means or processing involved in reporting the monitored data error or fault reporting or logging G06F11/0766
• CPC Class Codes: G06F 11/328 Computer systems status display G06F11/327 takes precedence
• CPC Class Codes: G06F 11/3466 Performance evaluation by tracing or monitoring
• CPC Class Codes: G06F 11/3476 Data logging G06F11/14, G06F11/2205 take precedence
• CPC Class Codes: G06F 11/3495 for systems
• CPC Class Codes: G06F 13/385 for adaptation of a particular data processing system to different peripheral devices
• CPC Class Codes: G06F 13/4027 : using bus bridges G06F13/4022 takes precedence
• CPC Class Codes: G06F 13/4081 : Live connection to bus, e.g. hot-plugging current or voltage limitation during live insertion H02H9/004
• CPC Class Codes: G06F 21/305 : by remotely controlling device operation
• CPC Class Codes: G06F 21/31 : User authentication
• CPC Class Codes: G06F 2201/86 : Event-based monitoring
• CPC Class Codes: G06F 3/0601 : Interfaces specially adapted for storage systems
• CPC Class Codes: G06F 3/0673 : Single storage device
• CPC Class Codes: G06F 9/4411 : Configuring for operating with peripheral devices; Loading of device drivers
• CPC Class Codes: G06F 9/44521 : Dynamic linking or loading; Link editing at or after load time, e.g. Java class loading
• CPC Class Codes: H02P 7/285 : controlling armature supply only
• CPC Class Codes: H04L 12/12 : Arrangements for remote connection or disconnection of substations or of equipment thereof
• CPC Class Codes: H04L 41/0213 : Standardised network management protocols, e.g. simple network management protocol [SNMP]
• CPC Class Codes: H04L 41/0803 : Configuration setting
• CPC Class Codes: H04L 41/12 : Discovery or management of network topologies
• CPC Class Codes: H04L 41/22 : comprising specially adapted graphical user interfaces [GUI]
• CPC Class Codes: H04L 43/00 : Arrangements for monitoring or testing data switching networks
• CPC Class Codes: H04L 43/06 : Generation of reports
• CPC Class Codes: H04L 43/065 : related to network devices
• CPC Class Codes: H04L 43/50 : Testing arrangements
• CPC Class Codes: Y02D 30/50 : in wire-line communication networks, e.g. low power modes or reduced link rate

Abstract

A network of microcontrollers for monitoring and diagnosing the environmental conditions of a computer is disclosed. The network of microcontrollers provides a management system by which computer users can accurately gauge the health of their computer. The network of microcontrollers provides users the ability to detect system fan speeds, internal temperatures and voltage levels. The invention is designed to not only be resilient to faults, but also allows for the system maintenance, modification, and growth—without downtime. Additionally, the present invention allows users to replace failed components, and add new functionality, such as new network interfaces, disk interface cards and storage, without impacting existing users. One of the primary roles of the present invention is to manage the environment without outside involvement. This self-management allows the system to continue to operate even though components have failed.

Claims

1. A computer monitoring and diagnostic system, comprising:

a remote computer configured to provide at least some control of the system;

one or more server computers, each server computer having a computing device and a housing and being in communication with the remote computer and any other server computers, wherein at least one of the server computers includes a plurality of canisters, each of the canisters having a plurality of card slots;

wherein the at least one server computer further comprises a plurality of canister controllers, wherein the canister controllers are configured to examine canister fan speeds associated with canister fans and to control power to the canisters;

wherein the at least one server computer further comprises a plurality of temperature detectors; and

wherein the system is configured to monitor temperatures indicated by the temperature detectors and to compare the indicated temperatures to a desired operating temperature range;

wherein the canister controller is further configured to automatically increase the canister fan speed of the at least one canister fan without user input when the indicated temperature exceeds an upper limit of the range, if the canister fan speed of least one canister fan is below a threshold;

wherein the canister controller is further configured to automatically power down the at least one server computer when the indicated temperature exceeds a warning threshold;

wherein the system is further configured to automatically indicate that the canister fan has a fault if the canister fan speed is zero;

wherein the system is further configured to automatically set the fan speed to high if the canister fan speed is below a fan speed threshold and above zero; and

wherein the system is further configured to automatically set the fan speed to low if the canister fan speed is above a fan speed threshold.

2. The system of claim 1, wherein at least one of the canisters is removable from the at least one server computer.

3. The system of claim 1, additionally comprising a microcontroller which is configured to log conditions about the canister to a recording system.

4. The system of claim 3, wherein the microcontroller is configured to log messages to non-volatile random access memory.

5. The system of claim 1, wherein the remote computer is configured to request status information from the one or more server computers.

6. The system of claim 5, wherein the system is configured such that the remote computer obtains system status information by retrieving a management information block (MIB) object from the one or more server computers.

7. The system of claim 1, wherein the at least one server computer comprises a remote interface controller and wherein the system is configured such that the remote interface controller continues to receive power so as to maintain communication with the remote computer even if the at least one server computer is otherwise powered down.

8. A computer monitoring and diagnostic system, comprising:

a remote computer configured to provide at least some control of the system;

one or more server computers in communication with the remote computer and any other server computers, the server computer comprising a plurality of networked microprocessors;

at least one sensor, located within at least one of the server computers, configured to sense conditions within the at least one server computer, the at least one sensor communicating with the plurality of networked microprocessors, the conditions comprising a first condition and a second condition; and

one or more variable control components in communication with the plurality of networked microprocessors and with the remote computer;

wherein at least one microprocessor of the plurality of networked microprocessors is configured to modify the operation of the variable control components based at least in part on a comparison of the first sensed condition to a first desired range of operation and the second sensed condition to a second desired range of operation;

wherein the modification is performed without user input when the sensed condition falls outside the desired range of operation;

wherein the modification comprises automatically powering down the at least one server computer when the first sensed condition exceeds a warning threshold;

wherein the modification further comprises automatically setting the variable control component to high when the second sensed condition falls within the second desired range of operation; and

wherein the modification further comprises automatically setting the variable control component to low when the sensed second condition falls outside the second desired range of operation.

9. The system of claim 8, wherein sensing the conditions comprises checking for a microcontroller bus time-out.

10. The system of claim 8, wherein the system is configured to maintain a system log in a non-volatile random access memory.

11. The system of claim 8, wherein sensing the conditions comprises monitoring the speed of a canister fan.

12. A microcontroller network for diagnosing and managing the conditions of a computer, the microcontroller network comprising:

one or more cooling fans arranged within the computer;

one or more temperature detectors;

at least one microcontroller, located within the computer, wherein the microcontroller is in communication with the one or more cooling fans and temperature detectors and is configured to self-manage temperature conditions within the computer;

wherein the microcontroller is further configured to indicate that the cooling fan has a fault without user input if the fan speed of the cooling fan is zero, to set the fan speed of the cooling fan to high without user input if the fan speed is below a fan speed threshold and above zero, and to set the fan speed of the cooling fan to low without user input if the fan speed is above the fan speed threshold; and

wherein the microcontroller is further configured to increase the fan speed of the cooling fans located within the computer without user input if a temperature warning is indicated and to automatically power down the computer when the sensed temperature conditions exceed a warning threshold; and

a remote interface microcontroller and wherein the microcontroller network is configured such that the remote interface microcontroller continues to receive power so as to maintain communication with a remote computer even if the at least one computer is otherwise powered down.

13. The microcontroller of claim 12, wherein the microcontroller is configured to check for a microcontroller bus time-out.

14. The microcontroller of claim 12, wherein the microcontroller is configured to check for a manual system board reset.

15. The microcontroller of claim 12, wherein the microcontroller is configured to check for a software reset command.

16. The microcontroller of claim 12, wherein the microcontroller is configured to check for system faults.

17. The microcontroller of claim 12, wherein the microcontroller is configured to maintain a system log in a non-volatile random access memory.

18. The microcontroller of claim 17, wherein the remote interface microcontroller is further configured to communicate data stored in the system log in non-volatile random access memory to the remote computer.

19. The microcontroller of claim 12, wherein a selected one of the at least one microcontroller is configured to monitor the speed of a canister fan.

20. A computer monitoring and diagnostic system, comprising:

a remote computer configured to provide at least some control of the system;

one or more server computers in communication with the remote computer and any other server computers, at least one of the server computers having a plurality of computer-related components, wherein the components have associated environmental and systemic conditions;

at least one sensor configured to sense the environmental and systemic conditions, wherein the sensor is located within the at least one server computer;

at least one environmental condition control component located within the at least one server computer; and

at least one microcontroller connected to the sensor, the environmental condition control component and the at least one server computer,

wherein the microcontroller is configured to modify operation of the environmental condition control component without user input if the sensed environmental conditions of the at least one server computer indicate a warning and to automatically power down the at least one server computer when the sensed environmental conditions exceed the ability of the environmental condition control component to maintain the sensed environmental conditions within a warning range of operation;

wherein the microcontroller is further configured to indicate a cooling fan fault without user input if the sensed systemic conditions of the at least one server computer indicate that the environmental condition control component is non-operational;

wherein the microcontroller is further configured to set the operation of the environmental condition control component to high without user input if the sensed systemic conditions of the at least one server computer indicate the sensed systemic condition is within a desired operating range;

wherein the microcontroller is further configured to set the operation of the environmental condition control component to low without user input if the sensed systemic conditions of the at least one server computer indicate the sensed systemic condition is outside the desired operating range.

21. The system of claim 20, wherein the microcontroller is located within the at least one server computer.

22. The system of claim 20, wherein the microcontroller is configured to process requests for environmental or systemic conditions from the at least one server computer and is configured to responsively provide the environmental or systemic conditions to the at least one server computer.

23. The system of claim 20, wherein the computer-related components comprise at least one component selected from the group consisting of:

a system board, a central processing unit (CPU), a CPU fan, a backplane board, a backplane fan, a chassis, a chassis fan, a canister, a canister fan, a PCI card, and a PCI card fan.

24. The system of claim 20, wherein the sensor is configured to detect the temperature levels of selected ones of the computer-related components.

25. The system of claim 20, wherein the sensor is configured to detect the speed of a fan intended to cool down selected ones of the computer-related components.

26. The system of claim 20, wherein the sensor is configured to detect the voltage level applied to selected ones of the computer-related components.