| Processor |
16-core 64-bit AMD Opteron 6200 Series processors, up to 96 per cabinet; NVIDIA® Tesla® K20 GPU Accelerators, up to 96 per cabinet |
| Memory |
16 GB or 32 GB registered ECC DDR3 SDRAM and 6 GB GDDR5 per compute node
Memory bandwidth: 4 channels of DDR3 memory per compute node |
| Compute Cabinet |
AMD processing cores: 1,536 processor cores per system cabinet
Peak performance: 100+ Tflops per system cabinet |
Interconnect
|
1 Gemini routing and communications ASIC per two compute nodes
48 switch ports per Gemini chip (160 GB/s internal switching capacity per chip)
3-D torus interconnect |
System Administration
|
Cray System Management workstation
Graphical and command line system administration
Single-system view for system administration
System software rollback capability |
Reliability Features (Hardware)
|
Cray Hardware Supervisory System (HSS) with independent 100 Mb/s management fabric between all system blades and cabinet-level controllers
Full ECC protection of all packet traffic in the Gemini network
Redundant power supplies; redundant voltage regulator modules
Redundant paths to all system RAID |
| Reliability Features (Software) |
HSS system monitors operation of all operating system kernels
Lustre file system object storage target failover; Lustre metadata server failover
Software failover for critical system services including system database, system logger, and batch subsystems
NodeKARE (Node Knowledge and Reconfiguration) |
|
| Operating System |
Cray Linux Environment (components include SUSE Linux SLES11, HSS and SMW software)
Extreme Scalability Mode (ESM) and Cluster Compatibility Mode (CCM) |
| Compilers, Libraries & Tools |
PGI compilers, Cray Compiler Environment, PathScale, CUDA, CAPS
Support for the ISO Fortran standard (2008) including parallel programming using coarrays, C/C++ and UPC
MPI 2.0, Cray SHMEM, OpenACC directives-based programming, other standard MPI libraries using CCM
|
| Job Management |
PBS Professional, Moab Adaptive Computing Suite, Platform LSF
|
| External I/O Interface |
InfiniBand, 10 Gigabit Ethernet, Fibre Channel (FC) and Ethernet |
| Disk Storage |
Full line of FC-attached disk arrays with support for FC and SATA disk drives |
| Parallel File System |
Lustre, Data Virtualization Service allows support for NFS, external Lustre and other file systems |
| Power |
45-54.1 kW (45.9 - 55.2 kVA) per cabinet, depending on configuration
Circuit requirements: three-phase wye, 100 AMP at 480/277 and 125 AMP at 400/230 (three-phase, neutral and ground) |
| Cooling |
Air-cooled, air flow: 3,000 cfm (1.41 m3/s); intake: bottom; exhaust: top
Optional ECOphlex liquid cooling |
Dimensions (Cabinet)
|
H 93 in. (2,362 mm) x W 22.50 in. (572 mm) x D 56.75 in. (1,441 mm) |
| Weight (Maximum) |
1,600 lbs. per cabinet (725 kg) air cooled; 2,000 lbs. per cabinet (907 kg) liquid cooled |
| Regulatory Compliance |
UL 60950-1, CAN/CSA - C 22.2 No. 60950-1, CE-mark, RoHS, WEEE |
| Safety |
FCC Class A, VCCI Class A, ICES-003, EN 50022:2006 Class A, AS/NZS CISPR 22:2006, EN 55024: 1998 +A1:2002 +A2:2003 |