| Processor |
16-core 64-bit AMD Opteron 6300 Series processors, up to 192 per cabinet
8x64 KB L1 instruction cache, 16x16 KB L1 data cache, 8x2 MB L2 cache per processor core, 2x8 MB shared L3 cache |
| Memory |
32 GB or 64 GB registered ECC DDR3 SDRAM per compute node
Memory Bandwidth: up to 102.4 GB/s per node |
| Compute Cabinet |
3072 processor cores per system cabinet
Peak Performance: up to 30.7 teraflops per system cabinet |
| Interconnect |
1 Gemini routing and communications ASIC per two compute nodes |
| |
48 switch ports per Gemini chip (160 GB/s switching capacity per chip) |
| |
2-D torus interconnect |
| System Administration |
Cray System Management workstation
Graphical and command line system administration |
| |
Single-system view for system administration |
| |
System software rollback capability |
| Reliability Features (Hardware) |
Cray Hardware Supervisory System (HSS) with independent 100 Mb/s management fabric between all system blades and cabinet-level controllers |
| |
Full ECC protection of all packet traffic in the Gemini network |
| |
Redundant power supplies; redundant voltage regulator modules |
| |
Redundant paths to all system RAID |
| |
Warm-swap compute blades
|
| Reliability Features (Software) |
HSS system monitors operation of all operating system kernels
Lustre file system object storage target failover; Lustre metadata server failover |
| |
Software failover for critical system services including system database, system logger, and batch subsystems
NodeKARE (Node Knowledge and Reconfiguration) |
| Operating System |
Cray Linux Environment (components include SUSE Linux SLES11, HSS and SMW software)
Extreme Scalability Mode (ESM) and Cluster Compatibility Mode (CCM) |
| Compilers, Libraries & Tools |
PGI compilers, Cray Compiler Environment, PathScale
Support for the ISO Fortran standard (2008) including parallel programming using coarrays, C/C++ and UPC
MPI 2.0, Cray SHMEM, other standard MPI libraries using CCM
Cray Apprentice, Cray PAT and Cray Compiler included with systems |
| Job Management |
PBS Professional job management system
Moab Adaptive Computing Suite job management system
|
| External I/O Interface |
InfiniBand, 10 Gigabit Ethernet, Fibre Channel (FC) and Ethernet |
| Disk Storage |
Full line of FC-attached disk arrays with support for FC and SATA disk drives |
| Parallel File System |
Lustre, Data Virtualization Service allows support for NFS, external Lustre and other file systems |
| Power |
45-54.1 kW (45.9 - 55.2 kVA) per cabinet, depending on configuration
Circuit requirements: three-phase wye, 100 AMP at 480/277 and 125 AMP at 400/230 (three-phase, neutral and ground) |
| Cooling |
Air-cooled, air flow: 3,000 cfm (1.41 m3/s); intake: bottom; exhaust: top
Optional ECOphlex liquid cooling |
| Dimensions (Cabinet) |
H 93 in. (2,362 mm) x W 22.50 in. (572 mm) x D 56.75 in. (1,441 mm) |
| Weight (Maximum) |
1,600 lbs. per cabinet (725 kg) air cooled; 2,000 lbs. per cabinet (907 kg) liquid cooled |
| Regulatory Compliance |
UL 60950-1, CAN/CSA - C 22.2 No. 60950-1, CE-mark, RoHS, WEEE |
| Safety |
FCC Class A, VCCI Class A, ICES-003, EN 50022:2006 Class A, AS/NZS CISPR 22:2006, EN 55024: 1998 +A1:2001 +A2:2003 |