FRCE Hardware Capabilities

The table below describes the computer hardware compromising the FRCE cluster.

CountCPU ModelCPU CoresCPU Memory (GB)GPU ModelGPU Cards per serverGPU Cores per cardGPU Memory per card (GB)
CPU Servers
62Intel(R) Xeon(R) Gold 6150 CPU @ 2.70GHz36768----
68Intel(R) Xeon(R) Gold 6342 CPU @ 2.80GHz48256----
2Intel(R) Xeon(R) Platinum 8268 CPU @ 2.90GHz963072----
GPU Servers
18Intel(R) Xeon(R) Gold 6150 CPU @ 2.70GHz36384P1003358416
6Intel(R) Xeon(R) Gold 6242R CPU @ 3.10GHz401536V1008512032
10Intel(R) Xeon(R) Gold 6254 CPU @ 3.10GHz361536V1008512032
2Intel(R) Xeon(R) Gold 6346 CPU @ 3.10GHz32512A1002691280
Batch Head Node - batch.ncifcrf.gov
1Intel(R) Xeon(R) Gold 6150 CPU @ 2.70GHz36384----
File Transfer Server - fsitgl-xfer03p.ncifcrf.gov
1Intel(R) Xeon(R) Gold 6150 CPU @ 2.70GHz36384----

All systems are connected by dual 10Gb ethernet cards, both to each other and to the NCI-F network, and by a 100Gb InfiniBand network between nodes.

Every user on any system has access to three NAS shares and one local partition:

  • /home/${user}
  • /scratch/cluster_scratch/${user}
  • /tmp or /scratch/local (two names for the same partition)
  • /mnt/nasapps (read-only)

Many other NAS shares are also mounted but are available only to specifically named users or groups.