The table below describes the computer hardware compromising the FRCE cluster.
Count | CPU Model | CPU Cores | CPU Memory (GB) | GPU Model | GPU Cards per server | GPU Cores per card | GPU Memory per card (GB) |
---|---|---|---|---|---|---|---|
CPU Servers | |||||||
62 | Intel(R) Xeon(R) Gold 6150 CPU @ 2.70GHz | 36 | 768 | - | - | - | - |
68 | Intel(R) Xeon(R) Gold 6342 CPU @ 2.80GHz | 48 | 256 | - | - | - | - |
2 | Intel(R) Xeon(R) Platinum 8268 CPU @ 2.90GHz | 96 | 3072 | - | - | - | - |
GPU Servers | |||||||
18 | Intel(R) Xeon(R) Gold 6150 CPU @ 2.70GHz | 36 | 384 | P100 | 3 | 3584 | 16 |
6 | Intel(R) Xeon(R) Gold 6242R CPU @ 3.10GHz | 40 | 1536 | V100 | 8 | 5120 | 32 |
10 | Intel(R) Xeon(R) Gold 6254 CPU @ 3.10GHz | 36 | 1536 | V100 | 8 | 5120 | 32 |
2 | Intel(R) Xeon(R) Gold 6346 CPU @ 3.10GHz | 32 | 512 | A100 | 2 | 6912 | 80 |
Illumina Dragon Server | |||||||
1 | Intel(R) Xeon(R) Gold 6226R CPU @ 2.90GHz | 32 | 512 | Custom FPGA | 1 | - | - |
Batch Head Node - batch.ncifcrf.gov | |||||||
1 | Intel(R) Xeon(R) Gold 6150 CPU @ 2.70GHz | 36 | 384 | - | - | - | - |
File Transfer Server - fsitgl-xfer03p.ncifcrf.gov | |||||||
1 | Intel(R) Xeon(R) Gold 6150 CPU @ 2.70GHz | 36 | 384 | - | - | - | - |
All systems are connected by dual 10Gb ethernet cards, both to each other and to the NCI-F network, and by a 100Gb InfiniBand network between nodes.
Every user on any system has access to three NAS shares and one local partition:
- /home/${user}
- /scratch/cluster_scratch/${user}
- /tmp or /scratch/local (two names for the same partition)
- /mnt/nasapps (read-only)
Many other NAS shares are also mounted but are available only to specifically named users or groups.