| Both sides previous revision
Previous revision
Next revision
|
Previous revision
|
gpu:file_systems [2010/10/08 17:34] mlawrence |
gpu:file_systems [2021/12/09 16:42] (current) |
| The GPU cluster is provisioned with two filesystems mounted on all the GPU compute nodes as follows : | |
| | The GPU cluster is provisioned with a set of two shared filesystems mounted on the head node as well as on all the GPU compute nodes as follows : |
| |
| Filesystem Size Used Avail Use% Mounted on | Filesystem Size Used Avail Use% Mounted on |
| /dev/sda1 48G 8.0G 38G 18% / | |
| /dev/sda2 48G 180M 45G 1% /spare | |
| tmpfs 12G 0 12G 0% /dev/shm | |
| | |
| /dev/gpfs 12T 45G 12T 1% /GPU | /dev/gpfs 12T 45G 12T 1% /GPU |
| sn8-ib@o2ib:/lustre 7.9T 5.7G 7.5T 1% /LUSTRE | sn8-ib@o2ib:/lustre 7.9T 5.7G 7.5T 1% /LUSTRE |
| |
| The **"/GPU**" filesystem of 12TB is served by a set of four (4) GPFS NSD Servers in the storage cluster. This mount is shared between all the nodes (hn, cn1, cn2,cn3,cn4,cn5). System administrators should refer to the Wiki namespace on GPFS for configuration and operations procedures. | The **"/GPU**" filesystem of 12TB is served by a set of four (4) GPFS NSD Servers in a GPFS storage cluster. This mount is shared between all the nodes (hn, cn1, cn2,cn3,cn4,cn5). System administrators should refer to the seperate Wiki namespace on GPFS for configuration, management and operations of the GPFS cluster. |
| | |
| | The **"/LUSTRE**" filesystem mount is a 7.9TB shared filesystem served by a Lustre cluster running on a single shared Lustre MDS/MGS, plus a set of 3 x ODS servers, serving a total of 9 Lustre OST's (3 per ODS). System administrators can refer to the Wiki namespace on Lustre for configuration, management and operations of the Lustre cluster. |
| | |
| | Connectivity between GPFS clients, Lustre clients and the respective storage cluster servers uses 40Gbps QDR Infiniband, with GPFS using Direct Memory Access (RDMA) over Infiniband. |
| |
| The **"/LUSTRE**" filesystem mount is a 7.9TB shared filesystem served by a Lustre cluster running on a single shared Lustre MDS/MGS, plus a set of 3 ODS servers, serving a total of 9 Lustre OST's (3 per ODS). System administrators can refer to the Wiki namespace on Lustre for configuration and operations prcoedures. | |