User Tools

Site Tools


research:ml

This is an old revision of the document!


If you are making use of Jupyter notebook to write your python scripts then you first need to make sure you export the .py file in Jupyter and then copy it onto the cluster

Also ensure job is copied to /mnt/lustre/users/YOURUSERNAME or subdirectories therein

Running Tensorflow on non-GPU nodes

To test a job on a normal compute node first get onto an interactive CPU compute node with the following:

qsub -I -P YOURPROGRAMME(E.G. CSCI1234) -q smp -l select=1:ncpus=24

Once on an interactive node cnode you need to load up the appropriate modules:

module purge module load chpc/python/3.6.1_gcc-6.3.0

You then cd /mnt/lustre/users/YOURUSERNAME or where ever you placed your .py file

Then type python nameofyourfile.py

Running Tensorflow on GPU nodes

As with CPU version you can test scripts with interactive jobs:

qsub -I -P YOURPROGRAMME(E.G. CSCI1234) -q gpu_1 -l select=1:ncpus=10:ngpus=1

Once on an interactive node gpu you need to load up appropriate modules:

module purge module load chpc/cuda/10.0 module load chpc/python/anaconda/3

You then cd /mnt/lustre/users/YOURUSERNAME or where ever you placed your .py file

Then type python nameofyourfile.py

I will update this page with easy scripts that can be used to submit jobs via the PBS scedular in due course Dr Krishna Govender

/app/dokuwiki/data/attic/research/ml.1562404578.txt.gz · Last modified: 2021/12/09 16:42 (external edit)