Differences

This shows you the differences between two versions of the page.

--- howto:r [2013/02/19 12:49]
kevin created
+++ howto:r [2021/12/09 16:42] (current)
@@ Line 1: / Line 1: @@
 ====== Using R ======
-**R** is installed in ''/opt/gridware/applications/R/R-2.15.2/'' and is compiled using Open-MPI with the GNU compilers so you will need to add
+**R** has been installed in ''/apps/chpc/bio/R/?'' and is compiled using openmpi and the GNU compilers. R modules have been created so simply adding:
 <code>
-module add openmpi/openmpi-1.6.1-gnu
+module add chpc/R/3.2.3-gcc5.1.0
 </code>
-to your **''.bashrc''**  file in your home directory.
+to your scripts will set up the appropriate paths to R, the compilers (if you want to add your own R packages) and the mpi libraries. Note that there may be several versions of R installed and can be seen by running the: <code>module avail 2>&1 | grep "R"</code> command.
-The ''rMPI'' and ''doMPI'' packages are already installed to allow R to use MPI to distribute its work across multiple nodes of the cluster.
-Once you've created your R script file, called '''job-1.r''', you will need to create a job script file to submit to the Moab scheduler.
+===== Parallel R =====
+The ''Rmpi'', ''doMPI'' and other packages are already installed to allow R to use MPI to distribute its work across multiple nodes of the cluster. **Please submit a request to helpdesk should you need any other packages installed.**
+Once you've created your R script file, called ''myScRipt.r'', you will need to create a job script file to submit to the PBSPro scheduler.
 Example job script file:
-<code>
+<file bash my_R_job.qsub>
 #!/bin/bash
-#MSUB -l nodes=2:ppn=8
+#PBS -l select=2:ncpus=24:mpiprocs=24
-#MSUB -l walltime=1:00:00
+#PBS -P SHORTNAME
-#MSUB -V
+#PBS -q normal
-#MSUB -o /export/home/username/simulations/job-1.out
+#PBS -l walltime=4:00:00
-#MSUB -e /export/home/username/simulations/job-1.err
+#PBS -o /mnt/lustre/users/USERNAME/my_R_data/stdout.txt
-#MSUB -d /export/home/username/simulations
+#PBS -e /mnt/lustre/users/USERNAME/my_R_data/stderr.txt
-#MSUB -M be your_emall@address
+#PBS -N RJob
-#MSUB -q
+#PBS -M myemailaddress@someplace.com
+#PBS -m abe
-mpirun -np 16 /opt/gridware/applications/R/R-2.12.2/bin/R --slave -f /export/home/username/simulations/job-1.r
-</code>
+# Add R module (includes appropriate openMPI and gcc modules)
+module add chpc/R/3.2.3-gcc5.1.0
+# explicitly calculate number of processes.
+nproc=`cat $PBS_NODEFILE | wc -l`
+# make sure we're in the correct working directory.
+cd /mnt/lustre/users/USERNAME/my_R_data
+mpirun -np $nproc -machinefile $PBS_NODEFILE  R --slave -f myScRipt.r
+</file>
 **Notes:**
-  * Replace ''username'' with **your** user name.
+  * Replace ''USERNAME'' with **your** user name.
-  * Replace ''your_emall@address'' with **your** email address.
+  * Replace ''SHORTNAME'' with **your research programme's** short name.
-  * And replace ''simulations'' with your program's //working directory// (which should really be on ''scratch'' for speed).
+  * Replace ''myemailaddress@someplace.com'' with **your** email address.
-  * And change ''job-1'' to be your //script file name//.
+  * And replace ''my_R_data'' with your program's //working directory// (which **must** be under ''/mnt/lustre/users/USERNAME/'').
+  * And change ''myScRipt.r'' to be your //script file name//.
+===Running the script===
+Submit to the scheduler
+<code>
+qsub my_R_job.qsub
+</code>
+Check the list of current jobs in the queue
+<code>
+qstat -w
+</code>
+==== R/bioconductor ====
+Here is a more complete example
+=== pbdR example ===
+== Job scripts ==
+<file bash pbdtest.qsub>
+#PBS -l select=2:ncpus=24:mpiprocs=24:place=excl
+#PBS -l walltime=00:01:00
+#PBS -q normal
+#PBS -P SHORTNAME
+#PBS -M YOUREMAILADDRESS
+#PBS -m be
+#PBS -e /mnt/luster/users/USERNAME/pbdR_test/std_err.txt
+#PBS -o /mnt/lustre/users/USERNAME/pbdR_test/std_out.txt
+#PBS -N PBDR_TEST
+#PBS -mb
+module add chpc/R/3.2.3-gcc5.1.0
+NP=`cat ${PBS_NODEFILE} | wc -l`
+cd /mnt/lustre/users/USERNAME/pbdR_test/
+mpirun -np ${NP} -machinefile ${PBS_NODEFILE} Rscript test_script.R
+</file>
+Note: __USERNAME__ should contain your actual user name!
+<file R test_script.R>
+library(pbdMPI, quiet=TRUE)
+init()
+my.rank <- comm.rank()
+comm.print(my.rank, all.rank=TRUE)
+finalize()
+</file>
+== Submit your job ==
+Finally submit your job using:<code bash>user@login01:~ $ qsub pbdtest.qsub</code>

wiki.chpc.ac.za

User Tools

Site Tools

Differences

Page Tools