User Tools

Site Tools


jobperformance:start

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
jobperformance:start [2021/08/17 14:37]
alopis
jobperformance:start [2021/12/09 16:42] (current)
Line 1: Line 1:
-First find out which nodes your running job is using+====== Getting an Idea of Job Performance ====== 
 +First find out which nodes your running job is using:
  
-qstat -awu <userid> -n1+  qstat -awu <userid> -n1
  
-Or if your job has many nodes then this is more legible.+Where <userid> refers to your userid on Lengau. Or if your job has many nodes then this is more legible.
  
-qstat -awu <userid> -n+  qstat -awu <userid> -n
  
 Thereafter login ("ssh" command) to the 1st node, and then at least 1 or 2 other nodes (if not an smp single node job of course). On each node run the command "htop" (or "top"). You can see how the resources of cpu and memory etc are being utilised on each node.  Thereafter login ("ssh" command) to the 1st node, and then at least 1 or 2 other nodes (if not an smp single node job of course). On each node run the command "htop" (or "top"). You can see how the resources of cpu and memory etc are being utilised on each node. 
  
-If only the first node is showing any real usage for example, then you know there's a potential issue - this code is only running on one node, and the other nodes are being wasted. You need to investigate whether this code can parallelise to more than one node. Also look at the info htop provides to see if anything seems suspicious or if all is ok. If you need advice, please submit a ticket to our Help Desk.+If only the first node is showing any real usage for example, then you know there's a potential issue - this code is only running on one node, and the other nodes are being wasted. You need to investigate whether this code can parallelise to more than one node. Please also check how many of the 24 cores on each node (normal queue) is actually being used, is this what you are expecting. Further, please look at the info htop provides to see if anything seems suspicious or if all is ok. If you need advice, please submit a ticket to our Help Desk.
  
-An example:+An example (htop info not shown):
  
   [alopis@login2 ~]$ qstat -awu alopis -n1   [alopis@login2 ~]$ qstat -awu alopis -n1
/app/dokuwiki/data/attic/jobperformance/start.1629203835.txt.gz · Last modified: 2021/12/09 16:42 (external edit)