Jobs

Submitting jobs, requirements, fairshare

Creating a batch script

#!/bin/bash -e 
#SBATCH --job-name=SerialJob # job name (shows up in the queue) 
#SBATCH --account=2024-mjb-sandbox # project to record usage against 
#SBATCH --time=00:01:00 # Walltime (days-HH:MM:SS) 
#SBATCH --mem=512MB # Memory in MB or GB

pwd # Prints working directory

Submitting

sbatch myjob.sl

Interactive Jobs

srun --cpus-per-task 2 --account 2024-mjb-sandbox --mem6G -p compute --time 01:00:00 --pty bash--partition compute

Job Efficiency

Inefficient Memory usage that allows 4 Jobs per node

login-0 ~ $ seff 391751

Job ID: 394314 
Array Job ID: 391751_28 
Cluster: eri User/Group: bixleym@agresearch.co.nz/bixleym@agresearch.co.nz 
State: COMPLETED (exit code 0) 
Nodes: 1 
Cores per node: 32 
CPU Utilized: 79-07:10:55 
CPU Efficiency: 76.80% of 103-06:03:12 
core-walltime Job Wall-clock time: 3-05:26:21
Memory Utilized: 25.34 GB 
Memory Efficiency: 9.90% of 256.00 GB

Similar Job - efficient memory request, would allow for 8 Job per node.

login-0 ~ $ seff 401588
Job ID: 432626
Array Job ID: 401588
Cluster: eri
User/Group: bixleym@agresearch.co.nz/bixleym@agresearch.co.nz
State: COMPLETED (exit code 0)
Nodes: 1
Cores per node: 32
CPU Utilized: 37-22:09:27
CPU Efficiency: 82.98% of 45-16:52:48 core-walltime
Job Wall-clock time: 1-10:16:39
Memory Utilized: 27.16 GB
Memory Efficiency: 84.86% of 32.00 GB

Fairshare

Relative use of the cluster. Everyone is assumed to have an equal proportion of the cluster or and equal right to use it. If you use a lot more than everyone else you Fairshare will decrease and you job priority will decrease relative to others. That decays over time (~1 week)

login-0 ~ $ sshare -U
Account                    User  RawShares  NormShares    RawUsage  EffectvUsage  FairShare 
-------------------- ---------- ---------- ----------- ----------- ------------- ---------- 
2023-nesi_slurm_tes+ bixleym@a+     parent    0.038462        3400      0.251494   0.788462