Intermediate Artemis HPC: Automating analysis with job arrays: Glossary

Key Points

Welcome back to Artemis HPC
  • Recall how to connect to Artemis HPC

  • Recall the difference between batch and interactive jobs

  • Recall the special Data Transfer Queue

PBS Job Arrays
  • Arrays allow you to submit multiple similar jobs in one script

  • Submit an array job with option -J i-f:s

  • Monitor the queue with qstat -t jobid[]

  • The ^array_index^ construction can be used inside PBS directives

  • The $PBS_ARRAY_INDEX construction is used elsewhere in your PBS script

Automating with Arrays Jobs
  • The PBS_ARRAY_INDEX can be used to index input data

  • awk is your friend!

More ways to automate
  • The PBS_JOBNAME variable can also be used to batch analyses

  • Array jobs can replace FOR loops in PBS scripts

Glossary

FIXME