Snakemake and the Cluster
Last updated on 2023-08-02 | Edit this page
- How can we express a one-task cluster operation in Snakemake?
- Write a Snakefile that executes a job on the cluster
- Use MPI options to ensure the job runs in parallel
Snakemake has provisions for operating on an HPC cluster.
Various command-line arguments can be provided to tell Snakemake not to run things locally, but do run things via the queuing system instead.
In this lesson, we will repeat the first module, running the admahl code on the cluster, but will use snakemake to make it happen.
Open your favorite editor, do the thing. Specify resources. Provide command line arguments to do the cluster operations by hand.
Throw the switch!
Use the “mpi” option in the resource block of the Snakemake rule, and
specify the number of tasks. This will be mapped to the
argument of the equivalent