Skip to content

Commit

Permalink
Update 064-parallel.md
Browse files Browse the repository at this point in the history
added summary
  • Loading branch information
Johnryder23 authored Oct 7, 2024
1 parent 43892ca commit b9ac5a4
Showing 1 changed file with 5 additions and 5 deletions.
10 changes: 5 additions & 5 deletions _episodes/064-parallel.md
Original file line number Diff line number Diff line change
Expand Up @@ -181,11 +181,11 @@ However, unless that function is where the majority of time is spent, this is un

| Name | Other Names | Slurm Option | Pros/cons |
| - | - | - | - |
| Shared Memory Parallelism | Multithreading, Multiproccessing | `--cpus-per-task` | |
| Distrubuted Memory Parallelism | MPI, OpenMPI | `--ntasks` and add `srun` before command | |
| Hybrid | | `--ntasks` and `--cpus-per-task` and add `srun` before command | |
| Job Array | | `--array` | |
| General Purpose GPU | | `--gpus-per-node` | |
| Shared Memory Parallelism | Multithreading, Multiproccessing | `--cpus-per-task` | does not have to use interconnect/can only use max one node |
| Distrubuted Memory Parallelism | MPI, OpenMPI | `--ntasks` and add `srun` before command | can use any number of nodes/does have to use interconnect |
| Hybrid | | `--ntasks` and `--cpus-per-task` and add `srun` before command | best of both!/can be tricky to set-up and get right |
| Job Array | | `--array` | most efficient form of parallelism/not as flexible and requires more manual set-up in Slurm script |
| General Purpose GPU | | `--gpus-per-node` | GPUs can accelerate your code A LOT/sometimes GPUs are all busy |

> ## Running a Parallel Job.
>
Expand Down

0 comments on commit b9ac5a4

Please sign in to comment.