Uni.lu HPC School 2020 PS08: Advanced Distributed Computing with Python Uni.lu High Performance Computing (HPC) Team E. Kieffer University of Luxembourg (UL), Luxembourg http://hpc.uni.lu 1 / 13 E. Kieffer & Uni.lu HPC Team (University of Luxembourg) Uni.lu HPC School 2020/ PS08 N
13
Embed
Uni.lu HPC School 2020 - PS08: Advanced Distributed Computing … · 2021. 1. 29. · Uni.lu HPC School 2020 - PS08: Advanced Distributed Computing with Python Author: Uni.lu High
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Uni.lu HPC School 2020PS08: Advanced Distributed Computing with Python
Uni.lu High Performance Computing (HPC) TeamE. Kieffer
University of Luxembourg (UL), Luxembourghttp://hpc.uni.lu
1 / 13E. Kieffer & Uni.lu HPC Team (University of Luxembourg) Uni.lu HPC School 2020/ PS08
IPython’s architecture for parallel and distributed computing
Support many different styles of parallelism:↪→ Single program, multiple data (SPMD) parallelism↪→ Multiple program, multiple data (MPMD) parallelism↪→ Message passing using MPI↪→ Task farming↪→ Hybrid approaches combined the above ones
Ipyparallel can detect a job scheduler (e.g. Slurm) when started on a HPC platform
7 / 13E. Kieffer & Uni.lu HPC Team (University of Luxembourg) Uni.lu HPC School 2020/ PS08