Dask Jobqueue Workshop 2021-02

Lead: Willi Rath & Katharina Höflich

Date and Place

See: https://www.cecam.org/workshop-details/1022

Agenda [90 min]

• Intro & Tour of the Docs [10 min]

• Example Problem: Monte-Carlo Estimate of the Number pi

  • With Numpy [10 min]
  • With Dask Array & dask.distributed.LocalCluster [10 min]
  • With Dask Array & dask_jobqueue.SLURMCluster [10 min]

• === Questions? === [10 min]

• Distributed IO [10 min]

• Adaptive Scaling of Dask (Jobqueue) Clusters [10 min]

• (optional) Resilience Against Terminated Workers [10 min]

• === Questions? === [10 min]