DPDispatcher is a Python package used to generate HPC (High-Performance Computing) scheduler systems (Slurm/PBS/LSF/Bohrium) jobs input scripts, submit them to HPC systems, and poke until they finish.
DPDispatcher will monitor (poke) until these jobs finish and download the results files (if these jobs are running on remote systems connected by SSH).
For more information, check the documentation.
Please cite the following paper if you use this project in your work:
- Fengbo Yuan, Zhaohan Ding, Yun-Pei Liu, Kai Cao, Jiahao Fan, Cao Thang Nguyen, Yuzhi Zhang, Haidi Wang, Yixiao Chen, Jiameng Huang, Tongqi Wen, Mingkang Liu, Yifan Li, Yong-Bin Zhuang, Hao Yu, Ping Tuo, Yaotang Zhang, Yibo Wang, Linfeng Zhang, Han Wang, Jinzhe Zeng, DPDispatcher: Scalable HPC Task Scheduling for AI-Driven Science, J. Chem. Inf. Model., 2025, DOI: 10.1021/acs.jcim.5c02081.
This project was separated out from the DP-GEN project (Section 3.3 in its paper) to be used by more workflow software.
DPDispatcher can be installed by pip:
pip install dpdispatcherTo add Bohrium support, execute
pip install dpdispatcher[bohrium]See Getting Started for usage.
DPDispatcher is maintained by Deep Modeling's developers and welcomes other people. See Contributing Guide to become a contributor! 🤓