Allow to store and load all configuration items with Docker / Kubernetes runners

Original issue: #282 

Tasks:
- [ ] TODO Store and load custom provider urls so that they don't need to be carried over manually
 - [ ] TODO