-
Notifications
You must be signed in to change notification settings - Fork 33
Open
Description
- Throw out cached values once you've merged them into irrelevance
- somewhat nontrivial, since you have to also remove it from all the other processes' caches
- don't give the whole cache to every process
- probably not worthwhile, it'd introduce all sorts of shenanigans to work out who needs to go where, and then the final process still has to use just as much memory.
- reduce the number of things the master python process keeps track of, or caching more of them on disc (although the latter isn't necessarily a great option, because we already spend a significant fraction of our time reading output files).
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
No labels