Consider: ability to set seed
I dunno if this is in scope (feel free to close if not), but when experimenting, setting a fixed seed is handy since you can remove one source of randomness (Karpathy's recipe even includes it as an important beginning step).
Basically, being able to set the seeds for the random, numpy, torch, and other common modules in the config would be handy.