Properly process the configs before things like -list-runs