Simplify config internals #4232

Job	Run time
cargo-deny	18s
shellcheck	11s
check	26s
clippy (macos-latest)	26s
clippy (ubuntu-latest)	18s
fmt	13s
clippy (windows-latest)	1m 39s
generate-matrix	33s
test (macos-latest)	1m 20s
test (ubuntu-latest)	1m 31s
test (windows-latest)	2m 7s
remote	1m 54s
foreign	2m 37s
bisect	4m 57s
podman	2m 3s
docker-in-docker	3m 52s
target (${{ matrix.pretty }},${{ matrix.os }})	0s
publish	0s
conclusion	2s
Coverage	27s
	24m 54s

Provide feedback