chore: peer_manager simple cleanup #6256

Job	Run time
changes	4s
build-ubuntu-22.04	24m 47s
build-macos-13	35m 2s
test-ubuntu-22.04	35m 37s
test-macos-13	39m 22s
build-docker-image / docker-build-ubuntu-22.04	5m 40s
js-waku-node / node	6h 0m 13s
js-waku-node-optional / node	1m 20s
nwaku-nwaku-interop-tests / test-pr / tests	3m 45s
Lint	24s
	8h 26m 14s

Provide feedback