Fix frozen video in simulcast due to wrong dropping of padding only packets #4740

Job	Run time
ci (ubuntu-20.04, gcc, g++, true, 20, Release)	35m 44s
ci (ubuntu-20.04, gcc, g++, true, 20, Debug)	25m 1s
ci (ubuntu-20.04, clang, clang++, true, 20, Release)	28m 28s
ci (ubuntu-20.04, clang, clang++, true, 20, Debug)	22m 24s
ci (ubuntu-22.04, gcc, g++, 20, Release)	30m 36s
ci (ubuntu-22.04, gcc, g++, 20, Debug)	21m 38s
ci (ubuntu-22.04, clang, clang++, 20, Release)	30m 34s
ci (ubuntu-22.04, clang, clang++, 20, Debug)	24m 23s
ci (macos-12, gcc, g++, 20, Release)	6m 58s
ci (macos-12, gcc, g++, 20, Debug)	7m 9s
ci (macos-14, clang, clang++, 20, Release)	4m 15s
ci (macos-14, clang, clang++, 20, Debug)	3m 51s
ci (windows-2022, cl, cl, 20, Release)	7m 2s
ci (windows-2022, cl, cl, 20, Debug)	6m 12s
	4h 14m 15s

Provide feedback