Fix frozen video in simulcast due to wrong dropping of padding only packets #4739

Job	Run time
ci (ubuntu-20.04, gcc, g++, true, 20, Release)	34m 16s
ci (ubuntu-20.04, gcc, g++, true, 20, Debug)	25m 36s
ci (ubuntu-20.04, clang, clang++, true, 20, Release)	29m 28s
ci (ubuntu-20.04, clang, clang++, true, 20, Debug)	23m 42s
ci (ubuntu-22.04, gcc, g++, 20, Release)	33m 8s
ci (ubuntu-22.04, gcc, g++, 20, Debug)	20m 57s
ci (ubuntu-22.04, clang, clang++, 20, Release)	31m 33s
ci (ubuntu-22.04, clang, clang++, 20, Debug)	24m 35s
ci (macos-12, gcc, g++, 20, Release)	6m 36s
ci (macos-12, gcc, g++, 20, Debug)	7m 25s
ci (macos-14, clang, clang++, 20, Release)	4m 14s
ci (macos-14, clang, clang++, 20, Debug)	3m 52s
ci (windows-2022, cl, cl, 20, Release)	7m 31s
ci (windows-2022, cl, cl, 20, Debug)	6m 23s
	4h 19m 16s

Provide feedback