Fixing Whisper Model Token Normalization #1599

Job	Run time
ubuntu-20.04 3.10 transducer	7m 38s
ubuntu-20.04 3.10 paraformer	8m 52s
ubuntu-20.04 3.10 zipformer2-ctc	7m 25s
ubuntu-22.04 3.10 transducer	6m 5s
ubuntu-22.04 3.10 paraformer	6m 49s
ubuntu-22.04 3.10 zipformer2-ctc	6m 9s
windows-latest 3.10 transducer	15m 46s
windows-latest 3.10 paraformer	18m 52s
windows-latest 3.10 zipformer2-ctc	15m 55s
macos-latest 3.10 transducer	7m 31s
macos-latest 3.10 paraformer	7m 11s
macos-latest 3.10 zipformer2-ctc	4m 39s
macos-14 3.10 transducer	5m 0s
macos-14 3.10 paraformer	5m 4s
macos-14 3.10 zipformer2-ctc	4m 5s
	2h 7m 1s

Provide feedback