Files

RWKV-v2-RNN

+eval code for 27M ppl 1.65 BPC 0.72 enwik8 model

Mar 25, 2022

88e921b · Mar 25, 2022

This branch is 260 commits behind BlinkDL/RWKV-LM:main.

Name		Name	Last commit message	Last commit date
parent directory ..
cuda		cuda	RWKV v2 RNN is here. Probably the strongest LM as of now.	Mar 24, 2022
src		src	+eval code for 27M ppl 1.65 BPC 0.72 enwik8 model	Mar 25, 2022
enwik8-vocab.json		enwik8-vocab.json	no message	Mar 25, 2022
run.py		run.py	+eval code for 27M ppl 1.65 BPC 0.72 enwik8 model	Mar 25, 2022
train.py		train.py	+eval code for 27M ppl 1.65 BPC 0.72 enwik8 model	Mar 25, 2022