Update README.md
Browse files
README.md
CHANGED
|
@@ -33,13 +33,13 @@ Use rwkv pip package 0.8.28+ for RWKV-7 inference: https://pypi.org/project/rwkv
|
|
| 33 |
|
| 34 |
Evals and more information: https://www.rwkv.com/
|
| 35 |
|
| 36 |
-
For developers: https://github.com/BlinkDL/RWKV-LM
|
| 37 |
|
| 38 |
Chat demo: https://github.com/BlinkDL/ChatRWKV/blob/main/API_DEMO_CHAT.py
|
| 39 |
|
| 40 |
-
MMLU rwkv7-v3-1b5 44.84% (rwkv6-v2.1-1b6 26.34%)
|
| 41 |
|
| 42 |
-
|
| 43 |
|
| 44 |
## Model Description
|
| 45 |
|
|
|
|
| 33 |
|
| 34 |
Evals and more information: https://www.rwkv.com/
|
| 35 |
|
| 36 |
+
For developers: https://github.com/BlinkDL/RWKV-LM
|
| 37 |
|
| 38 |
Chat demo: https://github.com/BlinkDL/ChatRWKV/blob/main/API_DEMO_CHAT.py
|
| 39 |
|
| 40 |
+
MMLU rwkv7-v3-1b5 44.84% (rwkv6-v2.1-1b6 26.34%): https://github.com/BlinkDL/RWKV-LM/blob/main/RWKV-v7/rwkv_mmlu_eval.py
|
| 41 |
|
| 42 |
+
0.1B = L12 D768 // 0.4B = L24 D1024 // 1.5B = L24 D2048 // ~3B = L32 D2560 // ~7B = L32 D4096
|
| 43 |
|
| 44 |
## Model Description
|
| 45 |
|