Update README.md
Browse files
README.md
CHANGED
|
@@ -38,7 +38,7 @@ datasets:
|
|
| 38 |
|
| 39 |
# details
|
| 40 |
|
| 41 |
-
bytebox is a model designed to change public perspective on byte-level language models. It's a deep model pretrained on roughly
|
| 42 |
|
| 43 |
To the author's knowledge, this is the first-ever decoder-only instruction pretrained byte-level transformer openly available to date.
|
| 44 |
|
|
|
|
| 38 |
|
| 39 |
# details
|
| 40 |
|
| 41 |
+
bytebox is a model designed to change public perspective on byte-level language models. It's a deep model pretrained on roughly 1B tokens that demonstrates instruction-following skills with only 60m parameters. Training and inference codes are included.
|
| 42 |
|
| 43 |
To the author's knowledge, this is the first-ever decoder-only instruction pretrained byte-level transformer openly available to date.
|
| 44 |
|