byte-deep-hybrid
appvoid commited on
Commit
96314af
·
verified ·
1 Parent(s): e1f3d99

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -38,7 +38,7 @@ datasets:
38
 
39
  # details
40
 
41
- bytebox is a model designed to change public perspective on byte-level language models. It's a deep model pretrained on roughly 500m tokens that demonstrates instruction-following skills with only 60m parameters. Training and inference codes are included.
42
 
43
  To the author's knowledge, this is the first-ever decoder-only instruction pretrained byte-level transformer openly available to date.
44
 
 
38
 
39
  # details
40
 
41
+ bytebox is a model designed to change public perspective on byte-level language models. It's a deep model pretrained on roughly 1B tokens that demonstrates instruction-following skills with only 60m parameters. Training and inference codes are included.
42
 
43
  To the author's knowledge, this is the first-ever decoder-only instruction pretrained byte-level transformer openly available to date.
44