Spaces:
Running
Running
Add Boris-2 and Boris-2-Think (opencerebral, 144M)
#2
by KlondikeDev - opened
Adds two OpenCerebral models (143.7M params each), with the numbers to verify:
- Boris-2, base model
- Boris-2-Think, Boris-2 fine-tuned on short reasoning traces (OpenThink)
lm-evaluation-harness 0.4.12, zero-shot, float32, acc_norm:
| Model | ARC Easy | PIQA | ARC Challenge | HellaSwag |
|---|---|---|---|---|
| Boris-2 | 59.76 | 72.85 | 32.00 | 50.27 |
| Boris-2-Think | 63.93 | 72.31 | 34.81 | 50.13 |
Reproduce: lm_eval --model hf --model_args pretrained=opencerebral/Boris-2,trust_remote_code=True,dtype=float32 --tasks arc_easy,arc_challenge,piqa,hellaswag (custom architecture, so trust_remote_code is needed).
Also adds an opencerebral entry to ORGS.
Action Automated by Claude Code