Update model card: remove AIME/HLE results
Browse files
README.md
CHANGED
|
@@ -30,8 +30,6 @@ Netis N1 is a 32B-parameter model specialized for **intelligent IT operations (A
|
|
| 30 |
| GPQA Diamond (198) | **54.0%** |
|
| 31 |
| IFEval (100) | **87.0% / 91.2%** |
|
| 32 |
| GSM8K (1319) | 91.4% |
|
| 33 |
-
| AIME (90) | 11.1% |
|
| 34 |
-
| HLE (100) | 1.0% |
|
| 35 |
|
| 36 |
## How to Evaluate
|
| 37 |
|
|
@@ -45,7 +43,7 @@ python -m vllm.entrypoints.openai.api_server \
|
|
| 45 |
# OpenRCA eval (requires OpenRCA Bank dataset)
|
| 46 |
python eval_model.py --llm-backend vllm --vllm-base-url http://localhost:6777
|
| 47 |
|
| 48 |
-
# General benchmarks (MMLU-Pro, GPQA,
|
| 49 |
python eval_multi_model.py --name netis-n1 --url http://localhost:6777 --model netis-n1
|
| 50 |
```
|
| 51 |
|
|
|
|
| 30 |
| GPQA Diamond (198) | **54.0%** |
|
| 31 |
| IFEval (100) | **87.0% / 91.2%** |
|
| 32 |
| GSM8K (1319) | 91.4% |
|
|
|
|
|
|
|
| 33 |
|
| 34 |
## How to Evaluate
|
| 35 |
|
|
|
|
| 43 |
# OpenRCA eval (requires OpenRCA Bank dataset)
|
| 44 |
python eval_model.py --llm-backend vllm --vllm-base-url http://localhost:6777
|
| 45 |
|
| 46 |
+
# General benchmarks (MMLU-Pro, GPQA, IFEval, GSM8K)
|
| 47 |
python eval_multi_model.py --name netis-n1 --url http://localhost:6777 --model netis-n1
|
| 48 |
```
|
| 49 |
|