| --- |
| license: apache-2.0 |
| language: |
| - en |
| - zh |
| base_model: Qwen/Qwen2.5-32B-Instruct |
| tags: |
| - aiops |
| - root-cause-analysis |
| - openrca |
| - tool-calling |
| --- |
| |
| # Netis N1 Preview |
|
|
| Netis N1 is a 32B-parameter model specialized for **intelligent IT operations (AIOps)**, fine-tuned using Continual Pre-training, SFT, and RL. |
|
|
| ## Highlights |
|
|
| - **OpenRCA Scoring 26.0%** — on par with Claude Opus 4.5 (26.9%), surpassing GPT Codex (21.0%) and DeepSeek (13.6%) |
| - General capabilities preserved or improved (GPQA +9.6%, MMLU-Pro +3.3%, IFEval +1.0%) |
| - Two-stage diagnostic workflow: tool-call planning + fault localization |
|
|
| ## Evaluation Results |
|
|
| | Benchmark | Netis N1 | |
| | ---------------------- | ----------------: | |
| | OpenRCA Bank (scoring) | **26.0%** | |
| | MMLU-Pro (300) | **67.0%** | |
| | GPQA Diamond (198) | **54.0%** | |
| | IFEval (100) | **87.0% / 91.2%** | |
| | GSM8K (1319) | 91.4% | |
|
|
| ## How to Evaluate |
|
|
| Serve with vLLM and run the eval suite: |
|
|
| ```bash |
| # Start vLLM server |
| python -m vllm.entrypoints.openai.api_server \ |
| --model ./netis-n1 --port 6777 --max-model-len 20000 |
| |
| # OpenRCA eval (requires OpenRCA Bank dataset) |
| python eval_model.py --llm-backend vllm --vllm-base-url http://localhost:6777 |
| |
| # General benchmarks (MMLU-Pro, GPQA, IFEval, GSM8K) |
| python eval_multi_model.py --name netis-n1 --url http://localhost:6777 --model netis-n1 |
| ``` |
|
|
| ## License |
|
|
| Apache 2.0 |
|
|
