Text Generation
Transformers
Safetensors
English
Chinese
mimo_v2
multimodal
vision-language
audio
agent
video-understanding
long-context
conversational
custom_code
fp8
Instructions to use XiaomiMiMo/MiMo-V2.5-Base with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use XiaomiMiMo/MiMo-V2.5-Base with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="XiaomiMiMo/MiMo-V2.5-Base", trust_remote_code=True) messages = [ {"role": "user", "content": "Who are you?"}, ] pipe(messages)# pip install -U transformers accelerate # Load model directly from transformers import AutoModelForCausalLM model = AutoModelForCausalLM.from_pretrained("XiaomiMiMo/MiMo-V2.5-Base", trust_remote_code=True, device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use XiaomiMiMo/MiMo-V2.5-Base with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "XiaomiMiMo/MiMo-V2.5-Base" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "XiaomiMiMo/MiMo-V2.5-Base", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/XiaomiMiMo/MiMo-V2.5-Base
- SGLang
How to use XiaomiMiMo/MiMo-V2.5-Base with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "XiaomiMiMo/MiMo-V2.5-Base" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "XiaomiMiMo/MiMo-V2.5-Base", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "XiaomiMiMo/MiMo-V2.5-Base" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "XiaomiMiMo/MiMo-V2.5-Base", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }' - Docker Model Runner
How to use XiaomiMiMo/MiMo-V2.5-Base with Docker Model Runner:
docker model run hf.co/XiaomiMiMo/MiMo-V2.5-Base
Add files using upload-large-folder tool
Browse files- model_mtp.safetensors +3 -0
- model_pp0_ep0_shard0.safetensors +3 -0
- model_pp0_ep0_shard1.safetensors +3 -0
- model_pp0_ep1_shard0.safetensors +3 -0
- model_pp0_ep1_shard1.safetensors +3 -0
- model_pp0_ep2_shard0.safetensors +3 -0
- model_pp0_ep2_shard1.safetensors +3 -0
- model_pp0_ep3_shard0.safetensors +3 -0
- model_pp0_ep3_shard1.safetensors +3 -0
- model_pp0_ep4_shard0.safetensors +3 -0
- model_pp0_ep4_shard1.safetensors +3 -0
- model_pp0_ep5_shard0.safetensors +3 -0
- model_pp0_ep5_shard1.safetensors +3 -0
- model_pp0_ep6_shard0.safetensors +3 -0
- model_pp0_ep6_shard1.safetensors +3 -0
- model_pp0_ep7_shard0.safetensors +3 -0
- model_pp0_ep7_shard1.safetensors +3 -0
model_mtp.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:595ba5a10c2045f1857c7909191e336bb519e6fc9c7e6316676f1a285cd689f5
|
| 3 |
+
size 1189405960
|
model_pp0_ep0_shard0.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:0be0a055d2dc60f42e8adfd98274057331833f51d6ee44e9c2f6603897997061
|
| 3 |
+
size 34369159872
|
model_pp0_ep0_shard1.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:34849fa056f4963dbcfade1f95c24ba2c1236a46a9735b0ab0f4f486b45ad4f4
|
| 3 |
+
size 14463302008
|
model_pp0_ep1_shard0.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:680079f6789f70535378d7ae5ce4f2389a2b9872c70ce03aae5856e3c791633a
|
| 3 |
+
size 34369162432
|
model_pp0_ep1_shard1.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:7f8641430b0c5d36b97be4cb68bc498c4eb090c9676abfe966e343036fe11927
|
| 3 |
+
size 3490619024
|
model_pp0_ep2_shard0.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:680f22d9f2962394523a2b2caa5335b15f391cff523bd3c6f51e0d4e19bd3433
|
| 3 |
+
size 34369162432
|
model_pp0_ep2_shard1.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:6f3009b84045ed6b0c94989310401e256d58ea23aeef3075e14d5a8143b532ed
|
| 3 |
+
size 3490619024
|
model_pp0_ep3_shard0.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:c0f61f84e55e594d89dd5b97fb7cc324841946ec3b0cca17e4247e849ad7f59c
|
| 3 |
+
size 34369169600
|
model_pp0_ep3_shard1.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:e12d047bbf5a8b52f06571ec9b03d5691cc9a2f55044d2d3d4f884eb2b5e5d7c
|
| 3 |
+
size 3490619752
|
model_pp0_ep4_shard0.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:ef5e71b40a776696e0328a4d59465fabaf2f35e54e5a237b21d893212d385dcd
|
| 3 |
+
size 34369170624
|
model_pp0_ep4_shard1.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:27e24cfb781298c4645721ecf3f2939b161268918b9feead9fdff3118aba908b
|
| 3 |
+
size 3490619856
|
model_pp0_ep5_shard0.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:571e4b5e1219dc0cc4402269b04626eb1e7ac51f7bea575386ba5d3ca5414427
|
| 3 |
+
size 34369170624
|
model_pp0_ep5_shard1.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:ee4ee777858bb796ce5b026495eb3e3e464f3161a468b38c10c798ef3251a2ac
|
| 3 |
+
size 3490619856
|
model_pp0_ep6_shard0.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:a5adb370ddcbdd407be7b2e217eb32eaceb9d76cd8d9149599c8ee7c2926fa08
|
| 3 |
+
size 34369170624
|
model_pp0_ep6_shard1.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:ebbba9ed4ed63a4ae06b449d6bce7111e261f0c541149ace43046073dfab848b
|
| 3 |
+
size 3490619856
|
model_pp0_ep7_shard0.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:c20f047ca03eed81cd6c87974c6827f6689eaffd571062fea0a583d65f57c764
|
| 3 |
+
size 34369170624
|
model_pp0_ep7_shard1.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:dd4c3790a14c5b28d299d11432077e56d79621db85504cae5e85694e92018be8
|
| 3 |
+
size 3490619856
|