Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

48

Base only

Active filters: INT4

nanishan/Qwen3-Coder-Next.w4a16.gguf

Text Generation • 12B • Updated Apr 2 • 9

lee5j/EXAONE-4.5-33B_GPTQ4

35B • Updated Apr 11 • 35

RedHatAI/MiniMax-M2.5-quantized.w4a16

Text Generation • 34B • Updated May 6 • 45

wasifb/Carnice_V2_27B_INT4_BF16MTP

Text Generation • 7B • Updated May 4 • 4

88plug/Qwen2.5-Omni-7B-W4A16

Text Generation • 11B • Updated Jul 17 • 77

88plug/Gemma4-E2B-it-W4A16

Image-Text-to-Text • 5B • Updated Jul 20 • 332

88plug/MiniCPM-o-4.5-W4A16

Image-Text-to-Text • 9B • Updated Jul 14 • 60 • 2

88plug/Nemotron-3-Nano-30B-A3B-W4A16

Text Generation • 33B • Updated Jul 14 • 86

88plug/Gemma4-E4B-it-W4A16

Image-Text-to-Text • 8B • Updated Jul 11 • 22

88plug/Qwen3-Omni-30B-W4A16

Text Generation • 35B • Updated Jul 10 • 142 • 1

nwzjk/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16-W4A16-G128

Text Generation • 565B • Updated Jun 8 • 15 • 1

eemin/Carnice_V2_27B_INT4_BF16MTP

Text Generation • 7B • Updated Jun 14 • 1

QuantTrio/GLM-5.2-Int4-Int8Mix

Text Generation • 785B • Updated Jun 22 • 8.73k • 20

88plug/Kimi-VL-A3B-Thinking-2506-W4A16

Image-Text-to-Text • 17B • Updated Jul 10 • 45

JunHowie/Qwythos-9B-Claude-Mythos-5-1M-AWQ

Text Generation • 9B • Updated Jul 2 • 624 • 1

drowzeys/keys-latest-GLM-5.2-Quantrio-INT4-INT8-Mixed-Abliterated-DFlash

Text Generation • 785B • Updated Jul 18 • 62 • 4

yuesheng123/MiniCPM-o-4.5-W4A16

Image-Text-to-Text • 9B • Updated Jul 28 • 9

agentvue/GLM-5.2-Int4-Int8Mix-FP8KV

Text Generation • 779B • Updated about 1 month ago • 61 • 1