Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

4,957

Base only

Active filters: llama.cpp

hesamation/Qwen3.6-35B-A3B-Claude-4.6-Opus-Reasoning-Distilled-GGUF

Text Generation • 35B • Updated Apr 19 • 145k • 270

armand0e/Qwen3.5-9B-Opus-Agent-GGUF

9B • Updated 5 days ago • 2.8k • 7

LiquidAI/LFM2.5-Audio-1.5B-GGUF

1B • Updated Mar 30 • 20.3k • 103

S4MPL3BI4S/gemma4-coding-agent

8B • Updated Apr 10 • 9.67k • 21

spiritbuun/Qwen3.6-27B-DFlash-GGUF

Updated Apr 24 • 29.2k • 70

bekoozkan/godot-gemma-4-e4b-it-GGUF

Any-to-Any • 8B • Updated 23 days ago • 8.38k • 6

teamblobfish/DeepSeek-V4-Flash-GGUF

Text Generation • 284B • Updated 12 days ago • 48.9k • 15

HuggingFaceBio/Carbon-8B-GGUF

8B • Updated 10 days ago • 1.13k • 8

Brian6145/Qwen3.6-27B-Claude-Opus-Sonnet-DistilledV2-MTP-GGUF

Text Generation • 27B • Updated 8 days ago • 3.83k • 5

osmapi/osmQwopus-3.6-27B-V2-heretic-abliterated-uncensored-TQ3_1s-GGUF

Image-Text-to-Text • 27B • Updated 6 days ago • 1.12k • 3

jedisct1/MiMo-V2.5-coder-Q2-v2-MTP

Text Generation • Updated 5 days ago • 434 • 3

pankajpandey-dev/Carbon-3B-GGUF

Text Generation • 3B • Updated 1 day ago • 577 • 3

Lazarus-Ai/ReAligned-Qwen3.5-27B-GGUF

Text Generation • 27B • Updated 4 days ago • 1.38k • 3

tvall43/Qwen3.6-14B-A3B-VibeForged-v2-GGUF

Text Generation • 14B • Updated 2 days ago • 10.6k • 3

bigatuna/Qwen3.5-9b-Sushi-Coder-RL-GGUF

Text Generation • 9B • Updated Apr 20 • 13.6k • 83

kai-os/Carnice-9b-GGUF

Text Generation • 9B • Updated Apr 4 • 3.08k • 57

khazarai/Qwen3-4B-Qwen3.6-plus-Reasoning-Distilled-GGUF

Text Generation • 4B • Updated Apr 19 • 23.3k • 42

invincibleambuj/Ambuj-Tripathi-Indian-Legal-Llama-GGUF

1B • Updated 9 days ago • 4.44k • 33

Jackrong/Qwopus3.5-2B-v3-GGUF

2B • Updated Apr 12 • 1.72k • 5

tomvaillant/qwen3.5-9b-abliterated-journalist-GGUF

9B • Updated 6 days ago • 395 • 2

kai-os/Carnice-V2-27b-GGUF

27B • Updated Apr 25 • 342k • 104

zlaabsi/Qwen3.6-27B-OTQ-GGUF

Image-Text-to-Text • 27B • Updated 29 days ago • 3.81k • 25

LibertAIDAI/Qwen3.6-27B-NVFP4-GGUF

Image-Text-to-Text • 27B • Updated 27 days ago • 7.27k • 12

LibertAIDAI/Qwen3.6-35B-A3B-NVFP4-GGUF

Image-Text-to-Text • 35B • Updated 27 days ago • 3.64k • 7

Dyluhn/lordx64-Qwen3.6-35B-A3B-Claude-4.7-Opus-Reasoning-Distilled-MTP-GGUF

Text Generation • 36B • Updated 25 days ago • 7.01k • 10

sana0756/Gemma-4-GodMode-V9-Ultimate-GGUF

8B • Updated 22 days ago • 495 • 2

Paulescu/LFM2.5-Audio-1.5B-OHF-Voice-GGUF

1B • Updated 19 days ago • 585 • 3

audreyt/CyberNeurova-DeepSeek-V4-Flash-abliterated-GGUF

Text Generation • 284B • Updated 18 days ago • 29k • 5

armand0e/Qwen3.5-9B-Agent-GGUF

9B • Updated 14 days ago • 3.44k • 5

originalGeek/Qwen3.6-27B-unsloth-MTP-Q8_0-HEAD-ONLY

Updated 3 days ago • 132 • 3