Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

24,323

Base only

Active filters: llama-cpp

EMD123/DictaLM-3.0-1.7B-Instruct-Q4_K_M-GGUF

Text Generation • 2B • Updated Feb 3 • 56 • 2

jinaai/jina-embeddings-v5-text-small-retrieval-GGUF

Sentence Similarity • 0.6B • Updated Feb 25 • 1.61k • 9

darrowoflykos/bge-m3-Q8_0-GGUF

Sentence Similarity • 0.6B • Updated Mar 4 • 19 • 1

CorryL/piccolo_gorgone

9B • Updated Mar 11 • 83 • 6

Sumitc13/sarvam-30b-GGUF

32B • Updated May 9 • 288 • 7

forkjoin-ai/qwen2-audio-7b-instruct-gguf

Text-to-Audio • 8B • Updated 29 days ago • 1.9k • 3

Tesslate/OmniCoder-9B-GGUF

9B • Updated Mar 12 • 9.59k • 319

joanlsoler/Qwen3-4b-Z-Image-Turbo-AbliteratedV1-Q4_K_M-GGUF

4B • Updated Mar 13 • 1.21k • 2

jackcloudman/Leanstral-2603-GGUF

119B • Updated Mar 17 • 331 • 9

Exil01/Qwen3.5-35B-Uncensored-YaRN-1M

35B • Updated Mar 20 • 743 • 4

prism-ml/Bonsai-1.7B-gguf

Text Generation • 2B • Updated Apr 18 • 5.22k • 76

WithinUsAI/IBM-Grok4-Ultra.Fast.Coder-1B-GGUF

Text Generation • 2B • Updated Mar 30 • 1.11k • 7

continuum-ai/qwen3-coder-30b-a3b-compacted-19b-256k

Text Generation • 20B • Updated Apr 11 • 5.99k • 2

atomicmilkshake/llama-cpp-turboquant-binaries

Updated Apr 8 • 11

Youssofal/MiniMax-M2.7-Abliterated-Heretic-GGUF

Text Generation • 229B • Updated Apr 14 • 1.63k • 46

dennny123/MiniMax-M2.7-GGUF

Text Generation • 229B • Updated Apr 12 • 249 • 2

DavidOKB/MathThink-Qwen-3.5-4B

4B • Updated Apr 12 • 79 • 6

Centara/gemma-4-E4B-it-OBLITERATED-Q8_0-GGUF

Text Generation • 7B • Updated Apr 15 • 426 • 8

Abiray/Qwen3.6-35B-A3B-Q4_K_M-GGUF

Image-Text-to-Text • 35B • Updated Apr 16 • 5.2k • 19

Abiray/Qwen3.6-35B-A3B-Q4_K_S-GGUF

Image-Text-to-Text • 35B • Updated Apr 16 • 310 • 3

prism-ml/Ternary-Bonsai-1.7B-gguf

Text Generation • 2B • Updated 27 days ago • 2.99k • 25

prism-ml/Ternary-Bonsai-4B-gguf

Text Generation • 4B • Updated 27 days ago • 2.56k • 20

barozp/Qwen3.6-28B-REAP20-A3B-GGUF

Text Generation • 28B • Updated Apr 19 • 23.3k • 51

samuelcardillo/Carnice-Qwen3.6-MoE-35B-A3B-GGUF

35B • Updated Apr 19 • 1.23k • 13

Ilya626/gemma-4-E4B-it-SDFT_Heretic_RP-GGUF

8B • Updated Apr 25 • 297 • 1

jinaai/jina-embeddings-v5-omni-small-clustering-GGUF

Feature Extraction • 0.6B • Updated May 12 • 302 • 2

prithivMLmods/Q3.6-27B-DS-v4-Flash-DA-GGUF

Image-Text-to-Text • 27B • Updated Jun 1 • 811 • 5

DAXZEIT/Qwen3.6-27B-mmproj-hybrid-Q8_0-F16-gguf

Updated May 8 • 305 • 2

diverWayne/mikky-64m

Text Generation • 68.8M • Updated May 10 • 50 • 1

Joni-121/gemma-3-1b-it-reasoning-grpo-lora-F16-GGUF

Text Generation • 52.2M • Updated May 13 • 41 • 1