Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

831

Base only

Active filters: ggml

microsoft/VibeVoice-ASR-BitNet

Automatic Speech Recognition • 0.3B • Updated 2 days ago • 665 • 47

unsloth/LTX-2.3-GGUF

Image-to-Video • 21B • Updated Apr 20 • 277k • 527

unsloth/FLUX.2-klein-9B-GGUF

Image-to-Image • 9B • Updated Jan 16 • 97.9k • 285

unsloth/FLUX.2-dev-GGUF

Image-to-Image • 32B • Updated Dec 10, 2025 • 16k • 78

unsloth/Z-Image-Turbo-GGUF

Text-to-Image • 6B • Updated Jan 8 • 47.6k • 238

unsloth/FLUX.2-klein-4B-GGUF

Image-to-Image • 4B • Updated Jan 16 • 157k • 186

Serveurperso/ACE-Step-1.5-GGUF

0.7B • Updated Apr 14 • 41k • 82

Serveurperso/Qwen3-TTS-GGUF

Text-to-Speech • 0.9B • Updated May 11 • 83.4k • 29

unsloth/Qwen-Image-Layered-GGUF

Image-Text-to-Image • 20B • Updated Jan 9 • 12.1k • 61

Serveurperso/OmniVoice-GGUF

Text-to-Speech • 0.6B • Updated Apr 30 • 47.2k • 40

mudler/locate-anything.cpp-gguf

Object Detection • 4B • Updated Jun 11 • 5.6k • 11

mudler/depth-anything.cpp-gguf

Depth Estimation • 0.1B • Updated Jun 20 • 19.2k • 10

ilintar/trellis2-gguf

Image-to-3D • 0.2B • Updated 28 days ago • 16.8k • 5

audiohacking/uniflow-audio-gguf

Text-to-Audio • 0.8B • Updated 6 days ago • 300 • 2

richiejp/deepvqe-aec-gguf

Audio-to-Audio • 7.97M • Updated Apr 27 • 210 • 3

cstr/qwen3-forced-aligner-0.6b-GGUF

Automatic Speech Recognition • 0.9B • Updated Apr 11 • 1.97k • 4

cstr/pyannote-v3-segmentation-GGUF

Voice Activity Detection • 1.49M • Updated Apr 12 • 158 • 1

unsloth/ERNIE-Image-GGUF

Text-to-Image • 8B • Updated Apr 14 • 1.95k • 70

unsloth/ERNIE-Image-Turbo-GGUF

Text-to-Image • 8B • Updated Apr 14 • 7.91k • 227

LocalAI-io/LocalVQE

Audio-to-Audio • 578k • Updated Jun 22 • 6.42k • 63

cstr/vibevoice-asr-GGUF

Automatic Speech Recognition • 8B • Updated 24 days ago • 5.91k • 6

cstr/omniASR-CTC-300M-v2-GGUF

Automatic Speech Recognition • 0.3B • Updated Apr 26 • 141 • 1

cstr/qwen3-tts-tokenizer-12hz-GGUF

Audio-to-Audio • 0.2B • Updated Apr 29 • 3.22k • 3

cstr/kokoro-voices-GGUF

Text-to-Speech • 131k • Updated May 1 • 3.12k • 2

cstr/kokoro-82m-GGUF

Text-to-Speech • 81.7M • Updated May 1 • 2.51k • 1

cstr/qwen3-tts-1.7b-voicedesign-GGUF

Text-to-Speech • 2B • Updated May 1 • 1.58k • 2

cstr/qwen3-tts-0.6b-customvoice-GGUF

Text-to-Speech • 0.9B • Updated May 1 • 1.28k • 2

cstr/qwen3-tts-1.7b-customvoice-GGUF

Text-to-Speech • 2B • Updated May 1 • 1.79k • 6

cstr/chatterbox-turbo-GGUF

Text-to-Speech • 0.3B • Updated Jun 21 • 1.6k • 2

cstr/m2m100-418m-GGUF

Translation • 0.5B • Updated 23 days ago • 800 • 1