Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

144

Base only

Active filters: erp

mradermacher/Slimaki-Tavern-24B-v1.3-i1-GGUF

24B • Updated Jul 4 • 6.25k • 3

ReadyArt/Dark-Scarlett-v1.0-26B-A4B-GGUF

25B • Updated Jun 15 • 5.91k • 23

ReadyArt/Melody1437-12B-GGUF

12B • Updated Jun 6 • 3.29k • 21

ReadyArt/For-Her-Darkside-26B-A4B-v1.4-GGUF

25B • Updated Jun 14 • 2.13k • 9

ReadyArt/Serenity-12B-GGUF

12B • Updated Jun 10 • 5.82k • 23

ReadyArt/Dark-Scarlett-v2.0-31B

31B • Updated Jun 16 • 102 • 6

ReadyArt/Serenity-12B

12B • Updated Jun 10 • 321 • 4

ReadyArt/Dark-Scarlett-v1.0-27B-GGUF

27B • Updated Jun 16 • 1.9k • 4

mradermacher/Melody1437-27B-i1-GGUF

27B • Updated Jun 20 • 262 • 1

MarsupialAI/KitchenSink_103b

Text Generation • 103B • Updated Mar 16, 2024 • 12 • 9

bcse/KitchenSink-103b-GGUF

103B • Updated Jan 23, 2024 • 25 • 1

AzureBlack/KitchenSink_103b-2.5bpw-6h-exl2

Text Generation • Updated Jan 28, 2024 • 5

AzureBlack/KitchenSink_103b-3.5bpw-6h-exl2

Text Generation • Updated Jan 28, 2024 • 4

AzureBlack/KitchenSink_103b-4.5bpw-6h-exl2

Text Generation • Updated Jan 28, 2024 • 7

MarsupialAI/Melusine_103b

Text Generation • 103B • Updated Mar 23, 2024 • 7

MarsupialAI/KitchenSink_103b_iMatrix_GGUF

103B • Updated May 11, 2024 • 36 • 1

MarsupialAI/LaDameBlanche-103b

Text Generation • 103B • Updated Mar 23, 2024 • 3 • 3

MarsupialAI/LaDameBlanche-v2-95b

Text Generation • 95B • Updated Apr 22, 2024 • 17 • 12

mradermacher/Melusine_103b-GGUF

103B • Updated May 6, 2024 • 28 • 1

mradermacher/LaDameBlanche-103b-GGUF

103B • Updated May 6, 2024 • 42 • 3

mradermacher/Melusine_103b-i1-GGUF

103B • Updated May 6, 2024 • 57 • 1

mradermacher/KitchenSink_103b-GGUF

103B • Updated May 6, 2024 • 31 • 1

mradermacher/KitchenSink_103b-i1-GGUF

103B • Updated May 6, 2024 • 77 • 1

mradermacher/LaDameBlanche-103b-i1-GGUF

103B • Updated May 6, 2024 • 33 • 2

mradermacher/LaDameBlanche-v2-95b-GGUF

95B • Updated May 6, 2024 • 4 • 2

mradermacher/LaDameBlanche-v2-95b-i1-GGUF

95B • Updated Feb 5, 2025 • 106 • 2

MarsupialAI/Monstral-123B_iMat_GGUF

Text Generation • 123B • Updated Oct 24, 2024 • 27 • 2

Pentium95/h34v7_DXP-Zero-V1.0-24b-Small-iMatrix-GGUF

Text Generation • 24B • Updated May 22, 2025 • 13 • 1

sandmanbuzz/Emerhyst-20B-Requantized-gguf

20B • Updated May 20, 2025 • 17

tooolz/4.2.0-Broken-Tutu-24b-AWQ-4bit-g128

24B • Updated Nov 2, 2025 • 3