Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

68

Base only

Active filters: Ollama

EnlistedGhost/Mistral-Small-4-119B-2603-GGUF

119B • Updated 16 days ago • 408 • 1

Tesleum/0xCoder

Text Generation • 12B • Updated 5 days ago • 360 • 2

foduucom/VoiceAssistant

Updated Jul 20, 2024 • 1

nguyenthanhthuan/Llama_3.2_1B_Intruct_Tool_Calling

Text Generation • 1B • Updated Oct 28, 2024 • 137 • • 4

nguyenthanhthuan/Llama_3.2_1B_Intruct_Tool_Calling_V2

Text Generation • 1B • Updated Oct 28, 2024 • 534 • • 8

prithivMLmods/Qwen2.5-Coder-1.5B-Instruct-GGUF

Text Generation • 2B • Updated Nov 18, 2024 • 242 • 3

prithivMLmods/Qwen2.5-Coder-3B-Instruct-GGUF

Text Generation • 3B • Updated Nov 13, 2024 • 173 • 5

prithivMLmods/Llama-Sentient-3.2-3B-Instruct-GGUF

Text Generation • 3B • Updated Nov 24, 2024 • 191 • 8

prithivMLmods/Llama-SmolTalk-3.2-1B-Instruct-GGUF

Text Generation • 1B • Updated Dec 13, 2024 • 115 • 4

prithivMLmods/Llama-Magpie-3.2-3B-Instruct

Text Generation • 3B • Updated Jan 16, 2025 • 4 • 1

QuantFactory/Llama-Magpie-3.2-3B-Instruct-GGUF

Text Generation • 4B • Updated Dec 2, 2024 • 211 • 2

prithivMLmods/Llama-3.2-3B-Promptist-Mini

Text Generation • Updated Jan 6, 2025 • 5 • 4

prithivMLmods/Llama-3.2-3B-Promptist-Mini-GGUF

Text Generation • 3B • Updated Dec 4, 2024 • 346 • 7

prithivMLmods/Neumind-Math-7B-Instruct

Text Generation • Updated Dec 5, 2024 • 9 • 2

prithivMLmods/Neumind-Math-7B-Instruct-GGUF

Text Generation • 8B • Updated Dec 5, 2024 • 62 • 5

prithivMLmods/Novaeus-Promptist-7B-Instruct-GGUF

Text Generation • 8B • Updated Dec 7, 2024 • 213 • 4

mradermacher/Neumind-Math-7B-Instruct-GGUF

8B • Updated Dec 6, 2024 • 41 • 1

mradermacher/Neumind-Math-7B-Instruct-i1-GGUF

8B • Updated Dec 6, 2024 • 86 • 1

prithivMLmods/Acrux-500M-o1-Journey

Text Generation • 0.5B • Updated Dec 20, 2024 • 10 • 2

prithivMLmods/Acrux-500M-o1-Journey-GGUF

Text Generation • 0.5B • Updated Dec 7, 2024 • 135 • 3

mradermacher/Acrux-500M-o1-Journey-GGUF

0.5B • Updated Dec 8, 2024 • 123

mradermacher/Acrux-500M-o1-Journey-i1-GGUF

0.5B • Updated Dec 8, 2024 • 238

prithivMLmods/Qwen-UMLS-7B-Instruct-GGUF

Text Generation • 8B • Updated Dec 9, 2024 • 44 • 2

QuantFactory/Neumind-Math-7B-Instruct-GGUF

Text Generation • 8B • Updated Dec 13, 2024 • 204 • 1

prithivMLmods/Llama-Chat-Summary-3.2-3B

Text Generation • 3B • Updated Dec 17, 2024 • 41 • 7

mradermacher/Llama-Chat-Summary-3.2-3B-GGUF

3B • Updated Dec 17, 2024 • 124

bartowski/Llama-Chat-Summary-3.2-3B-GGUF

Text Generation • 3B • Updated Dec 18, 2024 • 1.12k

prithivMLmods/Llama-3.1-8B-Open-SFT

Text Generation • 8B • Updated Dec 23, 2024 • 13 • • 6

prithivMLmods/Llama-3.1-8B-Open-SFT-GGUF

Text Generation • 8B • Updated Dec 18, 2024 • 27 • 1

mradermacher/Llama-3.1-8B-Open-SFT-GGUF

8B • Updated Mar 14, 2025 • 92 • 1