Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

6,990

Base only

Active filters: llama.cpp

huneyn2321/veriseti2

8B • Updated Mar 23 • 5

Simon-Liu/unsloth-funcgemma-270m-it

0.3B • Updated Mar 23 • 7

plixplox/Qwen3.5-9B

9B • Updated Mar 30 • 14

Alindstroem89/Llama-3.2-3B-Instruct_guardrail

Text Generation • 3B • Updated May 22 • 136

huneyn2321/TriyajAi

8B • Updated Mar 23 • 5

prithivMLmods/Polaris-VGA-9B-Post1.0e

Image-Text-to-Text • 9B • Updated Jun 1 • 215 • 2

prithivMLmods/Polaris-VGA-4B-Post1.0e

Image-Text-to-Text • 5B • Updated Jun 1 • 287 • 1

prithivMLmods/Polaris-VGA-27B-Post1.0e

Image-Text-to-Text • 27B • Updated Jun 1 • 226 • 1

prithivMLmods/OpenMed-SynthVision-MedVL-AIO-GGUF

Visual Question Answering • 3B • Updated Mar 24 • 669 • 3

prithivMLmods/Polaris-VGA-2B-Post1.0

Image-Text-to-Text • 2B • Updated Jun 1 • 278 • 1

prithivMLmods/Polaris-VGA-0.8B-Post1.0

Image-Text-to-Text • 0.9B • Updated Jun 1 • 256 • 1

Vincent-0907/Llama-3.2-3B-ascii-cats-trained-lora-merged-base-q4_k_m-GGUF

3B • Updated Mar 23 • 16

fevohh/WorldParser-8B-1903-GGUF

8B • Updated Mar 23 • 13

Bloce3an/qwen2.5-0.5B-entities-relationship-gguf

Text Generation • 0.5B • Updated Mar 23 • 21

JeanLima2024/dggirl-qwen3.5-9b-4bits-gguf

9B • Updated Mar 23 • 54

sammbann/md-llama-finetune-v1

Updated May 9 • 7

Meet-08/Llama-3.2-3B-ascii-cats-lora-q4_k_m-GGUF

3B • Updated Mar 24 • 5

elsayed5611/Qwen2.5-3B-Instruct_masrawy

3B • Updated Mar 24 • 11

Vincent-0907/Llama-3.2-3B-guide-GGUF

3B • Updated Mar 24 • 7

mwhyd2262/Space-Director-Llama3-GGUF

8B • Updated Mar 24 • 6

mwhyd2262/Space-Researcher-0.5B-Reasoning

0.5B • Updated Mar 24 • 18

gcards/phi3-tictactoe-reasoning

15B • Updated Mar 24 • 2

Vased7/Marcus-24B-DPO-GGUF

24B • Updated Mar 24 • 7

iamabhayaditya/EfficientMath-AI

Text Generation • 8B • Updated 8 days ago • 6

dxx117/Qwen3.5-397B-A17B-heretic-GGUF

396B • Updated Mar 26 • 266 • 3

thwrhrt/Qwen3.5-0.8B-Base-Quant

Text Generation • 0.8B • Updated Mar 25 • 21 • 1

DavidBPunkt/rust-expert-gguf

3B • Updated Mar 25 • 64 • 1

zhouyu199886/Qwen3.5-2B-JXSD

2B • Updated Mar 25 • 3

LiquidAI/LFM2.5-350M-GGUF

Text Generation • 0.4B • Updated Apr 8 • 13.9k • 81

reaperdoesntknow/Qwen3-1.7B-Coder-Distilled-SFT-GGUF

Text Generation • 2B • Updated about 17 hours ago • 3.02k • 1