Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

43

Base only

Active filters: fp_quant

ISTA-DASLab/Qwen3-8B-FPQuant-RTN-MXFP4

Text Generation • 5B • Updated Jul 15, 2025 • 7

ISTA-DASLab/Llama-3.1-8B-Instruct-FPQuant-GPTQ-MXFP4

5B • Updated Jul 20, 2025 • 2

ISTA-DASLab/Qwen3-8B-FPQuant-RTNv2-MXFP4

5B • Updated Jul 19, 2025

ISTA-DASLab/Qwen3-8B-FPQuant-GPTQ-MXFP4

5B • Updated Jul 24, 2025 • 3

ISTA-DASLab/Qwen3-14B-FPQuant-GPTQ-MXFP4

9B • Updated Jul 24, 2025 • 2

ISTA-DASLab/Qwen3-32B-FPQuant-GPTQ-MXFP4

18B • Updated Jul 24, 2025 • 6

ISTA-DASLab/Qwen3-0.6B-FPQuant-RTN-MXFP4

Text Generation • 0.4B • Updated Aug 4, 2025 • 17 • 1

ISTA-DASLab/Qwen3-0.6B-FPQuant-RTN-NVFP4

Text Generation • 0.4B • Updated Aug 4, 2025 • 7

ISTA-DASLab/Qwen3-4B-FPQuant-RTN-MXFP4

Text Generation • 2B • Updated Aug 4, 2025 • 5

ISTA-DASLab/Qwen3-4B-FPQuant-RTN-NVFP4

Text Generation • 2B • Updated Aug 4, 2025 • 7

ISTA-DASLab/Qwen3-1.7B-FPQuant-RTN-NVFP4

Text Generation • 1B • Updated Aug 4, 2025 • 4

ISTA-DASLab/Qwen3-1.7B-FPQuant-RTN-MXFP4

Text Generation • 1B • Updated Aug 4, 2025 • 6

ISTA-DASLab/Qwen3-8B-FPQuant-RTN-NVFP4

Text Generation • 5B • Updated Aug 4, 2025 • 5

ISTA-DASLab/Qwen3-1.7B-FPQuant-QAT-NVFP4-200steps

Text Generation • 1B • Updated Aug 10, 2025 • 5

ISTA-DASLab/Qwen3-1.7B-FPQuant-QAT-NVFP4-600steps

Text Generation • 1B • Updated Aug 10, 2025 • 4

ISTA-DASLab/Qwen3-8B-FPQuant-QAT-NVFP4-200steps

Text Generation • 5B • Updated Aug 10, 2025 • 7

ISTA-DASLab/Qwen3-8B-FPQuant-QAT-NVFP4-600steps

Text Generation • 5B • Updated Aug 10, 2025 • 6

ISTA-DASLab/Qwen3-8B-FPQuant-QAT-NVFP4-1400steps

Text Generation • 5B • Updated Aug 11, 2025 • 8

ISTA-DASLab/Qwen3-8B-FPQuant-QAT-NVFP4-1000steps

Text Generation • 5B • Updated Aug 11, 2025 • 7

ISTA-DASLab/Llama-3.1-8B-Instruct-MR-GPTQ-nvfp

Image-Text-to-Text • 5B • Updated Oct 3, 2025 • 36

ISTA-DASLab/Llama-3.1-8B-Instruct-MR-GPTQ-mxfp

Image-Text-to-Text • 5B • Updated Oct 3, 2025 • 53

ISTA-DASLab/Llama-3.1-8B-Instruct-FPQuant-QAT-NVFP4

5B • Updated Oct 27, 2025 • 181

ISTA-DASLab/Llama-3.2-1B-Instruct-FPQuant-QAT-NVFP4

0.8B • Updated Oct 27, 2025 • 7

ISTA-DASLab/Llama-3.2-1B-Instruct-FPQuant-QAT-MXFP4

0.8B • Updated Oct 27, 2025 • 3

ISTA-DASLab/Llama-3.2-3B-Instruct-FPQuant-QAT-NVFP4

2B • Updated Oct 27, 2025 • 69

ISTA-DASLab/Llama-3.2-3B-Instruct-FPQuant-QAT-MXFP4

2B • Updated Oct 27, 2025 • 2

ISTA-DASLab/Llama-3.1-8B-Instruct-FPQuant-QAT-MXFP4

5B • Updated Oct 27, 2025 • 86

ISTA-DASLab/Qwen3-0.6B-FPQuant-QAT-NVFP4

Text Generation • 0.4B • Updated Oct 16, 2025 • 4

ISTA-DASLab/Qwen3-1.7B-FPQuant-QAT-NVFP4

Text Generation • 1B • Updated Oct 16, 2025 • 6

ISTA-DASLab/Qwen3-4B-FPQuant-QAT-NVFP4

Text Generation • 2B • Updated Oct 16, 2025 • 3