Qwen3.8-27B-W4A16

W4A16 quantization of Qwen/Qwen3.8-27B, produced with llm-compressor via model_free_ptq (data-free).

Vision encoder, gated-delta attention (conv1d / linear_attn), lm_head, embeddings, and norm layers are kept in original precision.

Downloads last month
220
Safetensors
Model size
28B params
Tensor type
I32
ยท
BF16
ยท
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for lokeshe09/Qwen3.8-27B-W4A16

Base model

Qwen/Qwen3.8-27B
Quantized
(1611)
this model