Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Website
Tasks
HuggingChat
Collections
Languages
Organizations
Community
Blog
Posts
Daily Papers
Hardware
Learn
Discord
Forum
GitHub
Solutions
Team & Enterprise
Hugging Face PRO
Enterprise Support
Inference Providers
Inference Endpoints
Storage Buckets
Log In
Sign Up
chiruan
/
DeepSeek-R1-Distill-Qwen-1.5B-QuaRot-W4A8KV4
Like
0
Text Generation
Safetensors
qwen2
quarot
fake-quantization
w4a8kv4
custom-code
conversational
License:
mit
Model card
Files
Files and versions
xet
Community
Copy to bucket
new
main
DeepSeek-R1-Distill-Qwen-1.5B-QuaRot-W4A8KV4
3.57 GB
Ctrl+K
Ctrl+K
1 contributor
History:
2 commits
chiruan
Upload DeepSeek-R1-Distill-Qwen-1.5B W4A8KV4 checkpoint and runtime
b78f36e
verified
about 1 month ago
r1_quant_runtime
Upload DeepSeek-R1-Distill-Qwen-1.5B W4A8KV4 checkpoint and runtime
about 1 month ago
.gitattributes
Safe
1.57 kB
Upload DeepSeek-R1-Distill-Qwen-1.5B W4A8KV4 checkpoint and runtime
about 1 month ago
LICENSE
Safe
1.06 kB
Upload DeepSeek-R1-Distill-Qwen-1.5B W4A8KV4 checkpoint and runtime
about 1 month ago
LICENSE-Apache-2.0
Safe
11.3 kB
Upload DeepSeek-R1-Distill-Qwen-1.5B W4A8KV4 checkpoint and runtime
about 1 month ago
LICENSE-Quantized-Reasoning-Models
Safe
1.07 kB
Upload DeepSeek-R1-Distill-Qwen-1.5B W4A8KV4 checkpoint and runtime
about 1 month ago
NOTICE
Safe
792 Bytes
Upload DeepSeek-R1-Distill-Qwen-1.5B W4A8KV4 checkpoint and runtime
about 1 month ago
README.md
Safe
3.62 kB
Upload DeepSeek-R1-Distill-Qwen-1.5B W4A8KV4 checkpoint and runtime
about 1 month ago
SHA256SUMS
Safe
1.78 kB
Upload DeepSeek-R1-Distill-Qwen-1.5B W4A8KV4 checkpoint and runtime
about 1 month ago
config.json
Safe
1.28 kB
Upload DeepSeek-R1-Distill-Qwen-1.5B W4A8KV4 checkpoint and runtime
about 1 month ago
generate.py
Safe
3.28 kB
Upload DeepSeek-R1-Distill-Qwen-1.5B W4A8KV4 checkpoint and runtime
about 1 month ago
generation_config.json
Safe
181 Bytes
Upload DeepSeek-R1-Distill-Qwen-1.5B W4A8KV4 checkpoint and runtime
about 1 month ago
model.safetensors
3.55 GB
xet
Upload DeepSeek-R1-Distill-Qwen-1.5B W4A8KV4 checkpoint and runtime
about 1 month ago
requirements.txt
Safe
119 Bytes
Upload DeepSeek-R1-Distill-Qwen-1.5B W4A8KV4 checkpoint and runtime
about 1 month ago
runtime-provenance.json
Safe
1.41 kB
Upload DeepSeek-R1-Distill-Qwen-1.5B W4A8KV4 checkpoint and runtime
about 1 month ago
special_tokens_map.json
Safe
485 Bytes
Upload DeepSeek-R1-Distill-Qwen-1.5B W4A8KV4 checkpoint and runtime
about 1 month ago
tokenizer.json
Safe
11.4 MB
xet
Upload DeepSeek-R1-Distill-Qwen-1.5B W4A8KV4 checkpoint and runtime
about 1 month ago
tokenizer_config.json
Safe
6.77 kB
Upload DeepSeek-R1-Distill-Qwen-1.5B W4A8KV4 checkpoint and runtime
about 1 month ago
