CUDA fork of antirez ds4 that runs giant MoE language models on a single consumer GPU by streaming routed experts from SSD.
Gianni Sanrochman
giannisan
AI & ML interests
Transfromers, LLMs, multimodel, vision, audio
Recent Activity
updated a model about 19 hours ago
giannisan/Hy3-ds4-gguf liked a model 6 days ago
sakamakismile/ThinkingCap-Qwen3.6-27B-NVFP4 updated a collection 6 days ago
NeutronStarOrganizations
-
giannisan/penny-llama3-2x8b
Text Generation • 14B • Updated • 3 • 1 -
giannisan/penny5-dolphin-einstein-llama3-dare-ties-chatml
Text Generation • 8B • Updated • 6 • 1 -
giannisan/penny5-dolphin-einstein-llama3-dare-ties-chatml.gguf
8B • Updated • 18 • 1 -
mradermacher/penny-llama3-2x8b-v2-GGUF
14B • Updated • 63 • 1
CUDA fork of antirez ds4 that runs giant MoE language models on a single consumer GPU by streaming routed experts from SSD.
-
giannisan/penny-llama3-2x8b
Text Generation • 14B • Updated • 3 • 1 -
giannisan/penny5-dolphin-einstein-llama3-dare-ties-chatml
Text Generation • 8B • Updated • 6 • 1 -
giannisan/penny5-dolphin-einstein-llama3-dare-ties-chatml.gguf
8B • Updated • 18 • 1 -
mradermacher/penny-llama3-2x8b-v2-GGUF
14B • Updated • 63 • 1
models 48
giannisan/Hy3-ds4-gguf
299B • Updated • 6.05k • 24
giannisan/GLM-5.2-ds4-gguf
754B • Updated • 1.07k • 3
giannisan/light-fantasy-flux2-klein-base-lora
Text-to-Image • Updated • 10
giannisan/light-fantasy-flux2-klein-lora
Text-to-Image • Updated • 26
giannisan/heartformer
Object Detection • Updated • 3
giannisan/penta-reaserch
Updated
giannisan/PENNY-R1-7B-2-Q4_K_M-GGUF
8B • Updated • 2
giannisan/PENNY-R1-7B-2-Q8_0-GGUF
8B • Updated • 4
giannisan/PENNY-R1-7B-2
Text Generation • 8B • Updated • 3
giannisan/penny-lexi-llama3.1-8B
Text Generation • 8B • Updated • 2 • 1
datasets 22
giannisan/gemma-csm-shards
Updated • 1.2k
giannisan/light-fantasy-dataset
Viewer • Updated • 232 • 17
giannisan/light_fantasy_dataset
Viewer • Updated • 232 • 20
giannisan/penta-reaserch
Updated • 8
giannisan/test_dataset_7
Viewer • Updated • 4 • 12
giannisan/test_dataset_6
Viewer • Updated • 4 • 32
giannisan/test_dataset_5
Viewer • Updated • 13
giannisan/penny_dataset_v4
Viewer • Updated • 229k • 19
giannisan/conversations_dataset_v1
Viewer • Updated • 480 • 12
giannisan/penny_dataset_v3
Viewer • Updated • 168k • 29