GGUF please
#2
by yichenyanyu - opened
Need gguf version
Llama.cpp has to add the support, Ask them
Thanks for all your enthusiasm!
AFAIK this is done and merged like yesterday. https://github.com/ggml-org/llama.cpp/pull/26608
RichardBian changed discussion status to closed