ggml-org
/

Laya-GGUF

Text Classification

feature-extraction

Model card Files Files and versions

Laya

Run it in the Llama app: https://llama.app

Or from the terminal:

llama serve -hf ggml-org/Laya-GGUF

This is a decision model, to be used via /v1/systemone API. See https://github.com/ggml-org/llama.cpp/pull/29818

Source models

https://huggingface.co/convaiinnovations/laya

This model is automatically converted using https://github.com/ggml-org/convert

Downloads last month: 19,708

GGUF

Model size

0.4B params

Architecture

modern-bert

Hardware compatibility

Log In to add your hardware

8-bit

16-bit

Model tree for ggml-org/Laya-GGUF

Base model

convaiinnovations/laya

Quantized

(79)

this model

Collection including ggml-org/Laya-GGUF

Decision models

GGUF decision models for the /v1/systemone API in llama.cpp • 16 items • Updated 9 days ago • 38

Article mentioning ggml-org/Laya-GGUF

New in llama.cpp: Decision Models