Kanha β€” Custom-Trained On-Device Chatbot

This model was trained by Kanha and runs entirely on-device via WebGPU.

kanha.ai Β· Docs Β· SDK


What is this?

This is a custom-trained chatbot checkpoint, fine-tuned on a specific website's content using Kanha. It is optimized for on-device inference in the browser via WebGPU β€” no server-side API calls, no per-query costs, no data leaves the device.

This model is not general-purpose. It is trained to answer questions about a specific website's content.

How to use

Install the SDK and embed the bot:

<script type="module" src="https://cdn.jsdelivr.net/npm/kanha-ai/dist/widget.js"></script>
<kanha-bot model-url="https://huggingface.co/Kanha-AI/72d13402-2526-4264-b7f6-0df347075e65-medium/resolve/main/" model-size="medium" model-lib="https://huggingface.co/Kanha-AI/kanha-minicpm5-1b-grounded-matched-2ep-20260910-MLC/resolve/2aa9d7bb2b8b2909d2a21661bc1b109dac228678/minicpm5-1b-q4f16_1-webgpu.wasm"></kanha-bot>

Or with React:

import { KanhaBot } from 'kanha-ai';

<KanhaBot modelUrl="https://huggingface.co/Kanha-AI/72d13402-2526-4264-b7f6-0df347075e65-medium/resolve/main/" modelSize="medium" modelLib="https://huggingface.co/Kanha-AI/kanha-minicpm5-1b-grounded-matched-2ep-20260910-MLC/resolve/2aa9d7bb2b8b2909d2a21661bc1b109dac228678/minicpm5-1b-q4f16_1-webgpu.wasm" />

MLC model library: https://huggingface.co/Kanha-AI/kanha-minicpm5-1b-grounded-matched-2ep-20260910-MLC/resolve/2aa9d7bb2b8b2909d2a21661bc1b109dac228678/minicpm5-1b-q4f16_1-webgpu.wasm

About Kanha

Kanha crawls your website, generates training data, fine-tunes a compact model, and serves it directly in your visitors' browsers via WebGPU.

  • On-device execution β€” all inference runs locally, nothing sent to a server
  • Privacy-first β€” user queries never leave the device
  • Zero per-query costs β€” no API calls, no token billing

Learn more at kanha.ai Β· GitHub

Downloads last month
6
Inference Providers NEW
This model isn't deployed by any Inference Provider. πŸ™‹ Ask for provider support

Model tree for Kanha-AI/72d13402-2526-4264-b7f6-0df347075e65-medium

Finetuned
(67)
this model