AI Chat Bot

Chat with a small instruction-tuned Hugging Face model running in your browser. The first message downloads the model, then your browser caches it for later.

Ready. WebGPU is recommended for faster generation.
Assistant
Hi. Ask me a question and I will answer using a small local LLM.