hjLabs AI Playground

Starting the on-device runtime…

Chat with a local LLM running on your own GPU

A full chat interface backed by a small language model that lives in your browser. SmolLM2-135M loads in seconds on almost any machine; SmolLM2-1.7B and Qwen3-0.6B give noticeably better answers if you have a few gigabytes of VRAM to spare. Tokens stream as they are generated and the page reports real tokens-per-second, so you can see exactly what your hardware is doing. Because inference is local, the conversation never leaves the machine — useful for drafting anything you would not paste into a hosted chatbot.

browser llmlocal llm chatprivate ai chatchatgpt alternative offlinesmollm2 browserqwen3 webgpuwebllm chatllm without api keyrun llama in browseroffline chatbot

Frequently asked questions

How good is a 135M or 1.7B model compared to GPT-4?

Not close, and we will not pretend otherwise. Small local models are good at rewriting, summarising, extracting structure, brainstorming and simple Q&A. They hallucinate more on facts and are weaker at long multi-step reasoning. Pick the biggest model your GPU can hold.

How fast is it?

On a mid-range discrete GPU expect roughly 20–60 tokens/second for a 0.5B model and 8–20 for a 1.7B model at q4. Integrated graphics run maybe a third of that. The first message is slower because the weights must be uploaded to the GPU.

Is my data uploaded to a server?

No. The model weights are downloaded from Hugging Face to your browser once, and every inference after that runs on your own GPU through WebGPU. Your text, images and audio are never sent anywhere — hjLabs.in has no inference server and no way to see your input.

Models available for this task