quant.cpp

Drop a GGUF model here

Or click to browse. Recommended: SmolLM2-135M-Instruct (270MB) for browser use.

Runs entirely in your browser. Nothing uploaded to any server.