prismml

HIP/ROCm fork optimized for AMD RDNA2 (gfx1030) with PrismML Q1_0_G128 1-bit quant support, RotorQuant, TurboQuant, EAGLE3 and P-EAGLE speculative decoding, and full Wave32 kernel optimizations.

AMD ROCm (gfx1030) inference fork with RotorQuant/TurboQuant KV compression, PHANTOM-X zero-copy draft speculation, EAGLE3 speculative decoding, 12 RDNA2 crash fixes, and PrismML Bonsai Q1_0_G128 1-bit GGUF support.

Precompiled PrismML/llama.cpp backend for LM Studio on Windows. Run PrismML Bonsai 1-bit/ternary GGUF models natively in LM Studio with NVIDIA CUDA. No compiling required.

HTTP proxy serving PrismML Bonsai 1.7B (Q1_0 GGUF) through an Ollama-compatible API via llama-server.

Navigable Degeneracy in the Roots of 1-Bit Language Models

One-click Windows setup & launcher for PrismML Bonsai-demo — pick a model, everything else is automated.

One-click fix for LM Studio failing to load Bonsai 2 / PrismML ternary GGUF models ('invalid ggml type 143/142'). Swaps PrismML's llama.cpp fork into LM Studio's engine, with backup + verification.

Local chat app for running Bonsai GGUF models with streaming responses, built-in Prism runtime management, model switching, runtime diagnostics, and saved conversation history.

GGUFly — Interactive TUI launcher and model manager for GGUF models with llama.cpp, PrismML/Bonsai, and Mirai S runtimes. Built on Omarchy / Arch Linux.

Terminal workspace for chatting with Bonsai AI models locally using the PrismML custom runtime.