falcon3

Here are 3 public repositories matching this topic...

TQ1.0 ternary inference engine for BitNet b1.58 on CPU. Pack + run Falcon3-1B/3B/7B/10B, no GPU needed.

cpp high-performance simd avx2 quantization ternary bonsai inference-engine bitnet edge-ai ternary-weights cpu-inference local-llm llm-inference falcon3 1bit-llm bitnet-b158

Windows-native BitNet and ternary LLM inference with CPU GGUF, GPU runtime, terminal and browser chat, and release zips.

windows cuda pytorch quantization bitnet fastapi llama-cpp local-llm llm-inference gguf 1-bit-llm ternary-llm falcon3

Run BitNet 1.58-bit and ternary LLMs on Windows with CPU and GPU inference, chat tools, and release-ready builds

windows cuda pytorch quantization bitnet fastapi llama-cpp local-llm llm-inference gguf ternary-llm falcon3

To associate your repository with the falcon3 topic, visit your repo's landing page and select "manage topics."