OSS tagged “Inference”

What it does

A C/C++ LLM inference runtime spanning GGUF, quantization, CPU/GPU backends, CLI, and an OpenAI-compatible server.