llama-cpp - llama.cpp Secondary LLM Inference Engine
inference LLM GGUF LoRA
★ 18 · Updated 2026-03-10
Secondary local LLM inference engine for running GGUF models directly, loading LoRA adapters, benchmarking, and custom model serving
⚙ run GGUF inference ⚙ load LoRA adapter ⚙ benchmark inference