gguf-quantization - GGUF Quantization for Efficient Model Inference
GGUF Quantization llama.cpp CPU Inference
★ 0 · Updated 2026-06-30
Convert and quantize models to GGUF format for efficient CPU/GPU inference
⚙ convert model to GGUF ⚙ quantize GGUF model ⚙ run model inference