unsloth-inference - Deploy fine-tuned models for production inference with Unsloth
model-inference model-deployment vllm sglang
★ 650 · Updated 2026-02-14
Deploy fine-tuned models for production inference with optimized kernels and serving engines.
⚙ Load fine-tuned model ⚙ Load tokenizer ⚙ Enable optimized kernels