tensorrt-llm - NVIDIA TensorRT-LLM LLM Inference Optimizer
Inference Optimization TensorRT-LLM NVIDIA GPU LLM Inference
★ 248,179 · Updated 2026-03-19
Optimizes LLM inference on NVIDIA GPUs with quantization and multi-GPU scaling
⚙ optimize LLM inference ⚙ generate text ⚙ serve chat completions