Skills tagged "inference"

cnn-inference-on-spectral-data - Generate molecular embeddings from MS/MS spectra with CNN
mass-spectrometry metabolomics cnn inference
★ 15 · Updated 2026-09-19
Passes preprocessed MS/MS spectra through a trained CNN model to extract multidimensional molecular embedding vectors for downstream metabolite matching.
⚙ Load preprocessed MS/MS spectral data ⚙ Initialize trained CNN model checkpoint ⚙ Extract molecular embedding vectors
jatevo - Free LLM inference provider for OpenClaw
llm inference openclaw jatevo
★ 47 · Updated 2026-09-18
Provides free access to Qwen 3.5 Plus, Kimi K2.5, and GLM 4.7 models for OpenClaw.
⚙ Provide LLM inference access ⚙ Support text and vision inputs ⚙ Configure provider in OpenClaw
llm-config - LLM Configuration
swarmllm inference microlora sona
★ 2 · Updated 2026-09-10
Configure SwarmLLM local inference with model selection, MicroLoRA fine-tuning, and SONA adaptation.
⚙ Check model and adapter status ⚙ Generate LLM inference config ⚙ Create MicroLoRA task adapters
graph-mode-internals - LMdeploy graph mode architecture
graph mode inference performance runner
★ 74 · Updated 2026-06-30
Explains how graph mode captures and replays compute sequences for decode steps, covering runner architecture, buffer management, and vendor differences.
⚙ capture graph ⚙ replay graph ⚙ allocate buffers
gpu - Ollama GPU Monitoring
GPU monitoring Ollama performance
★ 18 · Updated 2026-05-28
Monitor GPU status and performance metrics for Ollama inference
⚙ check GPU status ⚙ monitor VRAM usage ⚙ view loaded models
sagemaker - Amazon SageMaker Management via CLI
aws sagemaker machine learning mlops
★ 3 · Updated 2026-05-28
Manage Amazon SageMaker notebooks, training jobs, models, endpoints, and pipelines via AWS CLI.
⚙ list notebook instances ⚙ describe notebook instance ⚙ list training jobs
gpu - Ollama GPU Monitoring
gpu monitoring ollama performance
★ 602 · Updated 2026-05-28
Monitor GPU usage, VRAM, loaded models, and inference performance metrics for Ollama
⚙ check GPU status ⚙ monitor VRAM usage ⚙ list loaded models
vllm-ascend-model-adapter - Adapt models for vLLM on Ascend NPU
Ascend NPU vLLM Hugging Face model adaptation
★ 0 · Updated 2026-05-11
Adapt and debug Hugging Face or local models for vLLM on Ascend NPU
⚙ collect model context ⚙ analyze model files ⚙ implement model adapter
vllm-ascend-model-adapter - Adapt Models for vLLM on Ascend NPU
vllm ascend npu model adaptation
★ 2 · Updated 2026-05-11
Adapt Hugging Face or local models to run on vllm-ascend with minimal changes
⚙ analyze model architecture ⚙ inspect model files ⚙ implement model adapter
vllm-ascend-model-adapter - vLLM Ascend Model Adaptation
model adaptation Ascend NPU vLLM inference
★ 57 · Updated 2026-05-11
Adapt and debug models for vLLM on Ascend NPU.
⚙ analyze model architecture ⚙ implement model adapter ⚙ add processor support
teoria-engine - Production-grade self-hosted LLM inference stack
LLM self-hosted inference OpenAI API
★ 0 · Updated 2026-05-09
Starts and manages a local LLM inference stack with OpenAI-compatible API for Linux and macOS
⚙ start inference engine ⚙ stop inference engine ⚙ check engine status
llm-inference-scaling - Auto-scale LLM inference clusters on Kubernetes
kubernetes autoscaling LLM GPU
★ 602 · Updated 2026-03-26
Scale LLM inference horizontally on Kubernetes with GPU-aware autoscaling, request queuing, and spot instance strategies.
⚙ Deploy vLLM inference pods ⚙ Configure KEDA autoscaling ⚙ Set up queue-based scaling
llama-cpp - llama.cpp Secondary LLM Inference Engine
inference LLM GGUF LoRA
★ 18 · Updated 2026-03-10
Secondary local LLM inference engine for running GGUF models directly, loading LoRA adapters, benchmarking, and custom model serving
⚙ run GGUF inference ⚙ load LoRA adapter ⚙ benchmark inference
unsloth-inference - Optimized inference deployment for fine-tuned models
inference model-deployment optimization production-serving
★ 0 · Updated 2026-02-15
Deploy fine-tuned models for production inference using kernel optimization, vLLM, or SGLang
⚙ enable optimized kernels ⚙ merge LoRA weights ⚙ export for production serving
unsloth-inference - Deploy Fine-Tuned Models for Production Inference
inference model deployment optimization serving
★ 18 · Updated 2026-02-15
Deploy fine-tuned models for production inference using optimized kernels, vLLM, or SGLang
⚙ load fine-tuned model ⚙ enable optimized kernels ⚙ merge LoRA weights
torchserve-config-generator - TorchServe Configuration Generator for ML Deployment
mlops serving inference monitoring
★ 18 · Updated 2026-02-12
Generates TorchServe configuration files for machine learning model deployment
⚙ provide step-by-step guidance ⚙ generate production-ready code ⚙ generate configurations
torchserve-config-generator - Automated TorchServe Configuration Generator for ML Deployment
mlops serving inference monitoring
★ 602 · Updated 2026-02-12
Automatically generates and validates TorchServe configuration files for machine learning deployment
⚙ generate configuration files ⚙ validate configuration standards ⚙ provide step-by-step guidance