cost-aware-llm-pipeline - Cost optimization patterns for LLM API usage
Combines model routing, budget tracking, narrow retry logic, and prompt caching into a cost optimization pipeline for LLM API calls.
Tags
Updated: 2026-09-16Capabilities
Typical Inputs
Typical Outputs
What this skill does
- Select models by task complexity
- Track costs using immutable records
- Retry calls on transient errors
- Cache prompts for system messages
Inputs
- Input text and prompt content
- Budget limits and configuration
- LLM API client credentials
Outputs
- API execution results
- Updated cost tracking records
Requirements
- Python runtime
- LLM API access keys