promptfoo - Promptfoo LLM Evaluation Framework
Test and compare LLM outputs using evaluation frameworks
Tags
Updated: 2026-03-09Capabilities
Typical Inputs
Typical Outputs
What this skill does
- write evaluation configurations
- create test cases
- debug evaluation runs
- work with assertions
- compare LLM outputs
Inputs
- promptfooconfig.yaml file
- test case files
- assertion rules
- LLM provider configuration
- variable data
Outputs
- evaluation results
- output comparisons
- test reports
- performance metrics
Requirements
- Node.js environment
- npx access
- promptfoo.dev access
- YAML/JSON config files