result-analysis - Compare paper results with reproduction runs
Analyzes completed reproduction runs, extracts metrics with auditable scripts, regenerates paper presentations, and compares them side by side.
Tags
Updated: 2026-09-28paper reproductionresult analysismetric extractionexperiment comparisonauditable scriptsscientific reporting
Capabilities
What this skill does
- Read completed run reports
- Locate paper result presentations
- Extract metrics with scripts
- Regenerate tables and plots
- Compare paper and reproduction
- Report upstream failures
Inputs
- Current codebase
- Run-experiment report
- Experiment-scoping report
- Paper PDF
- Completed run directories
- Run artifacts
- Conda environment
- Baseline report
Outputs
- result-analysis.md report
- Metric extraction scripts
- Extracted data files
- Regenerated figures
- Paper figure crops
- Comparison tables
- Analysis findings
Requirements
- Existing run-experiment report
- Available paper PDF
- Existing pr environment
- Required analysis packages
- Complete upstream runs
