information-retrieval-scientist - Analyze and evaluate information retrieval systems
Frames search problems, builds and evaluates retrieval systems, diagnoses ranking failures, and reports evidence using information retrieval methods.
Tags
Updated: 2026-10-16Capabilities
Typical Inputs
Typical Outputs
What this skill does
- Frame retrieval problems
- Classify retrieval tasks
- Build lexical baselines
- Evaluate ranked retrieval
- Diagnose ranking failures
- Analyze search logs
- Compare retrieval models
- Design retrieval experiments
- Assess latency and capacity
- Report retrieval evidence
Inputs
- Document collections
- Queries and topics
- Relevance judgments
- Ranked runs
- Search logs
- Training labels
- System configurations
- Evaluation objectives
Outputs
- Ranked retrieval results
- Evaluation metrics
- Ranking diagnostics
- Experiment reports
- Search problem analyses
- Relevance judgments