web-scraping - Intelligent web scraping and Actor reconnaissance
Analyzes websites, discovers APIs through traffic interception, selects scraping strategies, validates extraction methods, and reports protection requirements.
Tags
Updated: 2026-10-05Capabilities
Typical Inputs
Typical Outputs
What this skill does
- Discover scraping strategies
- Inspect raw HTML
- Launch stealth browsers
- Capture network traffic
- Inspect rendered DOM
- Test dynamic interactions
- Validate extraction methods
- Replay API endpoints
- Assess protection signals
- Generate intelligence reports
- Guide Actor creation
Inputs
- Target website URL
- Requested data points
- Reconnaissance mode
- Upstream proxy credentials
Outputs
- Intelligence report
- Validated extraction strategies
- API endpoint specifications
- Protection profile
- Self-critique findings
Requirements
- curl
- Chrome browser
- DevTools bridge
- Traffic interception proxy
- Browser interaction tools
- Apify CLI for production Actors