crawl - Browser Automation for Login-Required Content Extraction
Use logged-in browsers with Chrome DevTools to extract content from login-required websites
Tags
Updated: 2026-03-09Capabilities
Typical Inputs
Typical Outputs
What this skill does
- Detect operating system environment
- Launch Chrome browser instances
- Verify Chrome DevTools MCP connection
- Configure proxy settings automatically
- Start and manage API services
- Validate data format compliance
- Write data in batches
- Retry failed data writes
- Extract X/Twitter tweet content
- Extract The Atlantic articles
- Extract Medium articles
Inputs
- Chrome browser instance
- Chrome DevTools MCP tools
- Login-required website URLs
- User requirements
Outputs
- Execution logs
- Data files
- Page snapshots
- Execution reports
- Extracted content
Requirements
- Chrome browser and dependencies installed
- Chrome DevTools MCP connection
- Valid URL fields
- Login access to target websites
- MCP configuration
- Output folder in project root