data-scraper-agent - Build scheduled AI-powered data collection agents
Collects data from public websites or APIs, enriches it with Gemini, stores results, and learns from user feedback on a schedule.
Tags
Updated: 2026-10-19Capabilities
Typical Inputs
Typical Outputs
What this skill does
- Scrape public data sources
- Filter collected items
- Batch-enrich data with Gemini
- Store results in databases
- Schedule recurring runs
- Learn from user feedback
Inputs
- Public website, API, or RSS source
- Fields to extract
- Storage destination
- Enrichment criteria
- Run frequency
- API credentials
- User context and preferences
Outputs
- Collected data records
- AI scores and summaries
- Stored database entries
- Scheduled workflow files
- Feedback history file
Requirements
- Python environment
- Gemini API key
- Access to the selected data source
- Credentials for the selected storage service
- GitHub Actions for scheduled execution