LogoClawIndex
CasesSkillsAbout
LogoClawIndex

ClawIndex

OpenClaw Skills & Use Case Index

ClawIndex is an ecosystem-driven index of OpenClaw skills and real-world use cases.

Index

Skills·
Cases

Meta

About·
Disclaimer·
Email·
GitHub
© 2026 ClawIndex All Rights Reserved.

Skills tagged: web-crawling

Browse skills that share this tag.

  • crawl-render-audit - Audit website crawler accessibility and rendering parity
    web-crawlingseo-auditrobots-txtllms-txt

    ★ 0 · Updated 2026-09-13

    Audits website crawler accessibility, robots.txt rules, llms.txt files, sitemaps, and JavaScript rendering gaps for conversational AI bots.

    ⚙ Fetch and parse robots.txt⚙ Audit llms.txt context files⚙ Analyze internal link graphs
  • crawl - Web Crawling for Login-Required Websites
    web-crawlinglogin-requiredchrome-devtoolscontent-extraction

    ★ 18 · Updated 2026-03-09

    Uses Chrome DevTools to extract content from websites that require login access

    ⚙ detect operating system environment⚙ start Chrome browser instance⚙ check MCP tool readiness