Scraping & extraction
918 rows, by stacks then stars
107 of these skill files have been read, by 109 distinct authors, and what they tell an agent counted. What Scraping & extraction authors agree on, and what they forbid
Aetheris-MCP — x402 Web Scraping MCP Server
timwal78/aetheris-mcp-render/io.github.Timwal78/aetheris-mcp MCP server
no license0★ repox402-gated web scraping MCP server. Pay 0.01 USDC per page on Base. Returns clean Markdown via JSDOM
lazymac2x/ai-crawler-policy-api/io.github.lazymac2x/ai-crawler-policy MCP server
no license0★ repoCloudflare Workers MCP server: ai-crawler-policy
mifactory-bot/mifactory-scraping-api/io.github.mifactory-bot/mifactory-scraping-api MCP server
no license0★ repoWeb scraping for AI agents. Extract text and metadata from any URL worldwide. $0.005/page.
shulex-voc/smart-crawler/io.github.shulex-voc/smart-crawler MCP server
no license0★ repoE-commerce competitor intelligence, VOC sentiment, Amazon ASIN analysis, Reddit growth playbooks.
terradeed/terradeed-mcp-server/io.github.terradeed/terradeed-mcp-server MCP server
no license0★ repoTerraDeed MCP server — x402 web scraping & structured extraction. Pay-per-call with USDC on Base.
us/crw/io.github.us/fastcrw MCP server
552★ repoScrape, crawl, map & search the web. Open-source, self-hostable Rust crawler & search for AI agents.
ScrapeGraphAI/scrapegraph-mcp/io.github.ScrapeGraphAI/scrapegraph-mcp MCP server
93★ repoAI-powered web scraping and data extraction capabilities through ScrapeGraph API
CaesiumY/ko-design-md/.claude/skills/docs-crawler Skill
40★ repo한국 브랜드 디자인 시스템을 Stitch v0.1 마크다운으로 정리한 오픈 카탈로그 — Open catalog of Korean design systems in structured markdown.
ea-toolkit/architecture-catalog/.claude/skills/crawl-data Skill
38★ repoGit-native architecture catalog — Markdown registry, schema-driven UI, AI-ready
HasData/agent-skills/skills/hasdata Skill
no license9★ repoHasData official collection of agent skills
Harmeet10000/skills/skills/ai-ml/crawl4ai-skill Skill
7★ repoCollection of my Agent Skills and books.
thangnguyenworkspace/industry-pulse/.claude/skills/research-crawl-linkedin-posts Skill
4★ repoWatchlist-driven intelligence pipeline crawling LinkedIn, X, RSS, and email into one neutral signals brief.
yya007/SkillFinder/skills/crawl-sources Skill
3★ repoLocal-first semantic search across tens of thousands of agent skills (SKILL.md) for Claude Code, Codex & OpenClaw — describe your task, get ranked matches with install commands. FAISS + Ollama, no API calls.
Decodo/agent-skills/skills/decodo-web-scraping Skill
2★ repoAgent skills that teach AI coding agents to use Decodo for web scraping
sam6dvpte34/social-media-skill/skills/bilibili-creator-scraper Skill
no license2★ repoAgent-ready social media crawling and task automation Skills, best for Instagram, TikTok, YouTube, X/Twitter, LinkedIn, Facebook, Reddit, and Xiaohongshu
agishub/agishub-mcp/com.agishub/web-scraper MCP server
1★ repoWeb scraper for agents: fetch any URL as clean markdown (headings, links). x402 for JS rendering.
spider-rs/spider-claude-plugin/skills/spider-crawl-scrape Skill
0★ repoBartWaardenburg/isagentready-skills/ai-content-discovery Skill
0★ repoAgent skills for fixing AI agent readiness issues — robots.txt, structured data, semantic HTML, agent protocols, and security headers
Crawlio-app/crawlio-plugin/skills/crawl-site Skill
0★ repoAI skills for website crawling, observation, and analysis — powered by Crawlio
arufian/crawlit-skill/crawlit-crawl Skill
0★ repoAgent skill pack for Crawlit web scraping, crawling, and site mapping
aizech/bernhard-zechmann-skills/skills/engineering/browser-automation Skill
0★ repoModular AI agent skills used across engineering, writing, and research workflows. Model‑agnostic, composable, and production‑tested. Includes engineering, productivity, personal, and experimental skill packs.
fernandoleyra/watercrawl-skill/skills/watercrawl-crawl Skill
0★ repoOpen Source Agentic scrapping skill with 8 hyperfocused skills, to give research subagents web-search on steroids.
Albert-Tam/scrappycoco-integrations/skills/scrappycoco Skill
no license0★ repoOfficial Scrappycoco MCP plugin and portable agent skill
ComposioHQ/awesome-claude-skills/composio-skills/apify-automation Skill
no license72,074★ repoA curated list of awesome Claude Skills, resources, and tools for customizing Claude AI workflows
ComposioHQ/awesome-claude-skills/composio-skills/firecrawl-automation Skill
no license72,074★ repoA curated list of awesome Claude Skills, resources, and tools for customizing Claude AI workflows
ComposioHQ/awesome-claude-skills/composio-skills/phantombuster-automation Skill
no license72,074★ repoA curated list of awesome Claude Skills, resources, and tools for customizing Claude AI workflows
sickn33/agentic-awesome-skills/plugins/agentic-awesome-skills-claude/skills/apify-ultimate-scraper Skill
44,658★ repoAAS Core is the local, agent-first control plane for complete catalog discovery, agent-owned selection, stack validation, and planning, backed by 1,987+ agentic skills. Includes CLI, local MCP, catalog, plugins, and Workbench.
sickn33/agentic-awesome-skills/plugins/agentic-awesome-skills-claude/skills/firecrawl-scraper Skill
44,658★ repoAAS Core is the local, agent-first control plane for complete catalog discovery, agent-owned selection, stack validation, and planning, backed by 1,987+ agentic skills. Includes CLI, local MCP, catalog, plugins, and Workbench.
sickn33/agentic-awesome-skills/plugins/agentic-awesome-skills-claude/skills/hasdata Skill
44,658★ repoAAS Core is the local, agent-first control plane for complete catalog discovery, agent-owned selection, stack validation, and planning, backed by 1,987+ agentic skills. Includes CLI, local MCP, catalog, plugins, and Workbench.
sickn33/agentic-awesome-skills/plugins/agentic-awesome-skills-claude/skills/puppeteer-skill Skill
44,658★ repoAAS Core is the local, agent-first control plane for complete catalog discovery, agent-owned selection, stack validation, and planning, backed by 1,987+ agentic skills. Includes CLI, local MCP, catalog, plugins, and Workbench.
sickn33/agentic-awesome-skills/plugins/agentic-awesome-skills-claude/skills/web-scraper Skill
44,658★ repoAAS Core is the local, agent-first control plane for complete catalog discovery, agent-owned selection, stack validation, and planning, backed by 1,987+ agentic skills. Includes CLI, local MCP, catalog, plugins, and Workbench.
sickn33/agentic-awesome-skills/plugins/agentic-awesome-skills/skills/apify-ultimate-scraper Skill
44,658★ repoAAS Core is the local, agent-first control plane for complete catalog discovery, agent-owned selection, stack validation, and planning, backed by 1,987+ agentic skills. Includes CLI, local MCP, catalog, plugins, and Workbench.
sickn33/agentic-awesome-skills/plugins/agentic-awesome-skills/skills/firecrawl-scraper Skill
44,658★ repoAAS Core is the local, agent-first control plane for complete catalog discovery, agent-owned selection, stack validation, and planning, backed by 1,987+ agentic skills. Includes CLI, local MCP, catalog, plugins, and Workbench.
sickn33/agentic-awesome-skills/plugins/agentic-awesome-skills/skills/hasdata Skill
44,658★ repoAAS Core is the local, agent-first control plane for complete catalog discovery, agent-owned selection, stack validation, and planning, backed by 1,987+ agentic skills. Includes CLI, local MCP, catalog, plugins, and Workbench.
sickn33/agentic-awesome-skills/plugins/agentic-awesome-skills/skills/puppeteer-skill Skill
44,658★ repoAAS Core is the local, agent-first control plane for complete catalog discovery, agent-owned selection, stack validation, and planning, backed by 1,987+ agentic skills. Includes CLI, local MCP, catalog, plugins, and Workbench.
sickn33/agentic-awesome-skills/plugins/agentic-awesome-skills/skills/web-scraper Skill
44,658★ repoAAS Core is the local, agent-first control plane for complete catalog discovery, agent-owned selection, stack validation, and planning, backed by 1,987+ agentic skills. Includes CLI, local MCP, catalog, plugins, and Workbench.
sickn33/agentic-awesome-skills/skills/apify-ultimate-scraper Skill
44,658★ repoAAS Core is the local, agent-first control plane for complete catalog discovery, agent-owned selection, stack validation, and planning, backed by 1,987+ agentic skills. Includes CLI, local MCP, catalog, plugins, and Workbench.
sickn33/agentic-awesome-skills/skills/firecrawl-scraper Skill
44,658★ repoAAS Core is the local, agent-first control plane for complete catalog discovery, agent-owned selection, stack validation, and planning, backed by 1,987+ agentic skills. Includes CLI, local MCP, catalog, plugins, and Workbench.
sickn33/agentic-awesome-skills/skills/hasdata Skill
44,658★ repoAAS Core is the local, agent-first control plane for complete catalog discovery, agent-owned selection, stack validation, and planning, backed by 1,987+ agentic skills. Includes CLI, local MCP, catalog, plugins, and Workbench.
sickn33/agentic-awesome-skills/skills/puppeteer-skill Skill
44,658★ repoAAS Core is the local, agent-first control plane for complete catalog discovery, agent-owned selection, stack validation, and planning, backed by 1,987+ agentic skills. Includes CLI, local MCP, catalog, plugins, and Workbench.
sickn33/agentic-awesome-skills/skills/web-scraper Skill
44,658★ repoAAS Core is the local, agent-first control plane for complete catalog discovery, agent-owned selection, stack validation, and planning, backed by 1,987+ agentic skills. Includes CLI, local MCP, catalog, plugins, and Workbench.
sickn33/agentic-awesome-skills/skills/x-twitter-scraper Skill
44,658★ repoAAS Core is the local, agent-first control plane for complete catalog discovery, agent-owned selection, stack validation, and planning, backed by 1,987+ agentic skills. Includes CLI, local MCP, catalog, plugins, and Workbench.
github/awesome-copilot/skills/x-twitter-scraper Skill
37,897★ repoCommunity-contributed instructions, agents, skills, and configurations to help you make the most of GitHub Copilot.
alirezarezvani/claude-skills/.gemini/skills/universal-scraping-architect Skill
24,478★ repo345 Claude Code skills & agent skills & plugins (30+ Agents, 70+ custom commands, 330+ skills, customizable references, scripts)for Claude Code, Codex, Gemini CLI, Cursor, and 8 more coding agents — engineering, marketing, product, compliance, C-level advisory, research, business operations, commercial & finance, and your daily productivity skills.
alirezarezvani/claude-skills/engineering/universal-scraping-architect/skills/universal-scraping-architect Skill
24,478★ repo345 Claude Code skills & agent skills & plugins (30+ Agents, 70+ custom commands, 330+ skills, customizable references, scripts)for Claude Code, Codex, Gemini CLI, Cursor, and 8 more coding agents — engineering, marketing, product, compliance, C-level advisory, research, business operations, commercial & finance, and your daily productivity skills.
browser-act/skills/solutions/ecommerce/1688-product-detail Skill
5,304★ repoBrowser automation CLI built for AI agents. Break through anti-bot walls, hand off to humans across platforms when stuck. Parallel multi-task execution, independent multi-session operation, isolated multi-account browsing.
browser-act/skills/solutions/ecommerce/ebay-search-listing Skill
5,304★ repoBrowser automation CLI built for AI agents. Break through anti-bot walls, hand off to humans across platforms when stuck. Parallel multi-task execution, independent multi-session operation, isolated multi-account browsing.
browser-act/skills/solutions/ecommerce/ecommerce-listing Skill
5,304★ repoBrowser automation CLI built for AI agents. Break through anti-bot walls, hand off to humans across platforms when stuck. Parallel multi-task execution, independent multi-session operation, isolated multi-account browsing.
browser-act/skills/solutions/ecommerce/ecommerce-product-detail Skill
5,304★ repoBrowser automation CLI built for AI agents. Break through anti-bot walls, hand off to humans across platforms when stuck. Parallel multi-task execution, independent multi-session operation, isolated multi-account browsing.
browser-act/skills/solutions/ecommerce/etsy-category-listing Skill
5,304★ repoBrowser automation CLI built for AI agents. Break through anti-bot walls, hand off to humans across platforms when stuck. Parallel multi-task execution, independent multi-session operation, isolated multi-account browsing.
browser-act/skills/solutions/ecommerce/goofish-search-list Skill
5,304★ repoBrowser automation CLI built for AI agents. Break through anti-bot walls, hand off to humans across platforms when stuck. Parallel multi-task execution, independent multi-session operation, isolated multi-account browsing.
browser-act/skills/solutions/ecommerce/walmart-category-listing Skill
5,304★ repoBrowser automation CLI built for AI agents. Break through anti-bot walls, hand off to humans across platforms when stuck. Parallel multi-task execution, independent multi-session operation, isolated multi-account browsing.
browser-act/skills/solutions/lead-generation/google-maps-contact-extract Skill
5,304★ repoBrowser automation CLI built for AI agents. Break through anti-bot walls, hand off to humans across platforms when stuck. Parallel multi-task execution, independent multi-session operation, isolated multi-account browsing.
browser-act/skills/solutions/lead-generation/producthunt-launches Skill
5,304★ repoBrowser automation CLI built for AI agents. Break through anti-bot walls, hand off to humans across platforms when stuck. Parallel multi-task execution, independent multi-session operation, isolated multi-account browsing.
browser-act/skills/solutions/search-research/google-search-serp Skill
5,304★ repoBrowser automation CLI built for AI agents. Break through anti-bot walls, hand off to humans across platforms when stuck. Parallel multi-task execution, independent multi-session operation, isolated multi-account browsing.
browser-act/skills/solutions/search-research/web-search-scraper-api-skill Skill
5,304★ repoBrowser automation CLI built for AI agents. Break through anti-bot walls, hand off to humans across platforms when stuck. Parallel multi-task execution, independent multi-session operation, isolated multi-account browsing.
browser-act/skills/solutions/search-research/webcrawler-deep-crawl Skill
5,304★ repoBrowser automation CLI built for AI agents. Break through anti-bot walls, hand off to humans across platforms when stuck. Parallel multi-task execution, independent multi-session operation, isolated multi-account browsing.
browser-act/skills/solutions/social-listening/instagram-profile-posts Skill
5,304★ repoBrowser automation CLI built for AI agents. Break through anti-bot walls, hand off to humans across platforms when stuck. Parallel multi-task execution, independent multi-session operation, isolated multi-account browsing.
browser-act/skills/solutions/social-listening/trustpilot-reviews Skill
5,304★ repoBrowser automation CLI built for AI agents. Break through anti-bot walls, hand off to humans across platforms when stuck. Parallel multi-task execution, independent multi-session operation, isolated multi-account browsing.
browser-act/skills/solutions/social-listening/x-tweet-by-conversation Skill
5,304★ repoBrowser automation CLI built for AI agents. Break through anti-bot walls, hand off to humans across platforms when stuck. Parallel multi-task execution, independent multi-session operation, isolated multi-account browsing.