agentsclimarketplace

Firecrawl crawl

Skill arch3rPro/ark-space/skills/firecrawl-crawl

Use when bulk extracting a website or site section through Firecrawl CLI, especially docs sections, many pages on one site, or ArkSpace web_crawl routing that selects Firecrawl.From its SKILL.md

Install
npx -y skills add arch3rPro/ark-space --skill firecrawl-crawl

Assembled from the repository path, not quoted from the project. Check it against their README if it does not work.

2 things to look at

  • 2 stars2 stars. Stars are a popularity signal and not a quality one, but at this level it is likely that nobody has read this closely except its author, and you would be relying on your own review.
  • runs commandsInstructs the agent to run 3 commands, including `python3 <installed-arkspace-path>/scripts/arkspace.py provider check firecrawl --capability web_crawl` and 2 more.

SKILL.md

1.6 KB, 332 tokens by cl100k_base, as published. Nobody here has run it

Firecrawl Crawl

Use Firecrawl Crawl as a CLI-backed web_crawl provider when ArkSpace needs multi-page extraction from a known site or site section.

Before Use

Resolve the installed ArkSpace package root before running commands. Replace <installed-arkspace-path> with the directory two levels above this loaded SKILL.md, such as /Users/<user>/.claude/plugins/cache/ark-space/ark-space/0.1.2. Use the installed package path, not a repository-relative command.

Check configuration:

python3 <installed-arkspace-path>/scripts/arkspace.py provider check firecrawl --capability web_crawl

Set up Firecrawl:

python3 <installed-arkspace-path>/scripts/arkspace.py provider setup firecrawl --wizard

Missing Configuration Recovery

If the provider check reports missing configuration, ask whether to start setup with python3 <installed-arkspace-path>/scripts/arkspace.py provider setup firecrawl --wizard. Do not crawl with Firecrawl until the provider check succeeds.

Helper Script

Crawl a docs section:

python3 <installed-arkspace-path>/scripts/arkspace.py site crawl --provider firecrawl "https://docs.example.com" \
  --include-paths /docs \
  --limit 50 \
  --output json

Routing Notes

  • Use registry/web-crawl-providers.yaml before execution.
  • Start with shallow depth and small limits.
  • Use map first when the user only needs a specific page from a large site.

Keep looking

Skills are one crate of 325,949. Ordering is by how many stacks a row turns up in, so the top of any crate is what has actually been picked rather than what has the most stars.