Getdocs
Crawl and scrape a documentation site into the workspace as clean local markdown (via the getdocs CLI). Use when the user wants to fetch, mirror, crawl, or scrape the docs for a library/API/framework so the agent can read them locally.From its SKILL.md
npx -y skills add jonbakerfish/getdocs --skill getdocsAssembled from the repository path, not quoted from the project. Check it against their README if it does not work.
One thing to look at
- 0 stars0 stars. Stars are a popularity signal and not a quality one, but at this level it is likely that nobody has read this closely except its author, and you would be relying on your own review.
SKILL.md
2.9 KB, 713 tokens by cl100k_base, as published. Nobody here has run it
getdocs — fetch documentation as local markdown
Use this skill when the user wants documentation pulled into the workspace as clean local markdown they (and you) can grep and read — e.g. "get me the docs for X", "mirror these docs", "crawl/scrape this docs site".
getdocs does all the crawling and cloning — your job is to invoke it correctly and act on what it produced.
How to run it
Run getdocs through uvx so nothing has to be installed first, and pin a version
new enough to emit the machine-readable summary this skill relies on. Never pass
--ignore-robots: getdocs honors robots.txt, throttles politely, and identifies
itself honestly by default — keep it that way.
Pick a mode from what the user wants, and tell them which you chose and why:
-
Synchronous — a docs section (default; works under any agent). The URL points at a specific part of the docs, or the user wants "just these docs". getdocs bounds the crawl by Scope (same host + the URL's path prefix); a modest
--limitkeeps an over-wide crawl in check. Block on it:uvx --from "getdocs>=0.2.0" getdocs crawl "<docs-url>" -o ./getdocs-out --summary-json --limit 200 -
Background — a whole-site mirror. The user wants to mirror an entire docs site. Run it as a background task so the user can keep working. Under Claude Code you are resumed automatically when it finishes; other agents block or must poll, so prefer synchronous there.
uvx --from "getdocs>=0.2.0" getdocs crawl "<docs-url>" -o ./getdocs-out --summary-json &
--summary-json makes getdocs print one JSON object describing the Outcome
to stdout (files mode). Capture and parse it.
Act on the Outcome
Branch on the summary's outcome field:
"crawled"— getdocs scraped the rendered site into a Pages tree. Readoutput_dirandmanifest(thecrawl.jsonManifest); grep/read the.mdPages and follow the nav / reading order in the Manifest. Ifstatusis"truncated"(ortruncatedistrue), it hit the page cap — tell the user it's incomplete and offer to re-run with a higher--limit(or0for unlimited)."cloned"— the docs were open-source, so getdocs cloned the repo instead (a Clone has no Pages and no Manifest). Readrepo,output_dir, andmkdocs_config; read the source underoutput_dirand offer to serve it withmkdocs serve -f <mkdocs_config>.status: "empty"— getdocs produced no Pages (seed unreachable?) and exits non-zero. Report that and suggest checking the URL.
Finally, tell the user which docs you fetched and where they landed so they can find them alongside their code.
What ships with it
Read from the repository
Just SKILL.md. No reference files, no scripts.