Tavily extract

Skill Neetx/ai-security-research-radar/.claude/skills/tavily-extract

Extract clean markdown or text from specific URLs via the Tavily CLI. Use this skill whenever a URL must be opened to be cited — papers, changelogs, release pages, blog posts, docs — including JavaScript-rendered pages. Processes up to 20 URLs per call and supports query-focused chunking for long pages.From its SKILL.md

Install

npx -y skills add Neetx/ai-security-research-radar --skill tavily-extract

Assembled from the repository path, not quoted from the project. Check it against their README if it does not work.

2 things to look at

no licenseNo license file was found in the repository. Code published without one is not open source by default, so using it at work is a question for whoever answers licensing questions where you are.
4 stars4 stars. Stars are a popularity signal and not a quality one, but at this level it is likely that nobody has read this closely except its author, and you would be relying on your own review.

SKILL.md

2.1 KB, 485 tokens by cl100k_base, as published. Nobody here has run it

tavily extract

Extract clean markdown/text content from one or more URLs. In this repo, "opened" means extracted with this skill (or fetched with a built-in web tool) — only opened URLs are citable as evidence.

Before running any command

Check tvly --status. If tvly is not on PATH:

pip install -q tavily-cli || uv tool install tavily-cli

Auth comes from the TAVILY_API_KEY environment variable (already set in this environment). Never print it. If it is unset, report that and fall back to the built-in web tools.

Quick start

# Single URL
tvly extract "https://example.com/article" --json

# Batch (max 20 per call)
tvly extract "https://arxiv.org/abs/XXXX.XXXXX" "https://github.com/org/repo" --json

# Long pages: only the relevant chunks
tvly extract "https://example.com/docs" --query "release date changelog" --chunks-per-source 3 --json

# JS-heavy pages
tvly extract "https://app.example.com" --extract-depth advanced --json

Key options

Option	Description
`--query` + `--chunks-per-source`	Return only chunks relevant to a query (1–5 per URL)
`--extract-depth`	`basic` (default, try first) or `advanced` (JS-rendered pages)
`--format`	`markdown` (default) or `text`
`--timeout`	1–60 seconds for slow pages
`--json` / `-o FILE`	Structured output / save to file

Tips

Always quote URLs (shell interprets ? and &).
Try basic first; escalate to advanced only if content is missing.
arXiv abs pages often hide authors/dates in the extraction — cross-check exact metadata with curl -sL 'https://export.arxiv.org/api/query?id_list=...' (see radar-source-verify).
If a search already used --include-raw-content, skip the extract step.

What ships with it

Read from the repository

Just SKILL.md. No reference files, no scripts.