Scraper

Skill raven-sourav/pmm-content-engine/skills/scraper

PMM Content Distribution Engine — Newsletter scraper, Obsidian knowledge brain, multi-format content generation powered by Claude Code

Install

npx -y skills add raven-sourav/pmm-content-engine --skill scraper

Assembled from the repository path, not quoted from the project. Check it against their README if it does not work.

2 things to look at

no licenseNo license file was found in the repository. Code published without one is not open source by default, so using it at work is a question for whoever answers licensing questions where you are.
3 stars3 stars. Stars are a popularity signal and not a quality one, but at this level it is likely that nobody has read this closely except its author, and you would be relying on your own review.

SKILL.md

1.8 KB, as published. Nobody here has run it

Skill: Newsletter Scraper

Scrape newsletter posts from Substack and Beehiiv publications. No API keys needed.

Trigger

User wants to scrape, research, or pull posts from a newsletter URL.

Supported Platforms

Substack

Any Substack publication (subdomain or custom domain).

python3 skills/scraper/scripts/scrape_substack.py --url "https://newsletter.substack.com" --days 30 --output summary
python3 skills/scraper/scripts/scrape_substack.py --url "https://www.lennysnewsletter.com" --keywords "AI" --output json
python3 skills/scraper/scripts/scrape_substack.py --url "https://newsletter.substack.com" --full-content --output json

Beehiiv

Any Beehiiv publication (including custom domains).

python3 skills/scraper/scripts/scrape_beehiiv.py --url "https://www.growthunhinged.com" --days 30 --output summary
python3 skills/scraper/scripts/scrape_beehiiv.py --url "https://www.growthunhinged.com" --keywords "pricing" --output json
python3 skills/scraper/scripts/scrape_beehiiv.py --url "https://www.growthunhinged.com" --full-content --output json

CLI Flags (both scripts)

Flag	Default	Description
`--url`	required	Newsletter URL
`--keywords`	none	Filter by keywords (comma-separated, OR logic)
`--days`	all	Only include posts from last N days
`--max-posts`	all	Max posts to return
`--full-content`	false	Fetch full post body (slower)
`--output`	summary	`summary` (table) or `json`

How It Works

Substack: Uses public /api/v1/archive JSON endpoint. Returns title, subtitle, word count, reactions, comments, tags, author.
Beehiiv: Uses hidden /posts JSON endpoint. Returns title, subtitle, tags, reading time, author.

Dependencies

Only requests — install via pip install requests.