Xiaohongshu to markdown

Skill kohoj/skills/xiaohongshu-to-markdown

Claude Code skills for web scraping & content extraction — Twitter/X tweet scraper, Xiaohongshu (Little Red Book) OCR to Markdown. CDP + httpx architecture.

Install

npx -y skills add kohoj/skills --skill xiaohongshu-to-markdown

Assembled from the repository path, not quoted from the project. Check it against their README if it does not work.

One thing to look at

1 stars1 stars. Stars are a popularity signal and not a quality one, but at this level it is likely that nobody has read this closely except its author, and you would be relying on your own review.

What its author says it does

Copied from the file, not written here

Xiaohongshu Article to Markdown — Extracts text from Xiaohongshu image-based posts via OCR. Use when the user needs to convert a Xiaohongshu/Little Red Book post into readable Markdown text. The tool downloads all carousel images from a post and uses macOS Vision OCR to extract the text content. Requires a Chromium browser logged into xiaohongshu.com with CDP enabled. macOS only (uses Vision Framework for OCR).

SKILL.md

2.7 KB, as published. Nobody here has run it

Xiaohongshu Article to Markdown

Extracts authentication from a Chromium browser via CDP, fetches post data via httpx, downloads carousel images, and OCRs them into a clean Markdown file using macOS Vision Framework.

Quick Start

python3 <skill-path>/scripts/xhs_to_markdown.py <xiaohongshu_url> [--output-dir DIR] [--cdp-port PORT]

Arguments:

url (required): Xiaohongshu post URL (e.g., https://www.xiaohongshu.com/explore/...)
--output-dir: Output directory, defaults to current working directory
--cdp-port: CDP debugging port, default 9222

Output file: {title}_{noteId}.md

Prerequisites

macOS (uses Vision Framework for OCR — no Python OCR dependencies needed)
Chromium-based browser (Chrome / Edge / Brave / Arc) installed and logged in to xiaohongshu.com
Python dependencies: pip install playwright httpx && playwright install chromium
Swift (pre-installed on macOS)

Launch browser with CDP:

# Arc
/Applications/Arc.app/Contents/MacOS/Arc --remote-debugging-port=9222
# Chrome
/Applications/Google\ Chrome.app/Contents/MacOS/Google\ Chrome --remote-debugging-port=9222
# Edge
/Applications/Microsoft\ Edge.app/Contents/MacOS/Microsoft\ Edge --remote-debugging-port=9222
# Brave
/Applications/Brave\ Browser.app/Contents/MacOS/Brave\ Browser --remote-debugging-port=9222

Architecture

URL → CDP(extract cookies) → httpx(fetch HTML) → parse __INITIAL_STATE__ JSON
→ extract HD image URLs → httpx download images → Swift Vision OCR → Markdown

Step	Method	Notes
Cookie extraction	CDP `ctx.cookies()`	Invisible, no tabs opened
Page fetch	httpx GET	With browser cookies for auth
Data parsing	`__INITIAL_STATE__` JSON	Embedded in page HTML
Image download	httpx concurrent	Strips quality compression suffixes
OCR	macOS Vision Framework (Swift)	`.accurate` level, zh-Hans + zh-Hant + en
Output	Markdown file	Title + meta + OCR text + description

Output Format

# {title}

> Author: {author} | {time} | [Original]({url})

{OCR text from image 1}

{OCR text from image 2}

...

---

{post description, if present}

Lessons Learned

Date	Lesson	Action