agentsclimarketplace

Yao doubao crawler

Skill ShenyuanNext/wepr-growth-skills/skills/yao-doubao-crawler

Use when a user needs repeated Doubao AI-search collection from web or Android Appium into compatible JSON plus Markdown/Excel/HTML GEO reports. Requires keywords/questions and repeat count; target entity/type are required only for target-vs-competitor diagnosis. Not for generic scraping, Doubao API chat, hidden API extraction, SEO writing, high-frequency automation, or one-off answers.From its SKILL.md

Install
npx -y skills add ShenyuanNext/wepr-growth-skills --skill yao-doubao-crawler

Assembled from the repository path, not quoted from the project. Check it against their README if it does not work.

One thing to look at

  • 2 stars2 stars. Stars are a popularity signal and not a quality one, but at this level it is likely that nobody has read this closely except its author, and you would be relying on your own review.

SKILL.md

1.9 KB, 337 tokens by cl100k_base, as published. Nobody here has run it

Yao Doubao Crawler

Inputs

Collect with keywords/questions, repeat count, backend (web or mobile), connection fields, and output dir. Add target entity + entity type for standard diagnosis. Without a target, generate exploratory output and label inferred candidates as heuristic.

Workflow

  1. Read references/user-setup-and-usage.md, references/doubao-crawl-workflow.md, and references/report-contract.md.
  2. For Android/Appium, also read references/mobile-appium-workflow.md and run python3 scripts/doubao_mobile_crawl.py preflight ....
  3. Stage 1 web: run scripts/doubao_batch_crawl.mjs.
  4. Stage 1 mobile: run scripts/doubao_mobile_crawl.py batch; use --fresh-chat --require-fresh-chat when samples must start in separate Doubao app conversations.
  5. Stage 2: run scripts/analyze_doubao_results.py on the compatible crawl JSON.
  6. Use evals/ and templates/ for packaging checks and collection briefs.
  7. Return crawl JSON, summary.json, structured Markdown/Excel, HTML report, screenshots/XML for mobile, failed logs, and mobile search-material evidence when present.

Honest Boundaries

  • Do not bypass login, CAPTCHA, risk controls, hidden APIs, network traffic, or app storage.
  • Android/Appium is low-frequency visible UI evidence capture.
  • Probability and competitor metrics are repeated-sample estimates; review aliases before external use.
  • Preserve raw answers, references, URLs, screenshots/XML, and logs.

Keep looking

Skills are one crate of 325,949. Ordering is by how many stacks a row turns up in, so the top of any crate is what has actually been picked rather than what has the most stars.