agentsclimarketplace

Data acquisition pipeline

Skill Pranjay-kumar/universal-data-acquisition-pipeline-skill/skills/data-acquisition-pipeline

Codex/Claude skill for designing robust scraping, API, Playwright, and authorized data acquisition pipelines

Install
npx -y skills add Pranjay-kumar/universal-data-acquisition-pipeline-skill --skill data-acquisition-pipeline

Assembled from the repository path, not quoted from the project. Check it against their README if it does not work.

One thing to look at

  • 1 stars1 stars. Stars are a popularity signal and not a quality one, but at this level it is likely that nobody has read this closely except its author, and you would be relying on your own review.

What its author says it does

Copied from the file, not written here

Use when the user wants a production-grade scraping/API/browser pipeline design or implementation plan: pipeline.yaml, schemas, raw/staged/normalized outputs, dedupe, incremental refresh, checkpoints, retries, rate-limit strategy, quality gates, observability, run reports, and recovery.

SKILL.md

0.9 KB, as published. Nobody here has run it

Data Acquisition Pipeline

Act as the pipeline architect. Turn known or proposed sources into a restartable, observable, quality-checked pipeline.

Shared Core

Read from ../data-acquisition-core/references/:

  • pipeline-engineering.md
  • source-access.md
  • output-contracts.md
  • source-strategies.md
  • compliance-boundaries.md

Output

Return:

  • SourceAccessClass
  • PipelineQualityPlan
  • PipelinePlan
  • schema
  • output layout
  • run report shape
  • validation gates
  • ApprovalGate

If implementing, keep secrets local and outputs incremental.

Keep looking

Skills are one crate of 328,083. Ordering is by how many stacks a row turns up in, so the top of any crate is what has actually been picked rather than what has the most stars.