agentsclimarketplace
Sign in

Pipelines & ETL

567 rows, by stacks then stars

200 of these skill files have been read, by 149 distinct authors, and what they tell an agent counted. What Pipelines & ETL authors agree on, and what they forbid

  • Airflow dag patterns

    Sheshiyer/skill-clusters/skills/airflow-dag-patterns Skill

    0★ repo

    Hub-and-spoke agent-skill clusters, one per stack (Astro·GSAP·Remotion, Tauri, …). Installable via skills.sh.

  • Data throughput accelerator

    Sheshiyer/skill-clusters/skills/data-throughput-accelerator Skill

    0★ repo

    Hub-and-spoke agent-skill clusters, one per stack (Astro·GSAP·Remotion, Tauri, …). Installable via skills.sh.

  • Dbt transformation patterns

    Sheshiyer/skill-clusters/skills/dbt-transformation-patterns Skill

    0★ repo

    Hub-and-spoke agent-skill clusters, one per stack (Astro·GSAP·Remotion, Tauri, …). Installable via skills.sh.

  • Data pipeline

    Mattakushi432/Claude-Code-Skills-Custom-DevTools-Pack/plugins/devtools-pack/skills/data-pipeline Skill

    0★ repo

    A curated pack of custom Claude Code skills for developers — installable as a Claude Code plugin marketplace.

  • Python data pipeline

    Mattakushi432/Claude-Code-Skills-Custom-DevTools-Pack/plugins/devtools-pack/skills/python-data-pipeline Skill

    0★ repo

    A curated pack of custom Claude Code skills for developers — installable as a Claude Code plugin marketplace.

  • Ddia batch stream processing

    ebarti/skills/ddia-batch-stream-processing Skill

    0★ repo

    📚 Agent skills distilled from technical books — AI Engineering, Context Engineering, Designing Data-Intensive Applications, and more. Agent-agnostic, plain Markdown. Give your AI agent a bookshelf.

  • Kafka pipelines

    SkillMedev/data-engineering-pipeline/skills/kafka-pipelines Skill

    0★ repo

    Streams, batch, and storage — production data pipelines, encoded.

  • Spark jobs

    SkillMedev/data-engineering-pipeline/skills/spark-jobs Skill

    0★ repo

    Streams, batch, and storage — production data pipelines, encoded.

  • Data platform

    muxammadmamajonov/dot-claude/.claude/skills/data-platform Skill

    0★ repo

    Universal .claude AI Project OS — a reusable, safe, copy-into-any-project Claude Code operating system (agents, skills, commands, presets, checklists, hooks, operating-capability docs).

  • Build dbt model

    NorthStar-Analytics-LTD/skill-foundry/skills/build-dbt-model Skill

    0★ repo

    Claude Code skills that interview your analytics team before writing a line. /northstar master skill + 12 skill builders.

  • Data engineer

    sumitake/agent-collab/plugins/agent-collab/skills/data-engineer Skill

    no license0★ repo

    Unified dynamic-host agent collaboration policy and signed-runtime client

  • Data modeler

    karim-bhalwani/agent-skills-collection/skills/data-modeler Skill

    0★ repo

    AI agents are smart but unreliable without procedure. "Agent Skills" are executable checklists that package expertise.

  • Data pipeline engineer

    karim-bhalwani/agent-skills-collection/skills/data-pipeline-engineer Skill

    0★ repo

    AI agents are smart but unreliable without procedure. "Agent Skills" are executable checklists that package expertise.

  • Dbt transformation patterns

    karim-bhalwani/agent-skills-collection/skills/dbt-transformation-patterns Skill

    0★ repo

    AI agents are smart but unreliable without procedure. "Agent Skills" are executable checklists that package expertise.

  • Dataeng

    javalenciacai/develop-skills/.agents/skills/dataeng Skill

    0★ repo

    AI agent skills organized as a virtual development team for software development

  • Data engineering data pipeline

    planifest/planifest-framework/planifest-framework/external-skills/data-engineering-data-pipeline Skill

    0★ repo

    A specification framework for agentic development. Agents build from complete specs - not guesses.

  • Dbt transformation patterns

    planifest/planifest-framework/planifest-framework/external-skills/dbt-transformation-patterns Skill

    0★ repo

    A specification framework for agentic development. Agents build from complete specs - not guesses.

  • Kafka development

    planifest/planifest-framework/planifest-framework/external-skills/kafka-development Skill

    0★ repo

    A specification framework for agentic development. Agents build from complete specs - not guesses.

  • Snowflake development

    planifest/planifest-framework/planifest-framework/external-skills/snowflake-development Skill

    0★ repo

    A specification framework for agentic development. Agents build from complete specs - not guesses.

  • Sap datasphere

    VRIL-LABS/skill-jam/skills/ai-ml/sap-skills-main/sap-skills-main/plugins/sap-datasphere/skills/sap-datasphere Skill

    no license0★ repo

    Welcome to the skill-jam ☄️🏀

  • Kafka development

    VRIL-LABS/skill-jam/skills/ai-ml/skills-main-2/skills-main/kafka-development Skill

    no license0★ repo

    Welcome to the skill-jam ☄️🏀

  • Etl pipeline builder

    VRIL-LABS/skill-jam/skills/core-collections/new-skills-2026/data-engineering/etl-pipeline-builder Skill

    no license0★ repo

    Welcome to the skill-jam ☄️🏀

  • Data migration

    iceflower/agent-skills/data-migration Skill

    0★ repo

    Agent Skills 오픈 표준 기반 AI 코딩 에이전트용 스킬 컬렉션 (Java, Kotlin, Spring, NestJS, K8s, Terraform, GraphQL, gRPC, OpenTelemetry, a11y, i18n 등 60개)

  • Data pipeline design

    SWEStash/swe-workflow-skills/plugins/data/skills/data-pipeline-design Skill

    0★ repo

    A comprehensive SWE workflow, encoded. Might be useful to you too.

  • Ml pipeline design

    SWEStash/swe-workflow-skills/plugins/ml/skills/ml-pipeline-design Skill

    0★ repo

    A comprehensive SWE workflow, encoded. Might be useful to you too.

  • Data pipeline design

    SWEStash/swe-workflow-skills/skills/data-pipeline-design Skill

    0★ repo

    A comprehensive SWE workflow, encoded. Might be useful to you too.

  • Ml pipeline design

    SWEStash/swe-workflow-skills/skills/ml-pipeline-design Skill

    0★ repo

    A comprehensive SWE workflow, encoded. Might be useful to you too.

  • Data pipeline freshness auditor

    sisodiabhumca/agent-skills/skills/data-pipeline-freshness-auditor Skill

    0★ repo

    Production-Ready Agent Skills : product analytics, growth experiments, CRM, research synthesis, postmortems, data contracts, SaaS spend, compliance, architecture maps, and LLM eval and many more.

  • Etl lineage explainer

    sisodiabhumca/agent-skills/skills/etl-lineage-explainer Skill

    0★ repo

    Production-Ready Agent Skills : product analytics, growth experiments, CRM, research synthesis, postmortems, data contracts, SaaS spend, compliance, architecture maps, and LLM eval and many more.

  • Etl retry backoff simulator

    sisodiabhumca/agent-skills/skills/etl-retry-backoff-simulator Skill

    0★ repo

    Production-Ready Agent Skills : product analytics, growth experiments, CRM, research synthesis, postmortems, data contracts, SaaS spend, compliance, architecture maps, and LLM eval and many more.

  • Data pipeline designer

    POWR-DATA/mtx-skills/skills/data/data-pipeline-designer Skill

    0★ repo

    Reusable AI agent skills for application development, data, architecture, domain modelling and delivery workflows.

  • Kafka avro topic auto create config

    kjuhwa/skills-hub/skills/arch/kafka-avro-topic-auto-create-config Skill

    0★ repo

    Self-correcting knowledge corpus for Claude Code — 9 stable shape clusters, bias-correction pipeline baked into contribution flow. 47 papers, 45 techniques, 1.1k skills.

  • Kafka engine distributed job framework

    kjuhwa/skills-hub/skills/arch/kafka-engine-distributed-job-framework Skill

    0★ repo

    Self-correcting knowledge corpus for Claude Code — 9 stable shape clusters, bias-correction pipeline baked into contribution flow. 47 papers, 45 techniques, 1.1k skills.

  • Avro gradle kafka schema pipeline

    kjuhwa/skills-hub/skills/backend/avro-gradle-kafka-schema-pipeline Skill

    0★ repo

    Self-correcting knowledge corpus for Claude Code — 9 stable shape clusters, bias-correction pipeline baked into contribution flow. 47 papers, 45 techniques, 1.1k skills.

  • Event driven kafka scheduling

    kjuhwa/skills-hub/skills/backend/event-driven-kafka-scheduling Skill

    0★ repo

    Self-correcting knowledge corpus for Claude Code — 9 stable shape clusters, bias-correction pipeline baked into contribution flow. 47 papers, 45 techniques, 1.1k skills.

  • Kafka avro producer gzip 30mb

    kjuhwa/skills-hub/skills/backend/kafka-avro-producer-gzip-30mb Skill

    0★ repo

    Self-correcting knowledge corpus for Claude Code — 9 stable shape clusters, bias-correction pipeline baked into contribution flow. 47 papers, 45 techniques, 1.1k skills.

  • Kafka batch consumer partition tuning

    kjuhwa/skills-hub/skills/backend/kafka-batch-consumer-partition-tuning Skill

    0★ repo

    Self-correcting knowledge corpus for Claude Code — 9 stable shape clusters, bias-correction pipeline baked into contribution flow. 47 papers, 45 techniques, 1.1k skills.

  • Kafka consumer config 3 factories

    kjuhwa/skills-hub/skills/backend/kafka-consumer-config-3-factories Skill

    0★ repo

    Self-correcting knowledge corpus for Claude Code — 9 stable shape clusters, bias-correction pipeline baked into contribution flow. 47 papers, 45 techniques, 1.1k skills.

  • Kafka consumer errorhandling wrapper

    kjuhwa/skills-hub/skills/backend/kafka-consumer-errorhandling-wrapper Skill

    0★ repo

    Self-correcting knowledge corpus for Claude Code — 9 stable shape clusters, bias-correction pipeline baked into contribution flow. 47 papers, 45 techniques, 1.1k skills.

  • Kafka consumer semaphore chunking

    kjuhwa/skills-hub/skills/backend/kafka-consumer-semaphore-chunking Skill

    0★ repo

    Self-correcting knowledge corpus for Claude Code — 9 stable shape clusters, bias-correction pipeline baked into contribution flow. 47 papers, 45 techniques, 1.1k skills.

  • Kafka consumer tenant fan out

    kjuhwa/skills-hub/skills/backend/kafka-consumer-tenant-fan-out Skill

    0★ repo

    Self-correcting knowledge corpus for Claude Code — 9 stable shape clusters, bias-correction pipeline baked into contribution flow. 47 papers, 45 techniques, 1.1k skills.

  • Kafka debounce event coalescing

    kjuhwa/skills-hub/skills/backend/kafka-debounce-event-coalescing Skill

    0★ repo

    Self-correcting knowledge corpus for Claude Code — 9 stable shape clusters, bias-correction pipeline baked into contribution flow. 47 papers, 45 techniques, 1.1k skills.

  • Kafka message header metadata

    kjuhwa/skills-hub/skills/backend/kafka-message-header-metadata Skill

    0★ repo

    Self-correcting knowledge corpus for Claude Code — 9 stable shape clusters, bias-correction pipeline baked into contribution flow. 47 papers, 45 techniques, 1.1k skills.

  • Kafka producer async callback

    kjuhwa/skills-hub/skills/backend/kafka-producer-async-callback Skill

    0★ repo

    Self-correcting knowledge corpus for Claude Code — 9 stable shape clusters, bias-correction pipeline baked into contribution flow. 47 papers, 45 techniques, 1.1k skills.

  • Kafka producer config avro schema registry

    kjuhwa/skills-hub/skills/backend/kafka-producer-config-avro-schema-registry Skill

    0★ repo

    Self-correcting knowledge corpus for Claude Code — 9 stable shape clusters, bias-correction pipeline baked into contribution flow. 47 papers, 45 techniques, 1.1k skills.

  • Multi tenant kafka header organization context

    kjuhwa/skills-hub/skills/backend/multi-tenant-kafka-header-organization-context Skill

    0★ repo

    Self-correcting knowledge corpus for Claude Code — 9 stable shape clusters, bias-correction pipeline baked into contribution flow. 47 papers, 45 techniques, 1.1k skills.

  • Org scoped kafka topic bootstrap

    kjuhwa/skills-hub/skills/backend/org-scoped-kafka-topic-bootstrap Skill

    0★ repo

    Self-correcting knowledge corpus for Claude Code — 9 stable shape clusters, bias-correction pipeline baked into contribution flow. 47 papers, 45 techniques, 1.1k skills.

  • Testcontainers mongo kafka abstract base

    kjuhwa/skills-hub/skills/backend/testcontainers-mongo-kafka-abstract-base Skill

    0★ repo

    Self-correcting knowledge corpus for Claude Code — 9 stable shape clusters, bias-correction pipeline baked into contribution flow. 47 papers, 45 techniques, 1.1k skills.

  • Data pipeline visualization pattern

    kjuhwa/skills-hub/skills/design/data-pipeline-visualization-pattern Skill

    0★ repo

    Self-correcting knowledge corpus for Claude Code — 9 stable shape clusters, bias-correction pipeline baked into contribution flow. 47 papers, 45 techniques, 1.1k skills.

  • Etl visualization pattern

    kjuhwa/skills-hub/skills/design/etl-visualization-pattern Skill

    0★ repo

    Self-correcting knowledge corpus for Claude Code — 9 stable shape clusters, bias-correction pipeline baked into contribution flow. 47 papers, 45 techniques, 1.1k skills.

  • Data pipeline data simulation

    kjuhwa/skills-hub/skills/workflow/data-pipeline-data-simulation Skill

    0★ repo

    Self-correcting knowledge corpus for Claude Code — 9 stable shape clusters, bias-correction pipeline baked into contribution flow. 47 papers, 45 techniques, 1.1k skills.

  • Etl data simulation

    kjuhwa/skills-hub/skills/workflow/etl-data-simulation Skill

    0★ repo

    Self-correcting knowledge corpus for Claude Code — 9 stable shape clusters, bias-correction pipeline baked into contribution flow. 47 papers, 45 techniques, 1.1k skills.

  • Spark healthcare data pipeline

    rbr7/MedClawMini/skills/spark-healthcare-data-pipeline Skill

    0★ repo

    A focused, production-minded library of 197 clinical-AI and healthcare data-science skills for the OpenClaw agent platform featuring data quality, clinical NLP, big-data ML, explainable AI, drug safety, and regulatory.

  • Review data pipeline

    SystemicVoid/agentic-research-skills/skills/review-data-pipeline Skill

    0★ repo

    Six evidence-disciplined research workflow skills for coding agents. Install with npx skills, direct download, or git clone.

  • Discover data

    kenantang/codex-and-claude-skills/collected-academic-research-skills/sources/rand__cc-polymath/skills/discover-data Skill

    no license0★ repo

    Generated by Codex. Read with caution.

  • Answering natural language questions with dbt

    danielvogler/ai-skills-library/.agents/skills/answering-natural-language-questions-with-dbt Skill

    0★ repo

    Centralized manifest for AI agent skills. Synced via ai-agent-skills.

  • Building dbt semantic layer

    danielvogler/ai-skills-library/.agents/skills/building-dbt-semantic-layer Skill

    0★ repo

    Centralized manifest for AI agent skills. Synced via ai-agent-skills.

  • Configuring dbt mcp server

    danielvogler/ai-skills-library/.agents/skills/configuring-dbt-mcp-server Skill

    0★ repo

    Centralized manifest for AI agent skills. Synced via ai-agent-skills.

  • Creating mermaid dbt dag

    danielvogler/ai-skills-library/.agents/skills/creating-mermaid-dbt-dag Skill

    0★ repo

    Centralized manifest for AI agent skills. Synced via ai-agent-skills.

  • Fetching dbt docs

    danielvogler/ai-skills-library/.agents/skills/fetching-dbt-docs Skill

    0★ repo

    Centralized manifest for AI agent skills. Synced via ai-agent-skills.