Pipelines & ETL
567 rows, by stacks then stars
200 of these skill files have been read, by 149 distinct authors, and what they tell an agent counted. What Pipelines & ETL authors agree on, and what they forbid
ComeOnOliver/skillshub/skills/dbt-labs/dbt-agent-skills/adding-dbt-unit-test Skill
59★ repo🧠 The right skill, one API call. AI agent skills registry with token-efficient skill resolution. 5,000+ skills from 500+ top repos.
Answering natural language questions with dbt
ComeOnOliver/skillshub/skills/dbt-labs/dbt-agent-skills/answering-natural-language-questions-with-dbt Skill
59★ repo🧠 The right skill, one API call. AI agent skills registry with token-efficient skill resolution. 5,000+ skills from 500+ top repos.
ComeOnOliver/skillshub/skills/dbt-labs/dbt-agent-skills/building-dbt-semantic-layer Skill
59★ repo🧠 The right skill, one API call. AI agent skills registry with token-efficient skill resolution. 5,000+ skills from 500+ top repos.
ComeOnOliver/skillshub/skills/dbt-labs/dbt-agent-skills/configuring-dbt-mcp-server Skill
59★ repo🧠 The right skill, one API call. AI agent skills registry with token-efficient skill resolution. 5,000+ skills from 500+ top repos.
ComeOnOliver/skillshub/skills/dbt-labs/dbt-agent-skills/creating-mermaid-dbt-dag Skill
59★ repo🧠 The right skill, one API call. AI agent skills registry with token-efficient skill resolution. 5,000+ skills from 500+ top repos.
ComeOnOliver/skillshub/skills/dbt-labs/dbt-agent-skills/fetching-dbt-docs Skill
59★ repo🧠 The right skill, one API call. AI agent skills registry with token-efficient skill resolution. 5,000+ skills from 500+ top repos.
ComeOnOliver/skillshub/skills/dbt-labs/dbt-agent-skills/migrating-dbt-core-to-fusion Skill
59★ repo🧠 The right skill, one API call. AI agent skills registry with token-efficient skill resolution. 5,000+ skills from 500+ top repos.
Migrating dbt project across platforms
ComeOnOliver/skillshub/skills/dbt-labs/dbt-agent-skills/migrating-dbt-project-across-platforms Skill
59★ repo🧠 The right skill, one API call. AI agent skills registry with token-efficient skill resolution. 5,000+ skills from 500+ top repos.
ComeOnOliver/skillshub/skills/dbt-labs/dbt-agent-skills/running-dbt-commands Skill
59★ repo🧠 The right skill, one API call. AI agent skills registry with token-efficient skill resolution. 5,000+ skills from 500+ top repos.
Troubleshooting dbt job errors
ComeOnOliver/skillshub/skills/dbt-labs/dbt-agent-skills/troubleshooting-dbt-job-errors Skill
59★ repo🧠 The right skill, one API call. AI agent skills registry with token-efficient skill resolution. 5,000+ skills from 500+ top repos.
Using dbt for analytics engineering
ComeOnOliver/skillshub/skills/dbt-labs/dbt-agent-skills/using-dbt-for-analytics-engineering Skill
59★ repo🧠 The right skill, one API call. AI agent skills registry with token-efficient skill resolution. 5,000+ skills from 500+ top repos.
ComeOnOliver/skillshub/skills/jeremylongshore/claude-code-plugins-plus-skills/airflow-dag-generator Skill
59★ repo🧠 The right skill, one API call. AI agent skills registry with token-efficient skill resolution. 5,000+ skills from 500+ top repos.
ComeOnOliver/skillshub/skills/jeremylongshore/claude-code-plugins-plus-skills/airflow-operator-creator Skill
59★ repo🧠 The right skill, one API call. AI agent skills registry with token-efficient skill resolution. 5,000+ skills from 500+ top repos.
ComeOnOliver/skillshub/skills/jeremylongshore/claude-code-plugins-plus-skills/clari-core-workflow-a Skill
59★ repo🧠 The right skill, one API call. AI agent skills registry with token-efficient skill resolution. 5,000+ skills from 500+ top repos.
ComeOnOliver/skillshub/skills/jeremylongshore/claude-code-plugins-plus-skills/clari-performance-tuning Skill
59★ repo🧠 The right skill, one API call. AI agent skills registry with token-efficient skill resolution. 5,000+ skills from 500+ top repos.
ComeOnOliver/skillshub/skills/jeremylongshore/claude-code-plugins-plus-skills/clickhouse-webhooks-events Skill
59★ repo🧠 The right skill, one API call. AI agent skills registry with token-efficient skill resolution. 5,000+ skills from 500+ top repos.
ComeOnOliver/skillshub/skills/jeremylongshore/claude-code-plugins-plus-skills/databricks-core-workflow-a Skill
59★ repo🧠 The right skill, one API call. AI agent skills registry with token-efficient skill resolution. 5,000+ skills from 500+ top repos.
ComeOnOliver/skillshub/skills/jeremylongshore/claude-code-plugins-plus-skills/dbt-model-generator Skill
59★ repo🧠 The right skill, one API call. AI agent skills registry with token-efficient skill resolution. 5,000+ skills from 500+ top repos.
ComeOnOliver/skillshub/skills/jeremylongshore/claude-code-plugins-plus-skills/dbt-test-creator Skill
59★ repo🧠 The right skill, one API call. AI agent skills registry with token-efficient skill resolution. 5,000+ skills from 500+ top repos.
ComeOnOliver/skillshub/skills/jeremylongshore/claude-code-plugins-plus-skills/kafka-producer-consumer Skill
59★ repo🧠 The right skill, one API call. AI agent skills registry with token-efficient skill resolution. 5,000+ skills from 500+ top repos.
ComeOnOliver/skillshub/skills/jeremylongshore/claude-code-plugins-plus-skills/kafka-stream-processor Skill
59★ repo🧠 The right skill, one API call. AI agent skills registry with token-efficient skill resolution. 5,000+ skills from 500+ top repos.
ComeOnOliver/skillshub/skills/rmyndharis/antigravity-skills/airflow-dag-patterns Skill
59★ repo🧠 The right skill, one API call. AI agent skills registry with token-efficient skill resolution. 5,000+ skills from 500+ top repos.
Data engineering data pipeline
ComeOnOliver/skillshub/skills/rmyndharis/antigravity-skills/data-engineering-data-pipeline Skill
59★ repo🧠 The right skill, one API call. AI agent skills registry with token-efficient skill resolution. 5,000+ skills from 500+ top repos.
ComeOnOliver/skillshub/skills/rmyndharis/antigravity-skills/dbt-transformation-patterns Skill
59★ repo🧠 The right skill, one API call. AI agent skills registry with token-efficient skill resolution. 5,000+ skills from 500+ top repos.
lensesio/agentic-engineering-for-apache-kafka/skills/kafka-dlq-review Skill
56★ repoAI agent skills for building, operating and troubleshooting Apache Kafka applications. Topic audit, consumer lag, schema review, security, connectors and DLQ
lensesio/agentic-engineering-for-apache-kafka/skills/kafka-perf-review Skill
56★ repoAI agent skills for building, operating and troubleshooting Apache Kafka applications. Topic audit, consumer lag, schema review, security, connectors and DLQ
lensesio/agentic-engineering-for-apache-kafka/skills/kafka-python-client Skill
56★ repoAI agent skills for building, operating and troubleshooting Apache Kafka applications. Topic audit, consumer lag, schema review, security, connectors and DLQ
lensesio/agentic-engineering-for-apache-kafka/skills/kafka-schema-review Skill
56★ repoAI agent skills for building, operating and troubleshooting Apache Kafka applications. Topic audit, consumer lag, schema review, security, connectors and DLQ
lensesio/agentic-engineering-for-apache-kafka/skills/kafka-security-audit Skill
56★ repoAI agent skills for building, operating and troubleshooting Apache Kafka applications. Topic audit, consumer lag, schema review, security, connectors and DLQ
lensesio/agentic-engineering-for-apache-kafka/skills/kafka-shadowtraffic-java Skill
56★ repoAI agent skills for building, operating and troubleshooting Apache Kafka applications. Topic audit, consumer lag, schema review, security, connectors and DLQ
lensesio/agentic-engineering-for-apache-kafka/skills/kafka-shadowtraffic Skill
56★ repoAI agent skills for building, operating and troubleshooting Apache Kafka applications. Topic audit, consumer lag, schema review, security, connectors and DLQ
lensesio/agentic-engineering-for-apache-kafka/skills/kafka-topic-audit Skill
56★ repoAI agent skills for building, operating and troubleshooting Apache Kafka applications. Topic audit, consumer lag, schema review, security, connectors and DLQ
proyecto26/system-design-skills/skills/messaging-streaming Skill
53★ repoA divide-and-conquer wiki of system-design skills for Claude Code — reason about scalable systems, don't memorize architectures.
BagelHole/DevOps-Security-Agent-Skills/devops/ai/ai-pipeline-orchestration Skill
46★ repoAgent-ready DevOps, security, infrastructure, and compliance knowledge base with 80+ skills across Kubernetes, Terraform, AWS/Azure/GCP, AI platform operations, container hardening, SOC2/ISO27001, and incident response—plus ready-to-run scripts, templates, and playbooks for SRE, platform, and security teams.
magnus919/agent-skills/data-engineering Skill
41★ repoCurated collection of AI agent skills for Hermes and other agent frameworks
saskinosie/weaviate-claude-skills/weaviate-data-ingestion Skill
39★ repoClaude Skills for connecting Claude.ai to local Weaviate vector databases - manage collections, ingest data, and query with RAG
saeed-vayghan/gemini-agent-skills/.gemini/skills/data-engineer Skill
30★ repoA comprehensive collection of expert AI Agent Skills for Google Gemini, featuring a powerful CLI to convert and optimize Claude Code agents for the Gemini ecosystem.
vaquarkhan/data-engineering-agent-skills/skills/dbt-and-analytics-engineering Skill
29★ repoProduction-grade Agent Skills for data engineering AI agents: 73 workflows, platform presets, safe backfill/replay, Kafka & Spark reliability, MCP observability, and VS Code/JetBrains installers.
Debezium and kafka connect cdc
vaquarkhan/data-engineering-agent-skills/skills/debezium-and-kafka-connect-cdc Skill
29★ repoProduction-grade Agent Skills for data engineering AI agents: 73 workflows, platform presets, safe backfill/replay, Kafka & Spark reliability, MCP observability, and VS Code/JetBrains installers.
Enterprise etl and data integration modernization
vaquarkhan/data-engineering-agent-skills/skills/enterprise-etl-and-data-integration-modernization Skill
29★ repoProduction-grade Agent Skills for data engineering AI agents: 73 workflows, platform presets, safe backfill/replay, Kafka & Spark reliability, MCP observability, and VS Code/JetBrains installers.
Etl elt and modernization strategy
vaquarkhan/data-engineering-agent-skills/skills/etl-elt-and-modernization-strategy Skill
29★ repoProduction-grade Agent Skills for data engineering AI agents: 73 workflows, platform presets, safe backfill/replay, Kafka & Spark reliability, MCP observability, and VS Code/JetBrains installers.
Kafka resilience and schema evolution
vaquarkhan/data-engineering-agent-skills/skills/kafka-resilience-and-schema-evolution Skill
29★ repoProduction-grade Agent Skills for data engineering AI agents: 73 workflows, platform presets, safe backfill/replay, Kafka & Spark reliability, MCP observability, and VS Code/JetBrains installers.
Reverse etl and operational data serving
vaquarkhan/data-engineering-agent-skills/skills/reverse-etl-and-operational-data-serving Skill
29★ repoProduction-grade Agent Skills for data engineering AI agents: 73 workflows, platform presets, safe backfill/replay, Kafka & Spark reliability, MCP observability, and VS Code/JetBrains installers.
Streaming and messaging systems
vaquarkhan/data-engineering-agent-skills/skills/streaming-and-messaging-systems Skill
29★ repoProduction-grade Agent Skills for data engineering AI agents: 73 workflows, platform presets, safe backfill/replay, Kafka & Spark reliability, MCP observability, and VS Code/JetBrains installers.
inbharatai/claude-skills/skills/etl-pipeline Skill
28★ repoCurated Claude and Codex skill collection for local AI workflows, automation, research, and product-building.
mjunaidca/mjs-agent-skills/.claude/skills/kafka Skill
no license27★ repoA curated collection of Agent Skills — reusable units of intelligence that teach AI General Agents how to perform specific tasks autonomously.
charlieviettq/awesome-agent-skill/.claude/skills/tech-data-pipeline Skill
24★ repoCurated skill pack for LLM agents in engineer and science workflow (Cursor & Claude ready).
charlieviettq/awesome-agent-skill/.claude/skills/va-data-engineer Skill
24★ repoCurated skill pack for LLM agents in engineer and science workflow (Cursor & Claude ready).
charlieviettq/awesome-agent-skill/.cursor/skills/asgard-ai-platform/tech-data-pipeline Skill
24★ repoCurated skill pack for LLM agents in engineer and science workflow (Cursor & Claude ready).
charlieviettq/awesome-agent-skill/.cursor/skills/voltagent/data-ai/data-engineer Skill
24★ repoCurated skill pack for LLM agents in engineer and science workflow (Cursor & Claude ready).
Raishin/vanguard-frontier-agentic/skills/gcp/gcp-data-pipeline-engineer Skill
20★ repoCurated marketplace of AI skills, agents, and rules for cloud, zero-trust, and compliance-aware engineering - works with Claude Code, Codex, Cursor, Copilot, and more.
Huawei drs data replication operator
Raishin/vanguard-frontier-agentic/skills/huawei/huawei-drs-data-replication-operator Skill
20★ repoCurated marketplace of AI skills, agents, and rules for cloud, zero-trust, and compliance-aware engineering - works with Claude Code, Codex, Cursor, Copilot, and more.
Raishin/vanguard-frontier-agentic/skills/java/java-kafka-reliability Skill
20★ repoCurated marketplace of AI skills, agents, and rules for cloud, zero-trust, and compliance-aware engineering - works with Claude Code, Codex, Cursor, Copilot, and more.
zakelfassi/skills-driven-development/examples/data-pipeline/skills/pipeline-stage Skill
17★ repoAgents that learn by doing — and remember how they did it. A methodology for AI agents to create, evolve, and share reusable skills.
LazyIsEfficient/agentic-os/.claude/skills/typescript-data-engineering Skill
15★ repoAgentic Framework for Modern Development
martinholovsky/SOTA-skills/skills/sota-data-engineering Skill
15★ repoEngineering best practices that AI coding agents actually apply — 40+ skills, from secure coding and cloud to compliance and UX writing. BUILD + AUDIT modes. Measured: best-practice coverage 59% → 98% vs. the same model unguided.
Dataops airflow cost optimizer
ivanshamaev/de-agent-skills/group_skills/infra_dataops_group_skills/dataops_airflow_cost_optimizer Skill
no license15★ repoПрофессиональные Data Engineering Agent Skills для разработки AI Agentic Data Platform
ivanshamaev/de-agent-skills/group_skills/infra_dataops_group_skills/dataops_airflow_ha_review Skill
no license15★ repoПрофессиональные Data Engineering Agent Skills для разработки AI Agentic Data Platform
ivanshamaev/de-agent-skills/group_skills/infra_dataops_group_skills/dataops_airflow_observability Skill
no license15★ repoПрофессиональные Data Engineering Agent Skills для разработки AI Agentic Data Platform
Dataops airflow production readiness
ivanshamaev/de-agent-skills/group_skills/infra_dataops_group_skills/dataops_airflow_production_readiness Skill
no license15★ repoПрофессиональные Data Engineering Agent Skills для разработки AI Agentic Data Platform