Data platform ci cd and release management
Skill vaquarkhan/data-engineering-agent-skills/skills/data-platform-ci-cd-and-release-management
Production-grade Agent Skills for data engineering AI agents: 73 workflows, platform presets, safe backfill/replay, Kafka & Spark reliability, MCP observability, and VS Code/JetBrains installers.
npx -y skills add vaquarkhan/data-engineering-agent-skills --skill data-platform-ci-cd-and-release-managementAssembled from the repository path, not quoted from the project. Check it against their README if it does not work.
One thing to look at
- 21 stars21 stars. Stars are a popularity signal and not a quality one, but at this level it is likely that nobody has read this closely except its author, and you would be relying on your own review.
What its author says it does
Copied from the file, not written here
Guides agents through CI/CD and release management for data platforms. Use when promoting pipeline code, SQL models, contracts, infra, or configuration across environments with validation gates, staged rollout, and rollback awareness.
SKILL.md
2.2 KB, as published. Nobody here has run it
Data Platform CI CD And Release Management
Overview
Use this skill when changes need controlled promotion across environments. It helps agents design release gates for code, contracts, infra, and datasets so teams can ship faster without losing trust.
When to Use
- adding or changing CI pipelines for data projects
- promoting changes from dev to staging to production
- releasing
dbt, orchestration, infra, or schema updates - defining rollback-aware deployment behavior
Do not treat data releases like app-only deploys. Data contracts, backfills, and environment state matter too.
Workflow
-
Identify the release surface. Include:
- code
- SQL models
- infra
- contracts
- orchestration config
- published datasets
-
Define validation gates per stage. Common gates:
- lint or formatting
- tests
- contract validation
- sample or shadow runs
- reconciliation
-
Separate deployment from publish where needed.
-
Make rollback and forward-fix expectations explicit.
-
Record release ownership and approval points for high-risk changes.
Common Rationalizations
| Rationalization | Reality |
|---|---|
| "If tests pass, the data release is safe." | Data releases often need contract, reconciliation, and environment checks too. |
| "We can deploy and publish in one step." | Deployment and downstream visibility should not always be coupled. |
| "Rollback is easy because Git exists." | Rollback for data state and published outputs is often harder than code rollback. |
Red Flags
- environment promotion rules are unclear
- releases do not separate code success from publish safety
- rollback is mentioned but not operationally real
- high-risk changes have no staged validation
Verification
- Release surfaces and environment boundaries are explicit
- Validation gates exist for the change type
- Publish behavior is controlled where needed
- Rollback or forward-fix expectations are documented