Discover data
Automatically discover data pipeline and ETL skills when working with ETL, data pipelines, streaming, batch processing, data validation, or pipeline orchestration. Activates for data development tasks.From its SKILL.md
npx -y skills add kenantang/codex-and-claude-skills --skill discover-dataAssembled from the repository path, not quoted from the project. Check it against their README if it does not work.
2 things to look at
- no licenseNo license file was found in the repository. Code published without one is not open source by default, so using it at work is a question for whoever answers licensing questions where you are.
- 0 stars0 stars. Stars are a popularity signal and not a quality one, but at this level it is likely that nobody has read this closely except its author, and you would be relying on your own review.
What its file declares
Copied from the file, not written here
The file declares its own license as MIT. That is the author’s claim about this one file, and it is not the same thing as the license GitHub reports for the repository, which is listed with the other numbers below.
SKILL.md
3.6 KB, 711 tokens by cl100k_base, as published. Nobody here has run it
Data Skills Discovery
Provides automatic access to comprehensive data skills.
When This Skill Activates
This skill auto-activates when you're working with:
- ETL
- data pipelines
- batch processing
- stream processing
- data validation
- orchestration
- Airflow
- timely dataflow
- differential dataflow
- streaming aggregations
- windowing
- real-time analytics
Available Skills
Quick Reference
The Data category contains 9 skills:
- batch-processing - Orchestrating complex data pipelines with dependencies
- data-validation - Validating data schema before processing
- dataflow-coordination - Coordination patterns for distributed dataflow systems
- differential-dataflow - Differential computation for incremental updates and efficient joins
- etl-patterns - Designing data extraction from multiple sources
- pipeline-orchestration - Coordinating complex multi-step data workflows
- stream-processing - Processing real-time event streams (Kafka, Flink)
- streaming-aggregations - Windowing, sessionization, time-series aggregation
- timely-dataflow - Low-latency streaming computation with progress tracking
Load Full Category Details
For complete descriptions and workflows:
Read ../data/INDEX.md
This loads the full Data category index with:
- Detailed skill descriptions
- Usage triggers for each skill
- Common workflow combinations
- Cross-references to related skills
Load Specific Skills
Load individual skills as needed:
Traditional ETL/Batch
Read ../data/batch-processing.md Read ../data/data-validation.md Read ../data/etl-patterns.md Read ../data/pipeline-orchestration.md
Stream Processing
Read ../data/stream-processing.md Read ../data/streaming-aggregations.md
Advanced Dataflow Systems
Read ../data/timely-dataflow.md Read ../data/differential-dataflow.md Read ../data/dataflow-coordination.md
Common Workflow Combinations
Real-Time Analytics Pipeline
Load these skills together:
Read ../data/stream-processing.md # Kafka setup Read ../data/streaming-aggregations.md # Windowing patterns Read ../data/dataflow-coordination.md # Coordination
Incremental Computation System
Load these skills together:
Read ../data/timely-dataflow.md # Foundation Read ../data/differential-dataflow.md # Incremental updates Read ../data/dataflow-coordination.md # Distributed coordination
Hybrid Batch + Stream
Load these skills together:
Read ../data/batch-processing.md # Batch jobs Read ../data/stream-processing.md # Stream processing Read ../data/pipeline-orchestration.md # Overall coordination
Progressive Loading
This gateway skill enables progressive loading:
- Level 1: Gateway loads automatically (you're here now)
- Level 2: Load category INDEX.md for full overview
- Level 3: Load specific skills as needed
Usage Instructions
- Auto-activation: This skill loads automatically when Claude Code detects data work
- Browse skills: Run
Read ../data/INDEX.mdfor full category overview - Load specific skills: Use bash commands above to load individual skills
Next Steps: Run Read ../data/INDEX.md to see full category details.
What ships with it
Read from the repository
Just SKILL.md. No reference files, no scripts.
Gives 0 of the 12 instructions most data pipelines skills give in 711 tokens
Counted across 149 of the 156 authors here whose files we hold, read 2026-09-06
- Run a safe catch-up or sample benchmarkin 13 of 149, across 4 files
- Rerun final accounting after the codified path executesin 13 of 149, across 4 files
- Move compute to where the data already isin 13 of 149, across 4 files
- Batch small files, requests, and writesin 13 of 149, across 4 files
- Use manifests or checkpoints to skip completed filesin 13 of 149, across 4 files
- Measure backlog across files, rows, and timestampsin 13 of 149, across 4 files
- Codify the path as a CLI or scheduled jobin 12 of 149, across 3 files
- Promote only the fastest correctness-preserving pathin 10 of 149, across 3 files
- Separate the bottleneck categories before optimizingin 10 of 149, across 3 files
- Prefer warehouse-native scans, joins, and appendsin 9 of 149, across 2 files
- Make writes idempotent through keys, manifests, or replaceable stagingin 9 of 149, across 2 files
- Retry failures with exponential backoffin 9 of 149, across 7 files
Said here and by no other author read
- read the category index for full skill details
- load individual skills as needed
- load skill groups together for common workflows
- load progressively: gateway, then index, then specific skills
Grouped from the skills themselves: near-identical wordings counted once, and counted by distinct author, so one author publishing three of these counts once. Length counted with cl100k_base; the agent that loads this file may tokenize it differently.