agentsclimarketplace

Data & backend

10,137 rows, by stacks then stars

233 of these skill files have been read, by 258 distinct authors, and what they tell an agent counted. What Data & backend authors agree on, and what they forbid

  • Infra rbac audit

    ivanshamaev/de-agent-skills/group_skills/infra_dataops_group_skills/infra_rbac_audit Skill

    no license15★ repo

    RBAC audit for data platforms — Kubernetes RBAC (ClusterRole/Role/Binding audit), AWS IAM permission boundary and policy review (AWS IAM Access Analyzer), GCP IAM audit (principle of least privilege/owner role detection), database RBAC (PostgreSQL/Trino/ClickHouse role hierarchies), Airflow RBAC (role-based menu/DAG access), dbt permissions (warehouse roles), service account proliferation detection, wildcard permission detection, privilege escalation paths

  • Platform engineering data platform api

    ivanshamaev/de-agent-skills/group_skills/infra_dataops_group_skills/platform_engineering_data_platform_api Skill

    no license15★ repo

    Data platform self-service API — FastAPI REST API for platform operations (Kafka topic CRUD/Airflow DAG trigger/dbt job run/Trino query execution), OAuth2+JWT authentication with team-based RBAC, async job tracking with status polling, rate limiting per team, OpenAPI spec generation, Terraform provider for API resources, versioned API (v1/v2), audit logging of all platform operations, SDK generation (Python/TypeScript), Kubernetes deployment with HPA

  • Platform engineering internal developer platform

    ivanshamaev/de-agent-skills/group_skills/infra_dataops_group_skills/platform_engineering_internal_developer_platform Skill

    no license15★ repo

    Internal Developer Platform (IDP) for data engineering — Backstage Software Catalog (catalog-info.yaml for pipelines/datasets/services), Software Templates (scaffold new DAG/dbt project/Kafka topic), TechDocs integration, golden path enforcement, Port.io alternative, self-service data pipeline provisioning, platform scorecard (production readiness checks), team ownership model, API gateway for platform services, paved road vs escape hatch pattern

  • Airflow starrocks backfill

    ivanshamaev/de-agent-skills/group_skills/starrocks_group_skills/airflow_starrocks_backfill Skill

    no license15★ repo

    Airflow + StarRocks backfill patterns — historical partition reprocessing, date range loops with INSERT OVERWRITE, Broker Load replay for S3 partitions, safe backfill with max_active_runs=1, partial backfill resume from checkpoint, backfill idempotency via label strategy, clearing downstream tasks before rerun, parallel partition backfill with concurrency limits

  • Airflow starrocks cdc orchestrator

    ivanshamaev/de-agent-skills/group_skills/starrocks_group_skills/airflow_starrocks_cdc_orchestrator Skill

    no license15★ repo

    Airflow CDC orchestration for StarRocks — watermark-based incremental sync, Routine Load health check DAG, Flink job submission via REST API, offset lag alerting, dead letter queue reprocessing, multi-table incremental sync with dependency graph, schema change detection and pipeline pause/resume

  • Airflow starrocks data quality

    ivanshamaev/de-agent-skills/group_skills/starrocks_group_skills/airflow_starrocks_data_quality Skill

    no license15★ repo

    Airflow + StarRocks data quality gates — post-load row count validation, freshness checks (MAX(updated_at) vs expected), null explosion detection, duplicate key audit on Primary Key tables, volume anomaly detection (z-score vs 7-day avg), SODA-style SQL quality checks embedded in DAG, quarantine pattern for bad partitions

  • Airflow starrocks etl best practices

    ivanshamaev/de-agent-skills/group_skills/starrocks_group_skills/airflow_starrocks_etl_best_practices Skill

    no license15★ repo

    Airflow + StarRocks ETL best practices — idempotent DAG design (label strategy/partition overwrite), retry with backoff, SLA callbacks, dynamic partition creation, duplicate prevention with MERGE/INSERT OVERWRITE, DAG-level concurrency controls, dependency ordering, catchup safety, data lineage tagging

  • Airflow starrocks pipeline

    ivanshamaev/de-agent-skills/group_skills/starrocks_group_skills/airflow_starrocks_pipeline Skill

    no license15★ repo

    Airflow + StarRocks pipeline orchestration — MySqlHook for DDL/DML, Broker Load trigger + poll pattern, Stream Load via HTTP operator, Routine Load job lifecycle (pause/resume/stop), sensor for load completion, ANALYZE TABLE post-load, partition-aware DAG templating, Airflow variables for StarRocks connection config, XCom label passing

  • Dbt starrocks models

    ivanshamaev/de-agent-skills/group_skills/starrocks_group_skills/dbt_starrocks_models Skill

    no license15★ repo

    dbt + StarRocks models — dbt-starrocks adapter setup (profiles.yml), all materializations (table/view/incremental/ephemeral), incremental strategies (append/insert_overwrite/unique_key merge), StarRocks-specific model config (engine/keys/partition_by/distributed_by/properties), Duplicate/Aggregate/Primary Key table DDL from dbt, partition_by with date_trunc, on_schema_change behavior

  • Dbt starrocks performance

    ivanshamaev/de-agent-skills/group_skills/starrocks_group_skills/dbt_starrocks_performance Skill

    no license15★ repo

    dbt + StarRocks performance tuning — model DAG optimization (fan-in/fan-out), incremental merge window sizing, partition-aware incremental filters, avoiding full table rebuilds, query plan hints in dbt SQL (LEADING/JOIN hints), materialized view as dbt model target, concurrent model execution with threads, pre/post hooks for ANALYZE TABLE, dbt run selectors to minimize rebuilt models

  • Dbt starrocks production readiness

    ivanshamaev/de-agent-skills/group_skills/starrocks_group_skills/dbt_starrocks_production_readiness Skill

    no license15★ repo

    dbt + StarRocks production readiness — slim CI with state:modified+, manifest.json artifact storage and --defer for dev, dbt Cloud vs dbt Core deployment, RBAC for dbt users in StarRocks, secrets management for profiles.yml, dbt run/test exit codes in CI, breaking change detection, scheduled dbt runs via Airflow/dbt Cloud, dbt docs generation and hosting, model versioning

  • Dbt starrocks semantic layer

    ivanshamaev/de-agent-skills/group_skills/starrocks_group_skills/dbt_starrocks_semantic_layer Skill

    no license15★ repo

    dbt + StarRocks semantic layer — dbt Semantic Layer (MetricFlow) on StarRocks, metric definitions (simple/ratio/cumulative/derived), dimension definitions, saved queries, semantic model DDL, exposures for BI tool documentation, dbt-metricflow query CLI, linking metrics to StarRocks materialized views for performance, business KPI governance patterns

  • Dbt starrocks testing

    ivanshamaev/de-agent-skills/group_skills/starrocks_group_skills/dbt_starrocks_testing Skill

    no license15★ repo

    dbt + StarRocks testing — generic tests (not_null/unique/accepted_values/relationships), singular tests (custom SQL assertions), source freshness tests (loaded_at_field), StarRocks-specific volume and freshness tests, dbt-expectations integration, test severity (warn vs error), store_failures for debugging failed tests, ANALYZE before test runs, partition-scoped test SQL

  • Starrocks data modeling

    ivanshamaev/de-agent-skills/group_skills/starrocks_group_skills/starrocks_data_modeling Skill

    no license15★ repo

    StarRocks data modeling — star schema vs wide table design, fact/dimension DDL patterns, denormalization strategy for OLAP, bitmap indexes, bloom filter indexes, sort key optimization, schema review checklist, SCD type 2 with Primary Key table, aggregation table design, BI acceleration patterns, avoiding over-normalization

  • Starrocks routine load kafka

    ivanshamaev/de-agent-skills/group_skills/starrocks_group_skills/starrocks_routine_load_kafka Skill

    no license15★ repo

    StarRocks Routine Load for Kafka — CREATE ROUTINE LOAD DDL (all PROPERTIES/KAFKA clause parameters), JSON/CSV/Avro format config, desired_concurrent_number tuning, SHOW ROUTINE LOAD columns, PAUSE/RESUME/ALTER/STOP, consumer lag monitoring, error log analysis, exactly-once semantics, Schema Registry for Avro, Kafka SASL/SSL config, idempotent upsert to Primary Key table

  • Trino airflow lakehouse pipelines

    ivanshamaev/de-agent-skills/group_skills/trino_group_skills/trino_airflow_lakehouse_pipelines Skill

    no license15★ repo

    Airflow-orchestrated Iceberg lakehouse ETL pipelines — Bronze/Silver/Gold layer DAGs, Iceberg maintenance jobs (optimize/expire_snapshots/remove_orphan_files) as Airflow tasks, snapshot expiration scheduling, compaction DAG patterns, partition-by-partition backfill with dynamic task mapping, late-arriving data handling, watermark tracking table, post-load data quality gates (row count/freshness/null rate checks via TrinoHook), full medallion pipeline DAG example

  • Trino airflow orchestration

    ivanshamaev/de-agent-skills/group_skills/trino_group_skills/trino_airflow_orchestration Skill

    no license15★ repo

    Airflow orchestration for Trino pipelines — TrinoOperator and TrinoHook usage, trino_conn_id connection setup, idempotent DAG patterns (INSERT INTO / MERGE with deterministic run_ids), partition-aware scheduling with Airflow logical_date, sensor patterns (TrinoCheckOperator), SLA monitoring, retry configuration for Trino queries, incremental load orchestration, dbt + Trino Airflow integration (BashOperator/DbtRunOperator), metadata-driven DAG generation

  • Trino dbt platform

    ivanshamaev/de-agent-skills/group_skills/trino_group_skills/trino_dbt_platform Skill

    no license15★ repo

    Production dbt + Trino platform — dbt-trino adapter profiles.yml (ldap/kerberos/oauth/jwt/certificate auth), all materializations (table/view/incremental/materialized_view/ephemeral), incremental strategies (append/merge/delete+insert), Iceberg table_properties in config blocks (format/partitioning/sorted_by/location), on_schema_change, snapshots with TIMESTAMP(6), slim CI with state:modified+ and --defer, dbt project structure (staging/intermediate/mart), ANALYZE post-hook, session_properties in profiles, multi-thread parallelism

  • Trino dbt query performance

    ivanshamaev/de-agent-skills/group_skills/trino_group_skills/trino_dbt_query_performance Skill

    no license15★ repo

    Optimizing dbt-generated SQL performance on Trino — ephemeral vs view vs table materialization trade-offs, CTE explosion patterns, partition-aware incremental filters (bounded watermarks), MERGE vs delete+insert strategy selection, avoiding full-refresh anti-patterns, query hints in dbt SQL (BROADCAST hint), dbt thread tuning, session_properties for dbt runs, ANALYZE post-hooks, incremental model design patterns for Iceberg, avoiding small file proliferation from frequent incremental runs

  • Trino docker compose stack

    ivanshamaev/de-agent-skills/group_skills/trino_group_skills/trino_docker_compose_stack Skill

    no license15★ repo

    Full local Trino Lakehouse Docker Compose stack — trinodb/trino coordinator+worker, Hive Metastore 3.x with PostgreSQL backend, MinIO object storage (S3-compatible), Apache Airflow, dbt-trino, Apache Superset BI, Prometheus+Grafana monitoring, healthchecks, startup ordering, persistent volumes, isolated networks, catalog property files, Iceberg catalog config, environment variable injection, Trino CLI access

  • Trino federated query architecture

    ivanshamaev/de-agent-skills/group_skills/trino_group_skills/trino_federated_query_architecture Skill

    no license15★ repo

    Trino federated query architecture across heterogeneous sources — cross-catalog JOIN patterns (Iceberg+PostgreSQL+MySQL+Kafka+ClickHouse), pushdown behavior per connector type, minimizing cross-catalog data movement, materializing JDBC data into Iceberg, query routing strategy, connector-specific limitations (JDBC serial fetch, Kafka read-once), performance cost model for federated joins, metadata caching, CREATE TABLE AS SELECT federation patterns, catalog isolation design

  • Trino lakehouse platform architect

    ivanshamaev/de-agent-skills/group_skills/trino_group_skills/trino_lakehouse_platform_architect Skill

    no license15★ repo

    Trino-based Modern Data Platform architecture design — decoupled storage/compute, Iceberg as open table format, Hive Metastore/Glue catalog, MinIO/S3 object storage, Kafka ingestion layer, dbt transformation, Airflow orchestration, Superset BI — coordinator/worker topology, catalog design, metadata-driven architecture, multi-layer lakehouse (Bronze/Silver/Gold), federated query across heterogeneous sources

  • Trino modern data stack reference architecture

    ivanshamaev/de-agent-skills/group_skills/trino_group_skills/trino_modern_data_stack_reference_architecture Skill

    no license15★ repo

    Trino Modern Data Stack end-to-end reference architecture — full docker-compose (Kafka + MinIO + Hive Metastore + Trino + Airflow + dbt + Superset + Prometheus + Grafana), medallion lake DDL and pipeline DAGs, Kafka→Iceberg streaming ingest, dbt project layout with Trino profiles, Superset dataset config, Prometheus alert rules, production Kubernetes Helm values, operational runbook for daily maintenance

  • Trino query optimization

    ivanshamaev/de-agent-skills/group_skills/trino_group_skills/trino_query_optimization Skill

    no license15★ repo

    Trino distributed SQL query optimization — predicate/projection/aggregation pushdown, join reordering (AUTOMATIC/ELIMINATE_CROSS_JOINS), broadcast vs partitioned joins, dynamic filtering, CBO with ANALYZE, filter-early patterns, partition pruning, avoiding SELECT *, reducing shuffle, cross-catalog query cost, session property tuning, query hints, anti-patterns for slow Trino queries

  • Trino resource group governance

    ivanshamaev/de-agent-skills/group_skills/trino_group_skills/trino_resource_group_governance Skill

    no license15★ repo

    Trino resource group workload governance — resource-groups.properties configuration (maxQueued/hardConcurrencyLimit/softMemoryLimit/hardCpuLimit/schedulingPolicy/schedulingWeight), hierarchical group trees, selector rules (user/source/queryType/clientTags/regex), multi-tenant tenant isolation patterns, per-user dynamic sub-groups (${USER} template), scheduling policies (fair/weighted_fair/weighted/query_priority), CPU quota periods, database-backed configuration (MySQL/PostgreSQL), JMX monitoring of group utilization

  • Trino security and governance

    ivanshamaev/de-agent-skills/group_skills/trino_group_skills/trino_security_and_governance Skill

    no license15★ repo

    Trino security hardening and data governance — TLS/HTTPS setup, internal-communication shared secret, authentication (LDAP/OAuth2/JWT), file-based access control (catalog/schema/table/column rules, column masking, row-level filtering, query kill permissions), OPA integration, Ranger for dynamic row-filter and column-mask, catalog isolation by domain, user group mapping, impersonation rules, audit logging via event listener, password file authentication for development

  • Airbyte

    ivanshamaev/de-agent-skills/skills/airbyte Skill

    no license15★ repo

    Airbyte ELT — source/destination connectors, sync modes (Full Refresh Overwrite/Append, Incremental Append/Deduped), cursor fields, primary keys, catalog/streams, deployment (abctl, Kubernetes Helm, Airbyte Cloud), Connector Builder, Python CDK (HttpStream, IncrementalMixin), normalization (dbt-based, _airbyte_raw_ tables), Airbyte API, Terraform provider, schema evolution, monitoring, Airflow AirbyteTriggerSyncOperator integration

  • Airflow dag factory

    ivanshamaev/de-agent-skills/skills/airflow_dag_factory Skill

    no license15★ repo

    Use when building, reviewing, debugging, or scaling Apache Airflow DAGs declaratively with dag-factory YAML configs — including project setup, loader configuration, defaults hierarchy, custom/provider operators, dynamic task mapping, datasets/assets, callbacks, TaskFlow decorators, Jinja2 templating, environment variables, YAML DRY patterns, large-scale multi-DAG generation, CI/CD linting, and migration from pre-1.0.

  • Airflow dags

    ivanshamaev/de-agent-skills/skills/airflow_dags Skill

    no license15★ repo

    Apache Airflow DAG authoring — DAG definition, TaskFlow API (@task/@dag decorators), operators (Bash/Python/SQL/HTTP), sensors (poke/reschedule modes), TaskGroups, dynamic task mapping (expand/partial), branching, trigger rules, XComs, Pools, callbacks, cross-DAG pipelines, best practices

  • Apache kafka

    ivanshamaev/de-agent-skills/skills/apache_kafka Skill

    no license15★ repo

    Apache Kafka — topics, partitions, consumer groups, producer/consumer configuration (acks, idempotence, compression, commit strategies), exactly-once semantics, Kafka Connect (source/sink connectors, SMTs, DLQ), Schema Registry, consumer lag monitoring, CLI operations, Python confluent-kafka examples, partition strategy, replication, retention

  • Cdc debezium

    ivanshamaev/de-agent-skills/skills/cdc_debezium Skill

    no license15★ repo

    Change Data Capture with Debezium — PostgreSQL/MySQL/Oracle CDC connectors, change event structure (before/after/op/source), snapshot modes, Kafka Connect deployment, SMT transformations, outbox pattern, Iceberg/Delta sink integration, idempotency guarantees

  • Datahub catalog

    ivanshamaev/de-agent-skills/skills/datahub_catalog Skill

    no license15★ repo

    DataHub data catalog — metadata ingestion recipes (PostgreSQL/Hive/Spark/dbt/Airflow/Kafka/S3), Python SDK (DatahubRestEmitter, MetadataChangeProposalWrapper), column-level lineage (FineGrainedLineage), GMS/MCE/MCP architecture, Kubernetes Helm deployment, CLI operations, search/discovery REST API and GraphQL

  • Dbt core

    ivanshamaev/de-agent-skills/skills/dbt_core Skill

    no license15★ repo

    dbt Core (adapter-agnostic) — project structure, models (SQL/Python), sources and refs, materializations (table/view/incremental/ephemeral), incremental strategies (append/merge/delete+insert), is_incremental() macro, snapshots (SCD Type 2), seeds, tests (generic/singular/severity), Jinja macros, dbt-utils package, node selection syntax (graph operators), hooks, exposures, metrics (MetricFlow), CI/CD (slim CI with state:modified+), dbt_project.yml, profiles.yml, multi-adapter support (Spark/PostgreSQL/ClickHouse/BigQuery)

  • Dbt macros

    ivanshamaev/de-agent-skills/skills/dbt_macros Skill

    no license15★ repo

    dbt Jinja macros — macro authoring fundamentals, Jinja syntax (blocks/filters/tests), context variables (this/target/adapter/execute), run_query, adapter.dispatch for cross-database macros, generate_schema_name, hooks, custom materializations, dbt-utils patterns

  • Dbt trino

    ivanshamaev/de-agent-skills/skills/dbt_trino Skill

    no license15★ repo

    Use when writing, configuring, or optimizing dbt projects targeting Trino or Starburst — covering profiles.yml setup, all authentication methods, materializations (table/view/incremental/materialized_view/ephemeral), incremental strategies (append/merge/delete+insert), table properties (format/partitioning/sorted_by), on_schema_change, seeds, snapshots, grants, session properties, data modeling patterns (Kimball/staging/intermediate/mart), dbt project structure, tests, and CI/CD.

  • De rca

    ivanshamaev/de-agent-skills/skills/de_rca Skill

    no license15★ repo

    DE pipeline root cause analysis — failure taxonomy, lineage tracing, upstream/downstream impact, log analysis patterns, Airflow/Spark/dbt failure diagnosis, data quality anomaly RCA, 5-Whys template, incident timeline reconstruction, runbook-style investigation checklists

  • Docker data envs

    ivanshamaev/de-agent-skills/skills/docker_data_envs Skill

    no license15★ repo

    Docker for data engineering environments — multi-stage Dockerfiles for dbt/Spark/Airflow images, BuildKit layer caching (--mount=type=cache), private registries (ghcr.io/Harbor), docker buildx multi-platform builds, Docker Compose local data stacks (Spark+Airflow+Kafka+MinIO+Postgres), BuildKit secrets for private PyPI, security hardening (non-root user, slim base images, read-only FS), CI/CD with GitHub Actions build-push-action

  • Duckdb

    ivanshamaev/de-agent-skills/skills/duckdb Skill

    no license15★ repo

    DuckDB in-process OLAP analytics — reading Parquet/CSV/JSON/Iceberg/Delta from S3/local, SQL (window functions, PIVOT, ASOF join, QUALIFY), Python API (duckdb.connect, fetchdf, register, UDFs), extensions (httpfs/iceberg/delta/postgres), performance tuning, COPY TO, persistent DB

  • Feature store

    ivanshamaev/de-agent-skills/skills/feature_store Skill

    no license15★ repo

    Feast feature store — feature repo layout, Entity/FeatureView/FeatureService definitions, offline store (BigQuery/Redshift/Snowflake/file), online store (Redis/DynamoDB/SQLite), point-in-time correct joins, feast materialize, feast apply, Python SDK get_online_features/get_historical_features, push sources, streaming feature views, Airflow integration

  • Github actions dataops

    ivanshamaev/de-agent-skills/skills/github_actions_dataops Skill

    no license15★ repo

    Use when building or reviewing GitHub Actions CI/CD pipelines for data engineering — covering dbt slim CI (state:modified+, --defer, manifest.json), SQLFluff SQL linting with PR annotations, Airflow DAG integrity tests (pytest/DagBag), Great Expectations and Soda data quality gates, multi-stage Docker image builds for Spark/dbt/Airflow pushed to ghcr.io, secrets management with OIDC for AWS/GCP (no static keys), environment-scoped secrets, reusable workflows (workflow_call), matrix builds, composite actions, and full end-to-end dbt project CI/CD workflows.

  • Great expectations

    ivanshamaev/de-agent-skills/skills/great_expectations Skill

    no license15★ repo

    Great Expectations (GX) — DataContext setup, Data Sources (Pandas/Spark/SQL/file), Expectation Suites, built-in expectations (null/uniqueness/range/set/regex/table-level/statistical), Validation Definitions, Checkpoints, Data Docs, Airflow integration, custom expectations, dbt integration, CI/CD usage, severity levels (warning/critical)

  • Kimball data modeling

    ivanshamaev/de-agent-skills/skills/kimball_data_modeling Skill

    no license15★ repo

    Use when designing or implementing dimensional data models following Kimball methodology — fact tables (transaction/snapshot/accumulating), dimension tables, SCD types (1/2/3/4/6), star/snowflake schemas, surrogate keys, conformed dimensions, role-playing dimensions, junk dimensions, bridge tables, date dimensions, degenerate dimensions, DDL patterns, and DML update strategies for loading and maintaining dimensional tables.

  • Mlflow pipelines

    ivanshamaev/de-agent-skills/skills/mlflow_pipelines Skill

    no license15★ repo

    MLflow for data engineering — tracking server setup (PostgreSQL backend + S3 artifacts), experiment tracking (params/metrics/artifacts/autolog), ETL job metadata logging (row counts, DQ metrics, lineage tags), Model Registry (register/alias/promote), model serving (pyfunc/REST API/batch scoring), MLproject files, Airflow integration (MLflowClientHook/XCom/model promotion), Spark integration (mlflow.spark.autolog/log_model/Delta metadata)

  • Openlineage

    ivanshamaev/de-agent-skills/skills/openlineage Skill

    no license15★ repo

    OpenLineage data lineage tracking — RunEvent/Job/Dataset/facet spec, Marquez backend setup, Airflow/Spark/dbt integrations, column-level lineage, custom emitters, lineage-based impact analysis

  • Postgresql de

    ivanshamaev/de-agent-skills/skills/postgresql_de Skill

    no license15★ repo

    PostgreSQL for data engineering — declarative partitioning (RANGE/LIST/HASH/pg_partman), index types (B-Tree/BRIN/GIN/GIST/partial/covering), COPY bulk load, EXPLAIN ANALYZE plan reading, autovacuum tuning, window functions, JSONB, CTEs, LATERAL joins, and bulk-load patterns (UNLOGGED/pg_bulkload)

  • Pyspark etl

    ivanshamaev/de-agent-skills/skills/pyspark_etl Skill

    no license15★ repo

    Use when designing, implementing, reviewing, or optimizing production PySpark ETL/DataFrame pipelines at GB-TB+ scale, including schemas, joins, partitioning, window functions, writes, UDF avoidance, and Spark performance diagnostics.

  • Rag pipeline

    ivanshamaev/de-agent-skills/skills/rag_pipeline Skill

    no license15★ repo

    Use when designing, building, or debugging a RAG (Retrieval-Augmented Generation) data pipeline — document ingestion, chunking strategies (fixed/recursive/semantic/structure-aware), embedding models (OpenAI/Cohere/sentence-transformers), vector stores (pgvector/Chroma/Qdrant/Weaviate), incremental refresh, hybrid retrieval (dense + BM25 + RRF), re-ranking with cross-encoders, metadata filtering, and production monitoring.

  • Soda core

    ivanshamaev/de-agent-skills/skills/soda_core Skill

    no license15★ repo

    Soda Core data quality — SodaCL checks (row_count, missing, invalid, duplicate, freshness, schema, reference, custom SQL), configuration.yml for PostgreSQL/Spark/ClickHouse/BigQuery, soda scan CLI, Airflow integration, dbt integration, alerting

  • Spark sql

    ivanshamaev/de-agent-skills/skills/spark_sql Skill

    no license15★ repo

    Use when writing, reviewing, debugging, or optimizing production Spark SQL for Hive/lakehouse/HDFS tables, including CTE-heavy queries, joins, windows, partition pruning, Hive Metastore operations, insert/overwrite safety, query hints, statistics, EXPLAIN plans, AQE, skew, materialization, and SQL performance diagnostics.

  • Sqlfluff

    ivanshamaev/de-agent-skills/skills/sqlfluff Skill

    no license15★ repo

    SQLFluff SQL linter — .sqlfluff config, dialect selection (ansi/bigquery/clickhouse/duckdb/hive/postgres/snowflake/sparksql/trino), rule sets, templating (Jinja/dbt), fix command, VS Code integration, pre-commit hook, CI/CD GitHub Actions, custom rules, noqa inline suppression

  • Terraform data

    ivanshamaev/de-agent-skills/skills/terraform_data Skill

    no license15★ repo

    Terraform for data infrastructure — S3/MinIO data lake buckets (versioning, lifecycle, SSE-KMS), IAM roles for Spark/Airflow (least-privilege, IRSA on EKS), MSK/Kafka clusters (aws_msk_cluster, encryption, custom broker config), Kubernetes data platform (helm_release Airflow + Spark, namespace resource quotas), module layout (modules/ + envs/), typed variables with validation, S3 remote state + DynamoDB locking, Terragrunt DRY configs, GitHub Actions CI/CD pipeline with plan/apply

  • Vertica

    ivanshamaev/de-agent-skills/skills/vertica Skill

    no license15★ repo

    Use when writing, reviewing, debugging, or optimizing SQL for Vertica — covering DDL (CREATE/ALTER/DROP TABLE, columns, projections, segmentation, partitions), DML (INSERT, UPDATE, DELETE, MERGE, TRUNCATE, COPY), CRUD patterns, and Vertica-specific performance guidance including encoding, segmentation keys, partition pruning, and query optimization.

  • Vertica query optimization

    ivanshamaev/de-agent-skills/skills/vertica_query_optimization Skill

    no license15★ repo

    Use when optimizing, diagnosing, or reviewing Vertica 11.x SQL query performance — covering EXPLAIN plan reading, projection design for predicates/joins/GROUP BY/ORDER BY/analytic functions, segmentation strategies, column encoding, RLE, sort elimination, Top-K, INSERT-SELECT tuning, DELETE/UPDATE internals, and Data Collector diagnostics.

  • Drift canary

    HetCreep/CoalMine/skills/drift-canary Skill

    15★ repo

    Compatibility and schema drift canary — checks for database schema migration safety, breaking API contract changes, serializable payload mismatches, and backward compatibility drift. Triggers on keywords: "/drift-canary", "drift-canary", "contract drift", "breaking changes". Use when changing DB schemas, API contracts, serialized payloads, or required config keys.

  • Trtc

    Tencent-RTC/agent-skills/skills/trtc Skill

    15★ repo

    Routes Tencent RTC (TRTC) requests to the appropriate product, integration, documentation, or troubleshooting skill. Use when the user wants to build, integrate, troubleshoot, compare, price, or learn about real-time audio/video, video meetings, voice rooms, live streaming, 1v1 or group calls, IM chat, offline push, or TRTC Conversational AI. Also use for mentions of TRTC, Tencent RTC, Conference, TUIRoom, RoomKit, Chat, IM, TUIKit, Call, TUICallKit, Live, RTC Engine, TIMPush, UserSig, REST API, Webhook, TRTC SDK classes or packages, and TRTC error codes. Covers guided integration, SDK/API usage, errors, pricing, quotas, migration, AI customer service, real-time interpretation, and oral coaching, including 接入音视频、视频会议、 语音房、直播、通话、群聊、错误码、实时翻译、口语陪练、离线推送、计费和套餐。 TIMPush triggers also include 腾讯云 push, 腾讯云离线推送, registerPush, error 800006, and APNs/FCM in a Chat or TIMPush context; route these to trtc-push.

  • Dotnet core

    alexander-danilenko/cortex-ai-skills/skills/dotnet-core Skill

    14★ repo

    Apply these opinionated .NET 8 architecture conventions whenever structuring or reviewing a backend service: clean architecture layering and which direction dependencies point, when CQRS with MediatR is worth it, cross-cutting concerns as pipeline behaviours, minimal APIs grouped by feature, keeping DbContext in Infrastructure, health checks and structured logging, WebApplicationFactory integration tests, and when AOT pays off.

  • Nestjs

    alexander-danilenko/cortex-ai-skills/skills/nestjs Skill

    14★ repo

    Opinionated AI Coding Skills for AI coding agents

  • Graphql schema design

    Amey-Thakur/AI-SKILLS/skills/apis/graphql-schema-design Skill

    14★ repo

    Design GraphQL schemas that model the domain, solve N+1 with dataloaders, and handle pagination and errors, knowing when REST wins. Use when building a GraphQL API or evaluating GraphQL against REST.

  • Grpc services

    Amey-Thakur/AI-SKILLS/skills/apis/grpc-services Skill

    14★ repo

    Design gRPC services with clean proto contracts, versioning, streaming patterns, and deadline propagation. Use when building high-performance service-to-service APIs or evaluating gRPC against REST.

  • Rest endpoint design

    Amey-Thakur/AI-SKILLS/skills/backend/rest-endpoint-design Skill

    14★ repo

    Model REST endpoints around resources with correct status codes, partial updates, and bulk operations. Use when designing or reviewing HTTP APIs and their URL, method, and response conventions.