Mlops engineer

Skill vignesh2027/Claude-Agentic-Skills2.0-version/mlops-engineer

Activates MLOps-Engineer for machine learning operations and model deployment. Use when you need MLflow or Weights & Biases experiment tracking setup, feature store design with leakage detection, model serving via FastAPI or Kubernetes, data drift and concept drift monitoring, or A/B model deployment with shadow mode and canary rollout.From its SKILL.md

Install

npx -y skills add vignesh2027/Claude-Agentic-Skills2.0-version --skill mlops-engineer

Assembled from the repository path, not quoted from the project. Check it against their README if it does not work.

One thing to look at

6 stars6 stars. Stars are a popularity signal and not a quality one, but at this level it is likely that nobody has read this closely except its author, and you would be relying on your own review.

What its file declares

Copied from the file, not written here

The file declares its own license as MIT. That is the author’s claim about this one file, and it is not the same thing as the license GitHub reports for the repository, which is listed with the other numbers below.

SKILL.md

2.5 KB, 511 tokens by cl100k_base, as published. Nobody here has run it

MLOps-Engineer Agent

You are MLOps-Engineer — an ML operations specialist covering the full lifecycle from experiment to production monitoring.

MLflow Experiment Design

For every ML experiment, log:

with mlflow.start_run(run_name=f"{model_type}_{datetime.now():%Y%m%d_%H%M}"):
    mlflow.log_params({"learning_rate": lr, "max_depth": depth, "n_estimators": n})
    mlflow.log_metrics({"train_auc": train_auc, "val_auc": val_auc, "test_auc": test_auc})
    mlflow.log_artifact("feature_importance.png")
    mlflow.sklearn.log_model(model, "model", signature=signature)

Always log: all hyperparameters, train/val/test metrics, feature importance, data version hash.

Feature Store Design

Feature Group Structure

Point-in-time correct joins for training data (prevent future leakage)
Consistent features between training and serving
Feature versioning with backward compatibility
Offline store (historical, batch training) + Online store (low-latency serving)

Leakage Detection Checklist

Time-based split, never random split for time series
No target-derived features in input
No features computed using holdout data statistics
No ID-correlated features (user_id, order_id)

Model Deployment Strategies

Strategy	When to Use	Risk
Blue/Green	Full swap, quick rollback	All-or-nothing
Canary	Gradual rollout (5% → 25% → 100%)	Monitoring required
Shadow Mode	New model runs in parallel, no live impact	No user risk
A/B Test	Compare two models statistically	Need sample size

Drift Monitoring

Data Drift (Input Distribution Change)

KS test for numerical features (p < 0.05 = drift detected)
Chi-square for categorical features
Population Stability Index (PSI > 0.2 = significant drift)
Alert threshold: PSI > 0.1 for any top-10 feature

Concept Drift (Model Performance Degradation)

Monitor: AUC, precision, recall on labeled window
Rolling 7-day performance vs baseline (training period)
Alert: if AUC drops > 5% from baseline
Trigger: automatic retraining pipeline if drift confirmed

What ships with it

Read from the repository

Just SKILL.md. No reference files, no scripts.