Mlops validation

Skill MLOps-Courses/mlops-coding-skills/mlops-validation

Agent skills based on the MLOps Coding Course

Install

npx -y skills add MLOps-Courses/mlops-coding-skills --skill mlops-validation

Assembled from the repository path, not quoted from the project. Check it against their README if it does not work.

One thing to look at

19 stars19 stars. Stars are a popularity signal and not a quality one, but at this level it is likely that nobody has read this closely except its author, and you would be relying on your own review.

What its author says it does

Copied from the file, not written here

Guide to implement rigorous validation layers including static analysis, automated testing, structured logging, and security scanning.

SKILL.md

3.1 KB, as published. Nobody here has run it

MLOps Validation

Goal

To ensure software quality, reliability, and security through automated validation layers. This skill enforces Strict Typing (ty), Unified Linting (ruff), Comprehensive Testing (pytest), and Structured Logging (loguru).

Prerequisites

Language: Python
Manager: uv
Context: Ensuring code quality before merge/deploy.

Instructions

1. Static Analysis (Typing & Linting)

Catch errors before they run.

Typing:
- Tool: ty (Astral type checker; pre-1.0, pin a compatible range). The mandated checker — do not use mypy.
- Rule: No Any (unless absolutely necessary). Fully typed function signatures.
- DataFrames: Use pandera schemas to validate DataFrame structures/types.
- Classes: Use pydantic for data modeling and runtime validation.
Linting & Formatting:
- Tool: ruff (replaces black, isort, pylint, flake8).
- Rule: Zero tolerance for linter errors. Use noqa sparingly and with justification.
- Config: Centralize in pyproject.toml.

2. Testing Strategy

Verify behavior and prevent regressions.

Tool: pytest.
Structure: Mirror src/ in tests/.
```
src/pkg/mod.py -> tests/test_mod.py
```
Fixtures: Use tests/conftest.py for shared setup (mock data, temp paths).
Coverage: Aim for high coverage (>80%) on core business logic. Use pytest-cov.

Pattern: Use Given-When-Then in comments.

def test_pipeline_execution(input_data):
    # Given: Valid input data
    # When: The pipeline processes the data
    # Then: The output content matches expectations

3. Structured Logging

Enable observability and debugging.

Tool: loguru (replacing stdlib logging).
Format: Use structured logging (JSON) in production for queryability.
Levels:
- DEBUG: Low-level tracing (payloads, internal state).
- INFO: Key business events (Job started, Model saved).
- ERROR: Actionable failures (with stack traces).
Context: Include context (Job ID, Model Version) in logs.

4. Security

Protect the supply chain and runtime.

Code Scanning: Enable Ruff S (flake8-bandit) rules to detect unsafe patterns (e.g., eval, yaml.load) — this replaces standalone bandit.
Dependencies: Run pip-audit (and/or GitHub Dependabot) to patch vulnerable packages.
Secret Scanning: Run gitleaks to keep credentials out of the code and git history.
Secrets: NEVER log secrets. Sanitize outputs.

Self-Correction Checklist

Type Safety: Does ty pass without errors?
Lint Cleanliness: Does ruff check pass?
Test Discovery: Does pytest successfully find modules in src/?
Log Format: Are production logs serializing to JSON?
Security: Do Ruff S rules, pip-audit, and gitleaks pass?