agentsclimarketplace

Flaky test triage

Skill jukrap/ai-agent-playbook/skills/delivery/flaky-test-triage

Reusable AI agent skills, project templates, and guardrails for safer software maintenance and delivery.

Install
npx -y skills add jukrap/ai-agent-playbook --skill flaky-test-triage

Assembled from the repository path, not quoted from the project. Check it against their README if it does not work.

One thing to look at

  • 2 stars2 stars. Stars are a popularity signal and not a quality one, but at this level it is likely that nobody has read this closely except its author, and you would be relying on your own review.

What its author says it does

Copied from the file, not written here

Use when diagnosing, reproducing, stabilizing, quarantining, or documenting flaky, nondeterministic, timing-dependent, or intermittent tests.

SKILL.md

1.0 KB, 171 tokens by cl100k_base, as published. Nobody here has run it

Flaky Test Triage

Use this as the primary delivery skill for nondeterministic test failures.

Workflow

  1. Collect failure logs, seed/order, environment, changed files, timing, retries, and pass/fail frequency.
  2. Classify likely cause: time, concurrency, async wait, order dependence, shared state, network, filesystem, data fixture, browser/device, or resource limit.
  3. Reproduce with the smallest command and stabilize the assertion or setup before broad rewrites.
  4. Quarantine only with owner, reason, expiration or follow-up, and a replacement signal.

Reference

Read references/nondeterminism-sources.md for common flaky failure causes and evidence to collect.

Read references/stabilization-and-quarantine.md for safe fixes, retry policy, and quarantine handoff.

What ships with it: 2 files

2.2 KB alongside SKILL.md

Keep looking

Skills are one crate of 328,083. Ordering is by how many stacks a row turns up in, so the top of any crate is what has actually been picked rather than what has the most stars.