Evolve ai instructions
Skill tardis-labs/agent-instruction-kit/skills/evolve-ai-instructions
Improve AI skills, rules, prompts, agent instructions, and reusable development workflows from observed sessions, reviews, incidents, or evaluations. Use when repeated agent behavior suggests an instruction should be created or revised, when a proposed instruction change needs evidence and regression testing, or when an accepted change must be versioned, approved, promoted, or rolled back without binding the workflow to a project, stack, architecture, model, or agent vendor.From its SKILL.md
npx -y skills add tardis-labs/agent-instruction-kit --skill evolve-ai-instructionsAssembled from the repository path, not quoted from the project. Check it against their README if it does not work.
2 things to look at
- 28 days oldThe repository was created 28 days ago. New is not bad, but a brand new repository carrying a familiar-sounding name is the shape a typosquat arrives in, and there has been no time for anyone else to find a problem with it.
- 1 stars1 stars. Stars are a popularity signal and not a quality one, but at this level it is likely that nobody has read this closely except its author, and you would be relying on your own review.
SKILL.md
4.6 KB, 836 tokens by cl100k_base, as published. Nobody here has run it
Evolve AI Instructions
Create a reversible, evidence-backed instruction change. Compare the current and candidate instructions against frozen inputs, preserve held-out cases, and separate structural validation from artifact verification and the project release decision.
Protocol version: 2.0.0.
Workflow
-
Identify one target instruction and its current semantic version. Do not combine unrelated behaviors in one proposal.
-
Collect raw evidence. A summary may locate evidence but does not qualify without a retained, redacted artifact and SHA-256 digest.
-
Read the evaluation protocol. State a falsifiable hypothesis, choose
patch,minor, ormajor, and define criteria before running the candidate. -
Start with the proposal template. A
draftmay be incomplete. Before changing it tocandidate, freeze the diff, evaluator configuration, baseline and held-out inputs, criteria, rollback commit, and qualifying evidence. -
Run the current and candidate instructions against the same case inputs. For every run retain the actual output, tool trace, criterion-level result, and rationale. Do not rewrite criteria after observing failures.
-
Use the resolved skill directory from the active skill source locator; never assume
.agents/:python <resolved-skill-directory>/scripts/validate_proposal.py lint <proposal.json> python <resolved-skill-directory>/scripts/validate_proposal.py verify <proposal.json> \ --repo-root <repository> python <resolved-skill-directory>/scripts/validate_proposal.py gate <proposal.json> \ --repo-root <repository> --policy <release-policy.json> -
Ask a human owner or independent reviewer to decide. An
acceptedproposal records a hashed attestation and policy. The supplied policy must match the recorded digest and trust that exact principal/provider and required role; the proposer cannot be the approver. -
Promote only the exact verified candidate. Commit its proposal and evaluation artifacts. On a regression, revert through version control, retain regression and post-check artifacts, and mark the proposal
rolled-back.
Validation Levels
lintchecks schema, semantic versions, lifecycle requirements, case separation, complete runs, criterion results, timestamps, and artifact metadata. It reads no referenced state.verifyalso resolves local artifacts, checks SHA-256 digests, confirms the target exists, and resolves the full immutable rollback commit in the supplied Git repository.gatealso requiresstatus=acceptedand applies a supplied project approval policy.
These levels are cumulative. lint does not mean artifacts are genuine; verify does not
authenticate a remote account; gate trusts the supplied policy and retained attestation. A
provider-specific adapter must independently obtain or authenticate that attestation when required.
Non-Negotiable Gates
- Do not activate a target directly from chat memory or a generated summary.
- Require two qualifying sources with different independence keys, or one critical incident plus a reproducer. Different labels do not make copied evidence independent.
- Keep evidence cases separate from at least one held-out case.
- Store actual inputs, outputs, tool traces, evaluator configuration, and candidate diff with SHA-256.
- Do not expose secrets, personal chat content, or sensitive logs; retain redacted minimum evidence.
- Do not let this skill approve a change to itself. Evaluate self-changes with the last accepted protocol and require human approval.
- Keep project, stack, architecture, model, vendor, identity-provider, and approval-role details in an adapter. An adapter may strengthen but not weaken this protocol.
Outputs
Produce one proposal, candidate diff, evaluation inputs and runs, approval or rejection record, and immutable rollback commit. For accepted changes, retain the policy and approval attestation used by the release gate.
Follow the target repository's canonical evolution rule when one exists.
What ships with it: 9 files
44.9 KB alongside SKILL.md, 1 of them executable
agents/
- openai.yaml274 B
assets/
docs/
- ru/README.md7.4 KB
references/
- evaluation-protocol.md5.0 KB
scripts/
- validate_proposal.pyruns22.3 KB
- manifest.json137 B
- README.md5.1 KB