Reviewer protocol
Skill gustavo-meilus/superpipelines/.agents/skills/superpipelines/parity-test-f/reviewer-protocol
Loaded by the reviewer agent to supply operating protocol and invariants for findings validation in the parity-test-f pipeline. Not user-invocable.From its SKILL.md
npx -y skills add gustavo-meilus/superpipelines --skill reviewer-protocolAssembled from the repository path, not quoted from the project. Check it against their README if it does not work.
One thing to look at
- 4 stars4 stars. Stars are a popularity signal and not a quality one, but at this level it is likely that nobody has read this closely except its author, and you would be relying on your own review.
SKILL.md
5.1 KB, ~1.2k tokens by cl100k_base, as published. Nobody here has run it
Reviewer — Operational Protocol
<overview> The reviewer agent reads the structured findings JSON produced by the analyzer, validates completeness and correctness of the findings across all three issue categories (null checks, error handling, naming), and emits a verdict via terminal output text (no file write). It is the second step of the parity-test-f Sequential pipeline (Pattern 1) on Tier 1d (Codex CLI). This agent operates under structural write-deny: `sandbox_mode = "read-only"` in `reviewer.toml` prevents ALL file writes via the Codex host; the verdict is communicated exclusively through the terminal-output REVIEWER VERDICT block, which the orchestrator parses. The quality bar is: the verdict must provide a clear signal (approved / approved_with_concerns / rejected) with actionable notes for the reporter. </overview>Protocol
<protocol>1. DISCOVER
- Read inputs from the orchestrator dispatch context:
findings_path: path tofindings.jsonwritten by the analyzer.run_id: current run identifier.root: resolved scope root.
- Verify
findings_pathexists and is valid JSON. If the file does not exist: emitBLOCKEDwith message: "Analyzer findings not found at{findings_path}. The analyzer step may have failed." - Parse the findings JSON. If JSON is malformed: emit
BLOCKEDwith message: "Analyzer findings at{findings_path}are not valid JSON. Re-run the analyzer step."
2. PROCESS
Validate the findings for completeness and correctness:
-
Structural validation:
- Verify
findings.issue_countmatchesfindings.issues.length. If not: record a reviewer note that the count is inconsistent and lowercompleteness_scoreby 0.1. - Verify each issue entry has
category,severity,location, anddescriptionfields. Issues missing required fields are flagged as incomplete.
- Verify
-
Category coverage:
- Identify which of the three expected categories (
null_check,error_handling,naming) have at least one finding. Recordmissing_categoriesas any category with zero findings. - A missing category is not automatically a rejection — it may be genuinely absent from the diff. However, if all three categories are missing and
issue_count > 0, flag as suspicious and lowercompleteness_scoreby 0.2.
- Identify which of the three expected categories (
-
Severity plausibility:
null_checkissues should generally behighormedium. Alowseverity null_check finding is unusual; record a reviewer note.error_handlingissues should generally bemedium. Ahighseverity error_handling finding without a clear justification in the description is unusual; record a reviewer note.namingissues should generally below. Ahighseverity naming finding is unusual; record a reviewer note.
-
Compute verdict:
completeness_scorestarts at 1.0 and is adjusted per the rules above (minimum 0.0).verdict:"approved"—completeness_score >= 0.85and no structural validation failures."approved_with_concerns"—0.6 <= completeness_score < 0.85or minor notes present."rejected"—completeness_score < 0.6or structural validation failures (e.g., missing required fields, count mismatch).
-
Assemble the verdict object:
{
"findings_path": "{findings_path}",
"verdict": "approved | approved_with_concerns | rejected",
"completeness_score": 1.0,
"missing_categories": [],
"reviewer_notes": "{summary of any concerns or notes; empty string if none}"
}
3. RENDER VERDICT
- Render the verdict as a terminal-output block (NO file write — this agent is read-only). The orchestrator parses this block:
REVIEWER VERDICT: {verdict}
COMPLETENESS_SCORE: {completeness_score}
MISSING_CATEGORIES: {comma-separated categories, or "none"}
REVIEWER_NOTES: {summary of any concerns or notes, or "none"}
- Emit terminal status:
DONE— verdict is"approved".DONE_WITH_CONCERNS— verdict is"approved_with_concerns"or"rejected"(the orchestrator surfaces the verdict and reviewer_notes).BLOCKED— findings file missing or malformed; no verdict rendered.
What ships with it
Read from the repository
Just SKILL.md. No reference files, no scripts.