agentsclimarketplace
Sign in

Academic experiments

Skill joshua-zyy/academic-paper-writer/skills/academic-experiments

Audit, run, or verify experimental evidence for CS/AI/ML papers. Produces Evidence Inventory with evidence_type annotations (newly_run/preexisting_artifact/user_claim) and Protocol Risk assessments. Use when: checking if experiment results are reproducible, auditing existing experiment artifacts, running minimal reproducible commands, evaluating checkpoints without full retraining, documenting protocol risks like data leakage or missing baselines. Triggers on: 复核实验, run experiments, 实验结果, experiment evidence, verify results, 实验验证, evidence inventory, protocol risk, 跑实验, check results, reproduce experiments, 实验审计.From its SKILL.md

Install
npx -y skills add joshua-zyy/academic-paper-writer --skill academic-experiments

Assembled from the repository path, not quoted from the project. Check it against their README if it does not work.

One thing to look at

  • runs commandsInstructs the agent to run 2 commands, including `Read manifest.yaml` and 1 more.

SKILL.md

3.1 KB, 584 tokens by cl100k_base, as published. Nobody here has run it

Academic Experiments

将此 skill 视为"实验取证代理"，目标是建立最短且可信的证据链，而不是尽量多跑实验。

Router Protocol

  1. Read manifest.yaml. It declares always_load files, axes, and references.on_demand.
  2. Read every file listed under always_load. These are the skill's binding rules — not reference material.
  3. Apply the loaded material as constraints:
    • stance.md defines non-negotiable rules, evidence type semantics, failure degradation, and scope.
    • red-lines.md defines absolute prohibitions. Do not negotiate these.
    • output-contract.md defines deliverables per mode and claim-readiness classification.
    • anti-patterns.md defines known failure modes and their correct alternatives.
  4. Detect the mode using the manifest's mode axis: experiment-evidence-pass, evidence-inventory-only, or minimal-reproducible-run. Align evidence type semantics to ../shared/core/evidence-policy.md.
  5. Echo the selected mode to the user before executing.
  6. Reach for references/ only when the manifest's references.on_demand condition is satisfied.

Modes

ModeUse when
experiment-evidence-passFull audit: inventory + run + record + risk analysis
evidence-inventory-onlyInventory existing artifacts only, no execution
minimal-reproducible-runExecute minimal reproducible command (e.g. eval existing checkpoint)

Agent Dispatch

agents/experiment_agent.md is dispatched by academic-paper-writer orchestrator at Step 4. The agent may run experiments but must not modify project source code or data files, nor write paper prose independently.

Independent Use

InputModePriorityBehavior
repo_path + no run modeexperiment-evidence-pass2 (path trigger)Full audit: inventory → env → minimal run → risk
repo_path + "inspect only"evidence-inventory-only1 (explicit)Inventory only, no commands
repo_path + specific commandminimal-reproducible-run1 (explicit)Verify env → execute → record
No repo_path—3 (no input)Ask path, or auto-detect entry files
ScenarioRecommended
Just auditing/reproducing evidenceThis skill (standalone)
Writing results into paper proseacademic-paper-writer orchestrator
Draft results need verificationThis skill → academic-reviser

What ships with it: 10 files

20.6 KB alongside SKILL.md, 1 of them executable

agents/

references/

scripts/

static/

Keep looking

Skills are one crate of 325,949. Ordering is by how many stacks a row turns up in, so the top of any crate is what has actually been picked rather than what has the most stars.