agentsclimarketplace

Eval log

Skill rulebased-io/harness/rulebased-harness/skills/eval-log

Harness engineering tools for AI agents — audit, init, recommend your project's agent-readiness (AGENTS.md, context engineering, eval)

Install
npx -y skills add rulebased-io/harness --skill eval-log

Assembled from the repository path, not quoted from the project. Check it against their README if it does not work.

One thing to look at

  • 0 stars0 stars. Stars are a popularity signal and not a quality one, but at this level it is likely that nobody has read this closely except its author, and you would be relying on your own review.

What its author says it does

Copied from the file, not written here

Evaluates a Claude Code conversation log against harness compliance — measures human intervention, agent autonomy, tool usage, and session patterns

SKILL.md

1.0 KB, as published. Nobody here has run it

Evaluates a Claude Code conversation transcript against harness engineering compliance.

Analyzes the JSONL session log at ~/.claude/projects/<project>/<session>.jsonl.

Evaluation Criteria

  • Human Turn Count: fewer human turns = more autonomous. Ratio of human to total turns.
  • Autonomy Ratio: percentage of agent-driven turns. Higher is better.
  • Build/Test Execution: Bash tool invocations as proxy for builds and tests.
  • Tool Diversity: unique tools used (Read, Write, Edit, Bash, Grep, etc.)
  • Session Duration: not too short (incomplete) or excessively long.

How to Evaluate

  1. Find the session log at ~/.claude/projects/<project-path>/<session-id>.jsonl
  2. Parse JSONL, count human vs assistant turns
  3. Count unique tools and Bash invocations
  4. Calculate scores per criterion and overall grade

$ARGUMENTS

Keep looking

Skills are one crate of 328,083. Ordering is by how many stacks a row turns up in, so the top of any crate is what has actually been picked rather than what has the most stars.