Solution comparator

Skill a5c-ai/babysitter/library/specializations/algorithms-optimization/skills/solution-comparator

Compare multiple solutions for correctness and performanceFrom its SKILL.md

Install

npx -y skills add a5c-ai/babysitter --skill solution-comparator

Assembled from the repository path, not quoted from the project. Check it against their README if it does not work.

SKILL.md

2.1 KB, 432 tokens by cl100k_base, as published. Nobody here has run it

Solution Comparator Skill

Purpose

Compare multiple algorithm solutions against the same test cases to verify correctness and benchmark performance.

Capabilities

Run solutions against same test cases
Performance benchmarking and comparison
Output diff analysis
Find minimal failing test case
Memory usage comparison
Time complexity validation

Target Processes

correctness-proof-testing
complexity-optimization
upsolving
algorithm-implementation

Comparison Modes

Correctness: Compare outputs against a known-correct solution
Performance: Benchmark execution time across solutions
Stress Testing: Run with random large inputs to find discrepancies
Minimal Counter-example: Binary search to find smallest failing case

Input Schema

{
  "type": "object",
  "properties": {
    "solutions": {
      "type": "array",
      "items": {
        "type": "object",
        "properties": {
          "name": { "type": "string" },
          "code": { "type": "string" },
          "language": { "type": "string" }
        }
      }
    },
    "testCases": { "type": "array" },
    "mode": {
      "type": "string",
      "enum": ["correctness", "performance", "stress", "minimal"]
    },
    "oracleSolution": { "type": "string" },
    "timeout": { "type": "integer", "default": 5000 }
  },
  "required": ["solutions", "mode"]
}

Output Schema

{
  "type": "object",
  "properties": {
    "success": { "type": "boolean" },
    "results": { "type": "array" },
    "discrepancies": { "type": "array" },
    "performance": { "type": "object" },
    "minimalFailingCase": { "type": "object" }
  },
  "required": ["success"]
}

What ships with it: 1 file

735 B alongside SKILL.md

README.md735 B