Custom engine
An evaluation and evolution tool for Agent Skills.From the repository description
npx -y skills add alibaba/skill-up --skill custom-engineAssembled from the repository path, not quoted from the project. Check it against their README if it does not work.
SKILL.md
0.9 KB, 224 tokens by cl100k_base, as published. Nobody here has run it
Custom Engine e2e fixture
This directory is a minimal skill-up fixture that exercises the Custom
Engine local and http transports end-to-end. It is consumed by
e2e/custom_engine_test.go.
agent.sh + evals/eval.yaml cover the local transport: agent.sh is a
deterministic stand-in for a real custom agent that reads the SessionInput
JSON the framework writes to ${input_file} and emits a fixed SessionResult
on stdout. The case asserts that final_message flows from the agent's stdout
into the report.
evals/eval-http.yaml exercises the http transport against the same
hello.yaml case. TestPipeline_CustomEngine_HTTPTransport starts an
in-process httptest server, points ${CUSTOM_AGENT_ENDPOINT} at it, and
asserts the posted SessionInput reaches the server and the returned
SessionResult flows into the report — so the http stand-in agent lives in the
test rather than in agent.sh.
What ships with it: 4 files
1.9 KB alongside SKILL.md, 1 of them executable
evals/
- cases/hello.yaml154 B
- eval-http.yaml446 B
- eval.yaml398 B
- agent.shruns948 B