Pareto frontier analysis
[COLM'26] SkillLearnBench is the first benchmark for evaluating continual learning methods that automatically generate agent skills.
npx -y skills add cxcscmu/SkillLearnBench --skill pareto-frontier-analysisAssembled from the repository path, not quoted from the project. Check it against their README if it does not work.
SKILL.md
1.1 KB, 336 tokens by cl100k_base, as published. Nobody here has run it
name: pareto-frontier-analysis description: Identifying Pareto-optimal points from a set of multi-objective results. Use this when you need to find the best trade-offs between conflicting goals like maximizing F1 and minimizing error.
Pareto Frontier Analysis
The Pareto frontier consists of all points that are not dominated by any other point.
Dominance Definition
A point $A$ dominates point $B$ if:
- $A$ is at least as good as $B$ in all objectives.
- $A$ is strictly better than $B$ in at least one objective.
For the Mars cloud task:
- Objective 1: Maximize F1
- Objective 2: Minimize Delta
Point $(f1_1, d_1)$ dominates $(f1_2, d_2)$ if:
- $(f1_1 \ge f1_2)$ AND $(d_1 \le d_2)$
- AND ($(f1_1 > f1_2)$ OR $(d_1 < d_2)$)
Algorithm to Find Pareto Frontier
- Filter results to meet baseline criteria (e.g., F1 > 0.5).
- For each point $P$ in the filtered set:
- Check if any other point $P'$ dominates $P$.
- If no such $P'$ exists, $P$ is on the Pareto frontier.
Implementation Tip
To speed up, sort the points by one objective (e.g., descending F1). Then, as you iterate, keep track of the minimum Delta seen so far.
What ships with it
Read from the repository
Just SKILL.md. No reference files, no scripts.