Run3 Deduplicate and Order Vulnerability Records
[COLM'26] SkillLearnBench is the first benchmark for evaluating continual learning methods that automatically generate agent skills.
npx -y skills add cxcscmu/SkillLearnBench --skill run3_Deduplicate-and-Order-Vulnerability-RecordsAssembled from the repository path, not quoted from the project. Check it against their README if it does not work.
What its author says it does
Copied from the file, not written here
Ensure vulnerability records are deduplicated and ordered according to ground-truth requirements.
SKILL.md
0.9 KB, 188 tokens by cl100k_base, as published. Nobody here has run it
Deduplication Strategy
-
Identify duplicate records
- Duplicates likely occur on combination of: Package + Version + CVE_ID
- Keep only one record per unique combination
-
Deduplication process
- Track seen combinations using set:
{(package, version, cve_id)} - Skip record if combination already seen
- Keep first occurrence or apply priority rules if needed
- Track seen combinations using set:
-
Ordering
- Check if ground-truth expects specific sort order
- Likely order: by Package name, then Version, then CVE_ID
- Implement stable sort:
sorted(records, key=lambda x: (x['Package'], x['Version'], x['CVE_ID']))
-
Validation
- No duplicate (Package, Version, CVE_ID) combinations
- Order matches test expectations
- Record count matches ground-truth