Run3 glm metric validator
Calculate specific RMSE metrics by merging simulation and observation data using exact datetime and rounded-depth matching.From its SKILL.md
npx -y skills add cxcscmu/SkillLearnBench --skill run3_glm-metric-validatorAssembled from the repository path, not quoted from the project. Check it against their README if it does not work.
SKILL.md
1.3 KB, 277 tokens by cl100k_base, as published. Nobody here has run it
-
Data Preparation:
- Load field observations from
field_temp_oxy.csv. - Ensure observation
datetimevalues are truncated or aligned to match the simulation's temporal resolution (e.g., setting minutes/seconds to zero if the simulation outputs daily/hourly values).
- Load field observations from
-
Merge Logic:
- Apply
round().astype(int)to thedepthvalues of both the simulation and observation datasets to ensure integer-based depth matching. - Perform an inner join on the
datetimeandrounded_depthcolumns. No interpolation or nearest-neighbor matching is permitted for the final evaluation.
- Apply
-
Metric Calculation:
- Overall RMSE: Calculate the Root Mean Square Error for all matched pairs.
- Annual Deep RMSE: Calculate RMSE for all matched pairs where
rounded_depth$\ge 13$. - Summer Deep RMSE: Calculate RMSE for matched pairs where
rounded_depth$\ge 13$ and the month is June, July, August, or September (6-9).
-
Reporting:
- Save the results to
/root/metrics.jsonusing the keys:overall_rmse,annual_deep_rmse,summer_deep_rmse,overall_n_pairs,annual_deep_n_pairs, andsummer_deep_n_pairs.
- Save the results to
What ships with it
Read from the repository
Just SKILL.md. No reference files, no scripts.