Data audit
🔬 A curated collection of 23,000+ agent skills for empirical research across 8 social science disciplines. | 精选 23,000+ AI Agent 技能库，覆盖8大社会科学学科的实证研究。CoPaper.AI 20分钟完成一篇可复现的规范实证论文，并支持用户上传 Skills。-- Maintained by CoPaper.AI from Stanford REAP.
npx -y skills add brycewang-stanford/Auto-Empirical-Research-Skills --skill data-auditAssembled from the repository path, not quoted from the project. Check it against their README if it does not work.
One thing to look at
- no licenseNo license file was found in the repository. Code published without one is not open source by default, so using it at work is a question for whoever answers licensing questions where you are.
What its author says it does
Copied from the file, not written here
Scans notebooks for data file references and verifies each file exists on disk. Use when checking for broken data paths.
SKILL.md
1.8 KB, as published. Nobody here has run it
Audit Data References
Scan all notebooks for data file references and verify they exist on disk.
Steps
-
Scan all
.ipynbfiles innotebooks/for data loading patterns:- Python:
pd.read_csv(...),pd.read_stata(...),pd.read_excel(...),pd.read_parquet(...),open(...),np.loadtxt(...) - R:
read.csv(...),read_csv(...),read.dta(...),haven::read_dta(...),readxl::read_excel(...),load(...) - Stata:
use "...",import delimited "...",import excel "...",insheet using "..." - Also check the
.mdJupytext pairs for the same patterns
- Python:
-
Extract every referenced file path and normalize it:
- Resolve relative paths from the notebook's directory (
notebooks/) - Resolve paths using
DATA_DIR,RAW_DATA_DIRfromconfig.py/config.R
- Resolve relative paths from the notebook's directory (
-
Check that each referenced file exists in
data/rawData/ordata/ -
Scan
data/rawData/anddata/for all data files present on disk -
Report three categories:
Resolved — referenced and found:
- File path, which notebook references it, line/cell number
Broken — referenced but not found:
- File path as written in code, which notebook, suggested fix (closest matching file, or note that it may need to be downloaded)
Undocumented — on disk but never referenced by any notebook:
- File path in
data/rawData/ordata/that no notebook loads
-
Print a summary: total references, resolved, broken, undocumented files
Error handling
- If no notebooks exist, report "No notebooks found" and stop.
- If
data/rawData/does not exist, warn but continue checkingdata/.