agentsclimarketplace

Pyarrow format conversion starter

Skill ma-compbio-lab/SkillFoundry/skills/data-acquisition-and-dataset-handling/pyarrow-format-conversion-starter

A framework for discovering, compiling, and validating reusable skills for scientific agents.

Install
npx -y skills add ma-compbio-lab/SkillFoundry --skill pyarrow-format-conversion-starter

Assembled from the repository path, not quoted from the project. Check it against their README if it does not work.

SKILL.md

1.1 KB, 252 tokens by cl100k_base, as published. Nobody here has run it

PyArrow Format Conversion Starter

Use this skill to convert a small tabular file into Parquet with PyArrow and inspect a deterministic round-trip summary.

What This Skill Does

  • reads a tiny tabular input with typed columns
  • builds an Arrow table in memory
  • writes a local Parquet file
  • reads the Parquet file back and verifies the round trip

When To Use It

  • when you need a starter for format-conversion
  • when you want a small Arrow-to-Parquet example without a larger data stack
  • when you need a deterministic schema summary for tests or demos

Run

./slurm/envs/data-tools/bin/python skills/data-acquisition-and-dataset-handling/pyarrow-format-conversion-starter/scripts/run_pyarrow_format_conversion.py --input skills/data-acquisition-and-dataset-handling/pyarrow-format-conversion-starter/examples/toy_matrix.tsv --parquet-out scratch/pyarrow/toy_table.parquet --summary-out scratch/pyarrow/toy_table_summary.json

Notes

  • The example uses tab-separated input to keep the fixture readable in the repository.
  • The summary records typed schema information so downstream checks do not need to parse Parquet directly.

Keep looking

Skills are one crate of 328,083. Ordering is by how many stacks a row turns up in, so the top of any crate is what has actually been picked rather than what has the most stars.