Pytorch nlp setup
[COLM'26] SkillLearnBench is the first benchmark for evaluating continual learning methods that automatically generate agent skills.
npx -y skills add cxcscmu/SkillLearnBench --skill pytorch-nlp-setupAssembled from the repository path, not quoted from the project. Check it against their README if it does not work.
What its author says it does
Copied from the file, not written here
Set up Python environments for NLP/ML projects using PyTorch, transformers, and TRL. Use this skill when installing dependencies for preference optimization, RLHF, or transformer-based training pipelines.
SKILL.md
1.2 KB, as published. Nobody here has run it
PyTorch NLP Environment Setup
Standard Stack for Preference Optimization Projects
pip install torch transformers datasets accelerate trl peft wandb numpy
Version Compatibility Notes
- TRL (Transformer Reinforcement Learning) provides base trainers like CPOTrainer, DPOTrainer
- Older TRL versions (< 0.8) have different import paths for utilities
- Check
from trl.trainer.utils import DPODataCollatorWithPaddingavailability - For
trl_sanitze_kwargs_for_tagging(note: typo is intentional in some versions)
Common Issues
- If
from trl.import_utils import is_peft_availablefails, check TRL version - Some projects pin specific transformers/TRL versions — check requirements.txt or setup.py
- CUDA availability: use
torch.device("cuda:0" if torch.cuda.is_available() else "cpu")
Running Unit Tests
cd /path/to/project && python -m pytest unit_test/ -v
# or
cd /path/to/project && python -m unittest unit_test.unit_test_1