Ai finetuning
π Agent skills distilled from technical books β AI Engineering, Context Engineering, Designing Data-Intensive Applications, and more. Agent-agnostic, plain Markdown. Give your AI agent a bookshelf.
npx -y skills add ebarti/skills --skill ai-finetuningAssembled from the repository path, not quoted from the project. Check it against their README if it does not work.
One thing to look at
- 0 stars0 stars. Stars are a popularity signal and not a quality one, but at this level it is likely that nobody has read this closely except its author, and you would be relying on your own review.
What its author says it does
Copied from the file, not written here
Practical knowledge for finetuning foundation models. Covers when to finetune (vs prompt engineering or RAG), memory bottlenecks (backpropagation, quantization, numerical representations), parameter-efficient finetuning techniques (PEFT, LoRA, adapters), model merging strategies (summing, layer stacking, concatenation), and finetuning tactics (frameworks, hyperparameters). Use this skill when: - Deciding whether to finetune (vs prompt engineering or RAG) - Estimating memory requirements for finetuning - Implementing LoRA or other PEFT techniques - Merging multiple finetuned models - Choosing finetuning hyperparameters or frameworks - Quantizing models for inference or training
SKILL.md
1.8 KB, as published. Nobody here has run it
AI Finetuning
Knowledge from "AI Engineering" by Chip Huyen (Chapter 7). Practical guide to model finetuning with focus on parameter-efficient methods.
Quick Start
- Check
guidelines.mdto find which files to load for your task - Load only relevant files (each topic has knowledge.md, rules.md, examples.md)
- Apply guidance to your work
Contents
References
| Category | Purpose |
|---|---|
finetuning-overview | When to finetune, reasons for/against, finetuning vs RAG |
memory-bottlenecks | Backpropagation memory, numerical representations, quantization |
peft-techniques | Parameter-efficient finetuning, LoRA, adapter methods |
model-merging | Summing, layer stacking, concatenation for multi-task models |
finetuning-tactics | Frameworks, base model selection, hyperparameters |
Workflows
| Task | Workflow |
|---|---|
| Decide whether to finetune | workflows/should-i-finetune.md |
| Set up a finetuning job (memory β method β params) | workflows/setup-finetuning.md |
Guidelines
See guidelines.md for task-based file selection.