Rag pipeline
Skill ComeOnOliver/skillshub/skills/aiskillstore/marketplace/abdulsamad94/rag-pipeline
🧠The right skill, one API call. AI agent skills registry with token-efficient skill resolution. 5,000+ skills from 500+ top repos.
npx -y skills add ComeOnOliver/skillshub --skill rag-pipelineAssembled from the repository path, not quoted from the project. Check it against their README if it does not work.
What its author says it does
Copied from the file, not written here
Details on the Retrieval Augmented Generation pipeline, Ingestion, and Vector Search.
SKILL.md
1.0 KB, as published. Nobody here has run it
RAG Pipeline Logic
Ingestion
- Script:
backend/ingest.py - Process:
- Scans
docs/. - Cleans MDX (removes frontmatter/imports).
- Chunks text (1000 chars, 100 overlap).
- Embeds using
models/text-embedding-004. - Upserts to Qdrant collection
physical_ai_book.
- Scans
- Run:
python backend/ingest.py
Vector Search (Qdrant)
- Client:
qdrant-client - Collection:
physical_ai_book - Vector Size: 768 (Gecko-004)
- Similarity: Cosine
Prompt Engineering
- File:
backend/utils/helpers.py. - RAG Prompt: Constructs a prompt containing retrieved context chunks.
- Personalization:
backend/personalization.pycreates system instructions based onsoftware_backgroundandhardware_backgroundof the user.
Agentic Flow
We use a custom Agent class (backend/agents.py) that wraps the LLM calls, allowing for future expansion into multi-agent workflows.