Coreweave reference architecture
π§ The right skill, one API call. AI agent skills registry with token-efficient skill resolution. 5,000+ skills from 500+ top repos.
npx -y skills add ComeOnOliver/skillshub --skill coreweave-reference-architectureAssembled from the repository path, not quoted from the project. Check it against their README if it does not work.
What its author says it does
Copied from the file, not written here
Reference architecture for CoreWeave GPU cloud deployments. Use when designing ML infrastructure, planning multi-model serving, or establishing CoreWeave deployment standards. Trigger with phrases like "coreweave architecture", "coreweave design", "coreweave infrastructure", "coreweave best practices".
The file declares its own license as MIT. That is the authorβs claim about this one file, and it is not the same thing as the license GitHub reports for the repository, which is listed with the other numbers below.
SKILL.md
3.5 KB, 603 tokens by cl100k_base, as published. Nobody here has run it
CoreWeave Reference Architecture
Architecture Diagram
βββββββββββββββββββββββ
β Load Balancer β
β (Ingress/LB) β
ββββββββββββ¬βββββββββββ
β
ββββββββββββββββββΌβββββββββββββββββ
β β β
ββββββββββΌβββββββ ββββββββΌβββββββββ βββββββΌββββββββ
β Model A β β Model B β β Model C β
β (vLLM, A100) β β (TGI, H100) β β (SD, L40) β
β 2 replicas β β 1 replica β β 3 replicas β
βββββββββββββββββ βββββββββββββββββ βββββββββββββββ
β β β
ββββββββββΌβββββββββββββββββΌβββββββββββββββββΌββββββββ
β Shared Storage (PVC) β
β Models / Checkpoints / Data β
ββββββββββββββββββββββββββββββββββββββββββββββββββββ
Project Structure
ml-platform/
βββ k8s/
β βββ base/ # Shared templates
β βββ models/
β β βββ llama-8b/ # Per-model manifests
β β βββ llama-70b/
β β βββ stable-diffusion/
β βββ infra/
β βββ storage.yaml # PVCs
β βββ secrets.yaml # Model tokens
β βββ monitoring.yaml # Prometheus rules
βββ containers/
β βββ vllm/Dockerfile
β βββ custom-server/Dockerfile
βββ scripts/
β βββ deploy.sh
β βββ benchmark.sh
βββ monitoring/
βββ grafana-dashboards/
βββ alert-rules.yaml
Key Design Decisions
| Decision | Choice | Rationale |
|---|---|---|
| Serving framework | vLLM | Continuous batching, PagedAttention |
| GPU type (production) | A100 80GB | Best price/performance for inference |
| Storage | Shared PVC (SSD) | Fast model loading across replicas |
| Autoscaling | KServe + Knative | Native scale-to-zero support |
| Container registry | GHCR | GitHub integration, free for public |
Resources
Next Steps
For multi-environment setup, see coreweave-multi-env-setup.
What ships with it
Read from the repository
Just SKILL.md. No reference files, no scripts.