agentsclimarketplace
Sign in

Ollama

Skill G1Joshi/Agent-Skills/skills/ai-ml/ollama

Ollama local LLM deployment and management. Use for running LLMs locally.From its SKILL.md

Install
npx -y skills add G1Joshi/Agent-Skills --skill ollama

Assembled from the repository path, not quoted from the project. Check it against their README if it does not work.

One thing to look at

  • 12 stars12 stars. Stars are a popularity signal and not a quality one, but at this level it is likely that nobody has read this closely except its author, and you would be relying on your own review.

SKILL.md

1.1 KB, 274 tokens by cl100k_base, as published. Nobody here has run it

Ollama

Ollama makes running LLMs locally as easy as docker run. 2025 updates include Windows/AMD support, Multimodal input, and Tool Calling.

When to Use

  • Local Development: Coding without wifi or API costs.
  • Privacy: Processing sensitive documents on-device.
  • Integration: Works with LangChain, LlamaIndex, and Obsidian natively.

Core Concepts

Modelfile

Docker-like file to define a custom model (System prompt + Base model).

FROM llama3
SYSTEM You are Mario from Super Mario Bros.

API

Ollama runs a local server (localhost:11434) compatible with OpenAI SDK.

Best Practices (2025)

Do:

  • Use high-speed RAM: Local LLM speed depends on memory bandwidth.
  • Use Quantized Models: q4_k_m is the sweet spot for speed/quality balance.
  • Unload: ollama stop when done to free VRAM for games/rendering.

Don't:

  • Don't expect GPT-4 level: Smaller local models (8B) are smart but lack deep reasoning.

References

What ships with it

Read from the repository

Just SKILL.md. No reference files, no scripts.

Keep looking

Skills are one crate of 325,949. Ordering is by how many stacks a row turns up in, so the top of any crate is what has actually been picked rather than what has the most stars.