Local llm ops

Skill ulpi-io/plugin-marketplace/plugins/bobmatnyc/skills/local-llm-ops

Local LLM operations with Ollama on Apple Silicon, including setup, model pulls, chat launchers, benchmarks, and diagnostics.From its SKILL.md

Install

npx -y skills add ulpi-io/plugin-marketplace --skill local-llm-ops

Assembled from the repository path, not quoted from the project. Check it against their README if it does not work.

2 things to look at

no licenseNo license file was found in the repository. Code published without one is not open source by default, so using it at work is a question for whoever answers licensing questions where you are.
1 stars1 stars. Stars are a popularity signal and not a quality one, but at this level it is likely that nobody has read this closely except its author, and you would be relying on your own review.

What its file declares

Copied from the file, not written here

The file declares its own license as MIT. That is the author’s claim about this one file, and it is not the same thing as the license GitHub reports for the repository, which is listed with the other numbers below.

SKILL.md

2.3 KB, 460 tokens by cl100k_base, as published. Nobody here has run it

Local LLM Ops (Ollama)

Overview

Your localLLM repo provides a full local LLM toolchain on Apple Silicon: setup scripts, a rich CLI chat launcher, benchmarks, and diagnostics. The operational path is: install Ollama, ensure the service is running, initialize the venv, pull models, then launch chat or benchmarks.

Quick Start

./setup_chatbot.sh
./chatllm

If no models are present:

ollama pull mistral

Setup Checklist

Install Ollama: brew install ollama
Start the service: brew services start ollama
Run setup: ./setup_chatbot.sh
Verify service: curl http://localhost:11434/api/version

Chat Launchers

./chatllm (primary launcher)
./chat or ./chat.py (alternate launchers)
Aliases: ./install_aliases.sh then llm, llm-code, llm-fast

Task modes:

./chat -t coding -m codellama:70b
./chat -t creative -m llama3.1:70b
./chat -t analytical

Benchmark Workflow

Benchmarks are scripted in scripts/run_benchmarks.sh:

./scripts/run_benchmarks.sh

This runs bench_ollama.py with:

benchmarks/prompts.yaml
benchmarks/models.yaml
Multiple runs and max token limits

Diagnostics

Run the built-in diagnostic script when setup fails:

./diagnose.sh

Common fixes:

Re-run ./setup_chatbot.sh
Ensure ollama is in PATH
Pull at least one model: ollama pull mistral

Operational Notes

Virtualenv lives in .venv
Chat configs and sessions live under ~/.localllm/
Ollama API runs at http://localhost:11434

Related Skills

toolchains/universal/infrastructure/docker

What ships with it: 1 file

506 B alongside SKILL.md

metadata.json506 B