agentsclimarketplace
Sign in

Research model representations

Skill gaelic-ghost/socket/plugins/model-lab-skills/skills/research-model-representations

Design causal research into model activations, features, attention, residual streams, probes, and circuits. Use when locating behavior, testing a direction or feature, comparing layers, or reproducing interpretability research.From its SKILL.md

Install
npx -y skills add gaelic-ghost/socket --skill research-model-representations

Assembled from the repository path, not quoted from the project. Check it against their README if it does not work.

One thing to look at

  • 6 stars6 stars. Stars are a popularity signal and not a quality one, but at this level it is likely that nobody has read this closely except its author, and you would be relying on your own review.

SKILL.md

2.4 KB, 397 tokens by cl100k_base, as published. Nobody here has run it

Research Model Representations

Start With A Causal Question

Name the behavior, candidate representation, intervention point, predicted behavioral change, and falsifying result. A decodable probe or correlated activation is evidence of information, not evidence that the model uses it causally.

Workflow

  1. Pin the checkpoint, tokenizer, template, framework, and source-code revision.
  2. Construct matched positive, negative, and neutral examples. Control length, topic, syntax, and token positions where practical.
  3. Define hook names by verified model architecture rather than assuming layer paths from a related model.
  4. Decide local versus remote instrumentation. Before remote execution, classify prompts and activations, confirm authorization, retention/logging behavior, network exposure, and paid-compute budget; keep proprietary or sensitive inputs local unless explicitly approved.
  5. Collect activations with explicit batch, dtype, device, token-selection, pooling, and normalization rules.
  6. Split probe training and evaluation examples by the true contamination boundary.
  7. Establish selectivity controls: random labels, random directions, held-out concepts, and simple surface-feature baselines.
  8. Test causality through ablation, patching, steering, or counterfactual replacement at held-out examples.
  9. Measure target behavior and unrelated capability guardrails across layers, positions, and intervention strengths.
  10. Report unstable seeds, negative results, multiple-comparison choices, and architecture-specific limitations.

Tool Selection

  • TransformerLens provides activation caching and hook-oriented analysis for supported architectures.
  • NNsight provides model instrumentation and remote-capable intervention workflows.

Verify the pinned model and operation against the selected tool. Use direct framework hooks when a small, explicit intervention is clearer than adding a large abstraction.

References

Read references/causal-representation-evidence.md before interpreting a probe or direction as a mechanism.

What ships with it: 2 files

1.1 KB alongside SKILL.md

agents/

references/

Gives 0 of the 12 instructions most research analysis skills give in 397 tokens

Counted across 1,063 of the 1,754 authors here whose files we hold, read 2026-08-07

  • Generate a markdown reportin 32 of 1063, across 23 files
  • Cite each claim's sourcein 30 of 1063, across 15 files
  • Define the ideal customer profilein 20 of 1063, across 2 files
  • Search for companies matching the criteriain 20 of 1063, across 2 files
  • Assign a fit score from one to tenin 20 of 1063, across 2 files
  • Analyze the codebase to understand the productin 19 of 1063, across 1 file
  • Ask clarifying questions about the value propositionin 19 of 1063, across 1 file
  • Look for signals of immediate needin 19 of 1063, across 1 file
  • Identify the target decision maker rolein 19 of 1063, across 1 file
  • Suggest a personalized contact strategyin 19 of 1063, across 1 file
  • Provide conversation starters for outreachin 19 of 1063, across 1 file
  • Format results in a scannable markdown templatein 19 of 1063, across 1 file

Said here and by no other author read

  • name behavior, representation, intervention, prediction, and falsifier
  • treat decoded probes as non-causal evidence
  • pin checkpoint, tokenizer, template, framework, and revision
  • construct matched positive, negative, and neutral examples
  • define hook names by verified model architecture
  • split probe data by the contamination boundary

Grouped from the skills themselves: near-identical wordings counted once, and counted by distinct author, so one author publishing three of these counts once. Length counted with cl100k_base; the agent that loads this file may tokenize it differently.

Keep looking

Skills are one crate of 326,835. Ordering is by how many stacks a row turns up in, so the top of any crate is what has actually been picked rather than what has the most stars.