agentsclimarketplace
Sign in

Phoenix arize setup

Skill a5c-ai/babysitter/library/specializations/ai-agents-conversational/skills/phoenix-arize-setup

Arize Phoenix observability platform setup for LLM debugging and evaluationFrom its SKILL.md

Install
npx -y skills add a5c-ai/babysitter --skill phoenix-arize-setup

Assembled from the repository path, not quoted from the project. Check it against their README if it does not work.

SKILL.md

1.5 KB, 235 tokens by cl100k_base, as published. Nobody here has run it

Phoenix Arize Setup Skill

Capabilities

  • Set up Phoenix local server
  • Configure tracing instrumentation
  • Design evaluation experiments
  • Implement embedding visualizations
  • Set up retrieval analysis
  • Create custom evaluations with LLM-as-judge

Target Processes

  • llm-observability-monitoring
  • agent-evaluation-framework

Implementation Details

Core Features

  1. Tracing: OpenTelemetry-based LLM traces
  2. Evals: LLM-as-judge evaluations
  3. Embeddings: Visualization and drift detection
  4. Retrieval: RAG quality analysis
  5. Datasets: Experiment management

Instrumentation

  • OpenAI auto-instrumentation
  • LangChain instrumentation
  • LlamaIndex instrumentation
  • Custom span creation

Configuration Options

  • Phoenix server setup
  • Trace sampling
  • Evaluation metrics
  • Embedding models
  • Export settings

Best Practices

  • Comprehensive instrumentation
  • Regular evaluation runs
  • Monitor embedding drift
  • Analyze retrieval quality

Dependencies

  • arize-phoenix
  • openinference-instrumentation-openai

What ships with it: 1 file

502 B alongside SKILL.md

Keep looking

Skills are one crate of 325,949. Ordering is by how many stacks a row turns up in, so the top of any crate is what has actually been picked rather than what has the most stars.