agentsclimarketplace

Diagnosis

Skill github/awesome-copilot/skills/qdrant-search-quality/diagnosis

Diagnoses Qdrant search quality issues. Use when someone reports 'results are bad', 'wrong results', 'not relevant results', 'missing matches', 'recall is low', 'approximate search worse than exact', 'which embedding model', or 'quality dropped after quantization'. Also use when search quality degrades without obvious changes.From its SKILL.md

Install
npx -y skills add github/awesome-copilot --skill diagnosis

Assembled from the repository path, not quoted from the project. Check it against their README if it does not work.

SKILL.md

3.6 KB, 746 tokens by cl100k_base, as published. Nobody here has run it

How to Diagnose Bad Search Quality

Before tuning, establish baselines. Use exact KNN as ground truth, compare against approximate HNSW. Target >95% recall@K for production.

Don't Know What's Wrong Yet

Use when: results are irrelevant or missing expected matches and you need to isolate the cause.

  • Test with exact=true to bypass HNSW approximation Search API
  • Exact search bad = model or search pipeline problem. Exact good, approximate bad = tune HNSW.
  • Check if quantization degrades quality (compare with and without)
  • Check if filters are too restrictive (then you might need to use ACORN)
  • If duplicate results from chunked documents, use Grouping API to deduplicate Grouping

Payload filtering and sparse vector search are different things. Metadata (dates, categories, tags) goes in payload for filtering. Text content goes in sparse vectors for search.

Approximate Search Worse Than Exact

Use when: exact search returns good results but HNSW approximation misses them.

Binary quantization requires rescore. Without it, quality loss is severe. Use oversampling (3-5x minimum for binary) to recover recall. Always test quantization impact on your data before production. Quantization

Wrong Embedding Model

Use when: exact search also returns bad results.

Test top 3 MTEB models on 100-1000 sample queries, measure recall@10. Domain-specific models often outperform general models. Hosted inference

Unoptimized Search Pipeline

Use when: exact search also returns bad results and model choice is confirmed by user.

Optimize search according to advanced search-strategies skill.

What NOT to Do

  • Tune Qdrant before verifying the model is right for the task (most quality issues are model issues)
  • Use binary quantization without rescore (severe quality loss)
  • Set hnsw_ef lower than results requested (guaranteed bad recall)
  • Skip payload indexes on filtered fields then blame quality (HNSW can't traverse filtered-out nodes, and filterable HNSW is built only if payload indexes were set up prior)
  • Deploy without baseline recall or other search relevance metrics (no way to measure regressions)
  • Confuse payload filtering with sparse vector search (different things, different config)

What ships with it

Read from the repository

Just SKILL.md. No reference files, no scripts.

Gives 0 of the 12 instructions most rag retrieval skills give in 746 tokens

Counted across 199 of the 213 authors here whose files we hold, read 2026-09-06

  • Enable caching for frequent queriesin 14 of 199, across 5 files
  • Enable MMR for diverse resultsin 12 of 199, across 5 files
  • Enable binary quantization to reduce memoryin 11 of 199, across 4 files
  • Initialize the database with dimensions matching the embedding modelin 11 of 199, across 4 files
  • Start the similarity threshold at 0.7in 11 of 199, across 4 files
  • Check database statistics when diagnosing slow searchin 11 of 199, across 4 files
  • Export and import vectors as JSONin 10 of 199, across 3 files
  • Match index dimension to the embedding modelin 10 of 199, across 9 files
  • Order filters cheap before expensivein 9 of 199, across 2 files
  • Generate a runnable scaffold in the user's stackin 9 of 199, across 2 files
  • Recommend multi-action scoring when frequent tuning is expectedin 9 of 199, across 2 files
  • Batch store documents for bulk insertsin 9 of 199, across 2 files

Grouped from the skills themselves: near-identical wordings counted once, and counted by distinct author, so one author publishing three of these counts once. Length counted with cl100k_base; the agent that loads this file may tokenize it differently.

Keep looking

Skills are one crate of 325,949. Ordering is by how many stacks a row turns up in, so the top of any crate is what has actually been picked rather than what has the most stars.