agentsclimarketplace

Survey instrument verification

Skill fabioc-aloha/Alex_Skill_Mall/plugins/academic-research/survey-instrument-verification

Manuscripts evolve terminology that may not match what was actually administered:From its SKILL.md

Install
npx -y skills add fabioc-aloha/Alex_Skill_Mall --skill survey-instrument-verification

Assembled from the repository path, not quoted from the project. Check it against their README if it does not work.

2 things to look at

  • 4 stars4 stars. Stars are a popularity signal and not a quality one, but at this level it is likely that nobody has read this closely except its author, and you would be relying on your own review.
  • runs commandsInstructs the agent to run 1 command, including `diff manuscript-appendix.txt original-survey.txt`.

SKILL.md

2.2 KB, 424 tokens by cl100k_base, as published. Nobody here has run it

Survey Instrument Verification

The Problem

Manuscripts evolve terminology that may not match what was actually administered:

Manuscript says: "We measured perceived safety using a 5-point scale"
Raw data shows: 7-point scale with different anchors

Manuscript says: "Participants rated their agreement with 12 items"
Raw data shows: 14 items (2 were dropped but not documented)

The Solution

Before editing survey-related content, verify against raw data.

1. Check Scale Parameters

Manuscript ClaimsVerify In Data
Number of pointsActual min/max values
Anchor labelsCodebook or data dictionary
Number of itemsCount of columns/variables
Response optionsUnique values in data

2. Verify Item Wording

Manuscript Appendix: "How safe do you feel walking at night?"
Actual survey item: "How safe do you feel walking alone at night?"
                                         ^^^^^
                                    Missing word!

Compare exact wording:

  • Survey instrument file (if available)
  • Qualtrics/SurveyMonkey export
  • IRB-approved protocol

3. Check for "Exactly As Administered" Claims

If an appendix claims "items shown exactly as administered":

# Line-by-line comparison
diff manuscript-appendix.txt original-survey.txt

This claim is a testable hypothesis — test it.

Verification Checklist

  • Scale points match (5-point? 7-point? Likert?)
  • Anchor labels match ("Strongly agree" vs "Completely agree")
  • Item count matches (after exclusions?)
  • Item wording is verbatim (if claimed)
  • Response coding matches (1-5 vs 0-4)

When to Apply

  • Editing methods sections describing surveys
  • Reviewing appendices with survey items
  • Any manuscript with quantitative survey data

Tags

academic surveys verification data-quality

Keep looking

Skills are one crate of 325,949. Ordering is by how many stacks a row turns up in, so the top of any crate is what has actually been picked rather than what has the most stars.