survey-design

Design and validate surveys with Likert scales, attention checks, and reliability metrics.

33|6|Updated Mar 17, 2026
One-click install
npx skills add https://github.com/xjtulyc/awesome-rosetta-skills --skill survey-design-xjtulyc
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: survey-design
Source: https://github.com/xjtulyc/awesome-rosetta-skills/tree/main/skills/00-universal/survey-design
Command: npx skills add https://github.com/xjtulyc/awesome-rosetta-skills --skill survey-design-xjtulyc

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes assets (resource) components.

What problem does it solve?

This Skill helps you design and validate survey instruments so your results are reliable, interpretable, and usable by catching poorly designed items, low-quality responses, and reliability issues before analysis.

Core Features & Use Cases

  • Likert scale construction and scoring guidance: choose response formats, mitigate acquiescence via reverse-scoring, and plan scale structure for good measurement quality.
  • Reliability and quality control: compute ICC (via pingouin) for inter-rater/test-retest agreement and Cronbach’s alpha plus corrected item-total correlations to assess internal consistency.
  • Attention checks and response-quality filtering: detect straight-lining and speedy responders, apply instructed-response-item (IRI) logic, and support clean export workflows for Qualtrics/LimeSurvey data.

Quick Start

Use the survey-design Skill to design a Likert survey, run a pilot with attention checks, calculate ICC and Cronbach’s alpha, and export a cleaned dataset ready for your main study.

Frequently Asked Questions about survey-design

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I calculate Cronbach's alpha and ICC for my Likert scale survey?

To calculate Cronbach's alpha and ICC for Likert scale survey data, the tool computes internal consistency and inter-rater reliability using pingouin. It requires numeric survey item data to perform these reliability metrics and evaluate measurement quality.

How do I detect straight-lining and speedy responders in Qualtrics CSV data?

Detecting straight-lining and speedy responders in Qualtrics CSV data involves applying response-quality filtering and instructed-response-item logic. The tool identifies low-quality responses and supports clean export workflows for Qualtrics and LimeSurvey datasets.

What's the best way to design attention checks for a research questionnaire?

Designing attention checks for a research questionnaire involves embedding instructed-response-item logic into the survey. This approach catches low-quality responses during pilot testing, ensuring interpretable and usable results before main analysis.

Can I use this tool to plan Likert scale construction and pilot testing?

Yes, you can use this tool to plan Likert scale construction and pilot testing. It guides response format selection, mitigates acquiescence via reverse-scoring, and plans scale structure to achieve good measurement quality for your research survey.

Why do I need reverse scoring and item-total correlation filtering for reliability analysis?

Reverse scoring and item-total correlation filtering are needed for reliability analysis to mitigate acquiescence bias and assess internal consistency. Computing corrected item-total correlations helps identify and remove poorly designed items before analysis.

Does the survey validation process work with LimeSurvey CSV exports?

Yes, the survey validation process works with LimeSurvey CSV exports. It supports questionnaire data cleaning and preparation specifically oriented for Qualtrics and LimeSurvey CSV formats to produce a cleaned dataset ready for your main study.