conjoint-diagnostics

Diagnose conjoint studies using a systematic checklist covering design, estimation, and validity.

39|1|Updated Jan 21, 2026
One-click install
npx skills add https://github.com/scdenney/open-science-skills --skill conjoint-diagnostics
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: conjoint-diagnostics
Source: https://github.com/scdenney/open-science-skills/tree/main/plugin/skills/conjoint-diagnostics
Command: npx skills add https://github.com/scdenney/open-science-skills --skill conjoint-diagnostics

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Diagnostics framework that helps research teams evaluate and improve conjoint experiments by systematically identifying design, estimation, measurement error, external validity, and interpretation issues.

Core Features & Use Cases

  • Comprehensive design diagnostics covering attribute/level selection, profile restrictions, number of tasks, randomization, and sampling considerations.
  • Estimation and interpretation guidance focusing on estimand clarity, reference levels, subgroup analysis, standard errors, and multiple testing cautions.
  • Measurement error diagnostics describing IRR, swapping error, bias correction methods, and sensitivity analyses.
  • External validity and reporting guidance addressing profile distributions, forced-choice vs. real-world behavior, and transparent documentation.

Quick Start

Run through the conjoint study checklist, documenting how well design, estimation, measurement error, external validity, and interpretation checks are satisfied.

Frequently Asked Questions about conjoint-diagnostics

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I run diagnostics on a conjoint experiment design?

Conjoint diagnostics systematically evaluate attribute selection, randomization, and task design to identify estimation and external validity issues. The skill applies a structured checklist covering design, measurement error, and interpretation to real or simulated studies.

What is AMCE and how do I check estimand clarity for conjoint analysis?

AMCE estimand clarity is checked by evaluating reference levels, standard errors, and subgroup analysis. The diagnostic framework guides estimation and interpretation to ensure conjoint study results are transparent and correctly specified.

How do I assess measurement error and inter-rater reliability in conjoint studies?

Measurement error diagnostics assess inter-rater reliability (IRR), swapping error, and bias correction methods. The framework applies sensitivity analyses to evaluate how measurement inconsistencies impact conjoint experimental results.

Can I use this diagnostic checklist for simulated conjoint studies?

Yes, the diagnostic checklist applies to both real and simulated conjoint studies. It systematically evaluates profile restrictions, sampling considerations, forced-choice validity, and reporting contexts across simulated attributes and levels.

What external validity checks should I use for forced-choice conjoint tasks?

External validity checks address profile distributions and the gap between forced-choice tasks and real-world behavior. The diagnostic framework evaluates reporting transparency to ensure conjoint experimental interpretations match real-world contexts.

Why do my conjoint diagnostics flag multiple testing and subgroup analysis issues?

Conjoint diagnostics flag multiple testing issues to caution against misinterpreting subgroup analysis. The framework enforces standard error evaluation and estimand clarity, providing a final evaluation summary of interpretation risks.