scientific-critical-thinking

Evaluate scientific claims, study methodology, and evidence quality using GRADE and Cochrane frameworks.

Updated Oct 7, 2022
One-click install
npx skills add https://github.com/tamagusko/linux-cfg --skill scientific-critical-thinking-tamagusko
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: scientific-critical-thinking
Source: https://github.com/tamagusko/linux-cfg/tree/main/dotfiles/claude/skills/scientific-critical-thinking
Command: npx skills add https://github.com/tamagusko/linux-cfg --skill scientific-critical-thinking-tamagusko

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) components.

What problem does it solve? Researchers, reviewers, and students often struggle to systematically assess whether a study's conclusions are actually supported by its methods and data. This Skill provides structured frameworks for critiquing experimental design, detecting biases, evaluating statistics, and grading evidence quality. ## Core Features & Use Cases - Methodology and Design Critique: Assess internal, external, construct, and statistical conclusion validity, plus randomization, blinding, and control adequacy. - Bias and Fallacy Detection: Identify cognitive, selection, measurement, and analysis biases (p-hacking, HARKing, publication bias) and name specific logical fallacies in scientific arguments. - Evidence Grading: Apply the GRADE system, Cochrane Risk of Bias, and evidence hierarchies to weigh conflicting findings and calibrate confidence in conclusions. - Use Case: When reviewing a manuscript claiming a supplement improves memory, use this Skill to check the randomization procedure, sample size justification, outcome reporting, and whether causal language is justified by the correlational design. ## Quick Start Ask the AI to critically evaluate the methodology and evidence quality of an attached research paper using the scientific-critical-thinking skill.

Frequently Asked Questions about scientific-critical-thinking

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I evaluate the quality of a research paper?

Assess study design appropriateness, internal validity (randomization, blinding, confounding control), statistical rigor (power, test assumptions, multiple comparisons), and whether conclusions match the data. Frameworks like GRADE and Cochrane Risk of Bias provide structured criteria for this evaluation.

What is the GRADE system for evidence assessment?

GRADE rates evidence quality as high, moderate, low, or very low. RCTs start high and observational studies start low, then ratings are downgraded for risk of bias, inconsistency, indirectness, imprecision, or publication bias, and upgraded for large effects or dose-response relationships.

How do I detect p-hacking and HARKing in studies?

Check for preregistration and compare published outcomes against registered protocols. Red flags include p-values clustered just below .05, undisclosed subgroup analyses, outcome switching, and hypotheses presented as a priori that were formed after seeing results.

Can observational studies ever provide strong evidence?

Yes. Well-designed observational studies with large effect sizes, dose-response relationships, consistent replication across settings, and no plausible confounders can outweigh poorly conducted RCTs. The evidence hierarchy ranks design types, but execution quality matters more than category.

When should I use this instead of writing a formal peer review?

Use this Skill for understanding evidence quality, identifying methodological flaws, and learning critical analysis. For drafting formal peer review reports with structured reviewer comments, the description directs you to a dedicated peer-review skill instead.