scientific-critical-thinking

Evaluate scientific claims using GRADE and Cochrane Risk of Bias frameworks.

783|65|Updated Feb 27, 2026
One-click install
npx skills add https://github.com/LeonChaoX/qinyan-academic-skills --skill scientific-critical-thinking-leonchaox
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: scientific-critical-thinking
Source: https://github.com/LeonChaoX/qinyan-academic-skills/tree/main/skills/04-%E7%A0%94%E7%A9%B6%E6%96%B9%E6%B3%95%E4%B8%8E%E7%A7%91%E5%AD%A6%E6%80%9D%E7%BB%B4/scientific-critical-thinking
Command: npx skills add https://github.com/LeonChaoX/qinyan-academic-skills --skill scientific-critical-thinking-leonchaox

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) components.

What problem does it solve?

This Skill helps you evaluate whether scientific claims are supported by valid, unbiased methodology and whether the evidence quality is strong enough to justify the conclusion.

Core Features & Use Cases

  • Methodology Critique: Assess study design, internal/external/construct/statistical conclusion validity, blinding, control appropriateness, and measurement quality.
  • Bias Detection: Identify cognitive, selection, measurement, analysis, and confounding biases; surface reporting and interpretive red flags.
  • Evidence Quality Assessment: Apply evidence hierarchies and structured frameworks like GRADE and Cochrane Risk of Bias to judge overall credibility.
  • Statistical & Logical Reasoning Review: Check power/sample size, multiple comparisons, p-value interpretation, effect sizes/CI reporting, missing data issues, and common logical fallacies.

Quick Start

Ask the AI to critically appraise a specific paper’s methods, identify the most serious threats to validity and evidence strength using GRADE/ROB logic, and produce a structured critique with actionable improvements.

Frequently Asked Questions about scientific-critical-thinking

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I critically appraise a scientific paper's methodology and bias risk?

To critically appraise methodology and bias risk, evaluate study design, validity threats, and statistical reasoning against structured frameworks like GRADE and Cochrane Risk of Bias. This process identifies methodological flaws and produces structured critiques with actionable improvements.

What is the best way to assess evidence quality using the GRADE framework?

Assessing evidence quality using the GRADE framework involves rating study design, consistency, and statistical validity to grade overall credibility. Applying evidence hierarchies exposes bias and determines if the evidence is strong enough to justify conclusions.

How do I detect selection and measurement bias in observational studies?

Detecting selection and measurement bias in observational studies requires identifying cognitive and confounding biases, analyzing control appropriateness, and checking reporting red flags. Structured appraisal surfaces these validity threats to determine evidence strength.

Can I use critical appraisal to check statistical validity and p-value interpretation?

Yes, you can use critical appraisal to check statistical validity by reviewing power, sample size, multiple comparisons, and p-value interpretation. This logical reasoning review ensures accurate effect size reporting and identifies missing data issues.

Does critical appraisal support peer-review style feedback for grant-writing claims?

Yes, critical appraisal supports peer-review style feedback for grant-writing claims by evaluating experimental literature and construct validity. It assesses whether scientific claims are supported by unbiased methodology and strong evidence quality.

What are the limitations of evidence grading when reviewing systematic reviews?

Evidence grading limitations when reviewing systematic reviews include reliance on reported data quality and the inability to uncover unreported measurement biases. Appraisal effectiveness depends on the transparency of the original study's methodological rigor.