scientific-critical-thinking

Evaluate scientific claims, study methodology, and evidence quality using GRADE and Cochrane frameworks.

Updated Mar 23, 2026
One-click install
npx skills add https://github.com/hanasho744/codex --skill scientific-critical-thinking-hanasho744
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: scientific-critical-thinking
Source: https://github.com/hanasho744/codex/tree/main/.agents/skills/scientific-critical-thinking
Command: npx skills add https://github.com/hanasho744/codex --skill scientific-critical-thinking-hanasho744

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) components.

What problem does it solve? Researchers, reviewers, and analysts often need to judge whether a scientific claim is actually supported by its evidence. This Skill provides a systematic framework for critiquing methodology, detecting biases, evaluating statistics, and grading evidence quality instead of relying on intuition. ## Core Features & Use Cases - Methodology and Design Critique: Assess internal, external, construct, and statistical conclusion validity, including randomization, blinding, controls, and confounding. - Bias and Fallacy Detection: Identify cognitive, selection, measurement, and analysis biases (p-hacking, HARKing, publication bias) plus 40 named logical fallacies with detection strategies. - Evidence Grading: Apply the GRADE system, Cochrane Risk of Bias, ROBINS-I, and the traditional evidence hierarchy to rate confidence in findings. - Use Case: When reviewing a preprint claiming a supplement improves memory, use this Skill to check the study's power, control group adequacy, selective reporting, and whether causal language is justified by the correlational design. ## Quick Start Ask the AI to critically evaluate the methodology and evidence quality of an attached research paper using the scientific-critical-thinking skill.

Frequently Asked Questions about scientific-critical-thinking

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I critically evaluate a research paper's methodology?▼

Assess study design appropriateness, internal validity (randomization, blinding, confounding), external validity (sample representativeness), and statistical conclusion validity (power, test assumptions). The skill structures feedback into strengths, concerns by severity, and specific recommendations.

What is the GRADE system for evidence quality assessment?▼

GRADE rates evidence as high, moderate, low, or very low quality. RCTs start high and are downgraded for risk of bias, inconsistency, indirectness, imprecision, or publication bias; observational studies can be upgraded for large effects or dose-response relationships.

How do I detect p-hacking and HARKing in published studies?▼

Look for p-values clustering just below .05, undisclosed analyses, many researcher degrees of freedom, and hypotheses presented as a priori without preregistration. Compare published outcomes against trial registry entries to spot outcome switching.

When should I use this skill instead of writing a formal peer review?▼

Use this skill for evaluating evidence quality, identifying methodological flaws, and teaching critical analysis. For drafting formal peer review reports with journal-specific structure, the documentation points to the separate peer-review skill.

Does this skill require network access or API keys?▼

No. The analytical guidance works entirely offline. Network access and an OPENROUTER_API_KEY are only needed if you optionally generate diagrams through the separate scientific-schematics skill.