amstar2-review-appraisal

Appraises systematic reviews with the 16-item AMSTAR 2 checklist and derives overall confidence ratings.

4|1|Updated Jul 30, 2026
One-click install
npx skills add https://github.com/radarist/structured-analytic-skills --skill amstar2-review-appraisal-radarist
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: amstar2-review-appraisal
Source: https://github.com/radarist/structured-analytic-skills/tree/main/skills/amstar2-review-appraisal
Command: npx skills add https://github.com/radarist/structured-analytic-skills --skill amstar2-review-appraisal-radarist

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and references (resource) components.

What problem does it solve? Deciding whether a published systematic review or meta-analysis can be trusted requires a structured, defensible method rather than gut feel. This Skill applies AMSTAR 2 (Shea et al., BMJ 2017) to answer the 16 checklist items from the review's report, flag flaws in the seven critical domains, and derive the overall confidence rating — High, Moderate, Low, or Critically low — without ever summing items into a score. ## Core Features & Use Cases - Full 16-item appraisal: Answers every item with Yes / Partial Yes / No (or "No meta-analysis conducted" for items 11, 12, 15), quoting the evidence from the report, with Partial Yes restricted to items 2, 4, 7, 8, 9. - Mechanical Box 2 rating: Classifies critical flaws versus non-critical weaknesses against pre-specified critical domains (default items 2, 4, 7, 9, 11, 13, 15) and derives the confidence rating with an explicit rule trace. - Deterministic companion tool: scripts/amstar2.py (Python standard library only) validates answers, counts flaws, applies the Partial Yes convention, and prints the rating with warnings — removing counting slips while leaving judgement to the appraiser. - Use Case: Before citing a meta-analysis of remote-work productivity in a board memo, run the appraisal to discover unlisted excluded studies and uninvestigated publication bias, yielding a Critically low rating that tells you to verify the primary trials first. ## Quick Start Ask the AI to appraise the attached systematic review with AMSTAR 2 and report the overall confidence rating with per-item evidence.

Frequently Asked Questions about amstar2-review-appraisal

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I appraise a systematic review with AMSTAR 2?▼

Record the review's citation, type, and PICO, pre-specify the critical domains (default items 2, 4, 7, 9, 11, 13, 15) and the Partial Yes convention, then answer all 16 items from the report with quoted evidence. Classify each No in a critical domain as a critical flaw and derive the overall confidence rating from the Box 2 rules.

Which AMSTAR 2 items are critical domains?▼

The seven default critical domains from Box 1 are items 2 (protocol), 4 (search), 7 (excluded studies list), 9 (risk-of-bias assessment), 11 (pooling methods), 13 (RoB in interpretation), and 15 (publication bias). Appraisers may add or substitute domains, but must fix the list before answering.

What is the difference between AMSTAR 2 and GRADE?▼

AMSTAR 2 appraises the methodological quality of one systematic review and yields a confidence rating in that review's conduct. GRADE rates the certainty of a body of evidence per outcome across studies. Use AMSTAR 2 first to decide if a review is trustworthy, then GRADE its findings.

Can AMSTAR 2 be used for a single randomized trial?▼

No, AMSTAR 2 appraises systematic reviews, not primary studies. For a single randomized trial use the Cochrane RoB 2 tool, and for non-randomized studies use ROBINS-I; the companion skill assess-study-bias covers both.

Does AMSTAR 2 produce a numeric score?▼

No, the authors explicitly recommend against summing item ratings into a score. The instrument produces one of four overall confidence ratings — High, Moderate, Low, or Critically low — derived from counts of critical flaws and non-critical weaknesses.

How is a Partial Yes answer counted in AMSTAR 2?▼

The paper introduces Partial Yes for items 2, 4, 7, 8, and 9 but never weights it, so the appraisal team must pre-specify the convention. The default here treats it as a non-critical weakness; a strict convention counts it as a critical flaw in critical domains, and the chosen convention must be reported.