evidence-appraisal

Rates certainty of a body of evidence per outcome using the GRADE methodology.

4|1|Updated Jul 30, 2026
One-click install
npx skills add https://github.com/radarist/structured-analytic-skills --skill evidence-appraisal-radarist
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: evidence-appraisal
Source: https://github.com/radarist/structured-analytic-skills/tree/main/skills/evidence-appraisal
Command: npx skills add https://github.com/radarist/structured-analytic-skills --skill evidence-appraisal-radarist

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) components.

What problem does it solve? When studies conflict or a single exciting trial dominates the conversation, decision-makers lack a disciplined way to say how much trust a whole body of evidence deserves. This Skill applies the published GRADE method (Guyatt et al., 2008; GRADE Handbook, 2013) to rate certainty per outcome — high, moderate, low, or very low — with every downgrade or upgrade tied to a named reason. ## Core Features & Use Cases - Per-outcome GRADE rating: Frames a PICO, starts randomized bodies at High and observational bodies at Low, then applies the five rate-down factors (risk of bias, inconsistency, indirectness, imprecision, publication bias) and three rate-up factors (large effect, dose-response, opposing residual confounding) with explicit reasons. - Deterministic companion tool: scripts/grade.py (standard library only) performs the rating arithmetic, clamps to the four-level scale, prints summary-of-findings rows, and warns when rating up meets rating down or randomized evidence. - Calibrated communication: Produces GRADE-language certainty statements, bans words like "proven" and "no evidence", and names the surveillance trigger — the new evidence that would change the grade. - Use Case: A health researcher has five RCTs of CBT-I versus sleep-hygiene education with conflicting effect sizes. The Skill grades the body per outcome, producing a summary-of-findings row (e.g., ⊕⊕◯◯ Low, −1 inconsistency, −1 imprecision) and a calibrated statement for the recommendation. ## Quick Start Ask the assistant to GRADE the certainty of the evidence for your question, providing the assembled study set with per-study risk-of-bias ratings and any pooled effect estimates.

Frequently Asked Questions about evidence-appraisal

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I GRADE the certainty of evidence for a body of studies?▼

Frame a PICO and rank outcomes, assemble the study set, appraise each study with RoB 2 or ROBINS-I, then start randomized bodies at High and observational bodies at Low. Apply the five rate-down and three rate-up factors with reasons, and report the final level per outcome.

What is the difference between GRADE and RoB 2 risk of bias assessment?▼

RoB 2 assesses bias in a single randomized study, while GRADE rates the certainty of an entire body of evidence per outcome. Per-study RoB 2 or ROBINS-I ratings are inputs to GRADE's risk-of-bias rate-down factor, not a substitute for it.

When can observational evidence be rated up in GRADE?▼

Observational bodies can be rated up for a large effect (RR >2 or <0.5), a very large effect (RR >5 or <0.2), a dose-response gradient, or residual confounding working against the observed effect. Rating up is considered only after rating down and is exceptional for randomized evidence.

Does the grade.py companion tool require external Python packages?▼

No, the script uses only the Python standard library and runs on Python 3.9 or later. It performs the rating arithmetic, summary-of-findings table generation, and self-tests without any third-party dependencies.

When should I not use GRADE evidence appraisal?▼

Do not use it for a single study's bias assessment (use RoB 2 or ROBINS-I), for non-study sources like articles or datasets (use Admiralty source grading), or before the study set is assembled through a systematic review. GRADE rates bodies of evidence, not individual documents.