paper-eval-report

Evaluates research papers against reporting guidelines and generates academic Word reports.

Updated Feb 12, 2026
One-click install
npx skills add https://github.com/qmakescl/QSkills --skill paper-eval-report-qmakescl
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: paper-eval-report
Source: https://github.com/qmakescl/QSkills/tree/main/plugins/paper-eval-report/skills/paper-eval-report
Command: npx skills add https://github.com/qmakescl/QSkills --skill paper-eval-report-qmakescl

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires pdfplumber, python-docx, docx, pytesseract, and includes references (resource) components.

What problem does it solve? Manually assessing a research paper against international reporting and quality guidelines (PRISMA, CONSORT, STROBE, GRADE, etc.) and formatting the results into a formal academic document is slow and error-prone. This Skill automates the full pipeline from paper ingestion to a finished Word report. ## Core Features & Use Cases - Automatic Study Design Identification: Reads PDF or DOCX papers and classifies the research design (systematic review, RCT, cohort, diagnostic accuracy, case report) using a decision tree, with mandatory user confirmation. - Guideline-Based Appraisal: Applies the correct reporting guideline (PRISMA, CONSORT, STROBE, STARD, CARE) and risk-of-bias tool (RoB 2.0, ROBINS-I, QUADAS-2, NOS, AMSTAR 2), scoring each item as Yes/Partial/No/N/A with compliance rates. - GRADE Certainty Rating: Performs GRADE evidence certainty grading for systematic reviews and meta-analyses. - Word Report Generation: Outputs the full evaluation as an academic-style .docx document via a Node.js script. - Use Case: A researcher uploads a clinical trial PDF and asks for a CONSORT compliance check; the Skill identifies the design, appraises every checklist item, and delivers a formatted Evaluation_Report.docx. ## Quick Start Evaluate this paper PDF against the appropriate reporting guideline and generate the results as a Word document.

Frequently Asked Questions about paper-eval-report

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I evaluate a research paper against PRISMA or CONSORT guidelines?▼

Provide the paper as a PDF or DOCX file and request an evaluation. The Skill identifies the study design, loads the matching guideline checklist, judges each item as Yes, Partial, No, or N/A, and computes compliance rates with improvement suggestions.

How to generate a Word report from a paper quality assessment?▼

After the appraisal, the Skill writes the results as report_data.json and runs a Node.js script using the docx npm package to produce Evaluation_Report.docx. You need Node.js installed and must run npm install docx in the references folder first.

What study designs and risk of bias tools are supported?▼

Supported designs include systematic reviews, scoping reviews, RCTs, cohort, case-control, cross-sectional, diagnostic accuracy, and case reports. Tools include PRISMA, CONSORT, STROBE, STARD, CARE, AMSTAR 2, RoB 2.0, ROBINS-I, QUADAS-2, NOS, and GRADE.

Does GRADE certainty rating apply to all paper types?▼

No, GRADE evidence certainty grading is performed only for systematic reviews and meta-analyses. It starts from High for RCT evidence or Low for observational evidence, then applies five downgrading domains and optional upgrading criteria.

Why does PDF text extraction fail for some papers?▼

Extraction fails when the PDF is a scanned image without a text layer. In that case the Skill indicates OCR is needed and attempts text recognition with pytesseract before continuing the evaluation.