scholar-evaluation

Evaluate scholarly work across multiple quality dimensions using the ScholarEval framework.

1|Updated Jan 26, 2026
One-click install
npx skills add https://github.com/Victory-Hugo/S2-Agent-Skill --skill scholar-evaluation-victory-hugo
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: scholar-evaluation
Source: https://github.com/Victory-Hugo/S2-Agent-Skill/tree/main/skills/writing/scholar-evaluation
Command: npx skills add https://github.com/Victory-Hugo/S2-Agent-Skill --skill scholar-evaluation-victory-hugo

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and references (resource) components.

What problem does it solve?

ScholarEval provides a rigorous, repeatable framework to evaluate scholarly work across multiple quality dimensions, enabling objective feedback, structured improvement guidance, and publication-ready insights.

Core Features & Use Cases

  • Dimension-based assessment across problem formulation, literature review, methodology, data collection, analysis, results, writing, and citations.
  • Automated reporting: generates both qualitative feedback and a quantitative overall score; supports comparison across drafts.
  • Use Case: Evaluate a research paper, a grant proposal, or a literature review to identify gaps, strengths, and actionable revisions, then generate a balanced feedback report.

Quick Start

  1. Prepare a scores.json containing dimension scores (keys: problem_formulation, literature_review, methodology, data_collection, analysis, results, writing, citations) with values 1-5.
  2. Run: python scripts/calculate_scores.py --scores scores.json
  3. (Optional) Provide custom weights: python scripts/calculate_scores.py --scores scores.json --weights weights.json --output report.txt
  4. Review the generated report on stdout or in report.txt. For interactive scoring, run: python scripts/calculate_scores.py --interactive

Frequently Asked Questions about scholar-evaluation

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I evaluate a research paper across multiple quality dimensions?▼

Evaluating a research paper requires scoring dimensions like problem formulation, methodology, data collection, and citations from 1-5. The framework then calculates a weighted score and generates structured qualitative feedback.

What is ScholarEval framework assessment for academic writing?▼

ScholarEval framework assessment for academic writing is a systematic method to provide structured, multi-dimension evaluations. It identifies gaps, strengths, and actionable revisions to generate publication-ready insights and balanced feedback reports.

How do I generate a weighted evaluation report for a literature review?▼

To generate a weighted evaluation report for a literature review, prepare a scores.json file with dimension ratings, then run the calculation script with custom weights. The tool outputs both a quantitative score and qualitative feedback to stdout or a text file.

Can I use this academic evaluation framework for grant proposals?▼

Yes, this academic evaluation framework supports grant proposals. It systematically assesses proposals across dimensions like problem formulation, methodology, and data collection to identify gaps and provide actionable revision guidance.

Do I need to prepare a scores file before running the scholarly evaluation script?▼

Yes, you need to prepare a scores.json file containing dimension scores from 1-5 before running the script. Alternatively, you can run the calculation script in interactive mode to input scores directly without predefining a file.

What are the limitations of automated methodology assessment for scholarly work?▼

Automated methodology assessment limitations include relying on manual dimension scoring from 1-5 rather than autonomous reading. The framework requires pre-populated scores to calculate weighted results, meaning users must manually evaluate the text beforehand.