claim-evidence-alignment

Aligns research claims with evidence that measures exactly what each claim asserts.

1|Updated Aug 14, 2026
One-click install
npx skills add https://github.com/zhiyuan-zhang0206/Ava --skill claim-evidence-alignment-zhiyuan-zhang0206
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: claim-evidence-alignment
Source: https://github.com/zhiyuan-zhang0206/Ava/tree/main/ava_builtins/skills/ava-serious-research/principles/claim-evidence-alignment
Command: npx skills add https://github.com/zhiyuan-zhang0206/Ava --skill claim-evidence-alignment-zhiyuan-zhang0206

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve? Research conclusions often rest on metrics that do not actually measure what the claim asserts, numbers that cannot be traced to a concrete run, or citations that were never verified. This Skill enforces a warrant check between every claim and its evidence so conclusions, metrics, and citations stay aligned. ## Core Features & Use Cases - Metric-claim warrant checks: For every metric, explicitly state what it measures, why it supports the claim, and what it does not support, catching metric substitution such as claiming robustness while reporting accuracy. - Traceable numbers and citations: Require every key number to carry a run record, log, or config path, and verify every citation for existence and retraction status before it enters the record. - Uncertainty and scope discipline: Attach variance, replication counts, and matched statistical tests to point estimates, and scope conclusions to the evidence's distribution with external validation for generalization claims. - Use Case: When writing the results section of an ML paper, use this Skill to verify that each conclusion names its metric's warrant, traces to a logged run, reports mean±std across seeds, and avoids out-of-distribution generalization. ## Quick Start Review my results section and check whether every claim is supported by evidence that actually measures what the claim asserts.

Frequently Asked Questions about claim-evidence-alignment

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I check whether a metric supports my research claim?▼

Write an explicit warrant for each metric: state what it measures, why that supports the claim, and what it does not support. For example, F1 measuring minority-class recall supports a low-miss-rate claim but not an overall-accuracy claim.

What is metric substitution in machine learning evaluation?▼

Metric substitution is claiming one property while reporting a metric that measures another, such as claiming robustness while reporting accuracy. It is caught by checking whether the measured object is isomorphic to what the claim asserts.

How should I report experimental numbers with uncertainty?▼

Repeat experiments across seeds and report mean±std with the replication count. Use a statistical test matched to the comparison type, such as McNemar or 5x2cv F for paired designs on the same test set, and label n=1 results honestly.

How do I verify citations before including them in a paper?▼

Verify each citation's existence via DOI or arXiv, confirm authors, and check retraction status before citing. Record the verification in your notes and trace secondary-source quotes back to the primary source.

When do research conclusions overgeneralize beyond the evidence?▼

Conclusions overgeneralize when they exceed the data distribution and setup of the experiments, often inflated by leakage. Attach a distribution statement to each conclusion and require external validation for generalization claims.