ai-hallucination-fact-check-protocol

Generates an AI-adapted SIFT fact-checking protocol for verifying LLM-generated citations and statistics.

Updated Apr 13, 2026
One-click install
npx skills add https://github.com/xiaoshan1234/ai-skill --skill ai-hallucination-fact-check-protocol-xiaoshan1234
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: ai-hallucination-fact-check-protocol
Source: https://github.com/xiaoshan1234/ai-skill/tree/main/role/english-teacher/skills/ai-hallucination-fact-check-protocol
Command: npx skills add https://github.com/xiaoshan1234/ai-skill --skill ai-hallucination-fact-check-protocol-xiaoshan1234

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve? Students increasingly use AI chatbots that produce fluent, authoritative-sounding text containing fabricated citations, invented statistics, and misattributed studies. Standard source-evaluation frameworks like SIFT assume an institutional author that can be investigated, which breaks down for LLM output, leaving students without a workable verification method. ## Core Features & Use Cases - Hallucination Taxonomy: Identifies the hallucination types most likely in a given subject and output type, with examples and verification moves for each. - AI-Adapted SIFT Protocol: Replaces "Investigate the source" with claim-type identification and source reconstruction moves tailored to LLM output. - Classroom Activity and Modelling Script: Produces a Hallucination Hunt activity and a teacher think-aloud script demonstrating real versus fabricated citations. - Use Case: A Year 11 psychology teacher whose students used ChatGPT for a research summary receives a protocol to verify a cited "Twenge 2021 JAMA Psychiatry" study and its claimed 47% statistic. ## Quick Start Ask the AI to design a fact-checking protocol for students verifying a ChatGPT research summary with named citations, specifying the student year group and subject area.

Frequently Asked Questions about ai-hallucination-fact-check-protocol

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I teach students to fact-check AI-generated citations?▼

Use source reconstruction: search Google Scholar for the cited author, journal, and year to confirm the paper exists, then read the abstract to verify it says what the AI claims. The protocol provides step-by-step verification moves for citations, statistics, and expert quotes.

What is the SIFT method for evaluating online sources?▼

SIFT stands for Stop, Investigate the source, Find better coverage, and Trace claims, developed by Caulfield (2019) from lateral reading research. This protocol adapts it for AI output by replacing source investigation with claim-type identification and source reconstruction.

What types of hallucinations do AI chatbots produce?▼

Common types include fabricated citations with real authors and journals, invented statistics with plausible precision, real studies misattributed to wrong authors or years, and false consensus claims. The taxonomy is based on Ji et al.'s (2023) survey of hallucination in natural language generation.

Does this fact-checking protocol work for all subjects?▼

Yes, the protocol adapts its hallucination taxonomy to the subject area provided, since hallucination patterns differ by discipline. It is less reliable for niche or cutting-edge topics where hallucination rates are higher and verification sources are scarcer.

What are the limitations of AI hallucination detection for students?▼

Full verification takes 3-5 minutes per citation and requires database access, so exhaustive checking is impractical. Subtle errors like real studies applied to wrong populations require reading methods sections, which may exceed students' independent academic reading skills.