S02-来源数据分析

Analyzes bibliographic datasets to profile field completeness, document types, languages, and year distributions.

Updated May 18, 2026
One-click install
npx skills add https://github.com/heyixue511-creator/ai --skill s02-heyixue511-creator
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: S02-来源数据分析
Source: https://github.com/heyixue511-creator/ai/tree/main/My-Own-Skills-main/%E6%96%87%E7%8C%AE%E8%AE%A1%E9%87%8F%E5%88%86%E6%9E%90%E6%8A%80%E8%83%BD/S02-%E6%9D%A5%E6%BA%90%E6%95%B0%E6%8D%AE%E5%88%86%E6%9E%90
Command: npx skills add https://github.com/heyixue511-creator/ai --skill s02-heyixue511-creator

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve? Before cleaning a bibliographic dataset exported from platforms like Web of Science or Scopus, researchers need to know what the data actually contains: how many records exist, which fields are missing, what document types and languages are present, and whether duplicates or retracted papers lurk inside. This Skill performs a full structural scan and produces a data profile report answering those questions. ## Core Features & Use Cases - Field Completeness Audit: Counts populated versus missing values for every field and classifies fields as core, key, auxiliary, index, or redundant. - Distribution Analysis: Reports document type, language, and publication year distributions, flagging non-English homograph noise and anomalous years. - Quality & Duplicate Detection: Identifies exact duplicates by UT/DOI/PMID, near-duplicates by title similarity, empty or truncated records, and retraction or correction markers. - Use Case: After S01 detects that a file is a Web of Science plain-text export, run this Skill to generate a data analysis report showing 95% abstract completeness, 12 duplicate records, and 3 retracted articles before proceeding to cleaning. ## Quick Start Analyze the bibliographic data file at the given path and generate a full data profile report covering field completeness, document types, languages, years, and duplicates.

Frequently Asked Questions about S02-来源数据分析

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I profile a bibliographic dataset before cleaning it?▼

Run a full-record scan that counts total records, measures per-field completeness, and reports document type, language, and year distributions. This Skill produces a structured data analysis report with a cleaning-readiness assessment.

How to detect duplicate records in Web of Science or Scopus exports?▼

Detect exact duplicates by matching unique identifiers such as UT, DOI, or PMID, and flag suspected duplicates when title similarity exceeds 90% with the same publication year. Early Access and formal versions of the same paper should also be checked.

Why do non-English papers cause noise in bibliometric analysis?▼

Non-English literature introduces homograph noise, such as French 'même', Turkish 'meme' meaning breast, or Indonesian 'meme-' prefixed words. The language distribution step flags these languages so search-term false positives can be handled.

What should I do with retracted or corrected papers in a literature dataset?▼

Flag records whose titles contain 'Retracted', 'WITHDRAWN', 'Erratum', or 'Corrigendum', or whose document type is Correction. Retraction markers must propagate to the original paper, and users decide whether to exclude them before cleaning.

Can this analysis handle very large bibliographic export files?▼

Yes. Large files are processed with a chunked reading strategy from the companion long-text reading skill, ensuring full coverage of every record rather than sampling only the beginning of the file.