hugging-face-evaluation
CommunityManage Hugging Face model evaluations.
Author3kpro
Version1.0.0
Installs0
System Documentation
What problem does it solve?
This Skill streamlines the process of adding and managing evaluation results for Hugging Face models, ensuring accurate and discoverable performance metrics.
Core Features & Use Cases
- Automated Evaluation Updates: Extract evaluation tables from READMEs, import scores from Artificial Analysis, or run custom evaluations.
- Model-Index Integration: Automatically updates
model-index.jsonfor leaderboards and compatibility. - Use Case: A researcher wants to add benchmark scores from a new paper to their model card on Hugging Face. They can use this Skill to parse the scores from their README and create a pull request to update the model card.
Quick Start
Use the hugging-face-evaluation skill to extract evaluation tables from the model's README.
Dependency Matrix
Required Modules
huggingface-hubmarkdown-it-pypython-dotenvpyyamlrequestsinspect-aiinspect-evalsopenaivllmtorchtransformersaccelerate
Components
scriptsreferences
💻 Claude Code Installation
Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.
Please help me install this Skill: Name: hugging-face-evaluation Download link: https://github.com/3kpro/aiarsenal/archive/main.zip#hugging-face-evaluation Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
Agent Skills Search Helper
Install a tiny helper to your Agent, search and equip skill from 223,000+ vetted skills library on demand.