vllm-ascend-model-adapter

Adapt and validate models for vLLM on Ascend hardware with a signed commit.

3|17|Updated Mar 21, 2026
One-click install
npx skills add https://github.com/vLLM-HUST/vllm-ascend-hust --skill vllm-ascend-model-adapter-vllm-hust
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: vllm-ascend-model-adapter
Source: https://github.com/vLLM-HUST/vllm-ascend-hust/tree/main/.agents/skills/vllm-ascend-model-adapter
Command: npx skills add https://github.com/vLLM-HUST/vllm-ascend-hust --skill vllm-ascend-model-adapter-vllm-hust

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Adapt and debug existing or new models for vLLM on Ascend NPU. Implement in /vllm-workspace/vllm and /vllm-workspace/vllm-ascend, validate via direct vllm serve from /workspace, and deliver one signed commit in the current repo.

Core Features & Use Cases

  • Adapt Hugging Face or local models to run on vLLM Ascend with minimal changes and deterministic validation.
  • Validate model integration via vllm serve from /workspace and sign off with a single commit in the repo.

Quick Start

Run the two-stage serve workflow from /workspace using the provided model path and default port to validate startup and a smoke request.

Frequently Asked Questions about vllm-ascend-model-adapter

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I adapt a Hugging Face model to run on vLLM Ascend?▼

Model adaptation for vLLM Ascend is automated by implementing minimal code changes in /vllm-workspace/vllm and /vllm-workspace/vllm-ascend, validated through deterministic testing via vllm serve on port 8000.

What is the two-stage validation workflow for vLLM model adaptation?▼

The two-stage validation workflow for vLLM model adaptation first tests startup and smoke requests using dummy weights, then validates with real weights before delivering a single signed commit.

How do I validate model integration on Ascend hardware using vllm serve?▼

Validate model integration on Ascend hardware by starting vllm serve directly from /workspace on port 8000, which executes deterministic testing to confirm the adapted model runs correctly on Ascend NPU.

Does vLLM model adaptation for Ascend require manual commit signing?▼

No, vLLM model adaptation for Ascend automates the delivery process by requiring minimal code changes and producing an auditable final delivery with a single signed commit in the current repository.

Can I debug a new model for vLLM on Ascend NPU with deterministic testing?▼

Yes, you can debug new models for vLLM on Ascend NPU using deterministic testing, which validates the adaptation through direct vllm serve from /workspace before signing off the commit.