weicheng avatar

weicheng

Community

@weichengz0616

1Followers
|
10Public Repos
|
7Published Skills

Engineering discipline for FLA (flash-linear-attention) GPU kernel development: Triton/Gluon/TileLang optimization, correctness testing, backend dispatch, and MR readiness.

Skills Distribution
DomainAI Models & ...GPU Kernel Optimiz.. (40%)Kernel Correctness.. (25%)Code Review & MR G.. (20%)Linear Attention O.. (15%)

Agent Skills by weicheng

Showing 7 vetted skills indexed across 1 GitHub repositories.

Frequently Asked Questions About weicheng

FAQPage Schema
What tasks can I accomplish with weicheng's FLA skills?▼

You can optimize FLA GPU kernels (Triton, Gluon, TileLang, CuTe) through a disciplined multi-round loop, port Triton kernels to Gluon, manage backend dispatch decorators and BaseBackend subclasses, work on KDA gate modes and chunk kernels, add correctness tests, and prepare MR-ready benchmark evidence.

Who are these FLA skills designed for?▼

GPU kernel engineers and contributors to the flash-linear-attention repository who modify fla/ops/** code, review KDA kernels, run NVIDIA performance profiling, or need reproducible optimization workflows that never break or game correctness gates.

How does the FLA optimization loop guarantee correctness?▼

It anchors every iteration on FLA's frozen pytest suite covering both forward and backward passes under NaN poisoning as the immutable correctness gate, combined with a task-contract, three-phase iteration protocol, and a silent-bug catalog drawn from kernel-optimization frameworks like KDA and FlashInfer contests.

When should I port a Triton kernel to Gluon?▼

Port when a kernel is register-bound, when num_stages pipelining underperforms, or when you need Hopper/Blackwell features like TMA, TMEM, or tcgen05. The skill provides an incremental sequence preserving numerical parity, a Triton-to-Gluon API mapping, and pitfalls covering proxy fences, mbarriers, and smem budgets.

What prerequisites and dependencies do these skills require?▼

You need the FLA repository with its pytest suite, Triton and optionally Gluon (triton.experimental.gluon), TileLang or CuTe for alternative backends, and NVIDIA GPU access. Detailed profiling uses an installed ncu-report-skill for Nsight Compute collection and diagnosis.