weicheng avatar

weicheng

Community

@weichengz0616

1Followers
|
10Public Repos
|
7Published Skills

Engineering discipline for FLA (flash-linear-attention) GPU kernel development: Triton/Gluon/TileLang optimization, correctness testing, backend dispatch, and MR readiness.

Skills Distribution
DomainAI Models & ...GPU Kernel Optimiz.. (40%)Kernel Correctness.. (25%)Code Review & MR G.. (20%)Linear Attention O.. (15%)

Agent Skills by weicheng

Showing 7 vetted skills indexed across 1 GitHub repositories.

Frequently Asked Questions About weicheng

FAQPage Schema
What tasks can I accomplish with weicheng's FLA skills?

You can optimize FLA GPU kernels (Triton, Gluon, TileLang, CuTe) through a disciplined multi-round loop, port Triton kernels to Gluon, manage backend dispatch decorators and BaseBackend subclasses, work on KDA gate modes and chunk kernels, add correctness tests, and prepare MR-ready benchmark evidence.

Who are these FLA skills designed for?

GPU kernel engineers and contributors to the flash-linear-attention repository who modify fla/ops/** code, review KDA kernels, run NVIDIA performance profiling, or need reproducible optimization workflows that never break or game correctness gates.

How does the FLA optimization loop guarantee correctness?

It anchors every iteration on FLA's frozen pytest suite covering both forward and backward passes under NaN poisoning as the immutable correctness gate, combined with a task-contract, three-phase iteration protocol, and a silent-bug catalog drawn from kernel-optimization frameworks like KDA and FlashInfer contests.

When should I port a Triton kernel to Gluon?

Port when a kernel is register-bound, when num_stages pipelining underperforms, or when you need Hopper/Blackwell features like TMA, TMEM, or tcgen05. The skill provides an incremental sequence preserving numerical parity, a Triton-to-Gluon API mapping, and pitfalls covering proxy fences, mbarriers, and smem budgets.

What prerequisites and dependencies do these skills require?

You need the FLA repository with its pytest suite, Triton and optionally Gluon (triton.experimental.gluon), TileLang or CuTe for alternative backends, and NVIDIA GPU access. Detailed profiling uses an installed ncu-report-skill for Nsight Compute collection and diagnosis.