monkey-patch-kernels-to-transformers
OfficialMonkey-patch TileGym kernels into Transformers
Software Engineering#huggingface#transformers#kernel-integration#monkey-patch#tilegym#cuda-tile#nlp-models
AuthorNVIDIA
Version1.0.0
Installs0
System Documentation
What problem does it solve?
Patch and integrate TileGym CUDA tile kernels into HuggingFace Transformers models by monkey-patching selected modules and classes to enable TileGym-powered kernels during inference and training, without modifying core model code.
Core Features & Use Cases
- Inventory and map TileGym kernels to Transformer operations (attention, feed-forward, normalization) for compatible architectures.
- Provide non-intrusive monkey-patches that swap core components with TileGym-enabled implementations and verify functional correctness.
- Use cases include accelerating model inference and training loops on supported GPUs with cuTile backends.
Quick Start
Patch a HuggingFace Transformers model to utilize TileGym kernels by applying the monkey-patch and running a small forward pass to validate improvements.
Dependency Matrix
Required Modules
None requiredComponents
references
💻 Claude Code Installation
Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.
Please help me install this Skill: Name: monkey-patch-kernels-to-transformers Download link: https://github.com/NVIDIA/TileGym/archive/main.zip#monkey-patch-kernels-to-transformers Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
Agent Skills Search Helper
Install a tiny helper to your Agent, search and equip skill from 471,000+ vetted skills library on demand.