domains / families / software-engineering / tilegym-monkey-patch-kernels-to-transformers

tilegym-monkey-patch-kernels-to-transformers

separate

Integrate TileGym kernels into Hugging Face `transformers` models by replacing the library's submodule(s) and certain class(es)' implementations, and patching certain class(es)' init/forward/load weight methods prior to instantiating models. Used when the user requires integrating TileGym kernels into `transformers` models.

When to use

• Integrating TileGym kernels into transformers models
• Replacing transformers submodules and class implementations
• Patching class init/forward/load weight methods
• Creating new cuTile kernels for uncovered PyTorch code
• Validating end-to-end functional correctness and performance improvements

When not to use

• Modifying transformers source code directly

Skill page

Source