torch-compile

What problem does it solve?

This Skill optimizes PyTorch models by leveraging torch.compile, reducing execution time and Python overhead for faster inference and training.

Core Features & Use Cases

• Performance Optimization: JIT-compile PyTorch code for significant speedups.
• Debugging Compile Behavior: Analyze compilation overhead, graph breaks, and benchmark methodology.
• Use Case: When your PyTorch model is running slower than expected, use this Skill to compile it and measure the performance improvement, identifying any bottlenecks like frequent graph breaks.

Quick Start

Use the torch-compile skill to benchmark the performance of a PyTorch model with and without compilation.