benchmark-execution

What problem does it solve?

This Skill helps identify and resolve performance bottlenecks in training workflows, ensuring efficient use of computational resources and faster model development.

Core Features & Use Cases

• DataLoader Benchmarking: Optimize data loading throughput and GPU utilization.
• Training Performance Analysis: Measure end-to-end training speed and identify slow components.
• Cloud Performance Testing: Benchmark data loading from S3 and GCS with caching.
• Use Case: You're experiencing slow training times and want to understand if the bottleneck is data loading or the model itself. This Skill can run targeted benchmarks to pinpoint the issue and suggest optimizations.

Quick Start

Execute a benchmark for DataLoader performance using the specified input directory and GPU.