ml-pytorch

Generates PyTorch interview questions covering autograd, training loops, distributed training, and memory optimization.

23|1|Updated Aug 3, 2026
One-click install
npx skills add https://github.com/yuecao365/OfferCome --skill ml-pytorch-yuecao365
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: ml-pytorch
Source: https://github.com/yuecao365/OfferCome/tree/main/src/lib/mock-interviews/skills/ml-pytorch
Command: npx skills add https://github.com/yuecao365/OfferCome --skill ml-pytorch-yuecao365

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve? Interviewers and hiring teams need deep, scenario-based PyTorch questions that distinguish candidates who have genuinely trained models from those who only followed tutorials. This Skill provides a structured question bank for PyTorch-specific technical interviews. ## Core Features & Use Cases - Layered Question Ladders: Covers autograd, training loops, DataLoader pipelines, mixed precision, DDP/FSDP distributed training, memory optimization, torch.compile profiling, checkpointing, ONNX export, custom operators, and LoRA fine-tuning, each with progression from basics to production debugging. - Good vs Bad Question Patterns: Reframes trivia questions into anomaly-driven scenarios (NaN loss, OOM, NCCL hangs, GPU underutilization) that test troubleshooting reasoning. - Resume-Based Hooks: Maps resume claims like "trained a 7B model" or "used DDP" to targeted follow-up probes on memory budgets, throughput numbers, and failure modes. - Use Case: When a candidate's resume mentions PyTorch or deep learning training, load this Skill to generate calibrated interview questions matched to their project scale, from single-GPU ResNet work to multi-node FSDP training. ## Quick Start Ask the AI to generate PyTorch interview questions for a candidate whose resume mentions distributed training and mixed precision fine-tuning of a 7B model.

Frequently Asked Questions about ml-pytorch

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I interview a candidate on PyTorch distributed training?▼

Start from an anomaly scenario such as an 8-GPU DDP job hanging until NCCL timeout, then ask the candidate to locate the failing rank and cause. Strong answers cover gradient all-reduce, DistributedSampler set_epoch, and mismatched collective communication counts across ranks.

What PyTorch topics should machine learning interviews cover?▼

Core topics include autograd and computation graphs, training loop ordering, DataLoader performance, mixed precision with GradScaler, DDP versus FSDP, GPU memory accounting, torch.profiler and torch.compile, checkpoint recovery, and ONNX export. Match depth to the candidate's project scale.

DDP vs FSDP: when should each be used in training?▼

DDP replicates the full model on each GPU and synchronizes gradients, suiting models that fit in single-GPU memory. FSDP shards parameters, gradients, and optimizer states across GPUs, trading communication for memory when training very large models.

Why does mixed precision training produce NaN loss?▼

FP16 has a narrow dynamic range, so gradients can overflow without proper loss scaling via GradScaler. The Skill recommends checking the scaler value, keeping softmax, layernorm, and loss computation in FP32, or switching to BF16 which avoids the scaler.

How do I calibrate PyTorch question difficulty to a candidate?▼

Match question scale to the candidate's actual projects: single-GPU ResNet experience warrants autograd and training loop questions, while 7B-scale training requires FSDP sharding, memory budgeting, and NCCL debugging. Avoid asking framework trivia disconnected from their work.