Skip to content

Course catalog

2 courses matching “pytorch”

Reset search: pytorch
Abstract cover artwork for Transformers and Attention, Implemented Line by Line, a Deep Learning course Deep Learning
Deep Learning advanced

Transformers and Attention, Implemented Line by Line

Build a transformer from scratch: scaled dot-product attention, multi-head projections, positional encodings, KV caching and the modern variants (RoPE, grouped-query attention, RMSNorm) that make inference cheap. You will train a small model, profile it, and understand precisely where the FLOPs go.

HT Hiroshi Tanaka 4.9

$109.00

17 hours

Abstract cover artwork for Deep Learning with PyTorch: Fundamentals to Fine-Tuning, a Deep Learning course Deep Learning
Deep Learning intermediate

Deep Learning with PyTorch: Fundamentals to Fine-Tuning

Autograd from first principles, then real training loops: learning-rate schedules, mixed precision, gradient accumulation, distributed data parallel, and the debugging discipline for a loss that will not go down. Finishes by fine-tuning a pretrained model on a custom dataset with a proper evaluation harness.

HT Hiroshi Tanaka 4.9

$99.00

22 hours